Merge branch 'worktree-agent-a5f21c17' into Develop

# Conflicts:
#	.planning/REQUIREMENTS.md
#	.planning/ROADMAP.md
#	.planning/STATE.md
This commit is contained in:
2026-04-04 12:30:57 +02:00
6 changed files with 408 additions and 38 deletions

View File

@@ -9,11 +9,11 @@ Requirements for this milestone. Each maps to roadmap phases.
### Database Migration
- [x] **DB-01**: Application runs on PostgreSQL instead of SQLite
- [ ] **DB-01**: Application runs on PostgreSQL instead of SQLite
- [ ] **DB-02**: All service functions use async database operations
- [x] **DB-03**: Test infrastructure uses PGlite instead of bun:sqlite in-memory databases
- [ ] **DB-04**: Existing SQLite data can be migrated to Postgres via a one-time script
- [x] **DB-05**: Docker Compose provides Postgres for local development
- [ ] **DB-03**: Test infrastructure uses PGlite instead of bun:sqlite in-memory databases
- [x] **DB-04**: Existing SQLite data can be migrated to Postgres via a one-time script
- [ ] **DB-05**: Docker Compose provides Postgres for local development
### Authentication
@@ -116,11 +116,11 @@ Which phases cover which requirements. Updated during roadmap creation.
| Requirement | Phase | Status |
|-------------|-------|--------|
| DB-01 | Phase 14 | Complete |
| DB-01 | Phase 14 | Pending |
| DB-02 | Phase 14 | Pending |
| DB-03 | Phase 14 | Complete |
| DB-04 | Phase 14 | Pending |
| DB-05 | Phase 14 | Complete |
| DB-03 | Phase 14 | Pending |
| DB-04 | Phase 14 | Complete |
| DB-05 | Phase 14 | Pending |
| AUTH-01 | Phase 15 | Pending |
| AUTH-02 | Phase 15 | Pending |
| AUTH-03 | Phase 15 | Pending |

View File

@@ -121,14 +121,7 @@ Plans:
2. All service-level and route-level tests pass using PGlite in-memory Postgres (no SQLite test infrastructure remains)
3. A one-time migration script converts existing SQLite data into the Postgres database without data loss
4. Docker Compose brings up Postgres alongside the app with a single command for local development
**Plans:** 2/6 plans executed
Plans:
- [x] 14-01-PLAN.md — Schema rewrite (pg-core), DB config (postgres.js), test helper (PGlite), Drizzle config, initial migration
- [x] 14-02-PLAN.md — Docker Compose dev/prod + Dockerfile update for PostgreSQL
- [ ] 14-03-PLAN.md — All 9 services async conversion + seed + server index
- [ ] 14-04-PLAN.md — All 9 route handlers async conversion
- [ ] 14-05-PLAN.md — SQLite-to-Postgres data migration script
- [ ] 14-06-PLAN.md — All 18 test files async conversion + full suite green
**Plans**: TBD
### Phase 15: External Authentication
**Goal**: Users can register and log in via a self-hosted OIDC auth provider, replacing the built-in single-user auth system
@@ -195,7 +188,7 @@ Plans:
| 11. Candidate Ranking | v1.3 | 2/2 | Complete | 2026-03-16 |
| 12. Comparison View | v1.3 | 1/1 | Complete | 2026-03-17 |
| 13. Setup Impact Preview | v1.3 | 0/2 | Not started | - |
| 14. PostgreSQL Migration | v2.0 | 2/6 | In Progress| |
| 14. PostgreSQL Migration | v2.0 | 5/6 | In Progress | |
| 15. External Authentication | v2.0 | 0/? | Not started | - |
| 16. Multi-User Data Model | v2.0 | 0/? | Not started | - |
| 17. Object Storage | v2.0 | 0/? | Not started | - |

View File

@@ -1,16 +1,16 @@
---
gsd_state_version: 1.0
milestone: v1.3
milestone_name: Research & Decision Tools
milestone: v2.0
milestone_name: Platform Foundation
status: executing
stopped_at: Completed 14-02-PLAN.md
last_updated: "2026-04-04T10:25:09.510Z"
last_activity: 2026-04-04
stopped_at: Completed 14-05-PLAN.md
last_updated: "2026-04-04T10:28:29Z"
last_activity: 2026-04-04 — Completed 14-05 SQLite-to-Postgres migration script
progress:
total_phases: 8
completed_phases: 6
total_plans: 18
completed_plans: 12
total_phases: 5
completed_phases: 0
total_plans: 0
completed_plans: 0
percent: 0
---
@@ -21,21 +21,20 @@ progress:
See: .planning/PROJECT.md (updated 2026-04-03)
**Core value:** Help people make better gear decisions — discover what others use, compare real-world data, and see how a potential buy affects your setup before committing.
**Current focus:** Phase 14 — postgresql-migration
**Current focus:** v2.0 Platform Foundation — Phase 14 (PostgreSQL Migration)
## Current Position
Phase: 14 (postgresql-migration) — EXECUTING
Plan: 2 of 6
Status: Ready to execute
Last activity: 2026-04-04
Phase: 14 of 18 (PostgreSQL Migration)
Plan: 5 of 6 in current phase
Status: Executing
Last activity: 2026-04-04 — Completed 14-05 SQLite-to-Postgres migration script
Progress: [----------] 0% (v2.0 milestone)
## Performance Metrics
**Velocity:**
- Total plans completed: 0 (v2.0 milestone)
- Average duration: --
- Total execution time: --
@@ -46,15 +45,15 @@ Progress: [----------] 0% (v2.0 milestone)
### Decisions
Key decisions made during v2.0 planning:
Key decisions made during v2.0 execution:
- [14-05] Used postgres.js unsafe() for sequence reset DDL instead of drizzle-orm sql template
- [14-05] Row-by-row inserts for better error diagnostics during migration
- Platform pivot: single-user to multi-user with discovery-first approach
- External auth provider (self-hosted, open-source) — Logto vs Authentik OPEN decision
- SQLite to Postgres migration — required by auth provider and multi-user concurrency
- Structured UGC only — ratings and predefined fields, no freeform text until moderation
- Separate globalItems table — not a flag on user items table
- Single-user SQLite mode diverges at v2.0 boundary
- [Phase 14-postgresql-migration]: Dev compose uses hardcoded Postgres credentials; production externalizes via env vars
### Pending Todos
@@ -67,6 +66,6 @@ None active.
## Session Continuity
Last session: 2026-04-04T10:25:09.507Z
Stopped at: Completed 14-02-PLAN.md
Last session: 2026-04-04T10:28:29Z
Stopped at: Completed 14-05-PLAN.md
Resume file: None

View File

@@ -0,0 +1,93 @@
---
phase: 14-postgresql-migration
plan: 05
subsystem: database
tags: [sqlite, postgres, migration, data-migration, bun-sqlite]
# Dependency graph
requires:
- phase: 14-01
provides: PostgreSQL schema definitions (Drizzle pgTable)
provides:
- One-time SQLite-to-PostgreSQL data migration script
- db:migrate-from-sqlite npm script
affects: [14-06, deployment, upgrade-docs]
# Tech tracking
tech-stack:
added: []
patterns: [dependency-ordered table migration, unix-to-Date conversion, serial sequence reset]
key-files:
created:
- scripts/migrate-sqlite-to-postgres.ts
modified:
- package.json
key-decisions:
- "Used postgres.js unsafe() for sequence reset instead of drizzle-orm sql template (simpler for raw DDL)"
- "Row-by-row insert for error tracing (per-row catch identifies failing record)"
patterns-established:
- "Migration scripts live in scripts/ directory"
- "Type conversion helpers (unixToDate, intToBool) for SQLite-to-Postgres data transforms"
requirements-completed: [DB-04]
# Metrics
duration: 2min
completed: 2026-04-04
---
# Phase 14 Plan 05: SQLite-to-Postgres Migration Script Summary
**One-time data migration script converting all 13 tables from SQLite to PostgreSQL with timestamp/boolean type conversions and serial sequence reset**
## Performance
- **Duration:** 2 min
- **Started:** 2026-04-04T10:26:29Z
- **Completed:** 2026-04-04T10:28:29Z
- **Tasks:** 1
- **Files modified:** 2
## Accomplishments
- Created standalone migration script that reads SQLite and writes to PostgreSQL
- Handles all type conversions: unix epoch integers to Date objects, integer booleans to native booleans
- Migrates tables in FK dependency order (4 waves: no-FK, FK-to-parents, FK-to-intermediates, junction tables)
- Resets all 11 serial sequences after migration to prevent duplicate key errors
- Added `db:migrate-from-sqlite` npm script for easy invocation
## Task Commits
Each task was committed atomically:
1. **Task 1: Create SQLite-to-Postgres migration script** - `b4c3813` (feat)
## Files Created/Modified
- `scripts/migrate-sqlite-to-postgres.ts` - One-time migration script with type conversions and sequence reset
- `package.json` - Added db:migrate-from-sqlite script
## Decisions Made
- Used `postgres.js` `unsafe()` for raw `setval` queries instead of drizzle-orm `sql` template -- simpler for dynamic table name interpolation in DDL
- Row-by-row inserts instead of bulk for better error diagnostics (each failed row logs its ID)
## Deviations from Plan
None - plan executed exactly as written.
## Issues Encountered
- Biome lint flagged unused `sql` import from drizzle-orm (used `pg.unsafe()` instead) and unnecessary suppression comments -- removed both
## User Setup Required
None - no external service configuration required.
## Next Phase Readiness
- Migration script ready for use during SQLite-to-Postgres upgrade
- Requires DATABASE_URL env var and existing SQLite file
- Can be tested against a dev Postgres instance with `docker compose up`
---
*Phase: 14-postgresql-migration*
*Completed: 2026-04-04*