195 lines
9.6 KiB
Markdown
195 lines
9.6 KiB
Markdown
---
|
|
phase: 17-object-storage
|
|
plan: 01
|
|
type: execute
|
|
wave: 1
|
|
depends_on: []
|
|
files_modified:
|
|
- src/server/services/storage.service.ts
|
|
- tests/services/storage.service.test.ts
|
|
- docker-compose.yml
|
|
- docker-compose.dev.yml
|
|
- .env.example
|
|
autonomous: true
|
|
requirements: [IMG-01, IMG-04]
|
|
|
|
must_haves:
|
|
truths:
|
|
- "Storage service can upload a buffer to S3-compatible storage"
|
|
- "Storage service can delete an object from S3-compatible storage"
|
|
- "Storage service can generate a presigned URL for an object"
|
|
- "Docker Compose starts MinIO with automatic bucket creation"
|
|
artifacts:
|
|
- path: "src/server/services/storage.service.ts"
|
|
provides: "S3 storage abstraction"
|
|
exports: ["uploadImage", "deleteImage", "getImageUrl"]
|
|
- path: "tests/services/storage.service.test.ts"
|
|
provides: "Storage service unit tests with mocked S3Client"
|
|
- path: "docker-compose.dev.yml"
|
|
provides: "MinIO service for local development"
|
|
contains: "minio"
|
|
- path: "docker-compose.yml"
|
|
provides: "MinIO service for production"
|
|
contains: "minio"
|
|
key_links:
|
|
- from: "src/server/services/storage.service.ts"
|
|
to: "@aws-sdk/client-s3"
|
|
via: "S3Client with forcePathStyle"
|
|
pattern: "forcePathStyle.*true"
|
|
- from: "docker-compose.dev.yml"
|
|
to: "minio-init"
|
|
via: "mc init container creates bucket"
|
|
pattern: "mc mb.*gearbox-images"
|
|
---
|
|
|
|
<objective>
|
|
Create the S3 storage service abstraction and Docker Compose MinIO infrastructure.
|
|
|
|
Purpose: Establish the foundation that all subsequent image storage refactoring depends on. The storage service wraps @aws-sdk/client-s3 and the Docker config ensures MinIO is available for development and production.
|
|
Output: storage.service.ts with uploadImage/deleteImage/getImageUrl, unit tests, MinIO in both Docker Compose files.
|
|
</objective>
|
|
|
|
<execution_context>
|
|
@$HOME/.claude/get-shit-done/workflows/execute-plan.md
|
|
@$HOME/.claude/get-shit-done/templates/summary.md
|
|
</execution_context>
|
|
|
|
<context>
|
|
@.planning/PROJECT.md
|
|
@.planning/ROADMAP.md
|
|
@.planning/STATE.md
|
|
@.planning/phases/17-object-storage/17-CONTEXT.md
|
|
@.planning/phases/17-object-storage/17-RESEARCH.md
|
|
|
|
@src/server/services/image.service.ts
|
|
@docker-compose.yml
|
|
@docker-compose.dev.yml
|
|
@.env.example
|
|
</context>
|
|
|
|
<tasks>
|
|
|
|
<task type="auto">
|
|
<name>Task 1: Install S3 SDK and create storage service</name>
|
|
<files>src/server/services/storage.service.ts, tests/services/storage.service.test.ts</files>
|
|
<read_first>
|
|
- src/server/services/image.service.ts (current local file storage pattern)
|
|
- .planning/phases/17-object-storage/17-RESEARCH.md (Pattern 1: S3 Client Singleton, Pattern 2: Presigned URL Injection)
|
|
</read_first>
|
|
<action>
|
|
1. Install dependencies: `bun add @aws-sdk/client-s3 @aws-sdk/s3-request-presigner`
|
|
|
|
2. Create `src/server/services/storage.service.ts` per D-03, D-04, D-05:
|
|
- Create S3Client singleton at module level with `forcePathStyle: true` (REQUIRED for MinIO per research pitfall 4)
|
|
- Config from env vars: `S3_ENDPOINT`, `S3_ACCESS_KEY`, `S3_SECRET_KEY`, `S3_BUCKET` (default: "gearbox-images"), `S3_REGION` (default: "us-east-1")
|
|
- `uploadImage(buffer: Buffer | ArrayBuffer, filename: string, contentType: string): Promise<void>` — uses PutObjectCommand
|
|
- `deleteImage(filename: string): Promise<void>` — uses DeleteObjectCommand
|
|
- `getImageUrl(filename: string): Promise<string>` — uses GetObjectCommand + getSignedUrl with configurable expiry (default 1h per D-04, configurable via `S3_PRESIGN_EXPIRY` env var)
|
|
- Export a helper: `async function withImageUrl<T extends { imageFilename: string | null }>(record: T): Promise<T & { imageUrl: string | null }>` — returns null imageUrl when imageFilename is null, presigned URL otherwise (per D-09)
|
|
- Export a batch helper: `async function withImageUrls<T extends { imageFilename: string | null }>(records: T[]): Promise<(T & { imageUrl: string | null })[]>` — uses Promise.all for parallelism per research pitfall 5
|
|
|
|
3. Create `tests/services/storage.service.test.ts`:
|
|
- Mock @aws-sdk/client-s3 S3Client.send method using `mock.module` from bun:test
|
|
- Mock @aws-sdk/s3-request-presigner getSignedUrl
|
|
- Test uploadImage calls PutObjectCommand with correct Bucket, Key, Body, ContentType
|
|
- Test deleteImage calls DeleteObjectCommand with correct Bucket, Key
|
|
- Test getImageUrl calls getSignedUrl and returns the result
|
|
- Test withImageUrl returns null imageUrl when imageFilename is null
|
|
- Test withImageUrl returns presigned URL when imageFilename is present
|
|
- Test withImageUrls processes arrays correctly
|
|
</action>
|
|
<verify>
|
|
<automated>bun test tests/services/storage.service.test.ts</automated>
|
|
</verify>
|
|
<acceptance_criteria>
|
|
- grep -q "uploadImage" src/server/services/storage.service.ts
|
|
- grep -q "deleteImage" src/server/services/storage.service.ts
|
|
- grep -q "getImageUrl" src/server/services/storage.service.ts
|
|
- grep -q "withImageUrl" src/server/services/storage.service.ts
|
|
- grep -q "withImageUrls" src/server/services/storage.service.ts
|
|
- grep -q "forcePathStyle.*true" src/server/services/storage.service.ts
|
|
- grep -q "S3_ENDPOINT" src/server/services/storage.service.ts
|
|
- grep -q "PutObjectCommand" src/server/services/storage.service.ts
|
|
- grep -q "getSignedUrl" src/server/services/storage.service.ts
|
|
- bun test tests/services/storage.service.test.ts passes
|
|
</acceptance_criteria>
|
|
<done>Storage service exports uploadImage, deleteImage, getImageUrl, withImageUrl, withImageUrls. All unit tests pass with mocked S3 client.</done>
|
|
</task>
|
|
|
|
<task type="auto">
|
|
<name>Task 2: Add MinIO to Docker Compose and update env config</name>
|
|
<files>docker-compose.yml, docker-compose.dev.yml, .env.example</files>
|
|
<read_first>
|
|
- docker-compose.yml (current production compose)
|
|
- docker-compose.dev.yml (current dev compose)
|
|
- .env.example (current env vars)
|
|
- .planning/phases/17-object-storage/17-RESEARCH.md (Pattern 3: Docker Compose Init Container)
|
|
</read_first>
|
|
<action>
|
|
1. Update `docker-compose.dev.yml` per D-13, D-14:
|
|
- Add `minio` service using `quay.io/minio/minio:RELEASE.2025-09-07T16-13-09Z` (pinned per research — do NOT use latest or Docker Hub)
|
|
- Command: `server /data --console-address ":9001"`
|
|
- Environment: `MINIO_ROOT_USER: minioadmin`, `MINIO_ROOT_PASSWORD: minioadmin` (fixed creds for dev per D-14)
|
|
- Ports: 9000:9000 (API), 9001:9001 (console)
|
|
- Volume: `minio-data-dev:/data`
|
|
- Healthcheck: `["CMD", "mc", "ready", "local"]` interval 5s, timeout 3s, retries 5
|
|
- Add `minio-init` service using `quay.io/minio/mc:latest`
|
|
- depends_on minio with condition: service_healthy
|
|
- entrypoint shell script: set alias, create bucket `gearbox-images` with --ignore-existing, exit 0
|
|
- Add `minio-data-dev` to volumes section
|
|
- Add S3 env vars to app service (if app service exists in dev compose) — if not, these will be in the shell env
|
|
- Add comment noting MinIO GitHub repo archived Feb 2026, S3 API abstraction makes provider swappable
|
|
|
|
2. Update `docker-compose.yml` (production) per D-13, D-14:
|
|
- Add `minio` service same image, same healthcheck
|
|
- Environment: `MINIO_ROOT_USER: ${S3_ACCESS_KEY}`, `MINIO_ROOT_PASSWORD: ${S3_SECRET_KEY}` (env vars for prod per D-14)
|
|
- Ports: 9000:9000 only (no console in prod)
|
|
- Volume: `minio-data:/data`
|
|
- Add `minio-init` same pattern but using `${S3_ACCESS_KEY:-minioadmin}` and `${S3_SECRET_KEY:-minioadmin}` for mc alias
|
|
- Add S3 env vars to app service: S3_ENDPOINT=http://minio:9000, S3_ACCESS_KEY, S3_SECRET_KEY, S3_BUCKET=gearbox-images
|
|
- Remove `uploads:/app/uploads` volume from app service (per D-08 — no more local file serving)
|
|
- Remove `uploads` from volumes section
|
|
- Add `minio-data` to volumes section
|
|
- app service depends_on should include minio (service_healthy)
|
|
|
|
3. Update `.env.example`:
|
|
- Add S3 section with: S3_ENDPOINT, S3_ACCESS_KEY, S3_SECRET_KEY, S3_BUCKET, S3_REGION
|
|
- Include defaults as comments (endpoint: http://localhost:9000, bucket: gearbox-images, region: us-east-1)
|
|
</action>
|
|
<verify>
|
|
<automated>grep -q "minio" docker-compose.dev.yml && grep -q "minio" docker-compose.yml && grep -q "S3_ENDPOINT" .env.example && echo "PASS"</automated>
|
|
</verify>
|
|
<acceptance_criteria>
|
|
- grep -q "quay.io/minio/minio:RELEASE.2025-09-07" docker-compose.dev.yml
|
|
- grep -q "minio-init" docker-compose.dev.yml
|
|
- grep -q "gearbox-images" docker-compose.dev.yml
|
|
- grep -q "quay.io/minio/minio:RELEASE.2025-09-07" docker-compose.yml
|
|
- grep -q "minio-init" docker-compose.yml
|
|
- grep -q "S3_ENDPOINT" docker-compose.yml
|
|
- grep -q "S3_ACCESS_KEY" .env.example
|
|
- grep -q "S3_SECRET_KEY" .env.example
|
|
- grep -q "S3_BUCKET" .env.example
|
|
</acceptance_criteria>
|
|
<done>Both Docker Compose files include MinIO with automatic bucket creation. Production uses env vars, dev uses fixed credentials. .env.example documents all S3 variables.</done>
|
|
</task>
|
|
|
|
</tasks>
|
|
|
|
<verification>
|
|
- `bun test tests/services/storage.service.test.ts` passes
|
|
- `grep -r "forcePathStyle" src/server/services/storage.service.ts` confirms MinIO compatibility
|
|
- `docker compose -f docker-compose.dev.yml config` validates dev compose syntax
|
|
- `docker compose config` validates prod compose syntax
|
|
</verification>
|
|
|
|
<success_criteria>
|
|
- Storage service exists with all 5 exported functions (uploadImage, deleteImage, getImageUrl, withImageUrl, withImageUrls)
|
|
- Unit tests pass with mocked S3 client
|
|
- Both Docker Compose files include MinIO + init container
|
|
- .env.example documents S3 configuration
|
|
</success_criteria>
|
|
|
|
<output>
|
|
After completion, create `.planning/phases/17-object-storage/17-01-SUMMARY.md`
|
|
</output>
|