Merge pull request #16 from constructive-io/anmol/testing

local testing

Author: Anmol1696

.github/workflows/test.yaml

@@ -0,0 +1,40 @@
+name: Tests
+
+on:
+  push:
+    branches: [main]
+  pull_request:
+    branches: [main]
+  workflow_dispatch: {}
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  unit:
+    name: Unit tests
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: actions/setup-node@v4
+        with:
+          node-version: '22'
+      - run: npm install -g pnpm@10.12.2
+      - run: node --experimental-strip-types scripts/generate.ts
+      - run: pnpm install
+      - run: pnpm test:unit
+
+  integration:
+    name: Integration tests
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+      - uses: actions/setup-node@v4
+        with:
+          node-version: '22'
+      - run: npm install -g pnpm@10.12.2
+      - run: node --experimental-strip-types scripts/generate.ts
+      - run: pnpm install
+      - run: pnpm build
+      - run: pnpm test:integration

DEVELOPMENT.md

@@ -0,0 +1,225 @@
+# Development Guide
+
+Local development setup for running functions against real infrastructure (Postgres, GraphQL, Mailpit).
+
+## Prerequisites
+
+- Node.js >= 18.17.0
+- pnpm >= 10
+- Docker Desktop
+
+## Quick Start
+
+```bash
+# 1. Generate workspace packages from function templates
+pnpm generate
+
+# 2. Install dependencies
+pnpm install
+
+# 3. Build everything (packages, job service, generated functions)
+pnpm build
+
+# 4. Start infrastructure (Postgres, DB migrations, GraphQL server, Mailpit)
+make dev
+
+# 5. Wait for db-setup to finish (watch logs)
+make dev-logs
+
+# 6. Start functions as local Node processes
+make dev-fn
+```
+
+## Step-by-Step
+
+### 1. Generate + Build
+
+The generate step reads `functions/*/handler.json` manifests, resolves templates from `templates/node-graphql/`, and produces full workspace packages in `generated/`.
+
+```bash
+pnpm generate          # Generate all functions
+pnpm install           # Install dependencies (including generated packages)
+pnpm build             # Build all workspace packages
+```
+
+After this you should have built artifacts in:
+
+| Package | Output |
+|---------|--------|
+| `generated/send-email-link/dist/` | Send-email-link function server |
+| `generated/simple-email/dist/` | Simple-email function server |
+| `generated/example/dist/` | Example function server |
+| `job/service/dist/` | Knative job service (worker + scheduler) |
+| `packages/fn-runtime/dist/` | Function runtime library |
+| `packages/fn-app/dist/` | Function app framework |
+
+### 2. Start Infrastructure
+
+```bash
+make dev
+```
+
+This runs `docker compose up -d` which starts:
+
+| Service | Description | Port |
+|---------|-------------|------|
+| **postgres** | PostgreSQL 16 with pgvector + PostGIS | 5432 |
+| **db-setup** | One-shot: creates DB, bootstraps roles, deploys pgpm packages | (exits on completion) |
+| **graphql-server** | Constructive admin GraphQL API (header-based routing) | 3002 |
+| **mailpit** | SMTP capture server with web UI | 1025 (SMTP), 8025 (UI) |
+
+The `db-setup` container must finish before `graphql-server` starts (enforced by `service_completed_successfully`). Watch progress:
+
+```bash
+make dev-logs
+# or
+docker compose logs -f db-setup
+```
+
+Verify everything is running:
+
+```bash
+docker compose ps
+```
+
+You should see:
+- `postgres` — running (healthy)
+- `db-setup` — exited (0)
+- `graphql-server` — running
+- `mailpit` — running
+
+### 3. Start Functions Locally
+
+```bash
+make dev-fn
+```
+
+This runs `scripts/dev.ts` which spawns local Node processes with env vars pointing to Docker services:
+
+| Process | Port | Script |
+|---------|------|--------|
+| **job-service** | 8080 | `job/service/dist/run.js` |
+| **simple-email** | 8081 | `generated/simple-email/dist/index.js` |
+| **send-email-link** | 8082 | `generated/send-email-link/dist/index.js` |
+
+To start a single function:
+
+```bash
+pnpm dev:fn -- --only=send-email-link
+```
+
+### 4. Test a Function
+
+Send a request to `send-email-link`:
+
+```bash
+curl -X POST http://localhost:8082 \
+  -H 'Content-Type: application/json' \
+  -H 'X-Database-Id: constructive' \
+  -d '{"email_type":"invite_email","email":"test@example.com"}'
+```
+
+Check captured emails at http://localhost:8025 (Mailpit UI).
+
+Query the GraphQL API directly:
+
+```bash
+curl http://localhost:3002/graphql \
+  -H 'Content-Type: application/json' \
+  -H 'X-Database-Id: constructive' \
+  -d '{"query":"{ __typename }"}'
+```
+
+### 5. Shut Down
+
+```bash
+make dev-down          # Stop Docker infrastructure
+```
+
+`Ctrl+C` in the `make dev-fn` terminal stops the local function processes.
+
+## Commands Reference
+
+| Command | Description |
+|---------|-------------|
+| `pnpm generate` | Generate workspace packages from function templates |
+| `pnpm build` | Build all workspace packages |
+| `make dev` | Start Docker infrastructure |
+| `make dev-fn` | Start functions as local Node processes |
+| `make dev-down` | Stop Docker infrastructure |
+| `make dev-logs` | Follow Docker service logs |
+| `pnpm test` | Run all tests |
+| `pnpm test:unit` | Run unit tests only (`functions/*/__tests__/`) |
+| `pnpm test:integration` | Run integration tests only (`tests/integration/`) |
+
+## Port Map
+
+| Service | Port |
+|---------|------|
+| PostgreSQL | 5432 |
+| GraphQL API | 3002 |
+| Mailpit SMTP | 1025 |
+| Mailpit UI | 8025 |
+| Job Service | 8080 |
+| simple-email | 8081 |
+| send-email-link | 8082 |
+
+## Architecture
+
+```
+Docker Compose (infrastructure):
+  postgres -> db-setup (migrations) -> graphql-server
+                                       mailpit
+
+Local Node processes (functions):
+  job/service/dist/run.js                        (port 8080)
+  generated/simple-email/dist/index.js           (port 8081)
+  generated/send-email-link/dist/index.js        (port 8082)
+```
+
+Infrastructure runs in Docker. Functions run as local Node processes from `generated/` — no Docker rebuild needed when function code changes. Edit `functions/*/handler.ts`, rebuild (`pnpm build`), restart `make dev-fn`.
+
+## Troubleshooting
+
+**db-setup fails or graphql-server won't start**
+
+Check if the GHCR image is accessible:
+
+```bash
+docker pull ghcr.io/constructive-io/constructive:latest
+```
+
+If authentication is required, log in first:
+
+```bash
+echo $GITHUB_TOKEN | docker login ghcr.io -u USERNAME --password-stdin
+```
+
+**Port already in use**
+
+Stop any existing services using the ports:
+
+```bash
+make dev-down
+lsof -ti:5432,3002,1025,8025,8080,8081,8082 | xargs kill -9
+```
+
+**Functions can't connect to GraphQL**
+
+Ensure infrastructure is fully up before starting functions:
+
+```bash
+docker compose ps    # db-setup should show "Exited (0)", graphql-server should be "running"
+curl http://localhost:3002/graphql -H 'Content-Type: application/json' -d '{"query":"{ __typename }"}'
+```
+
+**Stale build artifacts**
+
+Clean and rebuild from scratch:
+
+```bash
+pnpm clean
+pnpm generate
+pnpm install
+pnpm build
+```

Makefile

@@ -1,4 +1,4 @@
-.PHONY: install build clean lint generate dev dev-build dev-down docker-build
+.PHONY: install build clean lint generate dev dev-fn dev-down dev-logs docker-build
 
 install:
 	node --experimental-strip-types scripts/generate.ts
@@ -16,15 +16,24 @@ lint:
 generate:
 	pnpm run generate
 
-dev-build:
-	docker compose build
+# --- Local development ---
+# Infrastructure (postgres, db-setup, graphql-server, mailpit) runs in Docker.
+# Functions run as local Node processes for fast edit-run cycles.
 
 dev:
-	docker compose up
+	docker compose up -d
+
+dev-fn:
+	node --experimental-strip-types scripts/dev.ts
 
 dev-down:
 	docker compose down
 
+dev-logs:
+	docker compose logs -f
+
+# --- Docker image builds ---
+
 docker-build:
 	pnpm run docker:build