feat: Trigger.dev index-repo task with R2 storage

[HrushiBorhade]

Summary

• apps/trigger: New Turborepo package with Trigger.dev SDK v4, scaffolded with trigger.config.ts and proper tsconfig. Closes chore: scaffold apps/trigger Trigger.dev package #81
• lib/github.ts: GitHub App JWT generation via node:crypto, installation token exchange, tarball download+extraction with strip:1 and commit SHA extraction. Closes feat: GitHub App JWT + tarball download #82
• lib/r2.ts: Cloudflare R2 upload helpers using @aws-sdk/client-s3 — uploadBuffer, uploadFile, uploadRepoFiles (bounded concurrency), buildFileTree. Closes feat: R2 upload helpers #83
• DrizzleSyncStorage: Implements SyncStorage interface using Drizzle ORM against fileHashes/dirHashes tables, scoped by repoId, with upsert-on-conflict idempotency. Closes feat: DrizzleSyncStorage for Neon Postgres #84
• index-repo task: Main schemaTask — loads repo from DB, downloads tarball, walks files (useGit: false), batched pipeline (50 files: chunk → embed → upsert → chunkCache), Merkle persist, R2 upload (tarball + file-tree.json + files), status updates, cleanup in finally. Deterministic point IDs via UUIDv5. Closes feat: implement index-repo Trigger.dev task #85
• Webhook wiring: After upsertRepos, triggers index-repo with idempotencyKey for dedup. Added .returning() to get repo IDs. Closes feat: wire webhook to trigger index-repo task #86

Test plan

• 153 core tests passing
• 17 web tests passing (170 total)
• Typecheck passes across all 4 packages (core, db, trigger, web)
• Lint passes
• Format check passes
• E2E: Install GitHub App on test repo → verify webhook → task → vectors → R2 (manual)

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
code-indexer-web	Ready	Preview, Comment	Mar 24, 2026 9:35pm

[greptile-apps]

Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.

[coderabbitai]

Warning

Rate limit exceeded

@HrushiBorhade has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 11 minutes and 43 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

ℹ️ Review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: c41df31b-53f3-4f4a-ab5a-6064c49e2115

📥 Commits

Reviewing files that changed from the base of the PR and between 6912ab9 and abc7158.

⛔ Files ignored due to path filters (1)

• pnpm-lock.yaml is excluded by !**/pnpm-lock.yaml

📒 Files selected for processing (10)

• apps/trigger/package.json
• apps/trigger/src/lib/drizzle-sync-storage.ts
• apps/trigger/src/lib/github.ts
• apps/trigger/src/lib/r2.ts
• apps/trigger/src/tasks/index-repo.ts
• apps/trigger/trigger.config.ts
• apps/trigger/tsconfig.json
• apps/web/package.json
• apps/web/src/app/api/webhooks/github/route.ts
• turbo.json

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch phase-2/index-repo

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}