Skip to content

cemergin/100x-engineer-guide

Repository files navigation

The 100x Engineer Guide

Backend & Software Engineering Mastery

A comprehensive, open-source mega-guide covering every paradigm, philosophy, and hard skill needed to become a lead/staff+ engineer — organized as a narrative that builds from theory to practice.

36 chapters · ~59,000 lines · ~3.5 MB · 5 parts + appendices

100x-engineer-guide/
├── part-1-foundations/          ← Theory: systems, data, architecture, reliability, security
├── part-2-applied-engineering/  ← Domains: concurrency, DevOps, testing, leadership, API design
├── part-3-tooling-practice/     ← Hands-on: languages, Linux/Vim/Git, AI tools, codebase org
├── part-4-cloud-operations/     ← Production: cloud, monitoring, AWS/Firebase, incident stories
├── course/                      ← 97 hands-on modules across 3 progressive loops (see below)
├── appendices/                  ← Reference: reading list, 250+ term glossary
└── README.md                    ← You are here

Quick Start — Reading Paths

Your Goal Start Here Then
Learn from zero Part I: Ch 1 → 2 → 3 → 4 → 5 Part II, then Part III
System design interviews Ch 1, 22, 3, 23 Ch 2, 6, 25, Glossary
Get productive immediately Ch 12/12b (tooling), 20 (env mgmt), 17 (Claude Code) Ch 15, 14
Ship to production Ch 13 (cloud), 18 (monitoring), 19 (AWS) Ch 4, 7, 26
Level up to staff+ Ch 9 (leadership), 29 (career), 10 (emerging) Ch 27, 16
Debug a production issue NOW Ch 18 (debugging), 21 (networking), 24 (DB internals) Ch 26 (war stories)
Hit the ground running (new team/company) Ch 36 (beast mode), 12/12b (tooling) Ch 18, 28, 29
Quick lookup Glossary (250+ terms) Resources (49 papers/books)

The theory and principles that underpin everything else.

Ch Title Difficulty What You'll Learn
1 System Design Paradigms Advanced CAP/PACELC, consistency models, Paxos/Raft, distributed transactions, CRDTs, sharding, load balancing
2 Data Engineering Inter→Adv SQL/NoSQL/NewSQL paradigms, data modeling, indexing, caching strategies, ETL/ELT, CDC, data mesh
3 Architecture Patterns Inter→Adv Monolith→microservices, hexagonal/clean/vertical slice, DDD, event-driven, CQRS, REST/gRPC/GraphQL
4 Reliability Engineering Inter→Adv SRE, SLOs/SLIs/error budgets, observability, circuit breaker, bulkhead, chaos engineering
5 Security Engineering Intermediate OAuth/OIDC/JWT, OWASP Top 10, cryptography, infrastructure security, GDPR/SOC2
21 Networking & Protocols Inter→Adv TCP internals, TLS 1.3 handshake, HTTP lifecycle, DNS, WebSocket, gRPC/protobuf, network debugging
22 Algorithms & Data Structures Inter→Adv Hash maps, B-trees, LSM trees, bloom filters, LRU cache, rate limiter, consistent hashing — with code
24 Database Internals Advanced Postgres MVCC/WAL/vacuum/planner, MySQL InnoDB, DynamoDB internals, EXPLAIN ANALYZE, perf tuning
24b SQL Mastery & Graph DBs Advanced Advanced SQL (CTEs, window functions, lateral joins), graph databases, Neo4j/Cypher
32 Software Engineering Principles Beg→Adv SOLID with real code, DRY/KISS/YAGNI, coupling/cohesion, 10 essential design patterns, clean code, code smells, composition vs inheritance, FP vs OOP

Read order: 1 → 2 → 3 → 4 → 5 (core sequence), then 21, 22, 24/24b in any order.


Deeper dives into specialized domains. Read after Part I, in any order.

Ch Title Difficulty What You'll Learn
6 Concurrency & Computing Advanced Threads, event loop, actors, CSP, mutex/CAS/lock-free, deadlocks, memory models, GC, FP/OOP
7 DevOps & Infrastructure Intermediate IaC/Terraform, containers/K8s, CI/CD, 12-factor app, DNS/CDN, service mesh, platform engineering
8 Testing & Quality Intermediate TDD/BDD/property-based/mutation testing, all test types, performance testing, refactoring patterns
9 Engineering Leadership Advanced ADRs/RFCs, system thinking, DORA/SPACE metrics, estimation, technical strategy, communication
10 Emerging Paradigms Advanced AI-native engineering, RAG/agents, edge computing, CRDTs, durable execution, Wasm, FinOps
23 System Design Case Studies Advanced 10 full designs: URL shortener, chat, payments, video streaming, ride-sharing — with diagrams
25 REST API Design Intermediate REST conventions, error handling, pagination, versioning, idempotency
25b API Operations & DX Intermediate Authentication, webhooks, SDKs, documentation, rate limiting
25c GraphQL Deep Dive Intermediate GraphQL schema design, resolvers, DataLoader, subscriptions, federation
29 Career Engineering All levels Promotion packets, brag docs, staff+ archetypes, IC vs mgmt, negotiation, influence, brand
30 Data Privacy & Compliance Intermediate GDPR implementation, anonymization, crypto-shredding, consent management, HIPAA/SOC2/PCI
36 Beast Mode — Operational Readiness All levels Operational readiness playbook, system mental models, observability hotlinks, incident readiness, codebase navigation, tribal knowledge

Hands-on skills and daily tools. Read at any point.

Ch Title Difficulty What You'll Learn
11 Programming Languages Intermediate Go, Rust, Python, Java/Kotlin, TypeScript, C#, Elixir, Zig — runnable servers, comparison tables
12 Linux, Shell & Editors Beg→Adv Linux, bash, SSH, fzf/tmux/rg, Vim/Neovim, VS Code
12b Git, Docker, Terraform & K8s Beg→Adv Git advanced, Docker, Terraform, kubectl
14 AI-Powered Engineering Beg→Inter AI for project planning, ERD design, code review, debugging, prompt engineering as a skill
15 Codebase Organization Beg→Adv Linting setup, CI/CD pipelines, team-size org (solo→100+), monorepo patterns, fitness functions
17 Claude Code Mastery Beg→Adv Skills/plugins/hooks, MCP servers, agent teams, CLAUDE.md, plan mode, TDD/debugging workflows
20 Dependency & Env Management Intermediate Nix, asdf/mise, nvm/pyenv/rustup, lockfiles, Docker dev envs, devcontainers, reproducible builds
27 Technical Writing Beg→Inter Diátaxis framework, READMEs, ADRs, RFCs, commit messages, runbooks, postmortems, code comments
28 Code Reading & Open Source Beg→Inter Navigating unfamiliar codebases, OSS contribution workflow, licensing, building your profile
33 GitHub Actions Core Inter→Adv Workflow syntax, reusable workflows, composite actions, matrix strategies, OIDC federation
33b Advanced GitHub Actions Advanced Self-hosted runners, monorepo CI, custom actions, security hardening, performance optimization, advanced patterns
34 Specs, RFCs & ADRs Inter→Adv RFCs, design docs, ADRs, the spec-first thesis
34b Contract-First API Inter→Adv OpenAPI, AsyncAPI, Protobuf, BDD/Gherkin, executable specs
34c AI-Native Specs Inter→Adv CLAUDE.md as spec, AI-native workflows, spec culture, anti-patterns

Running systems in production at scale. Read after Parts I–II.

Ch Title Difficulty What You'll Learn
13 Cloud & System Integration Advanced VPC networking, queues (Kafka/SQS), event-driven, data flow, migrations, full system walkthrough
18 Debugging & Monitoring Inter→Adv Debugging methodology, flame graphs, Datadog, Prometheus+Grafana, ELK, OpenTelemetry, Sentry
19 AWS Deep Dive Inter→Adv AWS 20 core services, VPC, IAM, cost optimization, 5 reference architectures
19b Firebase Deep Dive Inter→Adv Firestore, Auth, Cloud Functions, security rules, scaling Firebase, Firebase vs AWS
26 Incident War Stories Intermediate 9 real outages analyzed: Cloudflare, GitHub, AWS S3, Knight Capital, Facebook BGP, CrowdStrike
31 GCP Deep Dive Inter→Adv Compute Engine, Cloud Run, GKE, BigQuery, Spanner, Pub/Sub, Cloud Storage, IAM, cost optimization, GCP vs AWS comparison
35 Everything as Code Inter→Adv Policy-as-code (OPA/Kyverno/Checkov), secrets management (Vault/SOPS), DB migrations, observability-as-code, compliance-as-code, IaC testing, GitOps (ArgoCD/Flux), Crossplane, Backstage

Narrative: How all the pieces connect (Ch 13) → how to find and fix problems (Ch 18) → AWS in depth (Ch 19) → Firebase in depth (Ch 19b) → GCP in depth (Ch 31) → codify everything (Ch 35) → learning from others' failures (Ch 26).


Reference material. Look things up as needed.

Ch Title What's Inside
16 Essential Resources 49 foundational papers, books, blogs, and newsletters with summaries
A Glossary & Dictionary 250+ engineering terms, abbreviations, and culture phrases — ACID to yak shaving

Chapter Dependency Graph

Part I — Foundations (start here):
  Ch 1 → Ch 2 → Ch 3 → Ch 4        (core sequence)
  Ch 5                                (standalone)
  Ch 21, 22, 24/24b, 32                (standalone, enrich Part I)

Part II — Applied Engineering (after Part I, any order):
  Ch 6          ← benefits from Ch 1
  Ch 7          ← benefits from Ch 3
  Ch 8          ← standalone
  Ch 9          ← benefits from broad experience
  Ch 10         ← benefits from Ch 1-4
  Ch 23         ← benefits from Ch 1, 2, 3, 22
  Ch 25/25b/25c ← benefits from Ch 3
  Ch 29, 30     ← standalone
  Ch 36         ← benefits from Ch 12/12b, 18; standalone

Part III — Tooling & Practice (anytime):
  Ch 11, 12/12b, 14, 15, 27, 28 ← standalone
  Ch 17                          ← benefits from Ch 12/12b
  Ch 20                          ← benefits from Ch 12/12b
  Ch 33/33b                      ← benefits from Ch 7, 15, 8
  Ch 34/34b/34c                  ← benefits from Ch 27, 25, 9

Part IV — Cloud & Operations (after Parts I-II):
  Ch 13         ← benefits from Ch 1-4, 7
  Ch 18         ← benefits from Ch 4
  Ch 19/19b     ← benefits from Ch 7, 13
  Ch 31         ← benefits from Ch 7, 13
  Ch 35         ← benefits from Ch 7, 5
  Ch 26         ← benefits from Ch 4, 7

Appendices — anytime:
  Ch 16, Appendix A

How Each Chapter Is Structured

Every chapter follows a consistent, AI-scannable format:

<!-- HTML metadata: CHAPTER, TITLE, PART, PREREQS, KEY_TOPICS, DIFFICULTY, UPDATED -->

# Chapter N: Title

> Part · Prerequisites · Difficulty

Summary sentence.

### In This Chapter        ← section index
### Related Chapters       ← cross-references

---

## 1. MAJOR SECTION
### 1.1 Subsection
**What it is:** ...
**When to use:** ...
**Trade-offs:** ...
**Real-world example:** ...

To find content programmatically:

  • Parse <!-- ... --> blocks for structured metadata
  • Search KEY_TOPICS for topic matching
  • Follow PREREQS to build reading order
  • Filter by DIFFICULTY for level-appropriate content
  • Each subdirectory has its own README.md with local navigation

Interactive Learning with AI

The course/ directory contains 108 hands-on modules organized in 3 progressive loops, built from the same material as the guide chapters. Each module has exercises you build on a running project (TicketPulse) so concepts compound as you go:

  • Loop 1 (M01–M30): Foundations — dev environment, databases, APIs, testing, security, observability
  • Loop 2 (M31–M60): Applied — microservices, Kafka, Kubernetes, Terraform, advanced patterns
  • Loop 3 (M61–M90): Mastery — multi-region, system design, incident response, capstone

This course pairs with Tech Skill Builder, a Claude Code plugin that turns these modules into interactive learning experiences.

Learn with an AI Tutor

Use /tech-skill-builder:learn in Claude Code to start a guided tutoring session through any module. The tutor:

  • Walks you through concepts step-by-step with Socratic questioning
  • Generates hands-on exercises tailored to your skill level
  • Provides real-time feedback on your code and understanding
  • Adapts pacing based on your progress

Build Your Own Course

Use /tech-skill-builder:create-course to generate new courses from scratch — whether you want to extend this guide with your own topics or create entirely new curricula for your team.

Getting Started

# Install the plugin in Claude Code
claude plugin add cemergin/tech-skill-builder

# Start learning any module
/tech-skill-builder:learn

# Create a new course
/tech-skill-builder:create-course

Contributing

This guide is open source. To improve it:

  1. Fork the repo
  2. Create a branch (git checkout -b improve/chapter-name)
  3. Make your changes (follow the chapter format above)
  4. Submit a PR with a description of what you improved

Improvements welcome: corrections, deeper examples, new case studies, updated tool versions, additional resources.


Spiral Map

Every core concept revisits at increasing depth across the guide:

DATABASE:      Ch 2 (modeling) → Ch 24 (internals) → Ch 24b (SQL mastery)
               → Ch 23 (case studies) → Ch 18 (debugging queries)

SECURITY:      Ch 5 (foundations) → Ch 19 (AWS IAM) → Ch 30 (privacy)
               → Ch 33b (CI hardening) → Ch 35 (secrets as code)

TESTING:       Ch 8 (fundamentals) → Ch 34b (executable specs) → Ch 33 (CI)
               → Ch 15 (fitness functions) → Ch 17 (AI-assisted TDD)

ARCHITECTURE:  Ch 3 (patterns) → Ch 9 (ADRs) → Ch 34 (full specs)
               → Ch 23 (case studies) → Ch 1 (deep theory)

OBSERVABILITY: Ch 4 (SLOs) → Ch 18 (tools) → Ch 36 (on-call)
               → Ch 26 (war stories) → Ch 35 (as code)

Each chapter's Related Chapters section marks its position in these threads with ← (spirals from) and → (spirals to) arrows so you can follow any thread across the guide.


Key Principles

  1. Start simple, add complexity only when the problem demands it
  2. Every pattern has a cost — the best architecture is the simplest one that solves actual problems
  3. Measure before optimizing — intuition about bottlenecks is usually wrong
  4. Design for failure — the question is not if but when and how fast you recover
  5. Composition over invention — compose proven primitives rather than building from scratch

Built with Claude Code. Contributions welcome.

About

The 100x Engineer Guide: 30-chapter, 34K-line comprehensive backend & software engineering mastery guide

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors