Skip to content

Latest commit

 

History

History
23 lines (18 loc) · 1.19 KB

File metadata and controls

23 lines (18 loc) · 1.19 KB

Learn more

Selected external reading on Hoptimator's design and use at LinkedIn.

Engineering blog posts

  • Declarative data pipelines with Hoptimator — the original "what is this and why" post. Walks through the Subscription/materialized-view abstraction, the planner-as-orchestrator approach, and how Hoptimator unifies onboarding across systems like Kafka, Flink, Brooklin, Venice, and Espresso.
  • Powering Apache Pinot ingestion with Hoptimator — production case study. Describes how Pinot uses Hoptimator to manage its own ingestion pipelines: dynamic provisioning of Flink SQL jobs and Kafka topics, ML-driven partitioning, deduplication of overlapping pipeline components, and consumer-driven optimization.

Where to follow along