Commit 27cd0fc
committed
feat: Expand data category with 4 advanced dataflow skills
Added comprehensive skills for timely-dataflow and differential-dataflow systems:
- timely-dataflow.md: Timely dataflow framework, progress tracking, operators
* Core concepts: dataflow graphs, timestamps, frontiers
* Patterns: custom operators, stateful aggregation, iterative computation
* Rust examples with timely crate
- differential-dataflow.md: Differential computation, incremental updates
* Core concepts: collections, arrangements, differential operators
* Patterns: incremental joins, group-by reduce, connected components
* Efficient arrangements for shared state
- dataflow-coordination.md: Coordination patterns for distributed systems
* Core concepts: barriers, epochs, watermarks, snapshots
* Patterns: Chandy-Lamport snapshots, backpressure, causal consistency
* Multi-language examples (Rust, Go, Python)
- streaming-aggregations.md: Windowing and time-series aggregation
* Core concepts: tumbling/sliding/session windows, watermarks
* Patterns: late data handling, multi-resolution aggregation, top-K
* Time semantics and watermark strategies
Updated INDEX.md from 5 to 9 skills and enhanced discover-data gateway
with workflow combinations for real-time analytics and incremental
computation systems.1 parent c45da06 commit 27cd0fc
6 files changed
Lines changed: 2754 additions & 8 deletions
File tree
- skills
- data
- discover-data
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
| 5 | + | |
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
30 | 50 | | |
31 | 51 | | |
32 | 52 | | |
| |||
57 | 77 | | |
58 | 78 | | |
59 | 79 | | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
60 | 100 | | |
61 | 101 | | |
62 | 102 | | |
| |||
67 | 107 | | |
68 | 108 | | |
69 | 109 | | |
70 | | - | |
| 110 | + | |
71 | 111 | | |
72 | 112 | | |
73 | 113 | | |
| |||
0 commit comments