|
1 | 1 | # SharpCoreDB Documentation |
2 | 2 |
|
3 | | -Welcome to the SharpCoreDB documentation! This directory contains comprehensive guides for using, developing, and understanding SharpCoreDB. |
| 3 | +**Version:** 1.3.5 (Phase 9.2) |
| 4 | +**Status:** Production Ready ✅ |
4 | 5 |
|
5 | | ---- |
6 | | - |
7 | | -## 📚 Documentation Structure |
8 | | - |
9 | | -### 🎯 [Feature Status](./FEATURE_STATUS.md) **← START HERE** |
10 | | -Complete feature matrix with implementation status, performance data, and roadmap. |
11 | | - |
12 | | -- **[FEATURE_STATUS.md](./FEATURE_STATUS.md)** - Comprehensive status of all features |
13 | | - - Production-ready features |
14 | | - - Performance benchmarks |
15 | | - - Hardware requirements |
16 | | - - API compatibility |
17 | | - - Roadmap |
18 | | - |
19 | | -### 🚀 [Performance & Optimization](.) |
20 | | -Performance-focused guides for maximum throughput. |
21 | | - |
22 | | -- **[QUERY_PLAN_CACHE.md](./QUERY_PLAN_CACHE.md)** - Query plan caching guide (5-10x speedup) |
23 | | -- **[SIMD_OPTIMIZATION_SUMMARY.md](./SIMD_OPTIMIZATION_SUMMARY.md)** - SIMD acceleration guide (345x analytics) |
24 | | - |
25 | | -### 🗂️ [SCDB Single-File Format](./scdb/) |
26 | | -Complete documentation for the SCDB single-file storage format. |
27 | | - |
28 | | -- **[README](./scdb/README.md)** - Overview and quick start guide |
29 | | -- **[FILE_FORMAT_DESIGN](./scdb/FILE_FORMAT_DESIGN.md)** - Complete technical specification |
30 | | -- **[DESIGN_SUMMARY](./scdb/DESIGN_SUMMARY.md)** - Executive summary |
31 | | -- **[IMPLEMENTATION_STATUS](./scdb/IMPLEMENTATION_STATUS.md)** - Current implementation progress |
32 | | -- **[PHASE1_IMPLEMENTATION](./scdb/PHASE1_IMPLEMENTATION.md)** - Phase 1 technical details |
33 | | - |
34 | | -### 🔄 [Migration](./migration/) |
35 | | -Database migration guides for converting between storage formats. |
36 | | - |
37 | | -- **[MIGRATION_GUIDE](./migration/MIGRATION_GUIDE.md)** - Complete migration guide with examples |
38 | | - |
39 | | -### 🛠️ [Development](./development/) |
40 | | -Internal development documentation for contributors. |
41 | | - |
42 | | -- **[SCDB_COMPILATION_FIXES](./development/SCDB_COMPILATION_FIXES.md)** - Compilation error solutions (English) |
43 | | -- **[SCDB_COMPILATION_FIXES_NL](./development/SCDB_COMPILATION_FIXES_NL.md)** - Compilation error solutions (Dutch) |
44 | | - |
45 | | -### 📝 [Project Documentation](.) |
46 | | -General project documentation. |
47 | | - |
48 | | -- **[CHANGELOG](./CHANGELOG.md)** - Version history and release notes |
49 | | -- **[CONTRIBUTING](./CONTRIBUTING.md)** - Contribution guidelines |
50 | | -- **[DIRECTORY_STRUCTURE](./DIRECTORY_STRUCTURE.md)** - Repository organization |
| 6 | +Welcome to the SharpCoreDB documentation! This is the central hub for all documentation. |
51 | 7 |
|
52 | 8 | --- |
53 | 9 |
|
54 | | -## 🚀 Quick Start |
55 | | - |
56 | | -### For Users |
57 | | - |
58 | | -1. **Getting Started**: See the main [README.md](../README.md) in the root directory |
59 | | -2. **Feature Overview**: See [FEATURE_STATUS.md](./FEATURE_STATUS.md) for complete capabilities |
60 | | -3. **Performance Optimization**: See [QUERY_PLAN_CACHE.md](./QUERY_PLAN_CACHE.md) and [SIMD_OPTIMIZATION_SUMMARY.md](./SIMD_OPTIMIZATION_SUMMARY.md) |
61 | | -4. **SCDB Format**: Start with [scdb/README.md](./scdb/README.md) |
62 | | -5. **Migration**: See [migration/MIGRATION_GUIDE.md](./migration/MIGRATION_GUIDE.md) |
63 | | - |
64 | | -### For Developers |
65 | | - |
66 | | -1. **Build Setup**: See [CONTRIBUTING.md](./CONTRIBUTING.md) |
67 | | -2. **Feature Status**: See [FEATURE_STATUS.md](./FEATURE_STATUS.md) |
68 | | -3. **SCDB Implementation**: See [scdb/IMPLEMENTATION_STATUS.md](./scdb/IMPLEMENTATION_STATUS.md) |
69 | | -4. **Compilation Issues**: See [development/SCDB_COMPILATION_FIXES.md](./development/SCDB_COMPILATION_FIXES.md) |
| 10 | +## 🚀 Start Here |
70 | 11 |
|
71 | | ---- |
| 12 | +**[docs/INDEX.md](INDEX.md)** ← **Main Documentation Navigation** |
72 | 13 |
|
73 | | -## 📊 Feature Status |
74 | | - |
75 | | -| Feature | Status | Documentation | |
76 | | -|---------|--------|---------------| |
77 | | -| **Query Plan Caching** | ✅ Production | [QUERY_PLAN_CACHE.md](./QUERY_PLAN_CACHE.md) | |
78 | | -| **SIMD Analytics** | ✅ Production | [SIMD_OPTIMIZATION_SUMMARY.md](./SIMD_OPTIMIZATION_SUMMARY.md) | |
79 | | -| **Single-File Storage (.scdb)** | ✅ 95% Complete | [scdb/](./scdb/) | |
80 | | -| **Block Persistence** | ✅ Complete | [scdb/PHASE1_IMPLEMENTATION.md](./scdb/PHASE1_IMPLEMENTATION.md) | |
81 | | -| **VACUUM Operations** | ✅ Complete | [scdb/PHASE1_IMPLEMENTATION.md](./scdb/PHASE1_IMPLEMENTATION.md) | |
82 | | -| **Database Migration** | ✅ Complete | [migration/MIGRATION_GUIDE.md](./migration/MIGRATION_GUIDE.md) | |
83 | | -| **Directory Storage** | ✅ Production | Main README | |
84 | | -| **JOINs** | 🚧 Partial | [FEATURE_STATUS.md](./FEATURE_STATUS.md) | |
85 | | -| **Subqueries** | 🚧 Partial | [FEATURE_STATUS.md](./FEATURE_STATUS.md) | |
86 | | -| **Triggers** | 🚧 Planned Q2 2026 | [FEATURE_STATUS.md](./FEATURE_STATUS.md) | |
| 14 | +This file contains: |
| 15 | +- ✅ Complete documentation index |
| 16 | +- ✅ Use-case based guides (RAG, Analytics, etc.) |
| 17 | +- ✅ Quick start examples |
| 18 | +- ✅ API references |
| 19 | +- ✅ Project-specific READMEs |
87 | 20 |
|
88 | 21 | --- |
89 | 22 |
|
90 | | -## 🎯 Key Concepts |
91 | | - |
92 | | -### Storage Modes |
93 | | - |
94 | | -SharpCoreDB supports two storage modes: |
95 | | - |
96 | | -1. **Directory Mode** (Legacy) |
97 | | - - Multi-file format |
98 | | - - One file per block |
99 | | - - 100% backward compatible |
100 | | - - Best for: Large databases (>10GB), legacy systems |
101 | | - |
102 | | -2. **Single-File Mode** (.scdb) |
103 | | - - All data in one file |
104 | | - - SSD-optimized with page alignment |
105 | | - - 10x faster startup |
106 | | - - Best for: Desktop apps, embedded systems, <10GB databases |
107 | | - |
108 | | -### Performance Optimization |
109 | | - |
110 | | -SharpCoreDB provides multiple optimization techniques: |
111 | | - |
112 | | -1. **Query Plan Caching** - Automatic (5-10x speedup) |
113 | | -2. **SIMD Analytics** - Hardware-accelerated (345x vs LiteDB, 11.5x vs SQLite) |
114 | | -3. **StructRow API** - Zero-copy iteration (10x less memory) |
115 | | -4. **B-tree Indexes** - O(log n) range queries |
116 | | -5. **Compiled Queries** - Prepare once, execute many times |
117 | | -6. **Batch Operations** - Bulk inserts/updates (1.5x faster) |
118 | | - |
119 | | -### Migration |
| 23 | +## 📚 Essential Documentation |
120 | 24 |
|
121 | | -Bidirectional migration between formats is supported: |
122 | | -- Directory → .scdb: [Migration Guide](./migration/MIGRATION_GUIDE.md) |
123 | | -- .scdb → Directory: [Migration Guide](./migration/MIGRATION_GUIDE.md) |
124 | | - |
125 | | -### Performance |
126 | | - |
127 | | -| Operation | Directory | Single-File | Improvement | |
128 | | -|-----------|-----------|-------------|-------------| |
129 | | -| Startup | 100ms | 10ms | 10x faster | |
130 | | -| Write | 50k/s | 100k/s | 2x faster | |
131 | | -| VACUUM | 60s | 600ms | 100x faster | |
132 | | -| Analytics (SIMD) | 49.5µs | 49.5µs | 345x vs LiteDB | |
| 25 | +| Document | Purpose | |
| 26 | +|----------|---------| |
| 27 | +| **[INDEX.md](INDEX.md)** | Central navigation hub (START HERE) | |
| 28 | +| **[CHANGELOG.md](CHANGELOG.md)** | Version history and release notes | |
| 29 | +| **[USER_MANUAL.md](USER_MANUAL.md)** | Complete feature guide | |
| 30 | +| **[CONTRIBUTING.md](CONTRIBUTING.md)** | Contribution guidelines | |
133 | 31 |
|
134 | 32 | --- |
135 | 33 |
|
136 | | -## 📖 Documentation Conventions |
| 34 | +## 🎯 Feature Documentation |
137 | 35 |
|
138 | | -### File Naming |
| 36 | +### Analytics Engine (Phase 9) - NEW |
| 37 | +- **[docs/analytics/README.md](analytics/README.md)** - Overview & API reference |
| 38 | +- **[docs/analytics/TUTORIAL.md](analytics/TUTORIAL.md)** - 15+ working examples |
139 | 39 |
|
140 | | -- **UPPERCASE.md** - Major documentation files |
141 | | -- **README.md** - Directory overview files |
142 | | -- **lowercase.md** - Supplementary guides |
| 40 | +### Vector Search (Phase 8) |
| 41 | +- **[docs/vectors/](vectors/)** - HNSW indexing, semantic search |
143 | 42 |
|
144 | | -### Language |
| 43 | +### Graph Algorithms (Phase 6.2) |
| 44 | +- **[docs/graph/](graph/)** - A* pathfinding, traversal |
145 | 45 |
|
146 | | -- Primary documentation in **English** |
147 | | -- Translations available for some files (suffix: `_NL` = Dutch) |
| 46 | +### Collation & Localization |
| 47 | +- **[docs/collation/](collation/)** - Multi-language support |
148 | 48 |
|
149 | | -### Status Markers |
| 49 | +### Storage & Serialization |
| 50 | +- **[docs/storage/](storage/)** - BLOB storage, formats |
| 51 | +- **[docs/serialization/](serialization/)** - Data format specs |
150 | 52 |
|
151 | | -- ✅ **Complete** - Feature implemented and tested |
152 | | -- ⚠️ **Partial** - Feature partially implemented |
153 | | -- ❌ **Planned** - Feature not yet implemented |
154 | | -- 🚧 **In Progress** - Currently being worked on |
| 53 | +### Architecture |
| 54 | +- **[docs/architecture/](architecture/)** - System design, indexes |
155 | 55 |
|
156 | 56 | --- |
157 | 57 |
|
158 | | -## 🤝 Contributing to Documentation |
| 58 | +## 📖 Project-Specific Documentation |
159 | 59 |
|
160 | | -See [CONTRIBUTING.md](./CONTRIBUTING.md) for guidelines on: |
| 60 | +All `src/*/README.md` files are updated to v1.3.5: |
161 | 61 |
|
162 | | -- Writing new documentation |
163 | | -- Updating existing docs |
164 | | -- Code examples and formatting |
165 | | -- Translation guidelines |
| 62 | +| Project | README | |
| 63 | +|---------|--------| |
| 64 | +| SharpCoreDB | [src/SharpCoreDB/README.md](../src/SharpCoreDB/README.md) | |
| 65 | +| SharpCoreDB.Analytics | [src/SharpCoreDB.Analytics/README.md](../src/SharpCoreDB.Analytics/README.md) | |
| 66 | +| SharpCoreDB.VectorSearch | [src/SharpCoreDB.VectorSearch/README.md](../src/SharpCoreDB.VectorSearch/README.md) | |
| 67 | +| SharpCoreDB.Graph | [src/SharpCoreDB.Graph/README.md](../src/SharpCoreDB.Graph/README.md) | |
| 68 | +| SharpCoreDB.Extensions | [src/SharpCoreDB.Extensions/README.md](../src/SharpCoreDB.Extensions/README.md) | |
| 69 | +| SharpCoreDB.EntityFrameworkCore | [src/SharpCoreDB.EntityFrameworkCore/README.md](../src/SharpCoreDB.EntityFrameworkCore/README.md) | |
| 70 | +| SharpCoreDB.Data.Provider | [src/SharpCoreDB.Data.Provider/README.md](../src/SharpCoreDB.Data.Provider/README.md) | |
166 | 71 |
|
167 | 72 | --- |
168 | 73 |
|
169 | | -## 📄 License |
170 | | - |
171 | | -All documentation is licensed under the MIT License. See [LICENSE](../LICENSE) for details. |
172 | | - |
173 | | ---- |
174 | | - |
175 | | -## 📚 Documentation Index |
176 | | - |
177 | | -### Core Documentation |
178 | | -- [FEATURE_STATUS.md](./FEATURE_STATUS.md) - Complete feature matrix |
179 | | -- [QUERY_PLAN_CACHE.md](./QUERY_PLAN_CACHE.md) - Query caching guide |
180 | | -- [SIMD_OPTIMIZATION_SUMMARY.md](./SIMD_OPTIMIZATION_SUMMARY.md) - SIMD acceleration |
181 | | -- [CHANGELOG.md](./CHANGELOG.md) - Version history |
182 | | -- [CONTRIBUTING.md](./CONTRIBUTING.md) - Contribution guide |
183 | | -- [DIRECTORY_STRUCTURE.md](./DIRECTORY_STRUCTURE.md) - Repository structure |
184 | | - |
185 | | -### SCDB Format |
186 | | -- [scdb/README.md](./scdb/README.md) - SCDB overview |
187 | | -- [scdb/FILE_FORMAT_DESIGN.md](./scdb/FILE_FORMAT_DESIGN.md) - Technical specification |
188 | | -- [scdb/IMPLEMENTATION_STATUS.md](./scdb/IMPLEMENTATION_STATUS.md) - Implementation progress |
189 | | - |
190 | | -### Migration |
191 | | -- [migration/MIGRATION_GUIDE.md](./migration/MIGRATION_GUIDE.md) - Migration guide |
| 74 | +## 🎓 Getting Started |
192 | 75 |
|
193 | | -### Development |
194 | | -- [development/SCDB_COMPILATION_FIXES.md](./development/SCDB_COMPILATION_FIXES.md) - Compilation fixes |
| 76 | +1. **New User?** → Read **[INDEX.md](INDEX.md)** |
| 77 | +2. **Want Analytics?** → See **[docs/analytics/TUTORIAL.md](analytics/TUTORIAL.md)** |
| 78 | +3. **Building RAG?** → Check **[docs/vectors/](vectors/)** |
| 79 | +4. **Need Help?** → View **[USER_MANUAL.md](USER_MANUAL.md)** |
195 | 80 |
|
196 | 81 | --- |
197 | 82 |
|
198 | | -**Last Updated:** 2026-01-XX |
199 | | -**Documentation Version:** 2.0.0 |
200 | | -**SharpCoreDB Version:** 2.x |
| 83 | +**For detailed navigation, see [INDEX.md](INDEX.md)** |
0 commit comments