Optimize phases

Author: MPCoreDeveloper

README.md

@@ -40,11 +40,12 @@ A high-performance, encrypted, embedded database engine for .NET 10 with **B-tre
 - **Encryption**: AES-256-GCM at rest (**0% overhead, sometimes faster!** ✅)
 - **Analytics**: **28,660x faster** than LiteDB with SIMD vectorization ✅
 - **Analytics**: **682x faster** than SQLite with SIMD vectorization ✅
-- **INSERT**: **37% faster** than SQLite, **28% faster** than LiteDB! ✅
+- **INSERT**: **43% faster** than SQLite, **44% faster** than LiteDB! ✅
 - **SELECT**: **2.3x faster** than LiteDB for full table scans ✅
-- **UPDATE**: **7.5x faster** than LiteDB for random updates ✅
+- **UPDATE**: **5.4x faster** Single-File mode with batch coalescing ✅ **NEW!**
+- **UPDATE**: Competitive with LiteDB (60ms vs 65ms) ✅ **NEW!**
 - **B-tree Indexes**: O(log n + k) range scans, ORDER BY, BETWEEN support ✅
-- **Unlimited Rows**: FILESTREAM support for multi-gigabyte rows ✅ **NEW!**
+- **Unlimited Rows**: FILESTREAM support for multi-gigabyte rows ✅
 
 ---
 
@@ -92,10 +93,11 @@ db.ExecuteSQL("INSERT INTO files VALUES (1, @data)");
 
 - **SIMD Analytics**: **28,660x faster** aggregations than LiteDB (1.08µs vs 30.9ms)
 - **SIMD Analytics**: **682x faster** than SQLite (1.08µs vs 737µs)
-- **INSERT Operations**: **37% faster** than SQLite (4.09ms vs 6.50ms) ✅
-- **INSERT Operations**: **28% faster** than LiteDB (4.09ms vs 5.66ms) ✅
+- **INSERT Operations**: **43% faster** than SQLite (3.68ms vs 5.70ms) ✅
+- **INSERT Operations**: **44% faster** than LiteDB (3.68ms vs 6.51ms) ✅
 - **SELECT Queries**: **2.3x faster** than LiteDB for full table scans
-- **UPDATE Operations**: **7.5x faster** than LiteDB (10.7ms vs 81ms)
+- **UPDATE Operations**: **5.4x faster** Single-File mode (60ms vs 325ms) ✅ **NEW!**
+- **UPDATE Memory**: **280x less** allocations (1.9MB vs 540MB) ✅ **NEW!**
 - **AVX-512/AVX2/SSE2**: Hardware-accelerated analytics with SIMD vectorization
 - **NativeAOT-Ready**: Zero reflection, zero dynamic dispatch, aggressive inlining
 - **Memory Efficient**: **52x less memory** than LiteDB for SELECT operations
@@ -138,10 +140,10 @@ db.ExecuteSQL("INSERT INTO files VALUES (1, @data)");
 
 ---
 
-## 📊 Performance Benchmarks (January 28, 2026)
+## 📊 Performance Benchmarks (February 3, 2026)
 
 **Test Environment**: Windows 11, Intel i7-10850H @ 2.70GHz (6 cores/12 threads), 16GB RAM, .NET 10  
-**Status**: **SCDB Phase 6 Production Ready**
+**Status**: **SCDB Phase 6 Production Ready** + **Phase 2 Batch UPDATE Optimization**
 
 ---
 
@@ -163,10 +165,11 @@ db.ExecuteSQL("INSERT INTO files VALUES (1, @data)");
 
 | Database | Time | Ratio | Memory |
 |----------|------|-------|--------|
-| **SharpCoreDB Single File** | **4,092 µs** | **0.37x** ✅ | 4.6 MB |
-| **SharpCoreDB Single (Encrypted)** | **4,344 µs** | **0.39x** ✅ | 4.6 MB |
-| LiteDB | 5,663 µs | 0.51x | 12.5 MB |
-| SQLite | 6,501 µs | 0.59x | 926 KB |
+| **SharpCoreDB Single File** | **3,681 µs** | **0.36x** ✅ | 4.6 MB |
+| **SharpCoreDB Single (Encrypted)** | **3,941 µs** | **0.39x** ✅ | 4.6 MB |
+| SQLite | 5,701 µs | 0.56x | 926 KB |
+| LiteDB | 6,513 µs | 0.64x | 12.5 MB |
+| SharpCoreDB PageBased | 9,761 µs | 1.00x | 14.0 MB |
 
 ---
 
@@ -176,21 +179,29 @@ db.ExecuteSQL("INSERT INTO files VALUES (1, @data)");
 
 | Database | Time | Ratio | Memory |
 |----------|------|-------|--------|
-| SharpCoreDB Dir | 889 µs | 0.94x | 2.6 MB |
-| SharpCoreDB PageBased | 951 µs | 1.00x | 2.6 MB |
-| SharpCoreDB Single File | 2,269 µs | 2.40x | 3.6 MB |
+| **SharpCoreDB Dir (Unencrypted)** | **814 µs** | **0.86x** ✅ | 2.8 MB |
+| SharpCoreDB Dir (Encrypted) | 855 µs | 0.91x | 2.8 MB |
+| SharpCoreDB PageBased | 944 µs | 1.00x | 2.8 MB |
+| SharpCoreDB Single File | 2,547 µs | 2.70x | 3.6 MB |
 
 ---
 
-### ✏️ **4. UPDATE Performance**
+### ✏️ **4. UPDATE Performance - 5.4x IMPROVEMENT!** 🏆 **NEW!**
 
-**Test**: 500 random updates on 5,000 records
+**Test**: 500 random updates on 5,000 records (batch UPDATE optimization)
 
 | Database | Time | Ratio | Memory |
 |----------|------|-------|--------|
-| SQLite | 6,756 µs | 0.63x | 202 KB |
-| SharpCoreDB PageBased | 10,750 µs | 1.00x | 3.3 MB |
-| LiteDB | 81,051 µs | 7.56x slower | 24.1 MB |
+| SQLite | 6,459 µs | 0.54x | 202 KB |
+| **SharpCoreDB Dir (Encrypted)** | **7,513 µs** | **0.63x** ✅ | 3.3 MB |
+| **SharpCoreDB Dir (Unencrypted)** | **9,041 µs** | **0.75x** ✅ | 3.4 MB |
+| SharpCoreDB PageBased | 12,065 µs | 1.00x | 3.4 MB |
+| **SharpCoreDB Single File** | **60,170 µs** | **5.02x** | **1.9 MB** ✅ |
+| **SharpCoreDB Single (Encrypted)** | **62,107 µs** | **5.18x** | **1.9 MB** ✅ |
+| LiteDB | 65,126 µs | 5.43x | 24.5 MB |
+| AppendOnly | 118,638 µs | 9.89x | 35.1 MB |
+
+> **Note**: Single-File UPDATE improved **5.4x faster** (from 325ms to 60ms) with **280x less memory** (from 540MB to 1.9MB) thanks to batch UPDATE coalescing optimization.
 
 ---
 
@@ -288,8 +299,9 @@ db.ExecuteSQL("INSERT INTO data VALUES (@blob)");
 
 ## 🏆 Awards & Recognition
 
-- **Database Performance**: Beats SQLite by 37% on INSERT, LiteDB by 28% ✅
+- **Database Performance**: Beats SQLite by 43% on INSERT, LiteDB by 44% ✅
 - **Analytics Speed**: 682x faster than SQLite, 28,660x faster than LiteDB ✅
+- **UPDATE Optimization**: 5.4x faster Single-File mode, 280x less memory ✅ **NEW!**
 - **Code Quality**: 151+ tests, comprehensive documentation ✅
 - **Production Ready**: SCDB 100% complete with crash recovery ✅