Skip to content

Commit 0517a06

Browse files
authored
Introduce Quadtrix benchmark suite with Python and C++ support (#44)
## Summary - Project Versioning: Sets the starting project version to 0.1.0. - Code Shortcuts (Macros): Creates clean shorthand terms for CUDA keywords (like wrapping __device__ into QX_DEVICE) to make writing GPU kernels cleaner. - Math & Memory Utilities: Adds fast math helpers for aligning memory, rounding numbers, and calculating power-of-two boundaries quickly. - Memory Optimization: Forces a 128-byte memory alignment to ensure the GPU can read data as fast as possible (coalesced memory access). - Automatic Error Checking: Introduces safety wrappers (CUDA_CHECK, CUBLAS_CHECK, NCCL_CHECK) that instantly watch for crashes or failures in Nvidia's core hardware and math libraries, making debugging much easier.
2 parents 410f1fe + 157b4f0 commit 0517a06

8 files changed

Lines changed: 883 additions & 5 deletions

File tree

README.md

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,6 @@
11
# Quadtrix.cpp
2+
<img width="2442" height="1586" alt="run_20260508_110726" src="https://github.com/user-attachments/assets/ef51d1c3-e28e-4674-8a71-5513e753b174" />
3+
24
Quadtrix.cpp is a local language model project with several execution paths:
35

46
- A dependency-free C++17 transformer implementation with manual forward and backward passes.
@@ -15,10 +17,6 @@ Quadtrix.cpp is a local language model project with several execution paths:
1517
The project is designed as a technical learning implementation. The C++ path exposes the transformer internals directly: tensor operations, attention, layer normalization, cross-entropy, analytical gradients, AdamW, checkpointing, and autoregressive generation.
1618

1719
## v1.1.0
18-
<img width="2442" height="1586" alt="run_20260508_110726" src="https://github.com/user-attachments/assets/ef51d1c3-e28e-4674-8a71-5513e753b174" />
19-
20-
---
21-
2220
<img width="2185" height="829" alt="run_20260430_192930" src="https://github.com/user-attachments/assets/c6db061a-aa8d-4d8d-a1e2-1a81418bb613" />
2321

2422
---

0 commit comments

Comments
 (0)