Skip to content

Zeynal Mardanli: Implemented optimized matrix multiplication#5

Open
Lshiroc wants to merge 1 commit into
AA-parallel-computing:mainfrom
Lshiroc:zeynal-mardanli
Open

Zeynal Mardanli: Implemented optimized matrix multiplication#5
Lshiroc wants to merge 1 commit into
AA-parallel-computing:mainfrom
Lshiroc:zeynal-mardanli

Conversation

@Lshiroc

@Lshiroc Lshiroc commented May 31, 2026

Copy link
Copy Markdown

Optimizations:

Blocked matmul: Split matrices into 32×32 tiles so data stays in cache instead of being re-fetched from RAM on every access. Also reordered the inner loops (i-k-j) so memory reads are sequential.
Parallel matmul: Added #pragma omp parallel for over the row loop. Each row of C is independent, so no race conditions. Rows are split evenly across threads with schedule(static).

Challenges:

Test matrices are small (under 300×300), so they already fit in cache which made the blocked version show little to no speedup on most cases.
For very small matrices (e.g. 32×128×32), OpenMP thread startup overhead was larger than the actual computation, giving speedup below 1×.
The loop order in the assignment pseudocode (i-j-k) causes strided memory access inside a block, so I switched to i-k-j to fix that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant