You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -207,7 +207,7 @@ Here are the results from running this benchmark on a 8,000,000 row dataset (app
207
207
208
208
**Key Insights:**
209
209
- Circular buffers processed the same data **21x faster**
210
-
- Used **10.6x less memory** despite processing the same amount of data
210
+
- Used **16x less memory** despite processing the same amount of data
211
211
- Had **94% fewer garbage collection events**, leading to smoother performance
212
212
- Spent virtually no time on memory cleanup (405ms vs 826+ seconds)
213
213
- Produced identical results, proving accuracy isn't compromised
@@ -237,4 +237,6 @@ DataFrames are, and will remain, an essential, powerful, and correct choice for
237
237
238
238
However, when dataset is massive & we need only simple manipulations like calculating moving averages which we could do with a sliding window without loading everything into memory, a circular buffer can provide significant performance benefits. The key takeaway is to understand your data processing needs and choose the right tool for the job.
239
239
240
+
**Note:** It is also fair to mention that other DataFrame libraries vary significantly in optimization and performance. Libraries like [Pandas in Python](https://pandas.pydata.org/) are heavily optimized with specialized type systems, C extensions, and native computational libraries. Pharo's DataFrame implementation, while powerful and growing, has not yet reached that level of optimization. For this reason, if one were to repeat this benchmark with a more optimized DataFrame library, the performance difference would likely be smaller.
241
+
240
242
Want to explore more? Check out the [Containers-Buffer repository](https://github.com/pharo-containers/Containers-Buffer) to see the complete implementation and examples.
0 commit comments