[FEATURE] Comparaison to LitData

[tchaton]

Description

Hey there,

I just discovered Deeplake and found it to be an amazing library. I wondered if you would be interested to compare with LitData: https://github.com/Lightning-AI/litdata

Use Cases

Better understanding of market performance.

[istranical]

Hi @tchaton you raise a great point! A research group at Yale benchmarked Deep Lake against other dataloaders including FFCV last year, and our implementation has improver further.

We are currently working on DeepLake V4 which includes major changes, and we'll make sure to update benchmarks against other dataloaders, including FFCV.

[tchaton]

Thanks @istranical, I copied the wrong link, I meant Litdata: https://github.com/Lightning-AI/litdata

[grpiccoli]

Hi @tchaton @istranical, are there any updates on this?