Question: detach release cache memory?

[dentiny]

Hi team, I'm trying to understand the storage extension cache

• Cache entries are stored in the session and object cache, which never get evicted
• So when lance storage extension gets detached, the cache entries still live in memory until database instance gets destructed
• One way to address (if it's a problem) is to implement the detach hook, but that requires per-storage-extension to have its unique object cache entry

I'm not sure if that's expected? Thanks!

[Xuanwo]

Yes, this behavior is somewhat expected, as I don't have a use case for detaching a Lance extension. Is it a problem for you?

[dentiny]

Thanks for the reply! No a production problem -- for DuckLake, I put all cache entries into object cache and will be evicted sooner or later (with estimated memory size specified), so I was checking how other storage extension handles cache eviction. :)