We soon intend to submit a PR with following fixes and improvements:
- Shorten build time for AiSAQ in scale configuration
• In this version build process will no longer rearrange the index, it will only generate the rearranged data, this data shall be used during search for reading the PQ vectors in a rearranged manner.
• Use multiple threads when generating the rearranged data during build.
- Inline PQ optimization - Utilize sector unused space for additional inline PQ vectors when possible (this will not increase the index footprint on the disk).
- When rearranged is enabled, instead of saving both aligned rearranged PQ vectors file and original PQ vectors file, only the first one is saved.
- Set AiSAQ default beamwidth value from 8 to 2 to avoid excessive disk load.
- Improved RAM estimation for index build with GPU
- Fixed consumed memory size calculation function.
- Fixed AiSAQ thread context leak when index 'size' API is called and all PQ vectors are stored inline.
- Fixed context release to be done before notifying that it is free.
- Fixed index file existence check.
- Fixed index build with COSINE metric
- Fixed context resource release order to avoid race condition.
We soon intend to submit a PR with following fixes and improvements:
• In this version build process will no longer rearrange the index, it will only generate the rearranged data, this data shall be used during search for reading the PQ vectors in a rearranged manner.
• Use multiple threads when generating the rearranged data during build.