Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

memory-mapped faiss indices #4101

Open
alexanderguzhva opened this issue Dec 18, 2024 · 0 comments
Open

memory-mapped faiss indices #4101

alexanderguzhva opened this issue Dec 18, 2024 · 0 comments
Assignees

Comments

@alexanderguzhva
Copy link
Contributor

alexanderguzhva commented Dec 18, 2024

Summary

A prototype of memory-mapped files that contain Faiss Indices (IndexFlatCodes and HNSW at this moment).

zilliztech/knowhere#996

@mdouze Could you please give your comments on the approach, just in case I've missed some important corner cases? Despite the link is from the Faiss fork, it should be pretty straightforward to understand the changes. Basically, I replace std::vector<> with a custom container that supports mmap-ping.

The PR for Faiss will be implemented as soon as we agree on the details.
Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants