Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KD-Tree or Ball-Tree Algorithms for kNN search? #113

Open
RayHackett opened this issue Oct 2, 2024 · 2 comments
Open

KD-Tree or Ball-Tree Algorithms for kNN search? #113

RayHackett opened this issue Oct 2, 2024 · 2 comments

Comments

@RayHackett
Copy link

Thanks for developing the library. So far using to run a KNN on embedding vectors it has been pretty straight forward.
Are there any plans to speed up KNN search by introducing clever algorithms like a K-D tree or Ball-Tree? Running a brute force search on every query seems a bit wasteful for large data tables.
It would be amazing if create index ... ON Table(vector) was actually creating a K-D tree.

Best wishes!

@mholt
Copy link

mholt commented Oct 8, 2024

Is this the same as #25? (I am new here, sorry if irrelevant!)

@RayHackett
Copy link
Author

I suppose that depends on how you implement k-d or ball tree algorithms though they could be.
There seem to be some ANN implementations for SQLite. I was looking at this ticket #94 for alternatives.
This ticket was more aimed at faster exact kNN search algorithms before trying out approximate NNs. I realize implementing any of this is not at all trivial.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants