-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HNSW Flat Poor performance while Performance Testing #3774
Comments
https://github.com/facebookresearch/faiss/wiki/Indexing-1M-vectors
|
@IcanDoItL |
@alexanderguzhva I tried, it doesn't work.
|
the question like erikbern/ann-benchmarks#47 |
Normally one would parallelize the search using Faiss' internal threading. It is unavoidable that the python threading incurs an overhead. https://github.com/facebookresearch/faiss/blob/main/faiss/IndexHNSW.cpp#L266 should be parallelized only if the number of queries is > 1 (and presumbaly something larger than 1) |
For IVF search, this check is performed here: |
Thanks, I see https://github.com/facebookresearch/faiss/wiki/Indexing-1M-vectors. so I try use hnsw index instead of ivf index, but when I use hnsw index and jmeter Stress(Simulate users accessing simultaneously) Testing performance poor. I’m planning to use it in a production environment. each search the number of queries is 1, but there will be multiple users accessing simultaneously. Could you offer some advice? |
I use IndexHNSWFlat make Index.
when I use jmeter Stress Testing performance poor , has many context switch and system call
system call statistics : strace -c -p pid
Summary
Platform
OS: Linux
Faiss version: faiss-cpu = 1.8.0
Installed from: anaconda
Faiss compilation options:
Running on:
Interface:
Reproduction instructions
The text was updated successfully, but these errors were encountered: