Faiss: Get all added ids in the IVF index?
Running on:
CPU
Interface:
Python
Hi, I wonder if there is way to get all existing ids in the IVF index? It is kind of prone to error if maintaining a separate list. (I also notice we can add the same id to index more than once.) Thanks.
mylyu
All 5 comments
Getting all ids is not supported out-of-the-box but can be performed with the following code:
https://gist.github.com/mdouze/904e0b538ef7767c9e83a45ac1b57d1b
And yes there is no mechanism in place to avoid duplicate vector ids. Conceptually, the ids could be used as object classes, for example, that are not unique ids.
mdouze
on 23 Jul 2019
Getting all ids is not supported out-of-the-box but can be performed with the following code:
https://gist.github.com/mdouze/904e0b538ef7767c9e83a45ac1b57d1b
And yes there is no mechanism in place to avoid duplicate vector ids. Conceptually, the ids could be used as object classes, for example, that are not unique ids.
Thanks.
mylyu
on 2 Aug 2019
How to get same for index of type OPQ8,IVF16384_HNSW32,PQ8
nishathussain
on 4 Aug 2019
@mdouze https://gist.github.com/mdouze/904e0b538ef7767c9e83a45ac1b57d1b is invalid?
DaPenggg
on 12 Aug 2019
No activity, closing.
mdouze
on 30 Aug 2019
Related issues
xxllp
路
3Comments
maozezhong
路
3Comments
minjiaz
路
3Comments
ilyakhov
路
3Comments
linghuang
路
3Comments
Most helpful comment
Getting all ids is not supported out-of-the-box but can be performed with the following code:
https://gist.github.com/mdouze/904e0b538ef7767c9e83a45ac1b57d1b
And yes there is no mechanism in place to avoid duplicate vector ids. Conceptually, the ids could be used as object classes, for example, that are not unique ids.