Faiss: Should we wait for ScaNN inside faiss?

[sgjurano]

Hi guys!

Do you have plans about supporting ScaNN algorithm inside faiss?
https://github.com/google-research/google-research/tree/master/scann

[mdouze]

We are working on better support for PQ 4 bits in Faiss (which is the main advantage of SCANN over Faiss currently).

NB that this is already supported in a fork of Faiss, see
https://github.com/technicolor-research/faiss-quickeradc

[sgjurano]

Thanks for the link, I will check it :)
BTW, do you have some roadmap for faiss development?

[mdouze]

That is a recurrent question.
There are some elements in a presentation we gave a recently: https://www.facebook.com/groups/faissusers/permalink/1017557432001876

[mdouze]

The 4-bit PQ implementation of SCANN is in Faiss. See benchmarks in

https://github.com/facebookresearch/faiss/wiki/Indexing-1M-vectors
https://github.com/facebookresearch/faiss/wiki/Indexing-1G-vectors