Faiss: CUDA 10.1 conda builds

[datametrician]

Would you please provide a CUDA 10.1 conda build for FAISS? This would make our container build significantly more streamlined for CUDA 10.1 which we're planning for 0.7. Happy to help if needed as always. This also is urgent as we won't have 10.1 in our next release (0.6), but just wanted to give you all ample heads up. It's great working with all of you and thank you!

[beauby]

@datametrician We're now depending on conda's cudatoolkit package (https://anaconda.org/anaconda/cudatoolkit) to avoid conflicts with other CUDA-enabled libraries. However, they do not provide a 10.1 version yet AFAIK, so I'll keep this issue open as a reminder.

[datametrician]

Thanks @beauby. The RAPIDS project is moving to use the same cudatoolkit.

[mdouze]

No activity, closing.

[naah69]

@datametrician We're now depending on conda's cudatoolkit package (https://anaconda.org/anaconda/cudatoolkit) to avoid conflicts with other CUDA-enabled libraries. However, they do not provide a 10.1 version yet AFAIK, so I'll keep this issue open as a reminder.

conda ‘s cudatoolkit has the 10.1.
but the latest version of faiss just support cudatoolkit 10.0.
my gpu is GTR 2070. it must install 10.1.
Would you please provide a CUDA 10.1 conda build for FAISS?
thank you.

[beauby]

@naah69 A faiss package for cuda 10.1 will be made available soon. In the meantime, you can build it from source.

[naah69]

@naah69 A faiss package for cuda 10.1 will be made available soon. In the meantime, you can build it from source.

👌，thank you

[jarib]

This is still an issue. The 10.1 toolkit is still commented out here:

https://github.com/facebookresearch/faiss/blob/8b682606e1564b659f56afae5e16e672ac6ab564/conda/faiss-gpu/conda_build_config.yaml#L8

[lijing1996]

@naah69 When will cuda 10.1 be available?

[yifita]

This is still an issue. The 10.1 toolkit is still commented out here:

https://github.com/facebookresearch/faiss/blob/8b682606e1564b659f56afae5e16e672ac6ab564/conda/faiss-gpu/conda_build_config.yaml#L8

that line is uncommented now. But installing faiss-gpu from conda with cudatoolkit=10.1 still fails

$ conda install faiss-gpu cudatoolkit=10.1 -c pytorch                                                                                                                                    
Collecting package metadata (repodata.json): done                                                                                                                                        
Solving environment: failed with initial frozen solve. Retrying with flexible solve.                                                                                                     
Solving environment: |                                                                                                                                                                   
Found conflicts! Looking for incompatible packages.                                                                                                                                      
This can take several minutes.  Press CTRL-C to abort.                                                                                                                                   
failed                                                                                                                                                                                   

UnsatisfiableError: The following specifications were found to be incompatible with a past                                                                                               
explicit spec that is not an explicit spec in this operation (cudatoolkit):                                                                                                              

  - faiss-gpu -> cudatoolkit[version='>=10.0.130,<10.1.0a0|>=8.0,<8.1.0a0|>=9.0,<9.1.0a0']  

[ignacio-rocco]

This seems to be still an issue @mdouze

[davendu]

Seems this is still an issue. The library compiled into the binary is asking for wrong version of the CUDA library. Maybe the issue should be reopened. @mdouze

For CUDA 10.1, those libraries are libcudart.so.10.1.

Edit: I recompiled a wheel for cuda 10.1 using v1.6.3 tag and works fine without any code modification (except for issue #1159).

[16hchung]

What commands did you use to recompile a wheel for cuda 10.1 using v1.6.3 tag?