Spacy: Reducing Memory Usage?

Created on 11 Feb 2016  路  2Comments  路  Source: explosion/spaCy

Are their any parameters I can tweak to reduce the memory spaCy uses? Right now it seems to require about 1.7GB of RAM which is too much for many smaller virtual servers both locally or in datacenters.

I'm running it alone in a 2.5GB virtualbox ubuntu just to test and play around with.

I'm not sure exactly what vectors or data spaCy loads or how removing some of them would affect performance. Right now it seems to require about 1 minute on a dualcore i5 to load the data.

Most helpful comment

Unfortunatly you can currently only reduce memory usage by removing capabilities. We hope to reduce memory usage in future by switching to a neural network model. Progress on that is going well.

All 2 comments

Unfortunatly you can currently only reduce memory usage by removing capabilities. We hope to reduce memory usage in future by switching to a neural network model. Progress on that is going well.

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

nadachaabani1 picture nadachaabani1  路  3Comments

muzaluisa picture muzaluisa  路  3Comments

peterroelants picture peterroelants  路  3Comments

bebelbop picture bebelbop  路  3Comments

besirkurtulmus picture besirkurtulmus  路  3Comments