Are their any parameters I can tweak to reduce the memory spaCy uses? Right now it seems to require about 1.7GB of RAM which is too much for many smaller virtual servers both locally or in datacenters.
I'm running it alone in a 2.5GB virtualbox ubuntu just to test and play around with.
I'm not sure exactly what vectors or data spaCy loads or how removing some of them would affect performance. Right now it seems to require about 1 minute on a dualcore i5 to load the data.
Unfortunatly you can currently only reduce memory usage by removing capabilities. We hope to reduce memory usage in future by switching to a neural network model. Progress on that is going well.
This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.
Most helpful comment
Unfortunatly you can currently only reduce memory usage by removing capabilities. We hope to reduce memory usage in future by switching to a neural network model. Progress on that is going well.