Spacy: Spacy installation "killed" with no explanation...

[Bri-Will]

I'm trying to install Spacy on a fresh Azure VM with Ubuntu 16.04. This is a box I'm setting up just for simple prototyping so I don't need to worry about other users, virtual environments, etc. I'm trying to install spacy under the standard global python 2.7 installation.

I first tried to install with sudo pip install -U spacy, but this install ultimately failed because the cache and caching wheels were disabled due to permission problems. (pip suggested running sudo pip with the -H flag).

I restarted the install with the command sudo -H pip install -U spacy and this appeared to be working successfully. However, it got to the step of:

installing collected packages: spacy

and it hung there for a couple of hours. Eventually, I gave up and killed the script.

Now, when I try to install it will stop at the same spot, and "kill" itself. See below for the log.

pip uninstall spacy doesn't work...it reports that spacy is not installed.

Any advice on how to proceed? Thanks...

brian@FirstAzureInstance:~$ sudo -H pip install -U spacy
Collecting spacy
Requirement already up-to-date: numpy>=1.7 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: dill<0.3,>=0.2 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: thinc<6.11.0,>=6.10.1 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: msgpack-numpy in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: regex==2017.4.5 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: ujson>=1.35 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: ftfy<5.0.0,>=4.4.2 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: msgpack-python in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: six in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: murmurhash<0.29,>=0.28 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: requests<3.0.0,>=2.13.0 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: cymem<1.32,>=1.30 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: preshed<2.0.0,>=1.0.0 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: pathlib in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: plac<1.0.0,>=0.9.6 in /usr/local/lib/python2.7/dist-packages (from spacy)
Requirement already up-to-date: wrapt in /usr/local/lib/python2.7/dist-packages (from thinc<6.11.0,>=6.10.1->spacy)
Requirement already up-to-date: tqdm<5.0.0,>=4.10.0 in /usr/local/lib/python2.7/dist-packages (from thinc<6.11.0,>=6.10.1->spacy)
Requirement already up-to-date: cytoolz<0.9,>=0.8 in /usr/local/lib/python2.7/dist-packages (from thinc<6.11.0,>=6.10.1->spacy)
Requirement already up-to-date: termcolor in /usr/local/lib/python2.7/dist-packages (from thinc<6.11.0,>=6.10.1->spacy)
Requirement already up-to-date: html5lib in /usr/local/lib/python2.7/dist-packages (from ftfy<5.0.0,>=4.4.2->spacy)
Requirement already up-to-date: wcwidth in /usr/local/lib/python2.7/dist-packages (from ftfy<5.0.0,>=4.4.2->spacy)
Requirement already up-to-date: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy)
Requirement already up-to-date: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy)
Requirement already up-to-date: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy)
Requirement already up-to-date: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy)
Requirement already up-to-date: toolz>=0.8.0 in /usr/local/lib/python2.7/dist-packages (from cytoolz<0.9,>=0.8->thinc<6.11.0,>=6.10.1->spacy)
Requirement already up-to-date: setuptools>=18.5 in /usr/local/lib/python2.7/dist-packages (from html5lib->ftfy<5.0.0,>=4.4.2->spacy)
Requirement already up-to-date: webencodings in /usr/local/lib/python2.7/dist-packages (from html5lib->ftfy<5.0.0,>=4.4.2->spacy)
Installing collected packages: spacy
Killed

Your Environment

• Operating System: Linux Ubuntu Server 16.04
• Python Version Used: 2.7.12
• spaCy Version Used: 2.0.3
• Environment Information:

[honnibal]

Does the VM have very low memory? I guess it's possible the compiler ran out?

If so you could install via wheel using conda. We'll have wheels up on pip eventually --- it's just another devops task we haven't gotten around to yet.

[Bri-Will]

It's got 1GB of memory, so not a lot.

When you say "install via wheel using conda", I'm not sure I'm following you.

I've used Anaconda elsewhere, so I believe that conda is a 'pip-like" manager for Anaconda installations. But that's the extent of my knowledge.

How would I use conda "standalone"? Thanks...

[Bri-Will]

FYI, I resized my VM to a beefier machine with 8GB of RAM and it installed successfully. Thanks...

[honnibal]

2gb should be fine. Thanks for letting me know!

[lock[bot]]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.