Pulled the lastest. I've never tried making the venv before so this may be something dumb.
macbuddha:chapel buddha$ chpl --version
chpl Version 1.16.0 pre-release (1a24868554)
Copyright (c) 2004-2017, Cray Inc. (See LICENSE file for more details)
macbuddha:chapel buddha$ python --version
Python 2.7.10
macbuddha:chapel buddha$ make test-venv
cd chpl-venv && /Applications/Xcode.app/Contents/Developer/usr/bin/make test-venv
export PYTHONPATH=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7:$PYTHONPATH && \
/usr/local/bin/easy_install --install-dir=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7 virtualenv==12.0.5
Creating /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/site.py
Searching for virtualenv==12.0.5
Best match: virtualenv 12.0.5
Processing virtualenv-12.0.5-py2.7.egg
virtualenv 12.0.5 is already the active version in easy-install.pth
Installing virtualenv script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installing virtualenv-2.7 script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Using /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Processing dependencies for virtualenv==12.0.5
Finished processing dependencies for virtualenv==12.0.5
install/darwin/py2.7/virtualenv --python=/usr/bin/python /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv
Running virtualenv with interpreter /usr/bin/python
Overwriting /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/orig-prefix.txt with new content
New python executable in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/python
Installing setuptools, pip...
Complete output from command /Users/buddha/github...irtualenv/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/__init__.py", line 13, in <module>
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/utils/__init__.py", line 14, in <module>
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/zipfile.py", line 6, in <module>
import io
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/io.py", line 51, in <module>
import _io
ImportError: dlopen(/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so, 2): Symbol not found: __PyCodecInfo_GetIncrementalDecoder
Referenced from: /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so
Expected in: flat namespace
in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so
----------------------------------------
...Installing setuptools, pip...done.
Traceback (most recent call last):
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 2352, in <module>
main()
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 825, in main
symlink=options.symlink)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 993, in create_environment
install_wheel(to_install, py_executable, search_dirs)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 961, in install_wheel
'PIP_NO_INDEX': '1'
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 903, in call_subprocess
% (cmd_desc, proc.returncode))
OSError: Command /Users/buddha/github...irtualenv/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip failed with error code 1
make[2]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv] Error 1
make[1]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/chpl-test-reqs] Error 2
make: [third-party-test-venv] Error 2 (ignored)
macbuddha:chapel buddha$
Do you use Homebrew? If so, you might try make test-venv again, after brew install python (brings python 2.7.13 plus setuptools)
This looks similar to the error you had making chpldoc. The virtualenv requirements should be very similar, so I would recommend trying the step you took earlier.
Did you figure out what was with the execution error you encountered later?
@awallace-cray Do you mean homebrew to install Python? No, I'm using the system Python usually then a version from Conda. Is there a reason to use brew's?
@lydia-duncan I went back to the system python to build chpldoc, but that didn't work with test-venv.
I've always been a Homebrew fan, so its the first thing I reach for. As for python itself: I do not know of anything wrong w Mac's system python 2.7.10. However, the setup_tools (easy_install) that comes with that python is an old version, and IMO is the most likely culprit.
Good enough for me! :) I'll give it shot now and report back.
I am trying the Chapel build on my Mac with system python, no Homebrew.
Just got this using system Python, will do with Conda and Brew as well. I've included the easy_install version this time. Thanks!!
macbuddha:chapel buddha$ chpl --version
chpl Version 1.16.0 pre-release (1a24868554)
Copyright (c) 2004-2017, Cray Inc. (See LICENSE file for more details)
macbuddha:chapel buddha$ easy_install --version
setuptools 34.3.3 from /usr/local/lib/python2.7/site-packages (Python 2.7)
macbuddha:chapel buddha$ python --version
Python 2.7.10
macbuddha:chapel buddha$ make test-venv
cd chpl-venv && /Applications/Xcode.app/Contents/Developer/usr/bin/make test-venv
export PYTHONPATH=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7:$PYTHONPATH && \
/usr/local/bin/easy_install --install-dir=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7 virtualenv==12.0.5
Searching for virtualenv==12.0.5
Best match: virtualenv 12.0.5
Processing virtualenv-12.0.5-py2.7.egg
virtualenv 12.0.5 is already the active version in easy-install.pth
Installing virtualenv script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installing virtualenv-2.7 script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Using /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Processing dependencies for virtualenv==12.0.5
Finished processing dependencies for virtualenv==12.0.5
install/darwin/py2.7/virtualenv --python=/usr/bin/python /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv
Running virtualenv with interpreter /usr/bin/python
New python executable in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/python
Installing setuptools, pip...
Complete output from command /Users/buddha/github...irtualenv/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/__init__.py", line 13, in <module>
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/utils/__init__.py", line 14, in <module>
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/zipfile.py", line 6, in <module>
import io
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/io.py", line 51, in <module>
import _io
ImportError: dlopen(/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so, 2): Symbol not found: __PyCodecInfo_GetIncrementalDecoder
Referenced from: /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so
Expected in: flat namespace
in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so
----------------------------------------
...Installing setuptools, pip...done.
Traceback (most recent call last):
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 2352, in <module>
main()
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 825, in main
symlink=options.symlink)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 993, in create_environment
install_wheel(to_install, py_executable, search_dirs)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 961, in install_wheel
'PIP_NO_INDEX': '1'
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 903, in call_subprocess
% (cmd_desc, proc.returncode))
OSError: Command /Users/buddha/github...irtualenv/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip failed with error code 1
make[2]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv] Error 1
make[1]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/chpl-test-reqs] Error 2
make: [third-party-test-venv] Error 2 (ignored)
macbuddha:chapel buddha$
With Conda Python
macbuddha:chapel buddha$ chpl --version
chpl Version 1.16.0 pre-release (1a24868554)
Copyright (c) 2004-2017, Cray Inc. (See LICENSE file for more details)
macbuddha:chapel buddha$ python --version
Python 2.7.13 :: Continuum Analytics, Inc.
macbuddha:chapel buddha$ easy_install --version
setuptools 27.2.0 from /Users/buddha/miniconda2/lib/python2.7/site-packages/setuptools-27.2.0-py2.7.egg (Python 2.7)
macbuddha:chapel buddha$ make test-venv
cd chpl-venv && /Applications/Xcode.app/Contents/Developer/usr/bin/make test-venv
export PYTHONPATH=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7:$PYTHONPATH && \
/Users/buddha/miniconda2/bin/easy_install --install-dir=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7 virtualenv==12.0.5
Creating /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/site.py
Searching for virtualenv==12.0.5
Best match: virtualenv 12.0.5
Processing virtualenv-12.0.5-py2.7.egg
virtualenv 12.0.5 is already the active version in easy-install.pth
Installing virtualenv script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installing virtualenv-2.7 script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Using /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Processing dependencies for virtualenv==12.0.5
Finished processing dependencies for virtualenv==12.0.5
install/darwin/py2.7/virtualenv --python=/Users/buddha/miniconda2/bin/python /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv
Already using interpreter /Users/buddha/miniconda2/bin/python
Overwriting /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/orig-prefix.txt with new content
New python executable in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/python
Installing setuptools, pip...
Complete output from command /Users/buddha/github...irtualenv/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/__init__.py", line 13, in <module>
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/utils/__init__.py", line 14, in <module>
File "/Users/buddha/miniconda2/lib/python2.7/zipfile.py", line 6, in <module>
import io
File "/Users/buddha/miniconda2/lib/python2.7/io.py", line 51, in <module>
import _io
ImportError: dlopen(/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so, 2): Symbol not found: __PyCodecInfo_GetIncrementalDecoder
Referenced from: /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so
Expected in: flat namespace
in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so
----------------------------------------
...Installing setuptools, pip...done.
Traceback (most recent call last):
File "install/darwin/py2.7/virtualenv", line 11, in <module>
load_entry_point('virtualenv==12.0.5', 'console_scripts', 'virtualenv')()
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 825, in main
symlink=options.symlink)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 993, in create_environment
install_wheel(to_install, py_executable, search_dirs)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 961, in install_wheel
'PIP_NO_INDEX': '1'
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 903, in call_subprocess
% (cmd_desc, proc.returncode))
OSError: Command /Users/buddha/github...irtualenv/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip failed with error code 1
make[2]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv] Error 1
make[1]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/chpl-test-reqs] Error 2
make: [third-party-test-venv] Error 2 (ignored)
macbuddha:chapel buddha$
On my Mac (El Capitan), without Homebrew, make test-venv and make chpldoc built ok.
# 2017/09/06-08:33:31 awallace@sea-vpn-192-168-231-66:~/src/github/chapel
python --version
Python 2.7.10
# 2017/09/06-08:33:46 awallace@sea-vpn-192-168-231-66:~/src/github/chapel
easy_install --version
setuptools 1.1.6
# 2017/09/06-08:33:51 awallace@sea-vpn-192-168-231-66:~/src/github/chapel
type easy_install
easy_install is hashed (/usr/bin/easy_install)
# 2017/09/06-08:33:57 awallace@sea-vpn-192-168-231-66:~/src/github/chapel
make chpldocs
make: *** No rule to make target `chpldocs'. Stop.
# 2017/09/06-08:34:25 awallace@sea-vpn-192-168-231-66:~/src/github/chapel
make chpldoc
cd compiler && /Applications/Xcode.app/Contents/Developer/usr/bin/make
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C /Users/awallace/src/github/chapel/third-party/llvm none
make[2]: Nothing to be done for `none'.
***** adt/ *****
***** AST/ *****
***** backend/ *****
***** codegen/ *****
***** ifa/ *****
***** ipe/ *****
***** main/ *****
***** optimizations/ *****
***** parser/ *****
***** passes/ *****
***** resolution/ *****
***** util/ *****
***** ./ *****
cd chpl-venv && /Applications/Xcode.app/Contents/Developer/usr/bin/make chpldoc-venv
mkdir -p /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7
export PYTHONPATH=/Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7:$PYTHONPATH && \
/usr/bin/easy_install --install-dir=/Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7 virtualenv==12.0.5
Creating /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/site.py
Searching for virtualenv==12.0.5
Reading https://pypi.python.org/simple/virtualenv/
Best match: virtualenv 12.0.5
Downloading https://pypi.python.org/packages/38/a5/781ba11e55ccdede3d43e8493087c5c768e5a1724f30f255d8c066529720/virtualenv-12.0.5.tar.gz#md5=637abbbd04d270ee8c601ab29c4f7561
Processing virtualenv-12.0.5.tar.gz
Writing /var/folders/79/4rdpdr8d6qd2w5srghnw12vh000qq7/T/easy_install-T_ugeR/virtualenv-12.0.5/setup.cfg
Running virtualenv-12.0.5/setup.py -q bdist_egg --dist-dir /var/folders/79/4rdpdr8d6qd2w5srghnw12vh000qq7/T/easy_install-T_ugeR/virtualenv-12.0.5/egg-dist-tmp-4fgnKX
warning: no previously-included files matching '*' found under directory 'docs/_templates'
warning: no previously-included files matching '*' found under directory 'docs/_build'
Adding virtualenv 12.0.5 to easy-install.pth file
Installing virtualenv script to /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installing virtualenv-2.7 script to /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installed /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Processing dependencies for virtualenv==12.0.5
Finished processing dependencies for virtualenv==12.0.5
install/darwin/py2.7/virtualenv --python=/usr/bin/python /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv
Already using interpreter /usr/bin/python
New python executable in /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/python
Installing setuptools, pip...done.
export PATH=/Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin:$PATH && \
export VIRTUAL_ENV=/Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv && \
python /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip install \
-U --force-reinstall -r chpldoc-requirements.txt && \
install/darwin/py2.7/virtualenv --relocatable /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv
You are using pip version 6.0.6, however version 9.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Collecting Jinja2==2.8 (from -r chpldoc-requirements.txt (line 1))
Using cached Jinja2-2.8-py2.py3-none-any.whl
Collecting MarkupSafe==0.23 (from -r chpldoc-requirements.txt (line 2))
Downloading MarkupSafe-0.23.tar.gz
Collecting Pygments<3,>=2 (from -r chpldoc-requirements.txt (line 3))
Downloading Pygments-2.2.0-py2.py3-none-any.whl (841kB)
100% |################################| 843kB 6.4MB/s
Collecting Sphinx==1.3.3 (from -r chpldoc-requirements.txt (line 4))
Using cached Sphinx-1.3.3-py2.py3-none-any.whl
Collecting docutils==0.12 (from -r chpldoc-requirements.txt (line 5))
Using cached docutils-0.12.tar.gz
Collecting argparse==1.3.0 (from -r chpldoc-requirements.txt (line 6))
Using cached argparse-1.3.0-py2.py3-none-any.whl
Collecting sphinx-rtd-theme==0.1.9 (from -r chpldoc-requirements.txt (line 7))
Downloading sphinx_rtd_theme-0.1.9-py2-none-any.whl (693kB)
100% |################################| 696kB 4.9MB/s
Collecting sphinxcontrib-chapeldomain>=0.0.10 (from -r chpldoc-requirements.txt (line 8))
Downloading sphinxcontrib-chapeldomain-0.0.14.tar.gz
Collecting babel!=2.0,>=1.3 (from Sphinx==1.3.3->-r chpldoc-requirements.txt (line 4))
Downloading Babel-2.5.0-py2.py3-none-any.whl (6.8MB)
100% |################################| 6.8MB 1.1MB/s
Collecting snowballstemmer>=1.1 (from Sphinx==1.3.3->-r chpldoc-requirements.txt (line 4))
Downloading snowballstemmer-1.2.1-py2.py3-none-any.whl (64kB)
100% |################################| 65kB 5.6MB/s
Collecting six>=1.4 (from Sphinx==1.3.3->-r chpldoc-requirements.txt (line 4))
Downloading six-1.10.0-py2.py3-none-any.whl
Collecting alabaster<0.8,>=0.7 (from Sphinx==1.3.3->-r chpldoc-requirements.txt (line 4))
Downloading alabaster-0.7.10-py2.py3-none-any.whl
Collecting pytz>=0a (from babel!=2.0,>=1.3->Sphinx==1.3.3->-r chpldoc-requirements.txt (line 4))
Downloading pytz-2017.2-py2.py3-none-any.whl (484kB)
100% |################################| 487kB 6.1MB/s
Installing collected packages: pytz, alabaster, six, snowballstemmer, babel, sphinxcontrib-chapeldomain, sphinx-rtd-theme, argparse, docutils, Sphinx, Pygments, MarkupSafe, Jinja2
Running setup.py install for sphinxcontrib-chapeldomain
Skipping installation of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/site-packages/sphinxcontrib/__init__.py (namespace package)
Installing /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/site-packages/sphinxcontrib_chapeldomain-0.0.14-py2.7-nspkg.pth
Running setup.py install for docutils
changing mode of build/scripts-2.7/rst2html.py from 644 to 755
changing mode of build/scripts-2.7/rst2s5.py from 644 to 755
changing mode of build/scripts-2.7/rst2latex.py from 644 to 755
changing mode of build/scripts-2.7/rst2xetex.py from 644 to 755
changing mode of build/scripts-2.7/rst2man.py from 644 to 755
changing mode of build/scripts-2.7/rst2xml.py from 644 to 755
changing mode of build/scripts-2.7/rst2pseudoxml.py from 644 to 755
changing mode of build/scripts-2.7/rstpep2html.py from 644 to 755
changing mode of build/scripts-2.7/rst2odt.py from 644 to 755
changing mode of build/scripts-2.7/rst2odt_prepstyles.py from 644 to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2html.py to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2latex.py to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2man.py to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2odt.py to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2odt_prepstyles.py to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2pseudoxml.py to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2s5.py to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2xetex.py to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2xml.py to 755
changing mode of /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rstpep2html.py to 755
Running setup.py install for MarkupSafe
building 'markupsafe._speedups' extension
cc -fno-strict-aliasing -fno-common -dynamic -arch i386 -arch x86_64 -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch i386 -arch x86_64 -pipe -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c markupsafe/_speedups.c -o build/temp.macosx-10.11-intel-2.7/markupsafe/_speedups.o
cc -bundle -undefined dynamic_lookup -arch i386 -arch x86_64 -Wl,-F. build/temp.macosx-10.11-intel-2.7/markupsafe/_speedups.o -o build/lib.macosx-10.11-intel-2.7/markupsafe/_speedups.so
Successfully installed Jinja2-2.8 MarkupSafe-0.23 Pygments-2.2.0 Sphinx-1.3.3 alabaster-0.7.10 argparse-1.3.0 babel-2.5.0 docutils-0.12 pytz-2017.2 six-1.10.0 snowballstemmer-1.2.1 sphinx-rtd-theme-0.1.9 sphinxcontrib-chapeldomain-0.0.14
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/easy_install relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/easy_install-2.7 relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip2 relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip2.7 relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pybabel relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pygmentize relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2html.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2latex.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2man.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2odt.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2odt_prepstyles.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2pseudoxml.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2s5.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2xetex.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2xml.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rstpep2html.py relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/sphinx-apidoc relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/sphinx-autogen relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/sphinx-build relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/sphinx-quickstart relative
cd compiler && /Applications/Xcode.app/Contents/Developer/usr/bin/make chpldoc
rm -f /Users/awallace/src/github/chapel/bin/darwin/chpldoc
ln -s chpl /Users/awallace/src/github/chapel/bin/darwin/chpldoc
cd man && /Applications/Xcode.app/Contents/Developer/usr/bin/make chpldoc
mkdir -p man1
sed "/confchpldoc.rst/r confchpldoc.rst" chpldoc.rst > chpldoc.rst.tmp
/Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/rst2man.py chpldoc.rst.tmp > man1/chpldoc.1
rm -f chpldoc.rst.tmp
# 2017/09/06-08:34:44 awallace@sea-vpn-192-168-231-66:~/src/github/chapel
make test-venv
cd chpl-venv && /Applications/Xcode.app/Contents/Developer/usr/bin/make test-venv
export PYTHONPATH=/Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7:$PYTHONPATH && \
/usr/bin/easy_install --install-dir=/Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7 virtualenv==12.0.5
Searching for virtualenv==12.0.5
Best match: virtualenv 12.0.5
Processing virtualenv-12.0.5-py2.7.egg
virtualenv 12.0.5 is already the active version in easy-install.pth
Installing virtualenv script to /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installing virtualenv-2.7 script to /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Using /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Processing dependencies for virtualenv==12.0.5
Finished processing dependencies for virtualenv==12.0.5
install/darwin/py2.7/virtualenv --python=/usr/bin/python /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv
Already using interpreter /usr/bin/python
New python executable in /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/python
Installing setuptools, pip...done.
export PATH=/Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin:$PATH && \
export VIRTUAL_ENV=/Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv && \
python /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip install \
-U --force-reinstall -r test-requirements.txt && \
install/darwin/py2.7/virtualenv --relocatable /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv && \
touch /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/chpl-test-reqs
You are using pip version 6.0.6, however version 9.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Collecting subprocess32==3.2.6 (from -r test-requirements.txt (line 1))
Using cached subprocess32-3.2.6.tar.gz
Collecting argparse==1.3.0 (from -r test-requirements.txt (line 2))
Using cached argparse-1.3.0-py2.py3-none-any.whl
Collecting PyYAML==3.11 (from -r test-requirements.txt (line 3))
Using cached PyYAML-3.11.zip
Installing collected packages: PyYAML, argparse, subprocess32
Running setup.py install for PyYAML
checking if libyaml is compilable
cc -fno-strict-aliasing -fno-common -dynamic -arch i386 -arch x86_64 -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch i386 -arch x86_64 -pipe -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c build/temp.macosx-10.11-intel-2.7/check_libyaml.c -o build/temp.macosx-10.11-intel-2.7/check_libyaml.o
build/temp.macosx-10.11-intel-2.7/check_libyaml.c:2:10: fatal error: 'yaml.h' file not found
#include <yaml.h>
^
1 error generated.
libyaml is not found or a compiler error: forcing --without-libyaml
(if libyaml is installed correctly, you may need to
specify the option --include-dirs or uncomment and
modify the parameter include_dirs in setup.cfg)
Found existing installation: argparse 1.3.0
Uninstalling argparse-1.3.0:
Successfully uninstalled argparse-1.3.0
Running setup.py install for subprocess32
building '_posixsubprocess' extension
cc -fno-strict-aliasing -fno-common -dynamic -arch i386 -arch x86_64 -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch i386 -arch x86_64 -pipe -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c _posixsubprocess.c -o build/temp.macosx-10.11-intel-2.7/_posixsubprocess.o
_posixsubprocess.c:177:23: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
int keep_fd = PyLong_AsLong(py_keep_fd);
~~~~~~~ ^~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:465:28: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
int local_max_fd = max_fd;
~~~~~~~~~~~~ ^~~~~~
_posixsubprocess.c:500:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, "OSError:", 8);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:506:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, cur, hex_errno + sizeof(hex_errno) - cur);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:507:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, ":", 1);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:510:22: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, "noexec", 6);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:515:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, "RuntimeError:0:", 15);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:516:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, err_msg, strlen(err_msg));
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:768:37: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
if (oldflags < 0) res = oldflags;
~ ^~~~~~~~
_posixsubprocess.c:775:37: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
if (oldflags < 0) res = oldflags;
~ ^~~~~~~~
_posixsubprocess.c:806:41: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
if (oldflags < 0) res = oldflags;
~ ^~~~~~~~
11 warnings generated.
cc -bundle -undefined dynamic_lookup -arch i386 -arch x86_64 -Wl,-F. build/temp.macosx-10.11-intel-2.7/_posixsubprocess.o -o build/lib.macosx-10.11-intel-2.7/_posixsubprocess.so
Successfully installed PyYAML-3.11 argparse-1.3.0 subprocess32-3.2.6
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/easy_install relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/easy_install-2.7 relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip2 relative
Making script /Users/awallace/src/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip2.7 relative
Appears to work, a few steps, had to downgrade the Conda version of Python as in the SO Lydia Posted which I didn't have to do for chpldocs
Is there a way we can get it to work with Python > 2.7.10 ?
macbuddha:chapel buddha$ chpl --version
chpl Version 1.16.0 pre-release (1a24868554)
Copyright (c) 2004-2017, Cray Inc. (See LICENSE file for more details)
macbuddha:chapel buddha$ easy_install --version
setuptools 34.3.3 from /usr/local/lib/python2.7/site-packages (Python 2.7)
macbuddha:chapel buddha$ python --version
Python 2.7.10 :: Continuum Analytics, Inc.
macbuddha:chapel buddha$ make test-venv
cd chpl-venv && /Applications/Xcode.app/Contents/Developer/usr/bin/make test-venv
export PYTHONPATH=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7:$PYTHONPATH && \
/Users/buddha/miniconda2/bin/easy_install --install-dir=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7 virtualenv==12.0.5
Creating /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/site.py
Searching for virtualenv==12.0.5
Best match: virtualenv 12.0.5
Processing virtualenv-12.0.5-py2.7.egg
virtualenv 12.0.5 is already the active version in easy-install.pth
Installing virtualenv script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installing virtualenv-2.7 script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Using /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Processing dependencies for virtualenv==12.0.5
Finished processing dependencies for virtualenv==12.0.5
install/darwin/py2.7/virtualenv --python=/Users/buddha/miniconda2/bin/python /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv
Already using interpreter /Users/buddha/miniconda2/bin/python
New python executable in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/python
Installing setuptools, pip...done.
export PATH=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin:$PATH && \
export VIRTUAL_ENV=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv && \
python /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip install \
-U --force-reinstall -r test-requirements.txt && \
install/darwin/py2.7/virtualenv --relocatable /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv && \
touch /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/chpl-test-reqs
You are using pip version 6.0.6, however version 9.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Collecting subprocess32==3.2.6 (from -r test-requirements.txt (line 1))
Downloading subprocess32-3.2.6.tar.gz (51kB)
100% |################################| 53kB 1.0MB/s
Collecting argparse==1.3.0 (from -r test-requirements.txt (line 2))
Using cached argparse-1.3.0-py2.py3-none-any.whl
Collecting PyYAML==3.11 (from -r test-requirements.txt (line 3))
Downloading PyYAML-3.11.zip (371kB)
100% |################################| 372kB 1.4MB/s
Installing collected packages: PyYAML, argparse, subprocess32
Running setup.py install for PyYAML
checking if libyaml is compilable
...
I should have put that in a gist. Sorry.
Suggestions:
Assuming we are going without Homebrew:
I don't remember ever seeing that import io/ __PyCodecInfo_GetIncrementalDecoder not found problem on my Mac. (do not have anaconda).
I live in the murky margins...
Are you saying I can't already have virtualenv and pip installed on my system? That seems odd.
@buddha314 -- to summarize, you are having issues building that Chapel virtualenvs with python 2.7.13 and miniconda 2.7.13 - is that correct?
I think Lydia and Mr. Dobbs have helped me boil it down to that, yes.
My earlier comment was meant as, here are things to improve your odds of success if you are trying to make test-venv on your Mac with the system Python 2.7.
If there are no existing versions of virtualenv and pip, etc, then make test-venv will install them on the fly in a virtual environment, which helps make sure you and I are working with the same versions.
I see, thanks.
FWIW, the Chapel virtualenvs work fine for me on python 2.7.13, so I suspect something else impacting the build issues there.
For miniconda, it's not too surprising, given the history of issues between conda and virtualenvs. Maybe there is something we can do to better support miniconda users in the future.
@buddha314 - just checking in... has this been resolved for you? Were you able to build the test-venv with CPython 2.7.13 (not miniconda)? If so, do you know what was causing the issues?
New pull from Github, using standard Python first:
macbuddha:chapel buddha$ chpl --version
chpl Version 1.16.0 pre-release (b4a7c775a9)
Copyright (c) 2004-2017, Cray Inc. (See LICENSE file for more details)
macbuddha:chapel buddha$ python --version
Python 2.7.13 :: Continuum Analytics, Inc.
macbuddha:chapel buddha$ make test-venv
cd chpl-venv && /Applications/Xcode.app/Contents/Developer/usr/bin/make test-venv
mkdir -p /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
export PYTHONPATH=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7:$PYTHONPATH && \
/Users/buddha/miniconda2/bin/easy_install --install-dir=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7 virtualenv==12.0.5
Creating /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/site.py
Searching for virtualenv==12.0.5
Reading https://pypi.python.org/simple/virtualenv/
Downloading https://pypi.python.org/packages/38/a5/781ba11e55ccdede3d43e8493087c5c768e5a1724f30f255d8c066529720/virtualenv-12.0.5.tar.gz#md5=637abbbd04d270ee8c601ab29c4f7561
Best match: virtualenv 12.0.5
Processing virtualenv-12.0.5.tar.gz
Writing /var/folders/g5/4zwyfk513hd94tjs1fm5mdq00000gn/T/easy_install-zZD2Sx/virtualenv-12.0.5/setup.cfg
Running virtualenv-12.0.5/setup.py -q bdist_egg --dist-dir /var/folders/g5/4zwyfk513hd94tjs1fm5mdq00000gn/T/easy_install-zZD2Sx/virtualenv-12.0.5/egg-dist-tmp-B8Drs0
warning: no previously-included files matching '*' found under directory 'docs/_templates'
warning: no previously-included files matching '*' found under directory 'docs/_build'
creating /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Extracting virtualenv-12.0.5-py2.7.egg to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Adding virtualenv 12.0.5 to easy-install.pth file
Installing virtualenv script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installing virtualenv-2.7 script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installed /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Processing dependencies for virtualenv==12.0.5
Finished processing dependencies for virtualenv==12.0.5
install/darwin/py2.7/virtualenv --python=/Users/buddha/miniconda2/bin/python /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv
Already using interpreter /Users/buddha/miniconda2/bin/python
New python executable in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/python
Installing setuptools, pip...
Complete output from command /Users/buddha/github...irtualenv/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/__init__.py", line 13, in <module>
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/utils/__init__.py", line 14, in <module>
File "/Users/buddha/miniconda2/lib/python2.7/zipfile.py", line 6, in <module>
import io
File "/Users/buddha/miniconda2/lib/python2.7/io.py", line 51, in <module>
import _io
ImportError: dlopen(/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so, 2): Symbol not found: __PyCodecInfo_GetIncrementalDecoder
Referenced from: /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so
Expected in: flat namespace
in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/lib/python2.7/lib-dynload/_io.so
----------------------------------------
...Installing setuptools, pip...done.
Traceback (most recent call last):
File "install/darwin/py2.7/virtualenv", line 11, in <module>
load_entry_point('virtualenv==12.0.5', 'console_scripts', 'virtualenv')()
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 825, in main
symlink=options.symlink)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 993, in create_environment
install_wheel(to_install, py_executable, search_dirs)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 961, in install_wheel
'PIP_NO_INDEX': '1'
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg/virtualenv.py", line 903, in call_subprocess
% (cmd_desc, proc.returncode))
OSError: Command /Users/buddha/github...irtualenv/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip failed with error code 1
make[2]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv] Error 1
make[1]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/chpl-test-reqs] Error 2
make: [third-party-test-venv] Error 2 (ignored)
macbuddha:chapel buddha$ python --version
Python 2.7.13 :: Continuum Analytics, Inc.
Continuum Analytics, Inc. means that this is some distribution of anaconda (miniconda, in your case) which is not tested and consequently not officially supported by Chapel (yet).
I was more curious about the CPython case, which should look like this:
macbuddha:chapel buddha$ python --version
Python 2.7.13
This is tested and should work.
Yes, sir, running that now and will update shortly (after I rebuild everything).
Now with CPython 2.7.10
macbuddha:chapel buddha$ chpl --version
chpl Version 1.16.0 pre-release (b4a7c775a9)
Copyright (c) 2004-2017, Cray Inc. (See LICENSE file for more details)
macbuddha:chapel buddha$ python --version
Python 2.7.10
macbuddha:chapel buddha$ make test-venv
cd chpl-venv && /Applications/Xcode.app/Contents/Developer/usr/bin/make test-venv
mkdir -p /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
export PYTHONPATH=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7:$PYTHONPATH && \
/usr/local/bin/easy_install --install-dir=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7 virtualenv==12.0.5
Creating /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/site.py
Searching for virtualenv==12.0.5
Reading https://pypi.python.org/simple/virtualenv/
Downloading https://pypi.python.org/packages/38/a5/781ba11e55ccdede3d43e8493087c5c768e5a1724f30f255d8c066529720/virtualenv-12.0.5.tar.gz#md5=637abbbd04d270ee8c601ab29c4f7561
Best match: virtualenv 12.0.5
Processing virtualenv-12.0.5.tar.gz
Writing /var/folders/g5/4zwyfk513hd94tjs1fm5mdq00000gn/T/easy_install-SEwii1/virtualenv-12.0.5/setup.cfg
Running virtualenv-12.0.5/setup.py -q bdist_egg --dist-dir /var/folders/g5/4zwyfk513hd94tjs1fm5mdq00000gn/T/easy_install-SEwii1/virtualenv-12.0.5/egg-dist-tmp-jEkt3b
warning: no previously-included files matching '*' found under directory 'docs/_templates'
warning: no previously-included files matching '*' found under directory 'docs/_build'
creating /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Extracting virtualenv-12.0.5-py2.7.egg to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Adding virtualenv 12.0.5 to easy-install.pth file
Installing virtualenv script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installing virtualenv-2.7 script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7
Installed /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/virtualenv-12.0.5-py2.7.egg
Processing dependencies for virtualenv==12.0.5
Finished processing dependencies for virtualenv==12.0.5
install/darwin/py2.7/virtualenv --python=/usr/bin/python /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv
Running virtualenv with interpreter /usr/bin/python
New python executable in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/python
Installing setuptools, pip...done.
export PATH=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin:$PATH && \
export VIRTUAL_ENV=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv && \
python /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip install \
-U --force-reinstall -r test-requirements.txt && \
install/darwin/py2.7/virtualenv --relocatable /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv && \
touch /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/chpl-test-reqs
You are using pip version 6.0.6, however version 9.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Collecting subprocess32==3.2.6 (from -r test-requirements.txt (line 1))
Using cached subprocess32-3.2.6.tar.gz
Collecting argparse==1.3.0 (from -r test-requirements.txt (line 2))
Using cached argparse-1.3.0-py2.py3-none-any.whl
Collecting PyYAML==3.11 (from -r test-requirements.txt (line 3))
Using cached PyYAML-3.11.zip
Installing collected packages: PyYAML, argparse, subprocess32
Running setup.py install for PyYAML
checking if libyaml is compilable
cc -fno-strict-aliasing -fno-common -dynamic -arch x86_64 -arch i386 -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch x86_64 -arch i386 -pipe -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c build/temp.macosx-10.12-intel-2.7/check_libyaml.c -o build/temp.macosx-10.12-intel-2.7/check_libyaml.o
build/temp.macosx-10.12-intel-2.7/check_libyaml.c:2:10: fatal error: 'yaml.h' file not found
#include <yaml.h>
^
1 error generated.
libyaml is not found or a compiler error: forcing --without-libyaml
(if libyaml is installed correctly, you may need to
specify the option --include-dirs or uncomment and
modify the parameter include_dirs in setup.cfg)
Running setup.py install for subprocess32
building '_posixsubprocess' extension
cc -fno-strict-aliasing -fno-common -dynamic -arch x86_64 -arch i386 -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch x86_64 -arch i386 -pipe -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c _posixsubprocess.c -o build/temp.macosx-10.12-intel-2.7/_posixsubprocess.o
_posixsubprocess.c:177:23: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
int keep_fd = PyLong_AsLong(py_keep_fd);
~~~~~~~ ^~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:465:28: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
int local_max_fd = max_fd;
~~~~~~~~~~~~ ^~~~~~
_posixsubprocess.c:500:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, "OSError:", 8);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:506:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, cur, hex_errno + sizeof(hex_errno) - cur);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:507:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, ":", 1);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:510:22: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, "noexec", 6);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:515:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, "RuntimeError:0:", 15);
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:516:18: warning: implicit conversion loses integer precision: 'ssize_t' (aka 'long') to 'int' [-Wshorten-64-to-32]
unused = write(errpipe_write, err_msg, strlen(err_msg));
~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_posixsubprocess.c:768:37: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
if (oldflags < 0) res = oldflags;
~ ^~~~~~~~
_posixsubprocess.c:775:37: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
if (oldflags < 0) res = oldflags;
~ ^~~~~~~~
_posixsubprocess.c:806:41: warning: implicit conversion loses integer precision: 'long' to 'int' [-Wshorten-64-to-32]
if (oldflags < 0) res = oldflags;
~ ^~~~~~~~
11 warnings generated.
cc -bundle -undefined dynamic_lookup -arch x86_64 -arch i386 -Wl,-F. build/temp.macosx-10.12-intel-2.7/_posixsubprocess.o -o build/lib.macosx-10.12-intel-2.7/_posixsubprocess.so
Successfully installed PyYAML-3.11 argparse-1.3.0 subprocess32-3.2.6
Making script /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/easy_install relative
Making script /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/easy_install-2.7 relative
Making script /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip relative
Making script /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip2 relative
Making script /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py2.7/chpl-virtualenv/bin/pip2.7 relative
Does this help? Do I need to run it another way?
Reading this, it never says "Yep, all done" or, "Couldn't find something" or "Ouch, that hurt." Is this the output you were hoping for?
Reading this, it never says "Yep, all done" or, "Couldn't find something" or "Ouch, that hurt." Is this the output you were hoping for?
Yep, it looks like that succeeded. PyYAML likes to make a lot of noise when building...
And PyYAML is like a brooding teenager that won't tell you if they are happy? Can't it at least say "yeah, that's fine, Dad" ?
We'll never understand it...
If you agree that the issue is only with miniconda, I'd like to rename this issue and close it, opening a more general "support miniconda" issue that links this and any others that crop up down the road (until we support it).
I'll leave you to do the honors.
This issue will continue to be tracked in #7413
This problem has come up again after a make clean.
[Error: Chapel test virtualenv not available, run a top-level `make test-venv`]
macbuddha:chapel buddha$ python --version
Python 3.6.4
And
make test-venv
cd chpl-venv && /Applications/Xcode.app/Contents/Developer/usr/bin/make test-venv
export PYTHONPATH=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6:$PYTHONPATH && \
/usr/local/bin/easy_install --install-dir=/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6 virtualenv==12.0.5
Searching for virtualenv==12.0.5
Best match: virtualenv 12.0.5
Processing virtualenv-12.0.5-py3.6.egg
virtualenv 12.0.5 is already the active version in easy-install.pth
Installing virtualenv script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6
Installing virtualenv-3.4 script to /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6
Using /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/virtualenv-12.0.5-py3.6.egg
Processing dependencies for virtualenv==12.0.5
Finished processing dependencies for virtualenv==12.0.5
install/darwin/py3.6/virtualenv --python=/usr/local/bin/python /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/chpl-virtualenv
Running virtualenv with interpreter /usr/local/bin/python
Using base prefix '/usr/local/Cellar/python/3.6.4_3/Frameworks/Python.framework/Versions/3.6'
New python executable in /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/chpl-virtualenv/bin/python3.6
Not overwriting existing python script /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/chpl-virtualenv/bin/python (you must use /Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/chpl-virtualenv/bin/python3.6)
Installing setuptools, pip...
Complete output from command /Users/buddha/github...ualenv/bin/python3.6 -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 656, in _load_unlocked
File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/virtualenv-12.0.5-py3.6.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/__init__.py", line 13, in <module>
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 656, in _load_unlocked
File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/virtualenv-12.0.5-py3.6.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/utils/__init__.py", line 22, in <module>
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 656, in _load_unlocked
File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/virtualenv-12.0.5-py3.6.egg/virtualenv_support/pip-6.0.6-py2.py3-none-any.whl/pip/_vendor/pkg_resources/__init__.py", line 1649, in <module>
AttributeError: module 'importlib._bootstrap' has no attribute 'SourceFileLoader'
----------------------------------------
...Installing setuptools, pip...done.
Traceback (most recent call last):
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/virtualenv-12.0.5-py3.6.egg/virtualenv.py", line 2352, in <module>
main()
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/virtualenv-12.0.5-py3.6.egg/virtualenv.py", line 825, in main
symlink=options.symlink)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/virtualenv-12.0.5-py3.6.egg/virtualenv.py", line 993, in create_environment
install_wheel(to_install, py_executable, search_dirs)
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/virtualenv-12.0.5-py3.6.egg/virtualenv.py", line 961, in install_wheel
'PIP_NO_INDEX': '1'
File "/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/virtualenv-12.0.5-py3.6.egg/virtualenv.py", line 903, in call_subprocess
% (cmd_desc, proc.returncode))
OSError: Command /Users/buddha/github...ualenv/bin/python3.6 -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip failed with error code 1
make[2]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/chpl-virtualenv] Error 1
make[1]: *** [/Users/buddha/github/chapel/third-party/chpl-venv/install/darwin/py3.6/chpl-virtualenv/chpl-test-reqs] Error 2
make: [third-party-test-venv] Error 2 (ignored)
Most of the developer tools do not support python 3 (yet), including the test system AFAIK.
We definitely care about python 3 support, but it's less of a priority for developer tools.