Pipenv: tensorflow/html5lib "Your dependencies could not be resolved" but can't see problem

Created on 13 Mar 2018  ·  52Comments  ·  Source: pypa/pipenv 
$ pipenv install --dev
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

I did what it suggested: pipenv install --skip-lock and then pipenv graph

The graph shows that the only packages which ask for html5lib are dependencies of tensorflow, and they don't seem to conflict with each other or the installed version:

tensorflow==1.3.0
  - numpy [required: >=1.11.0, installed: 1.14.1]
  - protobuf [required: >=3.3.0, installed: 3.5.2]
    - setuptools [required: Any, installed: 38.5.1]
    - six [required: >=1.9, installed: 1.11.0]
  - six [required: >=1.10.0, installed: 1.11.0]
  - tensorflow-tensorboard [required: >=0.1.0,<0.2.0, installed: 0.1.8]
    - bleach [required: ==1.5.0, installed: 1.5.0]
      - html5lib [required: >=0.999,<0.99999999,!=0.9999,!=0.99999, installed: 0.9999999]
        - six [required: Any, installed: 1.11.0]
      - six [required: Any, installed: 1.11.0]
    - html5lib [required: ==0.9999999, installed: 0.9999999]
      - six [required: Any, installed: 1.11.0]
    - markdown [required: >=2.6.8, installed: 2.6.11]
    - numpy [required: >=1.11.0, installed: 1.14.1]
    - protobuf [required: >=3.2.0, installed: 3.5.2]
      - setuptools [required: Any, installed: 38.5.1]
      - six [required: >=1.9, installed: 1.11.0]
    - six [required: >=1.10.0, installed: 1.11.0]
    - werkzeug [required: >=0.11.10, installed: 0.14.1]
    - wheel [required: >=0.26, installed: 0.30.0]
  - wheel [required: >=0.26, installed: 0.30.0]

So we have:

html5lib [required: >=0.999,<0.99999999,!=0.9999,!=0.99999, installed: 0.9999999]

and

html5lib [required: ==0.9999999, installed: 0.9999999]

That package uses a pretty horrible versioning scheme, but the required versions don't seem to conflict.

One requires 0.9999999 (seven zeros, what we have installed) and the other requires <0.99999999 (eight zeros). Should be ok?

picture anentropic
👍3

Most helpful comment

omg is this real

picture kennethreitz42 on 13 Mar 2018
😄9 👍4

All 52 comments

omg is this real

kennethreitz42 picture kennethreitz42 on 13 Mar 2018
😄9 👍4

to top it off, these wacky versions have security vulnerabilities

$ pipenv check
Checking PEP 508 requirements…
Passed!
Checking installed package safety…
25846: html5lib <0.99999999 resolved (0.9999999 installed)!
html5lib before 0.99999999 is vulnerable to a XSS attack. Upgrading avoids the XSS bug potentially caused by serializer allowing attribute values to be escaped out of in old browser versions, changing the quote_attr_values option on serializer to take one of three values, "always" (the old True value), "legacy" (the new option,  and the new default), and "spec" (the old False value, and the old default).

35693: html5lib <0.99999999 resolved (0.9999999 installed)!
The serializer in html5lib before 0.99999999 might allow remote attackers to conduct cross-site scripting (XSS) attacks by leveraging mishandling of the < (less than) character in attribute values.

35694: html5lib <0.99999999 resolved (0.9999999 installed)!
The serializer in html5lib before 0.99999999 might allow remote attackers to conduct cross-site scripting (XSS) attacks by leveraging mishandling of special characters in attribute values, a different vulnerability than CVE-2016-9909.

34965: bleach <2.1 resolved (1.5.0 installed)!
bleach 2.1 converts control characters (backspace particularly) to "?" preventing malicious copy-and-paste situations.
anentropic picture anentropic on 13 Mar 2018

I think the problem part is:
Could not find a version that matches html5lib...==0.9999999,>=0.99999999pre

I don't see where the >=0.99999999pre specifier is coming from, it's not mentioned in the pipenv graph output

anentropic picture anentropic on 13 Mar 2018

it apparently comes from bleach package, but not the installed version:

bleach [required: ==1.5.0, installed: 1.5.0]

compare:
https://github.com/mozilla/bleach/blob/v1.5/setup.py

https://github.com/mozilla/bleach/blob/v2.1.3/setup.py

anentropic picture anentropic on 13 Mar 2018

I downloaded the 1.5.0 tarball from PyPI to confirm

the setup.py contains:

install_requires = [
    'six',
    # 3 9s up to but not including 8 9s, but not 4 9s or 5 9s because they're
    # busted
    'html5lib>=0.999,!=0.9999,!=0.99999,<0.99999999',
]

but the meta info on the PyPI page for the package shows the requirements from the latest version (naturally):

Requires Distributions
html5lib (!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre)
six

some problem here?

anentropic picture anentropic on 13 Mar 2018

reading further up the tensorboard issue thread linked above...

to confuse matters further, pip has its own vendored version of html5lib
https://github.com/pypa/pip/blob/9.0.1/pip/_vendor/html5lib/__init__.py
https://github.com/pypa/pip/blob/9.0.1/pip/_vendor/vendor.txt

html5lib==1.0b10

not sure if that's involved in some awful way

anentropic picture anentropic on 13 Mar 2018

are you using latest?

kennethreitz42 picture kennethreitz42 on 13 Mar 2018

I'm inside my project's pipenv shell

pipenv, version 11.6.1
pip 9.0.1
python 3.6
anentropic picture anentropic on 13 Mar 2018

metadata inside the bleach 1.5.0 _wheel_ from PyPI also looks correct

the conflict reported:

Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre

seems to exactly match the requirements in _latest_ (2.1.3) version of bleach instead

install_requires = [
    'six',
    # >= 8 9s because of breaking API change
    # the 'pre' suffix is needed for supporting '1.0b*' versions
    'html5lib>=0.99999999pre,!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8',
]

added to the requirement from tensorboard https://github.com/tensorflow/tensorboard/blob/0.1.8/tensorboard/pip_package/setup.py

REQUIRED_PACKAGES = [
    'numpy >= 1.11.0',
    'six >= 1.10.0',
    'protobuf >= 3.2.0',
    'werkzeug >= 0.11.10',
    'html5lib == 0.9999999',  # identical to 1.0b8
    'markdown >= 2.6.8',
    'bleach == 1.5.0',
]

So seems like something weird going on when determining requirements for bleach==1.5.0

anentropic picture anentropic on 13 Mar 2018

I am having the same problem. pipenv install complains that the dependencies need cryptography<1.0,>=1.7.2,>=1.8.1,>=1.8.2,>=1.9 (which can obviously never resolve), but I can't see any of my packages requiring cryptography<1.0 in pipenv graph. I don't know what to do, because it won't install at all.

skorokithakis picture skorokithakis on 13 Mar 2018

@skorokithakis please open a seperate issue

kennethreitz42 picture kennethreitz42 on 13 Mar 2018

@anentropic have you tried the latest version of pipenv?

kennethreitz42 picture kennethreitz42 on 13 Mar 2018

@anentropic also please don't run pipenv from _inside_ the pipenv shell, this isn't intended to work. Try again from _outside_ the pipenv shell and let us know if it is still broken

techalchemy picture techalchemy on 13 Mar 2018

@techalchemy uh, yes it is.

kennethreitz42 picture kennethreitz42 on 13 Mar 2018

that is literally the primary design principal behind this project

kennethreitz42 picture kennethreitz42 on 13 Mar 2018

Ok, I've upgraded pipenv 11.6.1 --> 11.6.9

same problem

$ pipenv --version
pipenv, version 11.6.9
$ pipenv lock
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1
anentropic picture anentropic on 14 Mar 2018

I can't tell what's going on with these version numbers.

I can tell you that this isn't likely to change any time soon, though.

kennethreitz42 picture kennethreitz42 on 14 Mar 2018

sure, I will keep looking into it if I can find anything

some more details:

  • I have no Pipfile.lock at the moment (it's unable to create one)
  • I tried deactivating my pipenv shell, deleting the associated virtualenv folder and running pipenv install (i.e. start over from scratch)... same problem
anentropic picture anentropic on 14 Mar 2018

I can also reproduce with a minimal example... in a new shell, create an empty directory, the following Pipfile and run pipenv install

[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]

tensorflow = "*"


[requires]

python_version = "3.6"
anentropic picture anentropic on 14 Mar 2018
👍1

pipenv lock --verbose should shed some light on this

kennethreitz42 picture kennethreitz42 on 14 Mar 2018

==0.9999999,>=0.99999999pre appears to be unresolvable to me.

kennethreitz42 picture kennethreitz42 on 14 Mar 2018

this versioning scheme is just absurd

kennethreitz42 picture kennethreitz42 on 14 Mar 2018
👍1

the point is that >=0.99999999pre requirement is attributed to bleach==1.5.0 but that project in that version does not specify that dependency

I don't know where pipenv or underlying tools get the dependency info from, is the PyPI server lying somehow?

Here is the verbose output:

Locking [dev-packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1
Current constraints:

Finding the best candidates:

Finding secondary dependencies:
------------------------------------------------------------
Result of round 1: stable, done

Locking [packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1
Current constraints:
  tensorflow

Finding the best candidates:
  found candidate tensorflow==1.6.0 (constraint was <any>)

Finding secondary dependencies:
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26

New dependencies found in this round:
  adding ['absl-py', '>=0.1.6', '[]']
  adding ['astor', '>=0.6.0', '[]']
  adding ['gast', '>=0.2.0', '[]']
  adding ['grpcio', '>=1.8.6', '[]']
  adding ['numpy', '>=1.13.3', '[]']
  adding ['protobuf', '>=3.4.0', '[]']
  adding ['six', '>=1.10.0', '[]']
  adding ['tensorboard', '<1.7.0,>=1.6.0', '[]']
  adding ['termcolor', '>=1.1.0', '[]']
  adding ['wheel', '>=0.26', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  gast>=0.2.0
  grpcio>=1.8.6
  numpy>=1.13.3
  protobuf>=3.4.0
  six>=1.10.0
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
  found candidate numpy==1.14.2 (constraint was >=1.13.3)
  found candidate protobuf==3.5.2 (constraint was >=3.4.0)
  found candidate six==1.11.0 (constraint was >=1.10.0)
  found candidate tensorboard==1.6.0 (constraint was >=1.6.0,<1.7.0)
  found candidate tensorflow==1.6.0 (constraint was <any>)
  found candidate termcolor==1.1.0 (constraint was >=1.1.0)
  found candidate wheel==0.30.0 (constraint was >=0.26)

Finding secondary dependencies:
  absl-py==0.1.11           requires six
  wheel==0.30.0             requires -
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26
  termcolor==1.1.0          requires -
  tensorboard==1.6.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  protobuf==3.5.2           requires setuptools, six>=1.9
  gast==0.2.0               requires -
  astor==0.6.2              requires -
  numpy==1.14.2             requires -
  grpcio==1.10.0            requires protobuf>=3.5.0.post1, six>=1.5.2
  six==1.11.0               requires -

New dependencies found in this round:
  adding ['bleach', '==1.5.0', '[]']
  adding ['html5lib', '==0.9999999', '[]']
  adding ['markdown', '>=2.6.8', '[]']
  adding ['numpy', '>=1.12.0,>=1.13.3', '[]']
  adding ['protobuf', '>=3.4.0,>=3.5.0.post1', '[]']
  adding ['six', '>=1.10.0,>=1.5.2,>=1.9', '[]']
  adding ['werkzeug', '>=0.11.10', '[]']
Removed dependencies in this round:
  removing ['numpy', '>=1.13.3', '[]']
  removing ['protobuf', '>=3.4.0', '[]']
  removing ['six', '>=1.10.0', '[]']
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 2: not stable

                          ROUND 3
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  bleach==1.5.0
  gast>=0.2.0
  grpcio>=1.8.6
  html5lib==0.9999999
  markdown>=2.6.8
  numpy>=1.12.0,>=1.13.3
  protobuf>=3.4.0,>=3.5.0.post1
  six>=1.10.0,>=1.5.2,>=1.9
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
  found candidate html5lib==0.9999999 (constraint was ==0.9999999)
  found candidate markdown==2.6.11 (constraint was >=2.6.8)
  found candidate numpy==1.14.2 (constraint was >=1.12.0,>=1.13.3)
  found candidate protobuf==3.5.2 (constraint was >=3.4.0,>=3.5.0.post1)
  found candidate six==1.11.0 (constraint was >=1.10.0,>=1.5.2,>=1.9)
  found candidate tensorboard==1.6.0 (constraint was >=1.6.0,<1.7.0)
  found candidate tensorflow==1.6.0 (constraint was <any>)
  found candidate termcolor==1.1.0 (constraint was >=1.1.0)
  found candidate werkzeug==0.14.1 (constraint was >=0.11.10)
  found candidate wheel==0.30.0 (constraint was >=0.26)

Finding secondary dependencies:
  numpy==1.14.2             requires -
  werkzeug==0.14.1          requires -
  absl-py==0.1.11           requires six
  html5lib==0.9999999       requires six>=1.9, webencodings
  gast==0.2.0               requires -
  bleach==1.5.0             requires html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre, six
  protobuf==3.5.2           requires setuptools, six>=1.9
  markdown==2.6.11          requires -
  six==1.11.0               requires -
  tensorboard==1.6.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26
  astor==0.6.2              requires -
  termcolor==1.1.0          requires -
  grpcio==1.10.0            requires protobuf>=3.5.0.post1, six>=1.5.2

New dependencies found in this round:
  adding ['html5lib', '!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre', '[]']
  adding ['webencodings', '', '[]']
Removed dependencies in this round:
  removing ['html5lib', '==0.9999999', '[]']
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 3: not stable

                          ROUND 4
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  bleach==1.5.0
  gast>=0.2.0
  grpcio>=1.8.6
  html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
  markdown>=2.6.8
  numpy>=1.12.0,>=1.13.3
  protobuf>=3.4.0,>=3.5.0.post1
  six>=1.10.0,>=1.5.2,>=1.9
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  webencodings
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
Using pip: -i https://pypi.python.org/simple

                          ROUND 1
Current constraints:
  tensorflow

Finding the best candidates:
  found candidate tensorflow==1.6.0 (constraint was <any>)

Finding secondary dependencies:
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26

New dependencies found in this round:
  adding ['absl-py', '>=0.1.6', '[]']
  adding ['astor', '>=0.6.0', '[]']
  adding ['gast', '>=0.2.0', '[]']
  adding ['grpcio', '>=1.8.6', '[]']
  adding ['numpy', '>=1.13.3', '[]']
  adding ['protobuf', '>=3.4.0', '[]']
  adding ['six', '>=1.10.0', '[]']
  adding ['tensorboard', '<1.7.0,>=1.6.0', '[]']
  adding ['termcolor', '>=1.1.0', '[]']
  adding ['wheel', '>=0.26', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  gast>=0.2.0
  grpcio>=1.8.6
  numpy>=1.13.3
  protobuf>=3.4.0
  six>=1.10.0
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
  found candidate numpy==1.14.2 (constraint was >=1.13.3)
  found candidate protobuf==3.5.2 (constraint was >=3.4.0)
  found candidate six==1.11.0 (constraint was >=1.10.0)
  found candidate tensorboard==1.6.0 (constraint was >=1.6.0,<1.7.0)
  found candidate tensorflow==1.6.0 (constraint was <any>)
  found candidate termcolor==1.1.0 (constraint was >=1.1.0)
  found candidate wheel==0.30.0 (constraint was >=0.26)

Finding secondary dependencies:
  astor==0.6.2              requires -
  six==1.11.0               requires -
  tensorboard==1.6.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  numpy==1.14.2             requires -
  grpcio==1.10.0            requires protobuf>=3.5.0.post1, six>=1.5.2
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26
  wheel==0.30.0             requires -
  protobuf==3.5.2           requires setuptools, six>=1.9
  termcolor==1.1.0          requires -
  absl-py==0.1.11           requires six
  gast==0.2.0               requires -

New dependencies found in this round:
  adding ['bleach', '==1.5.0', '[]']
  adding ['html5lib', '==0.9999999', '[]']
  adding ['markdown', '>=2.6.8', '[]']
  adding ['numpy', '>=1.12.0,>=1.13.3', '[]']
  adding ['protobuf', '>=3.4.0,>=3.5.0.post1', '[]']
  adding ['six', '>=1.10.0,>=1.5.2,>=1.9', '[]']
  adding ['werkzeug', '>=0.11.10', '[]']
Removed dependencies in this round:
  removing ['numpy', '>=1.13.3', '[]']
  removing ['protobuf', '>=3.4.0', '[]']
  removing ['six', '>=1.10.0', '[]']
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 2: not stable

                          ROUND 3
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  bleach==1.5.0
  gast>=0.2.0
  grpcio>=1.8.6
  html5lib==0.9999999
  markdown>=2.6.8
  numpy>=1.12.0,>=1.13.3
  protobuf>=3.4.0,>=3.5.0.post1
  six>=1.10.0,>=1.5.2,>=1.9
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)
  found candidate html5lib==0.9999999 (constraint was ==0.9999999)
  found candidate markdown==2.6.11 (constraint was >=2.6.8)
  found candidate numpy==1.14.2 (constraint was >=1.12.0,>=1.13.3)
  found candidate protobuf==3.5.2 (constraint was >=3.4.0,>=3.5.0.post1)
  found candidate six==1.11.0 (constraint was >=1.10.0,>=1.5.2,>=1.9)
  found candidate tensorboard==1.6.0 (constraint was >=1.6.0,<1.7.0)
  found candidate tensorflow==1.6.0 (constraint was <any>)
  found candidate termcolor==1.1.0 (constraint was >=1.1.0)
  found candidate werkzeug==0.14.1 (constraint was >=0.11.10)
  found candidate wheel==0.30.0 (constraint was >=0.26)

Finding secondary dependencies:
  protobuf==3.5.2           requires setuptools, six>=1.9
  html5lib==0.9999999       requires six>=1.9, webencodings
  gast==0.2.0               requires -
  bleach==1.5.0             requires html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre, six
  tensorflow==1.6.0         requires absl-py>=0.1.6, astor>=0.6.0, gast>=0.2.0, grpcio>=1.8.6, numpy>=1.13.3, protobuf>=3.4.0, six>=1.10.0, tensorboard<1.7.0,>=1.6.0, termcolor>=1.1.0, wheel>=0.26
  markdown==2.6.11          requires -
  termcolor==1.1.0          requires -
  astor==0.6.2              requires -
  numpy==1.14.2             requires -
  six==1.11.0               requires -
  absl-py==0.1.11           requires six
  tensorboard==1.6.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  grpcio==1.10.0            requires protobuf>=3.5.0.post1, six>=1.5.2
  wheel==0.30.0             requires -
  werkzeug==0.14.1          requires -

New dependencies found in this round:
  adding ['html5lib', '!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre', '[]']
  adding ['webencodings', '', '[]']
Removed dependencies in this round:
  removing ['html5lib', '==0.9999999', '[]']
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 3: not stable

                          ROUND 4
Current constraints:
  absl-py>=0.1.6
  astor>=0.6.0
  bleach==1.5.0
  gast>=0.2.0
  grpcio>=1.8.6
  html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
  markdown>=2.6.8
  numpy>=1.12.0,>=1.13.3
  protobuf>=3.4.0,>=3.5.0.post1
  six>=1.10.0,>=1.5.2,>=1.9
  tensorboard<1.7.0,>=1.6.0
  tensorflow
  termcolor>=1.1.0
  webencodings
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate absl-py==0.1.11 (constraint was >=0.1.6)
  found candidate astor==0.6.2 (constraint was >=0.6.0)
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
  found candidate gast==0.2.0 (constraint was >=0.2.0)
  found candidate grpcio==1.10.0 (constraint was >=1.8.6)

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1
Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1
anentropic picture anentropic on 14 Mar 2018

look, we're not going to be able to do anything about this.

kennethreitz42 picture kennethreitz42 on 14 Mar 2018

try 11.8.0

kennethreitz42 picture kennethreitz42 on 15 Mar 2018

Success!

kennethreitz42 picture kennethreitz42 on 15 Mar 2018

I think I found a similar error with django and django_pyodbc_azure. I need to install versions <2 so I run this command:

pipenv install django<2 django-pyodbc-azure<2

Here is what I get:

Installing django<2…
Collecting django<2
  Using cached Django-1.11.11-py2.py3-none-any.whl
Collecting pytz (from django<2)
  Using cached pytz-2018.3-py2.py3-none-any.whl
Installing collected packages: pytz, django
Successfully installed django-1.11.11 pytz-2018.3

Adding django<2 to Pipfile's [packages]…
Installing django-pyodbc-azure<2…
Collecting django-pyodbc-azure<2
  Using cached django_pyodbc_azure-1.11.11.0-py2.py3-none-any.whl
Collecting pyodbc>=3.0 (from django-pyodbc-azure<2)
  Using cached pyodbc-4.0.22-cp36-cp36m-win_amd64.whl
Requirement already satisfied: Django<2.0,>=1.11.11 in c:\users\msopko\.virtualenvs\kml_internal--4e53ydp\lib\site-packages (from django-pyodbc-azure<2)
Requirement already satisfied: pytz in c:\users\msopko\.virtualenvs\kml_internal--4e53ydp\lib\site-packages (from Django<2.0,>=1.11.11->django-pyodbc-azure<2)
Installing collected packages: pyodbc, django-pyodbc-azure
Successfully installed django-pyodbc-azure-1.11.11.0 pyodbc-4.0.22

Adding django-pyodbc-azure<2 to Pipfile's [packages]…
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches django<2,<2.1,>=2.0.3
Tried: 1.1.3, 1.1.4, 1.2, 1.2.1, 1.2.2, 1.2.3, 1.2.4, 1.2.5, 1.2.6, 1.2.7, 1.3, 1.3.1, 1.3.2, 1.3.3, 1.3.4, 1.3.5, 1.3.6, 1.3.7, 1.4, 1.4.1, 1.4.2, 1.4.3, 1.4.4, 1.4.5, 1.4.6, 1.4.7, 1.4.8, 1.4.9, 1.4.10, 1.4.11, 1.4.12, 1.4.13, 1.4.14, 1.4.15, 1.4.16, 1.4.17, 1.4.18, 1.4.19, 1.4.20, 1.4.21, 1.4.22, 1.5, 1.5.1, 1.5.2, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 1.5.7, 1.5.8, 1.5.8, 1.5.9, 1.5.10, 1.5.11, 1.5.12, 1.5.12, 1.6, 1.6, 1.6.1, 1.6.1, 1.6.2, 1.6.2, 1.6.3, 1.6.3, 1.6.4, 1.6.4, 1.6.5, 1.6.5, 1.6.6, 1.6.6, 1.6.7, 1.6.7, 1.6.8, 1.6.8, 1.6.9, 1.6.9, 1.6.10, 1.6.10, 1.6.11, 1.6.11, 1.7, 1.7, 1.7.1, 1.7.1, 1.7.2, 1.7.2, 1.7.3, 1.7.3, 1.7.4, 1.7.4, 1.7.5, 1.7.5, 1.7.6, 1.7.6, 1.7.7, 1.7.7, 1.7.8, 1.7.8, 1.7.9, 1.7.9, 1.7.10, 1.7.10, 1.7.11, 1.7.11, 1.8a1, 1.8b1, 1.8b2, 1.8rc1, 1.8, 1.8, 1.8.1, 1.8.1, 1.8.2, 1.8.2, 1.8.3, 1.8.3, 1.8.4, 1.8.4, 1.8.5, 1.8.5, 1.8.6, 1.8.6, 1.8.7, 1.8.7, 1.8.8, 1.8.8, 1.8.9, 1.8.9, 1.8.10, 1.8.10, 1.8.11, 1.8.11, 1.8.12, 1.8.12, 1.8.13, 1.8.13, 1.8.14, 1.8.14, 1.8.15, 1.8.15, 1.8.16, 1.8.16, 1.8.17, 1.8.17, 1.8.18, 1.8.18, 1.8.19, 1.8.19, 1.9a1, 1.9b1, 1.9rc1, 1.9rc2, 1.9, 1.9, 1.9.1, 1.9.1, 1.9.2, 1.9.2, 1.9.3, 1.9.3, 1.9.4, 1.9.4, 1.9.5, 1.9.5, 1.9.6, 1.9.6, 1.9.7, 1.9.7, 1.9.8, 1.9.8, 1.9.9, 1.9.9, 1.9.10, 1.9.10, 1.9.11, 1.9.11, 1.9.12, 1.9.12, 1.9.13, 1.9.13, 1.10a1, 1.10a1, 1.10b1, 1.10b1, 1.10rc1, 1.10rc1, 1.10, 1.10, 1.10.1, 1.10.1, 1.10.2, 1.10.2, 1.10.3, 1.10.3, 1.10.4, 1.10.4, 1.10.5, 1.10.5, 1.10.6, 1.10.6, 1.10.7, 1.10.7, 1.10.8, 1.10.8, 1.11a1, 1.11b1, 1.11rc1, 1.11rc1, 1.11, 1.11, 1.11.1, 1.11.1, 1.11.2, 1.11.2, 1.11.3, 1.11.3, 1.11.4, 1.11.4, 1.11.5, 1.11.5, 1.11.6, 1.11.6, 1.11.7, 1.11.7, 1.11.8, 1.11.8, 1.11.9, 1.11.9, 1.11.10, 1.11.10, 1.11.11, 1.11.11, 2.0a1, 2.0b1, 2.0rc1, 2.0, 2.0, 2.0.1, 2.0.1, 2.0.2, 2.0.2, 2.0.3, 2.0.3

I got around this error by specifying the branch:
django-pyodbc-azure = {git = "https://github.com/michiya/django-pyodbc-azure", ref = "azure-1.11"}

msopko81 picture msopko81 on 15 Mar 2018

I have upgraded to 11.8.0 but have same problem still

however my colleague could not reproduce it from my minimal example

I am currently debugging and will post more info when I have some

anentropic picture anentropic on 15 Mar 2018

ok, this is weird

I got it to work by:

$ pyenv virtualenv pipenvtemp
$ pyenv activate pipenvtemp
pipenvtemp > $ pip install pipenv
pipenvtemp > $ pipenv lock

This has now broken my 'outside' install of pipenv though:

pipenvtemp > $ source deactivate
$ pipenv lock
pyenv: pipenv: command not found

The `pipenv' command exists in these Python versions:
  2.7.11/envs/pipenvtemp
  pipenvtemp

$ pipsi install pipenv
pipenv is already installed

so I have some horrible interaction between pyenv-virtualenv, pipsi and pipenv on my system

I thought I had faithfully followed the install instructions, but maybe existing state of my system was not compatible

I think now I have to try blowing away all my Pythons and set up my dev environment from scratch 😢

anentropic picture anentropic on 15 Mar 2018

Oh it's specific to python 3 somehow, I tried the pyenv-virtualenv trick above with my actual project and it didn't work.

And if I try it again with the minimal example, but using Python 3.6.4 instead of 2.7, then it doesn't work:

$ pyenv virtualenv 3.6.4 pipenvtemp-py3
$ pyenv activate pipenvtemp-py3
pipenvtemp-py3 > $ pip install pipenv
pipenvtemp-py3 > $ rm Pipfile.lock
pipenvtemp-py3 > $ pipenv lock
Courtesy Notice: Pipenv found itself running within a virtual environment, so it will automatically use that environment, instead of creating its own for any project.
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1
anentropic picture anentropic on 16 Mar 2018

@anentropic just uninstall all of the pipenvs you have, everywhere, and reinstall using system 3.6.4 with --user

techalchemy picture techalchemy on 16 Mar 2018
👍1

Well I found the problem and a solution, if not an explanation for how it happened.

I spent a while stepping through the underlying code, i.e.

from pipenv.patched.piptools.repositories import PyPIRepository
from pipenv.patched.piptools.scripts.compile import get_pip_command
from pipenv.patched.notpip.req.req_install import InstallRequirement
from pipenv.patched.piptools.resolver import Resolver

pip_command = get_pip_command()
pip_options, _ = pip_command.parse_args([])
session = pip_command._build_session(pip_options)
pypi = PyPIRepository(pip_options=pip_options, use_json=False, session=session)

# first observe that this returns correct constraints:
ireq = InstallRequirement.from_line('bleach==1.5.0')
pypi.get_dependencies(ireq)
{<InstallRequirement object: six (from bleach==1.5.0) editable=False>,
 <InstallRequirement object: html5lib!=0.9999,!=0.99999,<0.99999999,>=0.999 (from bleach==1.5.0) editable=False>}

# I added the following breakpoint at pipenv/patched/piptools/resolver.py:200
            if str(best_match.req) == 'bleach==1.5.0':
                import ipdb; ipdb.set_trace()

# then ran the resolver:
ireq = InstallRequirement.from_line('tensorflow==1.3.0')
resolver = Resolver(constraints=[ireq], repository=pypi)
resolver.resolve()

# stepping through we fail this check, showing that 'html5lib' is already in the cache
    if ireq not in self.dependency_cache:

# so next it fetches dep from cache:
ipdb> pp self.dependency_cache[ireq]
['html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre',
 'six']
# aha!
ipdb> self.dependency_cache._cache_file
'/Users/anentropic/Library/Caches/pipenv/depcache-py3.6.json'

Somehow the bogus html5lib>=0.99999999pre requirement had got stuck in the dependency cache file.

Now I knew what to do...

pipenvtemp-py3 $ rm /Users/anentropic/Library/Caches/pipenv/depcache-py3.6.json
pipenvtemp-py3 $ pipenv lock
Courtesy Notice: Pipenv found itself running within a virtual environment, so it will automatically use that environment, instead of creating its own for any project.
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Success - lock file was created without error.

This also explains why it worked under Python 2.7 - I assume because pipenv has a separate dependency cache file per python version.

anentropic picture anentropic on 16 Mar 2018
👍5

@anentropic thanks for the update! We should have recommended that directly, bug I'm glad you got it sorted out!

techalchemy picture techalchemy on 17 Mar 2018

@anentropic @techalchemy I'm facing the same issue but removing /Users/.../Library/Caches/pipenv/depcache-py3.6.json didn't help me. Any suggestions on what else I can try? Thanks!

  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==1.0b8,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1
henadzit picture henadzit on 26 Mar 2018

@henadzit Please provide information for your platform. Open a new issue to see what information are expected to debug your problem. You don’t need to submit a new issue, only need to check the fields and provide them accordingly here.

uranusjr picture uranusjr on 27 Mar 2018

@uranusjr, sure! Here it is

$ python -m pipenv.help output

Pipenv version: '11.9.0'

Pipenv location: '/Users/henadzit/.local/share/virtualenvs/dopeoplesayit-BfIykoUf/lib/python3.6/site-packages/pipenv'

Python location: '/Users/henadzit/.local/share/virtualenvs/dopeoplesayit-BfIykoUf/bin/python'

Other Python installations in PATH:

  • 2.7: /usr/bin/python2.7
  • 2.7: /usr/bin/python2.7
  • 3.6: /Users/henadzit/.local/share/virtualenvs/dopeoplesayit-BfIykoUf/bin/python3.6m
  • 3.6: /Users/henadzit/.local/share/virtualenvs/dopeoplesayit-BfIykoUf/bin/python3.6
  • 3.6: /Users/henadzit/.pyenv/shims/python3.6
  • 3.6: /usr/local/bin/python3.6

  • 3.6: /usr/local/bin/python3.6

  • 3.6.4: /Users/henadzit/.local/share/virtualenvs/dopeoplesayit-BfIykoUf/bin/python

  • 3.6.4: /Users/henadzit/.pyenv/shims/python
  • 2.7.10: /usr/bin/python
  • 3.6.4: /Users/henadzit/.local/share/virtualenvs/dopeoplesayit-BfIykoUf/bin/python3
  • 3.6.4: /Users/henadzit/.pyenv/shims/python3
  • 3.6.4: /usr/local/bin/python3
  • 3.6.4: /usr/local/bin/python3

PEP 508 Information:

{'implementation_name': 'cpython',
 'implementation_version': '3.6.4',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '17.4.0',
 'platform_system': 'Darwin',
 'platform_version': 'Darwin Kernel Version 17.4.0: Sun Dec 17 09:19:54 PST '
                     '2017; root:xnu-4570.41.2~1/RELEASE_X86_64',
 'python_full_version': '3.6.4',
 'python_version': '3.6',
 'sys_platform': 'darwin'}

System environment variables:

  • TERM_PROGRAM
  • PIP_PYTHON_PATH
  • TERM
  • SHELL
  • TMPDIR
  • DOCKER_HOST
  • Apple_PubSub_Socket_Render
  • PYTHONUNBUFFERED
  • TERM_PROGRAM_VERSION
  • TERM_SESSION_ID
  • USER
  • DOCKER_MACHINE_NAME
  • CPATH
  • SSH_AUTH_SOCK
  • __CF_USER_TEXT_ENCODING
  • VIRTUAL_ENV
  • DOCKER_TLS_VERIFY
  • PIPENV_ACTIVE
  • PATH
  • PWD
  • JAVA_HOME
  • LETSENCRYPT_CERTS_FOLDER
  • LANG
  • DOPEOPLESAY_WEB_SECRET_KEY_BASE
  • ITERM_PROFILE
  • XPC_FLAGS
  • PS1
  • PYTHONDONTWRITEBYTECODE
  • RBENV_SHELL
  • XPC_SERVICE_NAME
  • PYENV_SHELL
  • DOCKER_CERT_PATH
  • SHLVL
  • HOME
  • COLORFGBG
  • ITERM_SESSION_ID
  • LOGNAME
  • PKG_CONFIG_PATH
  • DISPLAY
  • _

Pipenv–specific environment variables:

  • PIPENV_ACTIVE: 1

Debug–specific environment variables:

  • PATH: /Users/henadzit/.local/share/virtualenvs/dopeoplesayit-BfIykoUf/bin:/usr/local/Cellar/pipenv/11.9.0/libexec/tools:/Users/henadzit/.pyenv/shims:/Users/henadzit/.rbenv/shims:/Users/henadzit/.rbenv/bin:/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/X11/bin:/Users/henadzit/workspace/geckodriver:/Users/henadzit/.rvm/bin
  • SHELL: /bin/bash
  • LANG: en_US.UTF-8
  • PWD: /Users/henadzit/workspace/dopeoplesayit
  • VIRTUAL_ENV: /Users/henadzit/.local/share/virtualenvs/dopeoplesayit-BfIykoUf

Contents of Pipfile ('/Users/henadzit/workspace/dopeoplesayit/Pipfile'):

[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]

falcon = "==1.3.0"
gunicorn = "==19.7.1"
hunspell = "==0.5.0"
nltk = "==3.2.4"
pysolr = "==3.7.0"
pytest = "==3.1.2"
pytest-mock = "==1.6.3"
requests = "==2.18.4"


[dev-packages]

jupyter = "*"
spacy = "*"
matplotlib = "*"


[requires]

python_version = "3.6.4"

henadzit picture henadzit on 27 Mar 2018

@uranusjr, sorry for bothering you, but have you had a chance to look at the output in my previous comment? Thanks a lot!

henadzit picture henadzit on 29 Mar 2018

@henadzit don't activate the pipenv shell before you run dependency resolution. From _outside_ of the pipenv shell, try pipenv lock --verbose --clear and see if this resolves the problem

techalchemy picture techalchemy on 29 Mar 2018

@techalchemy, thank you for the suggestion! I tried it but ended up with the same error unfortunately.

Here's the output of pipenv.help without pipenv shell.

$ python -m pipenv.help output

Pipenv version: '11.9.0'

Pipenv location: '/Users/henadzit/.pyenv/versions/3.6.4/lib/python3.6/site-packages/pipenv'

Python location: '/Users/henadzit/.pyenv/versions/3.6.4/bin/python'

Other Python installations in PATH:

  • 2.7: /usr/bin/python2.7
  • 2.7: /usr/bin/python2.7
  • 3.6: /Users/henadzit/.pyenv/versions/3.6.4/bin/python3.6m
  • 3.6: /Users/henadzit/.pyenv/versions/3.6.4/bin/python3.6
  • 3.6: /Users/henadzit/.pyenv/shims/python3.6
  • 3.6: /usr/local/bin/python3.6

  • 3.6: /usr/local/bin/python3.6

  • 3.6.4: /Users/henadzit/.pyenv/versions/3.6.4/bin/python

  • 3.6.4: /Users/henadzit/.pyenv/shims/python
  • 2.7.10: /usr/bin/python
  • 3.6.4: /Users/henadzit/.pyenv/versions/3.6.4/bin/python3
  • 3.6.4: /Users/henadzit/.pyenv/shims/python3
  • 3.6.4: /usr/local/bin/python3
  • 3.6.4: /usr/local/bin/python3

PEP 508 Information:

{'implementation_name': 'cpython',
 'implementation_version': '3.6.4',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '17.4.0',
 'platform_system': 'Darwin',
 'platform_version': 'Darwin Kernel Version 17.4.0: Sun Dec 17 09:19:54 PST '
                     '2017; root:xnu-4570.41.2~1/RELEASE_X86_64',
 'python_full_version': '3.6.4',
 'python_version': '3.6',
 'sys_platform': 'darwin'}

System environment variables:

  • TERM_PROGRAM
  • PYENV_ROOT
  • SHELL
  • TERM
  • TMPDIR
  • Apple_PubSub_Socket_Render
  • DOCKER_HOST
  • TERM_PROGRAM_VERSION
  • TERM_SESSION_ID
  • PYENV_VERSION
  • USER
  • DOCKER_MACHINE_NAME
  • SSH_AUTH_SOCK
  • CPATH
  • PYENV_DIR
  • __CF_USER_TEXT_ENCODING
  • DOCKER_TLS_VERIFY
  • PATH
  • PWD
  • JAVA_HOME
  • LANG
  • ITERM_PROFILE
  • PYENV_HOOK_PATH
  • XPC_FLAGS
  • RBENV_SHELL
  • XPC_SERVICE_NAME
  • COLORFGBG
  • HOME
  • SHLVL
  • DOCKER_CERT_PATH
  • PYENV_SHELL
  • ITERM_SESSION_ID
  • LOGNAME
  • PKG_CONFIG_PATH
  • DISPLAY
  • PYTHONDONTWRITEBYTECODE
  • PIP_PYTHON_PATH
  • PYTHONUNBUFFERED

Pipenv–specific environment variables:

Debug–specific environment variables:

  • PATH: /Users/henadzit/.pyenv/versions/3.6.4/bin:/usr/local/Cellar/pyenv/1.2.2/libexec:/Users/henadzit/.pyenv/shims:/Users/henadzit/.rbenv/shims:/Users/henadzit/.rbenv/bin:/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/X11/bin:/Users/henadzit/workspace/geckodriver
  • SHELL: /bin/bash
  • LANG: en_US.UTF-8
  • PWD: /Users/henadzit/workspace/dopeoplesayit

Contents of Pipfile ('/Users/henadzit/workspace/dopeoplesayit/Pipfile'):

[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]

falcon = "==1.3.0"
gunicorn = "==19.7.1"
hunspell = "==0.5.0"
nltk = "==3.2.4"
pysolr = "==3.7.0"
pytest = "==3.1.2"
pytest-mock = "==1.6.3"
requests = "==2.18.4"


[dev-packages]

jupyter = "*"
spacy = "*"
matplotlib = "*"


[requires]

python_version = "3.6.4"

henadzit picture henadzit on 29 Mar 2018

🤔 Try removing the whole cache directory manually.

uranusjr picture uranusjr on 30 Mar 2018

@henadzit try pipenv lock --clear or wipe any of the following directories if they exist: 

/Users/.../Library/Caches/pipenv
/Users/.../Library/Caches/pip-tools
/Users/.../Library/Caches/pip
techalchemy picture techalchemy on 1 Apr 2018
👍2

@uranusjr @techalchemy, thank you for trying to help me out! I tried everything you suggested and no luck. I created a new Pipfile with just two packages and I'm getting the same error. Below is the output of pipenv.help. I'm about to try running this PIpfile in docker to see if it's just my environment.

$ python -m pipenv.help output

Pipenv version: '11.9.0'

Pipenv location: '/usr/local/Cellar/pipenv/11.9.0/libexec/lib/python3.6/site-packages/pipenv'

Python location: '/usr/local/Cellar/pipenv/11.9.0/libexec/bin/python3'

Other Python installations in PATH:

  • 2.7: /usr/bin/python2.7
  • 2.7: /usr/bin/python2.7
  • 3.6: /Users/henadzit/anaconda3/bin/python3.6m
  • 3.6: /Users/henadzit/anaconda3/bin/python3.6
  • 3.6: /Users/henadzit/.pyenv/shims/python3.6
  • 3.6: /usr/local/bin/python3.6

  • 3.6: /usr/local/bin/python3.6

  • 3.6.4: /Users/henadzit/anaconda3/bin/python

  • 3.6.4: /Users/henadzit/.pyenv/shims/python
  • 2.7.10: /usr/bin/python
  • 3.6.4: /Users/henadzit/anaconda3/bin/python3
  • 3.6.4: /Users/henadzit/.pyenv/shims/python3
  • 3.6.4: /usr/local/bin/python3
  • 3.6.4: /usr/local/bin/python3

PEP 508 Information:

{'implementation_name': 'cpython',
 'implementation_version': '3.6.4',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '17.4.0',
 'platform_system': 'Darwin',
 'platform_version': 'Darwin Kernel Version 17.4.0: Sun Dec 17 09:19:54 PST '
                     '2017; root:xnu-4570.41.2~1/RELEASE_X86_64',
 'python_full_version': '3.6.4',
 'python_version': '3.6',
 'sys_platform': 'darwin'}

System environment variables:

  • TERM_PROGRAM
  • TERM
  • SHELL
  • TMPDIR
  • DOCKER_HOST
  • Apple_PubSub_Socket_Render
  • TERM_PROGRAM_VERSION
  • OLDPWD
  • TERM_SESSION_ID
  • USER
  • LD_LIBRARY_PATH
  • DOCKER_MACHINE_NAME
  • CPATH
  • SSH_AUTH_SOCK
  • __CF_USER_TEXT_ENCODING
  • DOCKER_TLS_VERIFY
  • PATH
  • PWD
  • JAVA_HOME
  • LANG
  • ITERM_PROFILE
  • XPC_FLAGS
  • RBENV_SHELL
  • XPC_SERVICE_NAME
  • PYENV_SHELL
  • DOCKER_CERT_PATH
  • SHLVL
  • HOME
  • COLORFGBG
  • ITERM_SESSION_ID
  • LOGNAME
  • PKG_CONFIG_PATH
  • DISPLAY
  • _
  • PYTHONDONTWRITEBYTECODE
  • PIP_PYTHON_PATH
  • PYTHONUNBUFFERED

Pipenv–specific environment variables:

Debug–specific environment variables:

  • PATH: /Users/henadzit/anaconda3/bin:/Users/henadzit/.pyenv/shims:/Users/henadzit/.rbenv/shims:/Users/henadzit/.rbenv/bin:/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/X11/bin:/Users/henadzit/workspace/geckodriver:/Users/henadzit/workspace/torch/install/bin
  • SHELL: /bin/bash
  • LANG: en_US.UTF-8
  • PWD: /Users/henadzit/workspace/pipenv-html5lib-issue

Contents of Pipfile ('/Users/henadzit/workspace/pipenv-html5lib-issue/Pipfile'):

[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]
jupyter = "==1.0.0"
spacy = "==2.0.10"

[dev-packages]

[requires]

python_version = "3.6.4"

henadzit picture henadzit on 1 Apr 2018

@uranusjr @techalchemy, looks like the issue isn't related to my environment. I was able to reproduce the issue in the completely clean environment of docker. I created a repo to show the issue, please, have a look if you get a chance - https://github.com/henadzit/pipenv-html5lib-issue.

henadzit picture henadzit on 1 Apr 2018

@henadzit Your dependencies actually don't resolve. This is an issue with spaCy: https://github.com/explosion/spaCy/issues/2181.

romanczuk picture romanczuk on 3 Apr 2018

@henadzit Because spaCy is dropping its required version in 2.0.11, it felt more correct to use the TensorFlow version. I'm not sure what the canonical way to do this is, but I just (temporarily, I hope) pulled tensorflow out of my Pipfile and installed my packages like this:

pipenv install
pip install tensorflow
romanczuk picture romanczuk on 3 Apr 2018
👍2

@romanczuk, I upgraded spacy and it resolved the issue! Thank all for your help!

henadzit picture henadzit on 5 Apr 2018

For me the issue still persists. I am trying to install both tensorflow and jupyter[notebook]. Whereas the former pinns bleach==1.5.0, the later has a transitive unpinned bleach dependency. This dependency seems to adds the constraint >=0.99999999pre.

I can recreate the behavior by trying to install bleach (unpinned) and tensorboard (which pins the bleach version):

pipenv install bleach tensorboard
Creating a virtualenv for this project…
Using /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6 (3.6.4) to create virtualenv…
⠋Already using interpreter /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6
Using real prefix '/usr/local/Cellar/python/3.6.4_4/Frameworks/Python.framework/Versions/3.6'
New python executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python3.6
Also creating executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I
Creating a Pipfile for this project…
Installing bleach…
Collecting bleach
  Using cached bleach-2.1.3-py2.py3-none-any.whl
Collecting six (from bleach)
  Using cached six-1.11.0-py2.py3-none-any.whl
Collecting html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre (from bleach)
  Using cached html5lib-1.0.1-py2.py3-none-any.whl
Collecting webencodings (from html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre->bleach)
  Using cached webencodings-0.5.1-py2.py3-none-any.whl
Installing collected packages: six, webencodings, html5lib, bleach
Successfully installed bleach-2.1.3 html5lib-1.0.1 six-1.11.0 webencodings-0.5.1

Adding bleach to Pipfile's [packages]…
Installing tensorboard…
Collecting tensorboard
  Using cached tensorboard-1.7.0-py3-none-any.whl
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting werkzeug>=0.11.10 (from tensorboard)
  Using cached Werkzeug-0.14.1-py2.py3-none-any.whl
Collecting bleach==1.5.0 (from tensorboard)
  Using cached bleach-1.5.0-py2.py3-none-any.whl
Collecting numpy>=1.12.0 (from tensorboard)
  Using cached numpy-1.14.2-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
Collecting markdown>=2.6.8 (from tensorboard)
  Using cached Markdown-2.6.11-py2.py3-none-any.whl
Collecting protobuf>=3.4.0 (from tensorboard)
  Using cached protobuf-3.5.2.post1-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl
Requirement already satisfied: six>=1.10.0 in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting html5lib==0.9999999 (from tensorboard)
Requirement already satisfied: setuptools in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from protobuf>=3.4.0->tensorboard)
Installing collected packages: werkzeug, html5lib, bleach, numpy, markdown, protobuf, tensorboard
  Found existing installation: html5lib 1.0.1
    Uninstalling html5lib-1.0.1:
      Successfully uninstalled html5lib-1.0.1
  Found existing installation: bleach 2.1.3
    Uninstalling bleach-2.1.3:
      Successfully uninstalled bleach-2.1.3
Successfully installed bleach-1.5.0 html5lib-0.9999999 markdown-2.6.11 numpy-1.14.2 protobuf-3.5.2.post1 tensorboard-1.7.0 werkzeug-0.14.1

Adding tensorboard to Pipfile's [packages]…
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

When running install --skip-lock and graph there is no sign of this constraint:

$ pipenv install bleach tensorboard --skip-lock
...

$ pipenv graph | grep html5lib
    - html5lib [required: >=0.999,!=0.9999,!=0.99999,<0.99999999, installed: 0.9999999]
  - html5lib [required: ==0.9999999, installed: 0.9999999]

$ pipenv graph | grep bleach
  - bleach [required: ==1.5.0, installed: 1.5.0]

Removing the cache directories, does not change the behavior. I am running pipenv version 11.8.0. There does seem to be some interaction with global state. While searching for a minimal example, I tried the setup above multiple times. For one run, locking worked. However, I could not reproduce this behavior.

Further details:

$ pipenv --version
pipenv, version 11.8.0

$ pipenv graph
tensorboard==1.7.0
  - bleach [required: ==1.5.0, installed: 1.5.0]
    - html5lib [required: !=0.99999,!=0.9999,>=0.999,<0.99999999, installed: 0.9999999]
      - six [required: Any, installed: 1.11.0]
    - six [required: Any, installed: 1.11.0]
  - html5lib [required: ==0.9999999, installed: 0.9999999]
    - six [required: Any, installed: 1.11.0]
  - markdown [required: >=2.6.8, installed: 2.6.11]
  - numpy [required: >=1.12.0, installed: 1.14.2]
  - protobuf [required: >=3.4.0, installed: 3.5.2.post1]
    - setuptools [required: Any, installed: 39.0.1]
    - six [required: >=1.9, installed: 1.11.0]
  - six [required: >=1.10.0, installed: 1.11.0]
  - werkzeug [required: >=0.11.10, installed: 0.14.1]
  - wheel [required: >=0.26, installed: 0.31.0]
webencodings==0.5.1


$ cat Pipfile 
[[source]]

url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"


[packages]

bleach = "*"
tensorboard = "*"


[dev-packages]



[requires]

python_version = "3.6"

$ pipenv lock --clear --verbose
Locking [dev-packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1                           
Current constraints:

Finding the best candidates:

Finding secondary dependencies:
------------------------------------------------------------
Result of round 1: stable, done

Locking [packages] dependencies…
Using pip: -i https://pypi.python.org/simple

                          ROUND 1                           
Current constraints:
  bleach
  tensorboard

Finding the best candidates:
  found candidate bleach==2.1.3 (constraint was <any>)
  found candidate tensorboard==1.7.0 (constraint was <any>)

Finding secondary dependencies:
  tensorboard==1.7.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"
  bleach==2.1.3             requires html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre, six

New dependencies found in this round:
  adding ['bleach', '==1.5.0', '[]']
  adding ['html5lib', '!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre', '[]']
  adding ['markdown', '>=2.6.8', '[]']
  adding ['numpy', '>=1.12.0', '[]']
  adding ['protobuf', '>=3.4.0', '[]']
  adding ['six', '>=1.10.0', '[]']
  adding ['werkzeug', '>=0.11.10', '[]']
  adding ['wheel', '>=0.26', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2                           
Current constraints:
  bleach==1.5.0
  html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
  markdown>=2.6.8
  numpy>=1.12.0
  protobuf>=3.4.0
  six>=1.10.0
  tensorboard
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate bleach==1.5.0 (constraint was ==1.5.0)
Using pip: -i https://pypi.python.org/simple

                          ROUND 1                           
Current constraints:
  bleach
  tensorboard

Finding the best candidates:
  found candidate bleach==2.1.3 (constraint was <any>)
  found candidate tensorboard==1.7.0 (constraint was <any>)

Finding secondary dependencies:
  bleach==2.1.3             requires html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre, six
  tensorboard==1.7.0        requires bleach==1.5.0, html5lib==0.9999999, markdown>=2.6.8, numpy>=1.12.0, protobuf>=3.4.0, six>=1.10.0, werkzeug>=0.11.10, wheel>=0.26; python_version >= "3"; python_version >= "3"

New dependencies found in this round:
  adding ['bleach', '==1.5.0', '[]']
  adding ['html5lib', '!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre', '[]']
  adding ['markdown', '>=2.6.8', '[]']
  adding ['numpy', '>=1.12.0', '[]']
  adding ['protobuf', '>=3.4.0', '[]']
  adding ['six', '>=1.10.0', '[]']
  adding ['werkzeug', '>=0.11.10', '[]']
  adding ['wheel', '>=0.26', '[]']
Removed dependencies in this round:
Unsafe dependencies in this round:
------------------------------------------------------------
Result of round 1: not stable

                          ROUND 2                           
Current constraints:
  bleach==1.5.0
  html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
  markdown>=2.6.8
  numpy>=1.12.0
  protobuf>=3.4.0
  six>=1.10.0
  tensorboard
  werkzeug>=0.11.10
  wheel>=0.26

Finding the best candidates:
  found candidate bleach==1.5.0 (constraint was ==1.5.0)

INFO:pip9._vendor.requests.packages.urllib3.connectionpool:Starting new HTTPS connection (1): pypi.python.org
Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1
Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1

chmp picture chmp on 7 Apr 2018

Okay looking at this carefully this is a legitimate dependency conflict. html5lib>=0.99999999pre is a bigger number than html5lib==0.9999999 so this can’t actually be resolved. Just put tensorboard in the dev-packages section for now and pipenv install —dev — pipenv will favor the non-dev resolution this way

techalchemy picture techalchemy on 7 Apr 2018

Thanks for the workaround. I'll give a try.

What puzzles me: why does html5lib>=0.99999999pre even come up as a constraint? Tensorboard fixes bleach==1.5.0. Therefore, the additional bleach package passed to pipenv install should not affect the dependency graph, should it?

Concretely: given that tensorboard fixes bleach==1.5.0, I would expect the dependency graph for both these calls to be exactly the same:

pipenv install tensorboard

pipenv install bleach tensorboard
chmp picture chmp on 7 Apr 2018

It does because you have it listed first, which might be fixed if you swap the ordering? Not sure. Try that too and let me know

techalchemy picture techalchemy on 7 Apr 2018

If I add bleach to the commandline it fails (first two options). If I only install tensorboard, it works (last option). The pipenv output is inside the details blocks.

$ rm -rf ~/Library/Caches/pip* ~/.virtualenvs/foo-i7B_Qy-I Pipfile 
$ pipenv install tensorboard bleach

# fails


Creating a virtualenv for this project…
Using /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6 (3.6.4) to create virtualenv…
⠋Already using interpreter /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6
Using real prefix '/usr/local/Cellar/python/3.6.4_4/Frameworks/Python.framework/Versions/3.6'
New python executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python3.6
Also creating executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I
Creating a Pipfile for this project…
Installing tensorboard…
Collecting tensorboard
  Downloading tensorboard-1.7.0-py3-none-any.whl (3.1MB)
Collecting html5lib==0.9999999 (from tensorboard)
  Downloading html5lib-0.9999999.tar.gz (889kB)
Collecting werkzeug>=0.11.10 (from tensorboard)
  Downloading Werkzeug-0.14.1-py2.py3-none-any.whl (322kB)
Collecting markdown>=2.6.8 (from tensorboard)
  Downloading Markdown-2.6.11-py2.py3-none-any.whl (78kB)
Collecting numpy>=1.12.0 (from tensorboard)
  Downloading numpy-1.14.2-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (4.7MB)
Collecting protobuf>=3.4.0 (from tensorboard)
  Downloading protobuf-3.5.2.post1-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (1.2MB)
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting six>=1.10.0 (from tensorboard)
  Downloading six-1.11.0-py2.py3-none-any.whl
Collecting bleach==1.5.0 (from tensorboard)
  Downloading bleach-1.5.0-py2.py3-none-any.whl
Requirement already satisfied: setuptools in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from protobuf>=3.4.0->tensorboard)
Building wheels for collected packages: html5lib
  Running setup.py bdist_wheel for html5lib: started
  Running setup.py bdist_wheel for html5lib: finished with status 'done'
  Stored in directory: /Volumes/Home/Library/Caches/pip/wheels/6f/85/6c/56b8e1292c6214c4eb73b9dda50f53e8e977bf65989373c962
Successfully built html5lib
Installing collected packages: six, html5lib, werkzeug, markdown, numpy, protobuf, bleach, tensorboard
Successfully installed bleach-1.5.0 html5lib-0.9999999 markdown-2.6.11 numpy-1.14.2 protobuf-3.5.2.post1 six-1.11.0 tensorboard-1.7.0 werkzeug-0.14.1

Adding tensorboard to Pipfile's [packages]…
Installing bleach…
Requirement already satisfied: bleach in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages
Requirement already satisfied: six in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from bleach)
Requirement already satisfied: html5lib!=0.9999,!=0.99999,<0.99999999,>=0.999 in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from bleach)

Adding bleach to Pipfile's [packages]…
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1


$ rm -rf ~/Library/Caches/pip* ~/.virtualenvs/foo-i7B_Qy-I Pipfile
$ pipenv install bleach tensorboard 

# fails


Creating a virtualenv for this project…
Using /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6 (3.6.4) to create virtualenv…
⠋Already using interpreter /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6
Using real prefix '/usr/local/Cellar/python/3.6.4_4/Frameworks/Python.framework/Versions/3.6'
New python executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python3.6
Also creating executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I
Creating a Pipfile for this project…
Installing bleach…
Collecting bleach
  Downloading bleach-2.1.3-py2.py3-none-any.whl
Collecting html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre (from bleach)
  Downloading html5lib-1.0.1-py2.py3-none-any.whl (117kB)
Collecting six (from bleach)
  Downloading six-1.11.0-py2.py3-none-any.whl
Collecting webencodings (from html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,>=0.99999999pre->bleach)
  Downloading webencodings-0.5.1-py2.py3-none-any.whl
Installing collected packages: six, webencodings, html5lib, bleach
Successfully installed bleach-2.1.3 html5lib-1.0.1 six-1.11.0 webencodings-0.5.1

Adding bleach to Pipfile's [packages]…
Installing tensorboard…
Collecting tensorboard
  Downloading tensorboard-1.7.0-py3-none-any.whl (3.1MB)
Collecting werkzeug>=0.11.10 (from tensorboard)
  Downloading Werkzeug-0.14.1-py2.py3-none-any.whl (322kB)
Collecting markdown>=2.6.8 (from tensorboard)
  Downloading Markdown-2.6.11-py2.py3-none-any.whl (78kB)
Collecting bleach==1.5.0 (from tensorboard)
  Downloading bleach-1.5.0-py2.py3-none-any.whl
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting numpy>=1.12.0 (from tensorboard)
  Downloading numpy-1.14.2-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (4.7MB)
Collecting protobuf>=3.4.0 (from tensorboard)
  Downloading protobuf-3.5.2.post1-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (1.2MB)
Requirement already satisfied: six>=1.10.0 in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting html5lib==0.9999999 (from tensorboard)
  Downloading html5lib-0.9999999.tar.gz (889kB)
Requirement already satisfied: setuptools in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from protobuf>=3.4.0->tensorboard)
Building wheels for collected packages: html5lib
  Running setup.py bdist_wheel for html5lib: started
  Running setup.py bdist_wheel for html5lib: finished with status 'done'
  Stored in directory: /Volumes/Home/Library/Caches/pip/wheels/6f/85/6c/56b8e1292c6214c4eb73b9dda50f53e8e977bf65989373c962
Successfully built html5lib
Installing collected packages: werkzeug, markdown, html5lib, bleach, numpy, protobuf, tensorboard
  Found existing installation: html5lib 1.0.1
    Uninstalling html5lib-1.0.1:
      Successfully uninstalled html5lib-1.0.1
  Found existing installation: bleach 2.1.3
    Uninstalling bleach-2.1.3:
      Successfully uninstalled bleach-2.1.3
Successfully installed bleach-1.5.0 html5lib-0.9999999 markdown-2.6.11 numpy-1.14.2 protobuf-3.5.2.post1 tensorboard-1.7.0 werkzeug-0.14.1

Adding tensorboard to Pipfile's [packages]…
Pipfile.lock (d84f24) out of date, updating to (930330)…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches html5lib!=1.0b1,!=1.0b2,!=1.0b3,!=1.0b4,!=1.0b5,!=1.0b6,!=1.0b7,!=1.0b8,==0.9999999,>=0.99999999pre
Tried: 1.0-reupload, 0.2, 0.9, 0.10, 0.11, 0.11.1, 0.90, 0.95, 0.99, 0.999, 0.9999, 0.99999, 0.999999, 0.9999999, 0.99999999, 0.999999999, 0.999999999, 1.0b1, 1.0b2, 1.0b3, 1.0b5, 1.0b6, 1.0b7, 1.0b8, 1.0b9, 1.0b10, 1.0b10, 1.0.1, 1.0.1


$ rm -rf ~/Library/Caches/pip* ~/.virtualenvs/foo-i7B_Qy-I Pipfile 
$ pipenv install tensorboard

# works


Creating a virtualenv for this project…
Using /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6 (3.6.4) to create virtualenv…
⠋Already using interpreter /usr/local/Cellar/pipenv/11.8.0/libexec/bin/python3.6
Using real prefix '/usr/local/Cellar/python/3.6.4_4/Frameworks/Python.framework/Versions/3.6'
New python executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python3.6
Also creating executable in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/bin/python
Installing setuptools, pip, wheel...done.

Virtualenv location: /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I
Creating a Pipfile for this project…
Installing tensorboard…
Collecting tensorboard
  Downloading tensorboard-1.7.0-py3-none-any.whl (3.1MB)
Collecting markdown>=2.6.8 (from tensorboard)
  Downloading Markdown-2.6.11-py2.py3-none-any.whl (78kB)
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from tensorboard)
Collecting bleach==1.5.0 (from tensorboard)
  Downloading bleach-1.5.0-py2.py3-none-any.whl
Collecting html5lib==0.9999999 (from tensorboard)
  Downloading html5lib-0.9999999.tar.gz (889kB)
Collecting numpy>=1.12.0 (from tensorboard)
  Downloading numpy-1.14.2-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (4.7MB)
Collecting werkzeug>=0.11.10 (from tensorboard)
  Downloading Werkzeug-0.14.1-py2.py3-none-any.whl (322kB)
Collecting six>=1.10.0 (from tensorboard)
  Downloading six-1.11.0-py2.py3-none-any.whl
Collecting protobuf>=3.4.0 (from tensorboard)
  Downloading protobuf-3.5.2.post1-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (1.2MB)
Requirement already satisfied: setuptools in /Volumes/Home/.local/share/virtualenvs/foo-i7B_Qy-I/lib/python3.6/site-packages (from protobuf>=3.4.0->tensorboard)
Building wheels for collected packages: html5lib
  Running setup.py bdist_wheel for html5lib: started
  Running setup.py bdist_wheel for html5lib: finished with status 'done'
  Stored in directory: /Volumes/Home/Library/Caches/pip/wheels/6f/85/6c/56b8e1292c6214c4eb73b9dda50f53e8e977bf65989373c962
Successfully built html5lib
Installing collected packages: markdown, six, html5lib, bleach, numpy, werkzeug, protobuf, tensorboard
Successfully installed bleach-1.5.0 html5lib-0.9999999 markdown-2.6.11 numpy-1.14.2 protobuf-3.5.2.post1 six-1.11.0 tensorboard-1.7.0 werkzeug-0.14.1

Adding tensorboard to Pipfile's [packages]…
Pipfile.lock not found, creating…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…
Updated Pipfile.lock (d84f24)!
Installing dependencies from Pipfile.lock (d84f24)…
  🐍   ▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉ 9/9 — 00:00:04
To activate this project's virtualenv, run the following:
 $ pipenv shell

chmp picture chmp on 7 Apr 2018

@techalchemy thanks again for the work around. It solved my actual problem (installing jupyter + tensorflow): I put jupyter into the development packages and kept tensorflow in the production packages. This way, all packages can be locked.

chmp picture chmp on 8 Apr 2018
👍2
Was this page helpful?
0 / 5 - 0 ratings

Related issues

FooBarQuaxx picture FooBarQuaxx  ·  3Comments
fbender picture fbender  ·  3Comments
jacebrowning picture jacebrowning  ·  3Comments
AkiraSama picture AkiraSama  ·  3Comments
bgjelstrup picture bgjelstrup  ·  3Comments