Pip: Try to install mitmproxy-2.0.2 using pip on Windows 10, but Failed. Do i need to install MSVC Compiler?

Created on 13 Jul 2017 · 16Comments · Source: pypa/pip

Pip version: 9.0.1
Python version: 3.6
Operating system: Windows 10 x64

Description:

Try to install mitmproxy-2.0.2 using pip on Windows 10, do i need to install MSVC Compiler?

What I've run:

D:\repo\py3-webservice-http-ALG>python -m pip install mitmproxy
Collecting mitmproxy
  Using cached mitmproxy-2.0.2-py3-none-any.whl
Requirement already satisfied: certifi>=2015.11.20.1 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: pyparsing<2.3,>=2.1.3 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Collecting cssutils<1.1,>=1.0.1 (from mitmproxy)
  Using cached cssutils-1.0.2-py3-none-any.whl
Requirement already satisfied: blinker<1.5,>=1.4 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: sortedcontainers<1.6,>=1.5.4 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: pydivert<2.1,>=2.0.3; sys_platform == "win32" in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: brotlipy<0.7,>=0.5.1 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: pyOpenSSL<17.0,>=16.0 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: passlib<1.8,>=1.6.5 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Collecting urwid<1.4,>=1.3.1 (from mitmproxy)
  Using cached urwid-1.3.1.tar.gz
Requirement already satisfied: hyperframe<5,>=4.0.1 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: setuptools!=29.0.0,>=11.3 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: ruamel.yaml<0.14,>=0.13.2 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: construct<2.9,>=2.8 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: pyperclip<1.6,>=1.5.22 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: watchdog<0.9,>=0.8.3 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: click<7,>=6.2 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: requests<3,>=2.9.1 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Collecting jsbeautifier<1.7,>=1.6.3 (from mitmproxy)
Requirement already satisfied: pyasn1<0.3,>=0.1.9 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Collecting h2<3,>=2.5.1 (from mitmproxy)
  Using cached h2-2.6.2-py2.py3-none-any.whl
Requirement already satisfied: html2text<=2016.9.19,>=2016.1.8 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Collecting tornado<4.5,>=4.3 (from mitmproxy)
  Using cached tornado-4.4.3.tar.gz
Requirement already satisfied: cryptography<1.9,>=1.3 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: kaitaistruct<0.7,>=0.6 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from mitmproxy)
Requirement already satisfied: cffi>=1.0.0 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from brotlipy<0.7,>=0.5.1->mitmproxy)
Requirement already satisfied: six>=1.5.2 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from pyOpenSSL<17.0,>=16.0->mitmproxy)
Requirement already satisfied: argh>=0.24.1 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from watchdog<0.9,>=0.8.3->mitmproxy)
Requirement already satisfied: PyYAML>=3.10 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from watchdog<0.9,>=0.8.3->mitmproxy)
Requirement already satisfied: pathtools>=0.1.1 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from watchdog<0.9,>=0.8.3->mitmproxy)
Requirement already satisfied: idna<2.6,>=2.5 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from requests<3,>=2.9.1->mitmproxy)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from requests<3,>=2.9.1->mitmproxy)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from requests<3,>=2.9.1->mitmproxy)
Collecting editorconfig>=0.12.0 (from jsbeautifier<1.7,>=1.6.3->mitmproxy)
  Using cached EditorConfig-0.12.1-py3-none-any.whl
Collecting hpack<4,>=2.2 (from h2<3,>=2.5.1->mitmproxy)
  Using cached hpack-3.0.0-py2.py3-none-any.whl
Requirement already satisfied: asn1crypto>=0.21.0 in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from cryptography<1.9,>=1.3->mitmproxy)
Requirement already satisfied: packaging in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from cryptography<1.9,>=1.3->mitmproxy)
Requirement already satisfied: pycparser in c:\users\陈志祥\appdata\local\programs\python\python36\lib\site-packages (from cffi>=1.0.0->brotlipy<0.7,>=0.5.1->mitmproxy)
Building wheels for collected packages: urwid, tornado
  Running setup.py bdist_wheel for urwid ... error
  Failed building wheel for urwid
  Running setup.py clean for urwid
  Running setup.py bdist_wheel for tornado ... error
  Failed building wheel for tornado
  Running setup.py clean for tornado
Failed to build urwid tornado
Installing collected packages: cssutils, urwid, editorconfig, jsbeautifier, hpack, h2, tornado, mitmproxy
  Running setup.py install for urwid ... error
Exception:
Traceback (most recent call last):
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\compat\__init__.py", line 73, in console_to_str
    return s.decode(sys.__stdout__.encoding)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 17: invalid start byte

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\commands\install.py", line 342, in run
    prefix=options.prefix_path,
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\req\req_set.py", line 784, in install
    **kwargs
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\req\req_install.py", line 878, in install
    spinner=spinner,
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils\__init__.py", line 676, in call_subprocess
    line = console_to_str(proc.stdout.readline())
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\compat\__init__.py", line 75, in console_to_str
    return s.decode('utf_8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 17: invalid start byte

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\commands\install.py", line 385, in run
    requirement_set.cleanup_files()
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\req\req_set.py", line 729, in cleanup_files
    req.remove_temporary_source()
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\req\req_install.py", line 977, in remove_temporary_source
    rmtree(self.source_dir)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\retrying.py", line 49, in wrapped_f
    return Retrying(*dargs, **dkw).call(f, *args, **kw)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\retrying.py", line 212, in call
    raise attempt.get()
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\retrying.py", line 247, in get
    six.reraise(self.value[0], self.value[1], self.value[2])
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\six.py", line 686, in reraise
    raise value
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\retrying.py", line 200, in call
    attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils\__init__.py", line 102, in rmtree
    onerror=rmtree_errorhandler)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\shutil.py", line 494, in rmtree
    return _rmtree_unsafe(path, onerror)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\shutil.py", line 393, in _rmtree_unsafe
    onerror(os.rmdir, path, sys.exc_info())
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils\__init__.py", line 114, in rmtree_errorhandler
    func(path)
PermissionError: [WinError 32] 另一个程序正在使用此文件，进程无法访问。: 'C:\\Users\\陈志祥\\AppData\\Local\\Temp\\pip-build-euib5x4_\\urwid'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\basecommand.py", line 215, in main
    status = self.run(options, args)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\commands\install.py", line 385, in run
    requirement_set.cleanup_files()
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils\build.py", line 38, in __exit__
    self.cleanup()
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils\build.py", line 42, in cleanup
    rmtree(self.name)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\retrying.py", line 49, in wrapped_f
    return Retrying(*dargs, **dkw).call(f, *args, **kw)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\retrying.py", line 212, in call
    raise attempt.get()
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\retrying.py", line 247, in get
    six.reraise(self.value[0], self.value[1], self.value[2])
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\six.py", line 686, in reraise
    raise value
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\_vendor\retrying.py", line 200, in call
    attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils\__init__.py", line 102, in rmtree
    onerror=rmtree_errorhandler)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\shutil.py", line 494, in rmtree
    return _rmtree_unsafe(path, onerror)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\shutil.py", line 384, in _rmtree_unsafe
    _rmtree_unsafe(fullname, onerror)
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\shutil.py", line 393, in _rmtree_unsafe
    onerror(os.rmdir, path, sys.exc_info())
  File "C:\Users\陈志祥\AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils\__init__.py", line 114, in rmtree_errorhandler
    func(path)
PermissionError: [WinError 32] 另一个程序正在使用此文件，进程无法访问。: 'C:\\Users\\陈志祥\\AppData\\Local\\Temp\\pip-build-euib5x4_\\tornado'

encoding windows auto-locked support

Source

chenzx

All 16 comments

This may be a known issue with encodings. If you are able to try the development version of pip from github, then please confirm if the problem still exists with that.

pfmoore on 13 Jul 2017

How to use dev version of pip?

chenzx on 13 Jul 2017

Use python -m pip install git+https://github.com/pypa/pip.git to install it, then try running the same command and check if that fails. :)

pradyunsg on 13 Jul 2017

`python -m pip install git+https://github.com/pypa/pip.git
Collecting git+https://github.com/pypa/pip.git
Cloning https://github.com/pypa/pip.git to c:\users\陈志祥\appdata\local\temp\pip-9ygc4a_x-build
Installing collected packages: pip
Found existing installation: pip 9.0.1
Uninstalling pip-9.0.1:
Successfully uninstalled pip-9.0.1
Running setup.py install for pip ... error
Rolling back uninstall of pip
Exception:
Traceback (most recent call last):
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\compat__init__.py", line 73, in console_to_str
return s.decode(sys.__stdout__.encoding)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 18: invalid start byte

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\commands\install.py", line 342, in run
prefix=options.prefix_path,
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\req\req_set.py", line 784, in install
**kwargs
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\req\req_install.py", line 878, in install
spinner=spinner,
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils__init__.py", line 676, in call_subprocess
line = console_to_str(proc.stdout.readline())
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\compat__init__.py", line 75, in console_to_str
return s.decode('utf_8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 18: invalid start byte

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\basecommand.py", line 215, in main
status = self.run(options, args)
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\commands\install.py", line 385, in run
requirement_set.cleanup_files()
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\req\req_set.py", line 729, in cleanup_files
req.remove_temporary_source()
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\req\req_install.py", line 977, in remove_temporary_source
rmtree(self.source_dir)
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip_vendor\retrying.py", line 49, in wrapped_f
return Retrying(dargs, *dkw).call(f, args, *kw)
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip_vendor\retrying.py", line 212, in call
raise attempt.get()
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip_vendor\retrying.py", line 247, in get
six.reraise(self.value[0], self.value[1], self.value[2])
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip_vendor\six.py", line 686, in reraise
raise value
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip_vendor\retrying.py", line 200, in call
attempt = Attempt(fn(args, *kwargs), attempt_number, False)
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils__init__.py", line 102, in rmtree
onerror=rmtree_errorhandler)
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\shutil.py", line 494, in rmtree
return _rmtree_unsafe(path, onerror)
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\shutil.py", line 393, in _rmtree_unsafe
onerror(os.rmdir, path, sys.exc_info())
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\utils__init__.py", line 114, in rmtree_errorhandler
func(path)
PermissionError: [WinError 32] 另一个程序正在使用此文件，进程无法访问。: 'C:\Users\陈志祥\AppData\Local\Temp\pip-9ygc4a_x-build'
`

chenzx on 13 Jul 2017

Good news is, that pretty much confirms that it's an encoding issue (which is fixed in the latest version of pip). The bad news is that you can't use your current pip to upgrade itself because the current version has a bug :-(

I'm not sure what the best option is for a clean upgrade for you here. You could install by cloning the git repo and then using setup.py install but that's messy. I'll have a think and see if I can suggest an upgrade strategy for you.

pfmoore on 13 Jul 2017

👍1

I suspect that the problem is that your temporary directory includes your username, which is non-ASCII, and I suspect you're hitting an issue where the ANSI and OEM codepages set for Windows differ, which causes the sort of encoding issues you're seeing (and is what we've hopefully fixed in the next version of pip). A possible workaround would be to set the TEMP environment variable to a different value.

So one possible approach would be either to set TEMP to something like C:\Temp, which will let pip work at the cost of having to change your system configuration, or if you're OK with using an unreleased version of pip, getting the development version installed by doing:

mkdir C:\Temp
set TEMP=C:\Temp
python -m pip install git+https://github.com/pypa/pip.git
python -m pip --version

(The last command is to check that you now have the dev version of pip installed).

pfmoore on 13 Jul 2017

👍1

C:\Users\陈志祥>mkdir C:\Temp

C:\Users\陈志祥>set TEMP=C:\Temp

C:\Users\陈志祥>python -m pip install git+https://github.com/pypa/pip.git
Collecting git+https://github.com/pypa/pip.git
Cloning https://github.com/pypa/pip.git to c:\temp\pip-bzgvh2ks-build
Installing collected packages: pip
Found existing installation: pip 9.0.1
Uninstalling pip-9.0.1:
Successfully uninstalled pip-9.0.1
Running setup.py install for pip ... error
Rolling back uninstall of pip
Exception:
Traceback (most recent call last):
File "C:\Users\陈志祥AppData\Local\Programs\Python\Python36\lib\site-packages\pip\compat__init__.py", line 73, in console_to_str
return s.decode(sys.__stdout__.encoding)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 49: invalid start byte

During handling of the above exception, another exception occurred:

chenzx on 14 Jul 2017

Hmm, OK. SO I think you're either going to have to wait for the next release of pip, or install manually from git, by:

Manually remove your current copy of pip.
Clone the github repository (or download the tarball of the master branch from github and unpack it).
Run python setup.py install in the clone directory.

The code that's failing has been replaced in the development version of pip, so it's not really possible to diagnose any further until we confirm if the problem still exists in the development version.

pfmoore on 14 Jul 2017

Just one other thought - the final error says "Permission Error" (followed by some text in a language I'm afraid I don't know). Is your PC locked down in any way that means you might be refused permission to delete files that you created? It's possible that if your file permission settings are unusual, pip is not able to delete a file that it should be able to.

Another possibility is that if you have an aggressive anti-virus program, it could be locking some of pip's working files to scan them. You may want to try turning off your anti-virus program and try again.

pfmoore on 14 Jul 2017

@pfmoore Error 32 is "another process is using the file" .

On Fri, Jul 14, 2017, 13:24 Paul Moore notifications@github.com wrote:

Just one other thought - the final error says "Permission Error" (followed
by some text in a language I'm afraid I don't know). Is your PC locked down
in any way that means you might be refused permission to delete files that
you created? It's possible that if your file permission settings are
unusual, pip is not able to delete a file that it should be able to.

Another possibility is that if you have an aggressive anti-virus program,
it could be locking some of pip's working files to scan them. You may want
to try turning off your anti-virus program and try again.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/pypa/pip/issues/4619#issuecomment-315296385, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ADH7SQ2vqsQlelIe_JRG6jvROVr_5qUlks5sNx6_gaJpZM4OWqBe
.