Pip: 'utf8' encoding not found

[AurangZ]

• Pip version: 9.0.0
• Python version: 2.7.12
• Operating System: Ubuntu 16.04.1 LTS xenial

Description:

I tried to run Django makemessages with the latest version of pip and it gives me the following error
./lib/python2.7/site-packages/pip/_vendor/webencodings/__init__.py:1: Unknown encoding "utf8". Proceeding with ASCII instead.

xgettext: ./lib/python2.7/site-packages/pip/_vendor/webencodings/__init__.py:1: Unknown encoding "utf8". Proceeding with ASCII instead.
xgettext: Non-ASCII string at ./lib/python2.7/site-packages/pip/_vendor/webencodings/__init__.py:64.
          Please specify the source encoding through --from-code or through a comment
          as specified in http://www.python.org/peps/pep-0263.html.

[dstufft]

This appears to be a bug with https://github.com/gsnedders/python-webencodings.

[AurangZ]

Thanks, I opened an issue in there.
https://github.com/gsnedders/python-webencodings/issues/8

[di]

It seems like the problem is that xgettext does not assume utf8 is an alias for utf-8.

@AurangZ, have you tried doing what the error message suggests? Specifically, passing xgettext a --from-code=UTF-8 flag.

[AurangZ]

@di Thanks for your response.
xgettext is getting called inside django's manage.py makemessages command. I don't see how I can pass parameters to xgettext.

[di]

@AurangZ It seems like https://pypi.python.org/pypi/django-makemessages-xgettext might help you.

[AurangZ]

Thanks @di. I'll see how I can use the new makemessage package.

I don't have this issue with pip 8.1.2. Is there something changed related to xgettext?

[di]

@AurangZ The reason is because pip did not vendor python-webencodings before 9.0.0.

[AurangZ]

I see. Thanks @di.

I guess the ultimate fix is to fix this in webencoding and import the fix into the pip. Should we close this ticket? or keep it open until the new changes from webencoding is merged? I'll let you decide.

If django-makemessage-xgettext was successful I report back here on this ticket.
Because I am very close to a deadline, for now I am going to keep using 8.1.2 though.

[di]

@AurangZ Sorry for the late reply. I made https://github.com/gsnedders/python-webencodings/pull/9 to fix this in python-webencodings, let's leave this issue open until that PR is merged, released, and vendored into pip.

[AurangZ]

Thanks @di

[dstufft]

This appears to have been merged, and is now just waiting on a release.

[MaGaroo]

I've encountered the same problem some minutes ago. Is it really OK? :-"
I'm using pip 9.0.1, Django 2.0.2, Python 3.6 on Ubuntu 17.10

[toptalo]

Same issue
Django 1.9.6
pip 9.0.3
Python 2.7.10
macOS 10.13.4 (17E199)

[johanna]

What worked for me was using the -i flag to ignore my virtualenv:

python manage.py makemessages -l 'sv' -i venv

[lock[bot]]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.