Cannot handle non-ASCII characters about isort HOT 4 CLOSED

Thanks for reporting this issue! The problem has been verified and it will be resolved in the next point release

from isort.

cool! that's what I wanner talking about. 🎯

from isort.

This has been fixed in release 1.3.1, Thanks!

from isort.

Hi!

Sorry to re-open such an old thread.

I just ran into this problem when running isort on OSX yosemite, with python 3.4.2 and isort 3.9.4

The problems seems to be that OSX doesn't have LANG set to anything by default, so when isort opens the file to check (line 94), it doesn't specify an encoding, which then default to "ASCII" on OSX.

If LANG is set to something like en_US.UTF-8 the problem goes away, but will break in systems where for any reason changing the locale is not an option.

The second link I put here talks about a “Unicode sandwich” approach. That might solve the problem.

http://robjwells.com/post/61198832297/get-your-us-ascii-out-of-my-face
http://nedbatchelder.com/text/unipain.html

Traceback (most recent call last):
  File "/Users/fjm/Development/acora_dj/venv/bin/isort", line 11, in <module>
    sys.exit(main())
  File "/Users/fjm/Development/acora_dj/venv/lib/python3.4/site-packages/isort/main.py", line 119, in main
    incorrectly_sorted = SortImports(file_name, **arguments).incorrectly_sorted
  File "/Users/fjm/Development/acora_dj/venv/lib/python3.4/site-packages/isort/isort.py", line 95, in __init__
    file_contents = file_to_import_sort.read()
  File "/usr/local/Cellar/python3/3.4.2_1/Frameworks/Python.framework/Versions/3.4/lib/python3.4/encodings/ascii.py", line 26, in decode
    return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 2709: ordinal not in range(128)

from isort.