Incubator-superset: Choose encoding when export csv

[kylozw]

Is there any plan to add this feature that I can choose encoding when export csv?
Because Excel uses the ansi to open the csv files, Chinese is mess code.

[xrmx]

We should just probably export the csv encoded in utf-8. Isn't this the case? If so and excel cannot handle it, that's an excel issue. Btw what do you mean with ansi?

[kylozw]

You're right, it's an excel issue. But the truth is, people not familiar with encoding will always use excel to open csv. So I think maybe it's better to let them choose encoding(gbk) which I tell them to when exporting csv.

[HugoPu]

You can add utf8 file header manually, to tell software decode it with utf8
header = bytes(b'\xEF\xBB\xBF').decode('utf-8')
return Response(
header+payload,
status=200,
headers=generate_download_headers("csv"),
mimetype="application/csv")

[mistercrunch]

PR welcomed!

[JulieRossi]

We are having issues with csv default encoding (and default separator as well) too.

Would you be interested in a PR that allows to choose csv encoding and separator using the config.py ?

We were thinking about adding two variables in config.py (CSV_SEP and CSV_ENCODING) to be able to change the default way of writing CSV (values would be retrieved when calling to_csv method).

Does it sound right to you ?

[ashdaka]

I tried to adding the CSV_ENCODING in config.py like #3441, In Python3.5 it doesn't work，however in Python2.7 it works well.
It seems that Pandas IO tool "to_csv" ignores encoding argument in Python3.

[JulieRossi]

Yes I noticed this too ... I am planning on issuing a new PR (today) to fix this using flask Response encoding.

[chengwei1231]

I modify config.py:
CSV_EXPORT = {
'encoding': 'gbk',
}

But it doesn't work.Using vim to view the downloaded file:
fileencoding=utf-8

Do I have an operation in error?

[wutengyue]

now if you solve this problem? i am in this trouble now. @chengwei1231

[chuancyzhang]

now if you solve this problem? i am in this trouble now. @chengwei1231

in /views/core.py, i change Response to CsvResponse.
eg:
response = CsvResponse(csv, mimetype='text/csv')

[ohoroyoi]

@chuancyzhang Could you explain more detail? you mean def generate_json??

[fortmate]

For those who are still suffering from csv export encoding matters,
Try editting /views/core.py
Look for the term
'Responce(csv,'
You'll find it under def csv.
Add 'Csv' in front of the term to show like
'CsvResponse(csv,'
Save it and add below lines to your Superset_config.py:
CSV_EXPORT = {
'encoding': 'utf_8_sig',
}

The encoding should be changed accodingly to your requirement.
Then run superset init and restart.
Now you should be able to download properly encoded csvs.