Datasets: Downloaded datasets are not usable offline
I've been trying to use the IMDB dataset offline, but after downloading it and turning off the internet it still raises an error from the requests library trying to reach for the online dataset.
Is this the intended behavior ?
(Sorry, I wrote the the first version of this issue while still on nlp 0.3.0).
ghazi-f
>All comments
Yes currently you need an internet connection because the lib tries to check for the etag of the dataset script online to see if you don't have it locally already.
If we add a way to store the etag/hash locally after the first download, it would allow users to first download the dataset with an internet connection, and still have it working without an internet connection.
I'll let you know when we add this feature.
lhoestq
on 27 Oct 2020
👍4
Was this page helpful?
0 / 5 - 0 ratings
Related issues
astariul
路
3Comments
thomwolf
路
4Comments
david-waterworth
路
3Comments
mrm8488
路
5Comments
jplu
路
5Comments
Most helpful comment
Yes currently you need an internet connection because the lib tries to check for the etag of the dataset script online to see if you don't have it locally already.
If we add a way to store the etag/hash locally after the first download, it would allow users to first download the dataset with an internet connection, and still have it working without an internet connection.
I'll let you know when we add this feature.