Twint: Month Scrape Limit

Created on 12 Apr 2018  路  6Comments  路  Source: twintproject/twint

It seems tweet scraping is limited to a month back from the specified date, even when using the following commands:

python twint.py -u BBC --since 2006-03-21 -o BBC.csv --csv
python twint.py -u BBC --since 2006-03-21 --until 2017-06-01 -o BBC.csv --csv

This might be an issue, or am I overlooking an option?

I am running Twint on Windows 10, with Python 3.6.4 (Anaconda 64 bit).

bug

Most helpful comment

Thanks for the fix! This is a nifty piece of software

All 6 comments

I have the same problem with Twint while the previous Tweep release seems to work with older posts

Hi all and thanks for reporting,

in the while _since < _until loop, after else remove break . This should fix the problem.

I firstly added the feature as this, but maybe this breaks the code somehow with the newest features (since a break was added). I'm going to fix this.

I have a quick fix, will update in a few mins

Fixed in this commit

Opted for a seperate loop

Thanks for the fix! This is a nifty piece of software

Thank you :)

Was this page helpful?
0 / 5 - 0 ratings