Covid_19: AG scraper with wrong date

Created on 28 Mar 2020  路  2Comments  路  Source: openZH/covid_19

Today the scraper added a new entry with the same numbers as yesterday. When checking the website, these numbers were not there.

But the scraper code extracts the first entry in the timeline and then proceeds to get the first numbers on the page (in this case from yesterday). So they were erroneously assigned with todays date.

bug
Source
picture metaodi

All 2 comments

Looking into it.

fabian picture fabian on 28 Mar 2020
👎1 👍1

It looks like the code is not very smart, and captures numbers from different days.

The solution would be to find most recent article with numbers, then download only the one article, and parse it. We do similar thing few other scrapers.

baryluk picture baryluk on 28 Mar 2020
Was this page helpful?
0 / 5 - 0 ratings

Related issues

dominikgehl picture dominikgehl  路  6Comments
andreasamsler picture andreasamsler  路  3Comments
ebeusch picture ebeusch  路  3Comments
jb3-2 picture jb3-2  路  6Comments
baryluk picture baryluk  路  3Comments