Electricitymap-contrib: US-MIDW-MISO: Reporting negative unknown production

[FelixDQ]

This seems to happen around ~6 to 11 am UTC every day.

From Kibana:

invalid point: {'zoneKey': 'US-MIDW-MISO', 'datetime': datetime.datetime(2020, 10, 9, 23, 30, tzinfo=tzfile('/usr/share/zoneinfo/America/New_York')), 'production': {'coal': 14997.0, 'gas': 16936.0, 'nuclear': 8028.0, 'wind': 13199.0, 'solar': 0.0, 'unknown': -268.0}, 'storage': {}, 'source': 'misoenergy.org', 'schemaVersion': 3}, reason:US-MIDW-MISO: key unknown has negative value -268.0

I don't know if this is a bug in the parser or if there something wrong with the data source.

[thtomate]

_Other_ contains pumped storage, according to the website and they really have pumped storage (https://en.wikipedia.org/wiki/Ludington_Pumped_Storage_Power_Plant), so negative values can be valid data.
We just need to move them to storage

[tth4vb]

Maybe we can have a check that reclassifies negative production as storage then?

[systemcatch]

This came up before in #1482

[FelixDQ]

Do we know if this problem is also present in the EIA parser?

It wouldn't be ideal to switch to EIA because then we wouldn't be able to display live data, but it also isn't ideal to have ~5 hours of missing data every day. What are your thoughts?

[systemcatch]

I don't see any negative production in the EIA data for MISO-Other however they may count things differently.

Quoting @jarek from the old issue for a possible solution.

An alternative is to dig up statistical data on what actually makes up this "unknown" category over longer periods of time. MISO might have it on their website... Unfortunately I don't have time to go searching at the moment.

Last couple of days MISO hasn't gone negative overnight, it looks like this as a sample:

I'm not really a fan of switiching to EIA data which lags and is less detailed.