Electricitymap-contrib: Hawaii

[corradio]

Data is shown here as an image. Maybe someone can contact them?

https://www.hawaiianelectric.com/clean-energy-hawaii/integration-tools-and-resources/renewable-watch

[jarek]

I contacted them in August, no luck. See details in comment for #143 on 9 August 2017 (https://github.com/tmrowco/electricitymap-contrib/issues/143#issuecomment-321346838)

[jarek]

For what it's worth, I tried OCRing the images with tesseract, but only got gibberish back. With some optimisations, we could _maybe_ parse out the current solar/wind production number, but the overall production/load is only available as a line in the chart.

I would suggest closing this issue, unless someone has a contact at Hawaiian Electric they can ask for more open data.

[jarek]

I don't believe this issue is worth keeping open. Please reopen if useful real-time data becomes available.

[corradio]

I had a very good call with the person that set up the tool (https://www.hawaiianelectric.com/clean-energy-hawaii/integration-tools-and-resources/renewable-watch). Will follow up with more info.

[jarek]

Any updates on Hawaii @corradio ?

[corradio]

Unfortunately none. I tried re-contacting but without luck

On Wed, Oct 31, 2018 at 11:49 AM jarek [e-mail] wrote:

Any updates on Hawaii @corradio https://github.com/corradio ?

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tmrowco/electricitymap-contrib/issues/814#issuecomment-434642384,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABlEKGwYlCQx2LmMho9n1HfOoFrJGtD7ks5uqYBOgaJpZM4QOHNL
.

[jarek]

I'm going to close it again since we don't have data. On upside, these current "renewable watch" images on https://www.mauielectric.com/clean-energy-hawaii/integration-tools-and-resources/renewable-watch seem to be screenshots of Windows 7 machines so maybe they'll be upgrading the system soon when Windows 7 support runs out and they provide an API then...

[kepiej]

I came across this website https://www.islandpulse.org/ which provides an overview of the energy production by energy mix in realtime (updates approx. every 30min) for the Oahu island of Hawaii. The data is provided by Hawaiian Electric.

I was able to find out where the data comes from (all the way back to December 2013):

• Energy mix : https://www.islandpulse.org/api/mix
• Energy usage: https://www.islandpulse.org/api/usage
• High and low energy usage per week: https://www.islandpulse.org/api/highlow

These URLS accept "date" and "limit" parameters to filter on specific dates or limit the number of returned results. E.g.,:

• https://www.islandpulse.org/api/mix?date=2019-06-13
• https://www.islandpulse.org/api/mix?date=2019-06-13&limit=1
• https://www.islandpulse.org/api/usage?limit=2

I guess this data would be sufficient to add Oahu island to the map? :)

[jarek]

Timezones need investigating (most data points in https://www.islandpulse.org/api/mix do not specify timezone, and https://www.islandpulse.org/ gave me "We Were Using 665 Megawatts At 8:30am" at 9:30 am EDT (3:30 Oahu time) but looks promising!

[systemcatch]

As far as I can tell Oahu doesn't have interconnections with the other islands, so I might take a crack at this in the near future.

[kepiej]

@systemcatch Great! I already gave it a go over the weekend. This parser fetches the most recent mix and wraps it in the necessary structure. I attach the file so it might possibly serve as a starting point for you. :)
US_HI.txt
I wasn't able to work on it further, because I have problems with getting Docker to work on Windows (it exits after trying to run "RUN bash topogen.sh").

As @jarek already mentioned there is something weird with the timestamp returned by https://www.islandpulse.org/api/mix?limit=1 . However, if you compare this with the results of energy usage (which seem to have correct timestamps) from https://www.islandpulse.org/api/usage?limit=6 then the numbers do add up!
I'm not sure whether we should just "fix" the timestamp manually in the parser?

Finally, the site of Hawaiian Electric does provide a nice map with the generation capacities on Oahu island:

[systemcatch]

@kepiej does docker show an error message? It seems like the first mix datapoint always contains a timestamp with a different format to the others, e.g. 2019-06-20T08:00:00.000Z in https://www.islandpulse.org/api/mix?limit=5

[kepiej]

@kepiej does docker show an error message? It seems like the first mix datapoint always contains a timestamp with a different format to the others, e.g. 2019-06-20T08:00:00.000Z in https://www.islandpulse.org/api/mix?limit=5

Sorry for my slow response. Running Docker on windows fails when it comes to the step "RUN bash topogen.sh":

"Service 'web' failed to build: the command '/bin/sh -c bash topogen.sh' returned a non-zero code 2."
The error is: "invalid option nameet: pipefail".

A quick search came up with this stackoverflow question: https://stackoverflow.com/questions/54055549/linux-ubuntu-set-illegal-option-o-pipefail#
I don't know how to resolve this with Docker though.

[corradio]

you need to change the line endings of topogen.sh (try between CR and
CRLF). I think it's a windows thing.

On Sun, Jul 14, 2019 at 6:19 PM Pieter Jan Kerstens <
[email protected]> wrote:

@kepiej https://github.com/kepiej does docker show an error message? It
seems like the first mix datapoint always contains a timestamp with a
different format to the others, e.g. 2019-06-20T08:00:00.000Z in
https://www.islandpulse.org/api/mix?limit=5

Sorry for my slow response. Running Docker on windows fails when it comes
to the step "RUN bash topogen.sh":

"Service 'web' failed to build: the command '/bin/sh -c bash topogen.sh'
returned a non-zero code 2."
The error is: "invalid option nameet: pipefail".

A quick search came up with this stackoverflow question:
https://stackoverflow.com/questions/54055549/linux-ubuntu-set-illegal-option-o-pipefail#
I don't know how to resolve this with Docker though.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tmrowco/electricitymap-contrib/issues/814?email_source=notifications&email_token=AAMUIKFUBCG75HEGJST57GLP7NGYFA5CNFSM4EBYONF2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODZ4ISZA#issuecomment-511215972,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAMUIKC2RQPUM67EZAMZETDP7NGYFANCNFSM4EBYONFQ
.

--

Olivier Corradi

Founder, CEO

https://www.linkedin.com/in/oliviercorradi https://twitter.com/corradio

tmrow.com

[systemcatch]

@kepiej If the Windows thing is stopping you then just make a PR and one of us can build the branch instead.

[kepiej]

Thanks for the help! I got Docker working on Windows. :) I opened a pull request #1900 that implements the basic parser for realtime data.
Still to do:

• Split up the Hawaii islands: the data is only for the Oahu island. I don't know how to do this.
• Implement parser for historical data. I'll do this later when I find the time.

[robertahunt]

Closing as I think this is solved for now?