Electricitymap-contrib: Add Canada

[corradio]

Ontario: http://live.gridwatch.ca/home-page.html

[GuillaumeHo]

In Canada, the provinces have the control of their energy policy, hence the regulation of their electric power. 2 Provinces, Ontario and Alberta switched from regulated prices to an energy market. Here are the provinces and the pages or API I found to follow the production by type of energy and the exchanges with other provinces.

On a federal (=national level) the National Energy Board issues a report every year (here the data for 2015). Could be used to have static data on energy type
https://www.neb-one.gc.ca/nrg/sttstc/lctrct/rprt/2016cndrnwblpwr/2016cndrnwblpwr-eng.pdf

Canada is also good at open data, so in the future if we want maps or positions of plants, electric connexions with the US etc.
http://open.canada.ca/en/open-data

• [x] Alberta
  AESO, Electric System Operator (organises the electric marketplace)
  Very well done page with everything in it
  http://ets.aeso.ca/ets_web/ip/Market/Reports/CSDReportServlet
  Prices : http://ets.aeso.ca/

• [ ] British Columbia
  Very few data on the website on the provincial operator (https://www.bchydro.com/index.html)

  • [x] Found export and import with US and Alberta
    https://www.bchydro.com/energy-in-bc/our_system/transmission/transmission-system/actual-flow-data.html

• [x] Île-du-Prince-Édouard (Prince Edward Island)
  Small Island but good practices : they offer an endpoint for retrieving data in JSON. Only wind + fuel powered generators
  https://ruk.ca/content/open-data-pei-electricity

• [ ] Manitoba
  Not found, nearly 96% in hydroelectricity

• [ ] New-Brunswick
  Production of the province and exchanges with other provinces (no breakdown by type of production)
  https://tso.nbpower.com/Public/en/SystemInformation_realtime.asp

• [x] Nova Scotia
  http://www.nspower.ca/en/home/about-us/todayspower.aspx#%20

• [x] Ontario
  IESO, Electric System Operator (organises the electric marketplace)
  Production of electricity by type of energy, price.
  http://www.ieso.ca/Pages/Power-Data/default.aspx#supply
  or
  http://www.ieso.ca/xml/data/generation_fuel_type_multiday.xml

  • [x] Import/Export: http://reports.ieso.ca/public/IntertieScheduleFlow/PUB_IntertieScheduleFlow_20170420.xml

• [ ] Québec
  Not found, nearly 97% hydroelectricity

• [ ] Saskatchewan
  Not found

• [ ] Newfoundland and Labrador
  https://www.nlhydro.com/system-information/system-information-center/

Three Federal territories

• [ ] Territoires du Nord-Ouest

• [ ] Nunavut
  http://www.nunavutenergy.ca/fr/Syst%C3%A8me_%C3%A9nerg%C3%A9tique_du_Nunavut
  The electricity system only function with imported oil and has 3 solar panels for a few kw. The website can be put in Inuit language. Worth the try.
• [ ] Yukon
  The operator : http://www.atcoelectricyukon.com/
  Provides no data

[corradio]

Sounds terrific! I'll work on preparing the map itself so we have the right topologies.

[jarek]

Hi, I saw that some Canadian data started appearing in Country Ranking and found the region=northamerica page. I would like to contribute a bit to this. Is anyone else working on any Canadian data right now? The Alberta data linked to by Guillaume looks like it'll be easy to integrate.

[corradio]

Go ahead @jarek - would be awesome to have your contribution!
Let me know what you need, or ask us on Slack!

[corradio]

Hey @jarek ? Are you on Slack? (http://slack.tmrow.co). We're preparing a big launch soon and it would be nice if AB would be there!

[jarek]

Sorry @corradio, I ended up having no time so far :( I see mlucchini has done Alberta, congrats! I might try to integrate some other provinces.

I notice there are no capacities for Canada - should they be named with underscore (like NZ-NZN in zones.json) or with dash (like CA_ON.py in parsers)?

[corradio]

Hi @jarek. No worries. Glad we did no do double work :)
Happy to get some capacities :)
They should be named with a dash (like in zones.json).

On Tue, Apr 25, 2017 at 8:13 PM, jarek [e-mail] wrote:

Sorry @corradio https://github.com/corradio, I ended up having no time
so far :( I see mlucchini has done Alberta, congrats! I might try to
integrate some other provinces.

I notice there are no capacities for Canada - should they be named with
underscore (like NZ-NZN in zones.json) or with dash (like CA_ON.py in
parsers)?

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tmrowco/electricitymap/issues/166#issuecomment-297118475,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABlEKByLOPcskTzKLRWgOBw8qF_pwcETks5rzjezgaJpZM4LMJC-
.

[jarek]

There are no links to current generation numbers that I saw, but the "Provinces and Territories" sections of http://peoplepowerplanet.ca/ has a decent overview of electricity/energy sector per province, and might help people trying to figure out what numbers are what or what is roughly correct.

[jarek]

I have also been working off Statistics Canada historical data, which is pretty good. Follow links from http://www5.statcan.gc.ca/cansim/a33?lang=eng&spMode=tables&themeID=1744&pattern=&stByVal=2&RT=TABLE, particularly "Table 127-0002: Electric power generation, by class of electricity producer; monthly (megawatt hour)" and "Table 127-0008: Supply and disposition of electric power, electric utilities and industry; annual"

It doesn't have any real-time data, and the categorization of fossil fuels doesn't line up with electricitymap's (it has e.g. "Conventional steam turbine" and "Combustion turbine" rather than actual fuels), but particularly 127-0002 is pretty good in understanding what each province's supply looks like. Data is up to 2015, in most cases annual and in few cases monthly.

[jarek]

Saving research notes for if anyone else is looking at Ontario:

Per http://www.ieso.ca/learn/ontario-supply-mix/ontario-energy-capacity and http://www.ieso.ca/-/media/files/ieso/document-library/contracted-electricity-supply/progress-report-contracted-supply-q12017.pdf?la=en there is about 1.9 GW of distributed solar (this would include residential rooftop installations) and about 500 MW of distributed wind generation in Ontario. These are not included in the IESO data because that only includes what goes over high-voltage parts of the grid. There appears to be no real-time data or estimate for this production currently, though http://live.gridwatch.ca/total-capacity.html says IESO is working on embedded generation reporting. Per Table 3 in the PDF, distributed generation is about 11.5% of the total capacity, and it's mostly solar.

As there is no real-time data or official estimates, we would have to make our own estimates as to how much the distributed generation is producing. To keep things simple, we're opting against custom estimates for now, and only show what IESO is showing.

[jarek]

We would love to get real-time generation breakdown for Quebec, British Columbia, Manitoba, Saskatchewan, New Brunswick, Newfoundland and Labrador, Nunavut, and Northwest Territories. If anyone knows of sources, or can ask for one to be opened to the public, please contact us!

[HansHyde]

@jarek, @corradio

Updates for Quebec

Possible places to look for realtime data

1. App? - | https://itunes.apple.com/ca/app/hydro-quebec/id1045080947?l=fr&ls=1&mt=8
2. HQ Reliability Coordinator - | http://www.hydroquebec.com/reliability-coordinator/
3. Contact the HQ RC - | https://www.hydroquebec.com/sefco2016/en/reliability-standards.html

Updated capacities - all others not owned by HQ, have contracted feed-in terms into HQ

No. 3 may be worth a shot for @brunolajoie to contact, show off Electricitymap.org and see if we can get access to realtime data. The RC is to the best of my knowledge the system operator (ISO)

Additional info for exchanges to keep in mind -

1. 15 with Ontario, New Brunswick and the U.S. Northeast.
2. 6,025 MW of import capacity
3. 7,974 MW of export capacity

I also added the nuclear plant, although it was closed Dec 28th 2012, with a "comment" linking to more information. Nuclear could be taken off the Quebec table, but maybe reactors recently closed is knowledge worth having - as is possibly "recently closed coal capacity"??? Food for thought...

updates passed in local mockserver, tried to link commits to this issue

[jarek]

@HansHyde - I would keep Churchill Falls in Newfoundland and Labrador for now. Until we have real-time data for either, changes either way are academic. For what it's worth, the aggregate production data from Statistics Canada has Churchill Falls output listed in NL.

I would also not add the QC nuclear power plant. It's not coming back. Similarly Ontario shows 0 coal capacity for "recently closed".

I'm wondering if the opening of Maritime Link is an opportunity to press for real-time data on its operation. Or if they'll rather keep it a secret, as the associated hydro project is beleaguered enough as it is...

[corradio]

@jarek you should probably review https://github.com/tmrowco/electricitymap/pull/942 if you have additional info

[HansHyde]

Hi @jarek
No. 1 - I humbly disagree as a page deeper than the source you pulled original capacities from specifies the terms of Churchill Falls - see image (data I compiled from the source data)

Pulling from Statistics Canada is higher level (almost qualitative data), and would be similar to us getting data from EIA in the US, when we can go to the ISO/RTOs for higher level quantitative data. Good for baseline, but open to further refinement & accuracy.

No. 2 - I agree with you. For a later date, it might be nice to include closed power plants by type & installed capacity within the past 10 years. In a "war on carbon emissions" perspective - nuclear closures could be seen as a negative, coal closures a positive, etc.

No. 3 - Sorry, not looked closely at the Maritime link (trying to sort US regions). Points re:

• Both NE-ISO & NYISO have realtime data on imports, for HQ we know it is >98% hydro, that we could capture (without a Quebec parser) via HQ_imports x Hydro_CO2/kW thru an override in both the US_NEISO & US_NY parsers. But Oli has not been a fan of that approach (making assumptions - even though they are well documented/supported educated decisions). This is going to be necessity in NYISO/PJM exchanges also - contracted capacities x volume, as well as unreported "spinning reserves".
• Shy (possibly Bruno) contacting HQ - Reliability Coordinator and selling EM's purpose to try to get access to HQ's realtime data (see point above), I have 1 contact well respected within the energy circles of Ontario & Quebec which I may tap to see if he would have any luck getting us access to realtime data.

[jarek]

I also asked about assuming co2eq of imports from a zone with unknown imports in #563, there is no easy way to do this right now in the system.

[jarek]

I will close this issue as currently all known real-time information is integrated in Electricity Map. Please reopen if more information is identified or becomes available.

[jarek]

The PEI data source gives only the current data. However, I have just ran across https://energy.reinvented.net/, which is operated by Peter Rukavina (who runs the ruk.ca website linked in the second comment). It contains a scraped CSV archive of the data, every 15 minutes, going back to November 2012. If we are ever interested in getting archive data for PEI, it might be the ticket.

A new API endpoint for PEI data is also named at https://ruk.ca/content/new-api-endpoint-pei-wind, though the old one still seems to work for now.

Minor data point, the interchange between PEI and NB now has capacity of 360 MW per https://www.cbc.ca/news/canada/prince-edward-island/pei-electric-underwater-cable-northumberland-strait-1.4267315 and other similar news stories.

[reinvented]

I was told that the endpoint for Prince Edward Island, at http://www.gov.pe.ca/windenergy/chart-values.php would be deprecated on Oct. 31, 2018. That hasn't happened, but I believe that is still the plan.

Here's the technical information I received about the replacement endpoint:

Wind Energy Endpoint
POST https://wdf.princeedwardisland.ca/prod/workflow

Request Header
Content-Type : application/json

Request Body

{
"featureName": "WindEnergy"
}

Response Body

Note: The decimal value will need to be parsed from the "header" string. At first glance you may think to use actualValue but this is a truncated value for display on the gauge. We are aware of this and will be changing in a future release.

{
"components": [
 {
  "type": 7,
  "data": {
   "actualValue": 198,
   "footer": "",
   "maxValue": 300,
   "header": "Total On-Island Load: 198.46 MW",
   "color": "#008570"
  }
 },
 {
  "type": 7,
  "data": {
   "actualValue": 92,
   "footer": "",
   "maxValue": 200,
   "header": "Wind Power Used On Island: 92.41 MW",
   "color": "#008570"
  }
 },
 {
  "type": 7,
  "data": {
   "actualValue": 188,
   "footer": "",
   "maxValue": 300,
   "header": "Total On-Island Wind Generation: 188.63 MW",
   "color": "#008570"
  }
 },
 {
  "type": 7,
  "data": {
   "actualValue": 96,
   "footer": "",
   "maxValue": 200,
   "header": "Wind Power Exported Off Island: 96.22 MW",
   "color": "#008570"
  }
 },
 {
  "type": 7,
  "data": {
   "actualValue": 0,
   "footer": "",
   "maxValue": 200,
   "header": "Total On-Island Fossil Fuel Generation: 0.00 MW",
   "color": "#008570"
  }
 },
 {
  "type": 5,
  "data": {
   "text": "Last updated October 24, 2018 09:59 AM"
  }
 }
]
}

Sample cURL command

curl -X POST -H 'Content-Type: application/json' -d '{"featureName":"WindEnergy"}' -v -i 'https://wdf.princeedwardisland.ca/prod/workflow'

[jarek]

new PEI endpoint implemented in #1791