Netatmo shouts many errors in the log after running for a while, and stops working. Makes no sense to me what could be wrong. Tought about reporting them now because it doesnt' seem to stop even after a clean install.
arch| armv7l
-- | --
dev | false
docker | true
hassio | true
os_name | Linux
python_version | 3.7.6
timezone | Europe/Amsterdam
version | 0.105.4
virtualenv | false
-->
2020-02-16 08:11:57 WARNING (MainThread) [homeassistant.helpers.entity] Update of camera.netatmo_netatmo_presence_achtertuin is taking over 10 seconds
2020-02-16 08:12:17 ERROR (MainThread) [homeassistant.helpers.entity] Update for camera.netatmo_netatmo_presence_achtertuin fails
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 421, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 416, in _make_request
httplib_response = conn.getresponse()
File "/usr/local/lib/python3.7/http/client.py", line 1344, in getresponse
response.begin()
File "/usr/local/lib/python3.7/http/client.py", line 306, in begin
version, status, reason = self._read_status()
File "/usr/local/lib/python3.7/http/client.py", line 267, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/local/lib/python3.7/socket.py", line 589, in readinto
return self._sock.recv_into(b)
File "/usr/local/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 326, in recv_into
raise timeout("The read operation timed out")
socket.timeout: The read operation timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
timeout=timeout
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 720, in urlopen
method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 400, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.7/site-packages/urllib3/packages/six.py", line 735, in reraise
raise value
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 672, in urlopen
chunked=chunked,
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 423, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 331, in _raise_timeout
self, url, "Read timed out. (read timeout=%s)" % timeout_value
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='api.netatmo.com', port=443): Read timed out. (read timeout=30)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 279, in async_update_ha_state
await self.async_device_update()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 461, in async_device_update
await self.hass.async_add_executor_job(self.update)
File "/usr/local/lib/python3.7/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/src/homeassistant/homeassistant/components/netatmo/camera.py", line 223, in update
self._data.update()
File "/usr/src/homeassistant/homeassistant/util/__init__.py", line 240, in wrapper
result = method(*args, **kwargs)
File "/usr/src/homeassistant/homeassistant/components/netatmo/camera.py", line 282, in update
self.camera_data = pyatmo.CameraData(self.auth, size=100)
File "/usr/local/lib/python3.7/site-packages/pyatmo/camera.py", line 28, in __init__
resp = self.authData.post_request(url=_GETHOMEDATA_REQ, params=postParams)
File "/usr/local/lib/python3.7/site-packages/pyatmo/auth.py", line 119, in post_request
resp = query(url, params, timeout, 3)
File "/usr/local/lib/python3.7/site-packages/pyatmo/auth.py", line 114, in query
return self._oauth.post(url=url, data=params, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 581, in post
return self.request('POST', url, data=data, json=json, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests_oauthlib/oauth2_session.py", line 516, in request
method, url, headers=headers, data=data, **kwargs
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 529, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='api.netatmo.com', port=443): Read timed out. (read timeout=30)
2020-02-16 10:25:12 WARNING (MainThread) [asyncio] socket.send() raised exception.
2020-02-16 10:25:12 WARNING (MainThread) [asyncio] socket.send() raised exception.
2020-02-16 10:25:12 WARNING (MainThread) [asyncio] socket.send() raised exception.
2020-02-16 10:25:12 WARNING (MainThread) [asyncio] socket.send() raised exception.
2020-02-16 10:25:12 WARNING (MainThread) [asyncio] socket.send() raised exception.
Netatmo Prescence
And yet another crash:
2020-02-16 14:37:51 ERROR (MainThread) [homeassistant.helpers.entity] Update for camera.netatmo_netatmo_presence_achtertuin fails
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 485, in wrap_socket
cnx.do_handshake()
File "/usr/local/lib/python3.7/site-packages/OpenSSL/SSL.py", line 1934, in do_handshake
self._raise_ssl_error(self._ssl, result)
File "/usr/local/lib/python3.7/site-packages/OpenSSL/SSL.py", line 1664, in _raise_ssl_error
raise SysCallError(-1, "Unexpected EOF")
OpenSSL.SSL.SysCallError: (-1, 'Unexpected EOF')
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 672, in urlopen
chunked=chunked,
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 376, in _make_request
self._validate_conn(conn)
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 994, in _validate_conn
conn.connect()
File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 360, in connect
ssl_context=context,
File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 370, in ssl_wrap_socket
return context.wrap_socket(sock, server_hostname=server_hostname)
File "/usr/local/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 491, in wrap_socket
raise ssl.SSLError("bad handshake: %r" % e)
ssl.SSLError: ("bad handshake: SysCallError(-1, 'Unexpected EOF')",)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
timeout=timeout
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 720, in urlopen
method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 436, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='prodvpn-eu-5.netatmo.net', port=443): Max retries exceeded with url: /restricted/10.255.243.128/blabladlallalablabla38a19/blablablaMTg3MjQwMDllalalalalalala7UY1uiBZI1OA,,/command/ping (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')")))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 279, in async_update_ha_state
await self.async_device_update()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 461, in async_device_update
await self.hass.async_add_executor_job(self.update)
File "/usr/local/lib/python3.7/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/src/homeassistant/homeassistant/components/netatmo/camera.py", line 229, in update
cid=self._camera_id
File "/usr/local/lib/python3.7/site-packages/pyatmo/camera.py", line 280, in camera_urls
temp_local_url = check_url(vpn_url)
File "/usr/local/lib/python3.7/site-packages/pyatmo/camera.py", line 274, in check_url
resp = self.authData.post_request(url=f"{url}/command/ping")
File "/usr/local/lib/python3.7/site-packages/pyatmo/auth.py", line 119, in post_request
resp = query(url, params, timeout, 3)
File "/usr/local/lib/python3.7/site-packages/pyatmo/auth.py", line 114, in query
return self._oauth.post(url=url, data=params, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 581, in post
return self.request('POST', url, data=data, json=json, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests_oauthlib/oauth2_session.py", line 516, in request
method, url, headers=headers, data=data, **kwargs
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 514, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='prodvpn-eu-5.netatmo.net', port=443): Max retries exceeded with url: /restricted/10.255.243.128/blalalalalalalalala354tegwegw/blablalalalalalal353453463464363OA,,/command/ping (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')")))
2020-02-16 14:38:22 ERROR (MainThread) [homeassistant.helpers.entity] Update for camera.netatmo_netatmo_presence_achtertuin fails
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 485, in wrap_socket
cnx.do_handshake()
File "/usr/local/lib/python3.7/site-packages/OpenSSL/SSL.py", line 1934, in do_handshake
self._raise_ssl_error(self._ssl, result)
File "/usr/local/lib/python3.7/site-packages/OpenSSL/SSL.py", line 1664, in _raise_ssl_error
raise SysCallError(-1, "Unexpected EOF")
OpenSSL.SSL.SysCallError: (-1, 'Unexpected EOF')
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 672, in urlopen
chunked=chunked,
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 376, in _make_request
self._validate_conn(conn)
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 994, in _validate_conn
conn.connect()
File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 360, in connect
ssl_context=context,
File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 370, in ssl_wrap_socket
return context.wrap_socket(sock, server_hostname=server_hostname)
File "/usr/local/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 491, in wrap_socket
raise ssl.SSLError("bad handshake: %r" % e)
ssl.SSLError: ("bad handshake: SysCallError(-1, 'Unexpected EOF')",)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
timeout=timeout
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 720, in urlopen
method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 436, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='prodvpn-eu-5.netatmo.net', port=443): Max retries exceeded with url: /restricted/10.255.243.128/againbalalablalablalalalala/blablablacodelalalalalalalala,,/command/ping (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')")))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 279, in async_update_ha_state
await self.async_device_update()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 461, in async_device_update
await self.hass.async_add_executor_job(self.update)
File "/usr/local/lib/python3.7/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/src/homeassistant/homeassistant/components/netatmo/camera.py", line 229, in update
cid=self._camera_id
File "/usr/local/lib/python3.7/site-packages/pyatmo/camera.py", line 280, in camera_urls
temp_local_url = check_url(vpn_url)
File "/usr/local/lib/python3.7/site-packages/pyatmo/camera.py", line 274, in check_url
resp = self.authData.post_request(url=f"{url}/command/ping")
File "/usr/local/lib/python3.7/site-packages/pyatmo/auth.py", line 119, in post_request
resp = query(url, params, timeout, 3)
File "/usr/local/lib/python3.7/site-packages/pyatmo/auth.py", line 114, in query
return self._oauth.post(url=url, data=params, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 581, in post
return self.request('POST', url, data=data, json=json, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests_oauthlib/oauth2_session.py", line 516, in request
method, url, headers=headers, data=data, **kwargs
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 514, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='prodvpn-eu-5.netatmo.net', port=443): Max retries exceeded with url: /restricted/10.255.243.128/fakedatatbalalalalalalalalala/Evenmorelalalalalalalalalala,,/command/ping (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')")))
2020-02-16 14:40:56 ERROR (MainThread) [homeassistant.helpers.entity] Update for camera.netatmo_netatmo_presence_achtertuin fails
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 485, in wrap_socket
cnx.do_handshake()
File "/usr/local/lib/python3.7/site-packages/OpenSSL/SSL.py", line 1934, in do_handshake
self._raise_ssl_error(self._ssl, result)
File "/usr/local/lib/python3.7/site-packages/OpenSSL/SSL.py", line 1664, in _raise_ssl_error
raise SysCallError(-1, "Unexpected EOF")
OpenSSL.SSL.SysCallError: (-1, 'Unexpected EOF')
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 672, in urlopen
chunked=chunked,
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 376, in _make_request
self._validate_conn(conn)
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 994, in _validate_conn
conn.connect()
File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 360, in connect
ssl_context=context,
File "/usr/local/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 370, in ssl_wrap_socket
return context.wrap_socket(sock, server_hostname=server_hostname)
File "/usr/local/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 491, in wrap_socket
raise ssl.SSLError("bad handshake: %r" % e)
ssl.SSLError: ("bad handshake: SysCallError(-1, 'Unexpected EOF')",)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
timeout=timeout
File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 720, in urlopen
method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 436, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='prodvpn-eu-5.netatmo.net', port=443): Max retries exceeded with url: /restricted/10.255.243.128/againlalalalalalalalalalala/blalalalalalalalalalalalal,,/command/ping (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')")))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 279, in async_update_ha_state
await self.async_device_update()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 461, in async_device_update
await self.hass.async_add_executor_job(self.update)
File "/usr/local/lib/python3.7/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/src/homeassistant/homeassistant/components/netatmo/camera.py", line 229, in update
cid=self._camera_id
File "/usr/local/lib/python3.7/site-packages/pyatmo/camera.py", line 280, in camera_urls
temp_local_url = check_url(vpn_url)
File "/usr/local/lib/python3.7/site-packages/pyatmo/camera.py", line 274, in check_url
resp = self.authData.post_request(url=f"{url}/command/ping")
File "/usr/local/lib/python3.7/site-packages/pyatmo/auth.py", line 119, in post_request
resp = query(url, params, timeout, 3)
File "/usr/local/lib/python3.7/site-packages/pyatmo/auth.py", line 114, in query
return self._oauth.post(url=url, data=params, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 581, in post
return self.request('POST', url, data=data, json=json, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests_oauthlib/oauth2_session.py", line 516, in request
method, url, headers=headers, data=data, **kwargs
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 533, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 514, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='prodvpn-eu-5.netatmo.net', port=443): Max retries exceeded with url: /restricted/10.255.243.128/aaaaghagainbllalalalalalalala/Andtelastalalalalalalalalalala,,/command/ping (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')")))
Hey there @cgtobi, mind taking a look at this issue as its been labeled with a integration (netatmo) you are listed as a codeowner for? Thanks!
@YRRK thanks for reporting. I'll take a look to handle this more gracefully.
@YRRK Let me know if you can test a fix for this on your system. You can find me on discord.
@YRRK Let me know if you can test a fix for this on your system. You can find me on discord.
oowww testing. Hmm I need to order an extra SDcard before I do that. I don't wanna use my current running system for testing. Just a moment for that. So you found something wrong? I have no idea where te logs are complaining about.
Don't worry, I've pushed a new version to the testers group.
Oh bummers. Did anyone ever added 2 Netatmo Presence camera's to Home Assistant? Loads of errors when I did that. Don't even know where to begin. Even afer re-installing I get different results. But the errors are mixing with the above errors. Is there an update expected about this issue soon?
Yes, I know of setups with multiple cameras. A new version is on the horizon.
Ahhhh it took 2 days' before suddenly the 2nd Netatmo camera appears in HomeAssistant. Reinstalls, many reboots didn't contribute to getting it working. And suddenly... weird :-)
Errors are on going. Waiting patienly on the new version :-)
Update of binary_sensor.netatmo_presence_blabla_outdoor_human is taking over 10 seconds
7:31:10 AM – __main__.py (WARNING)
Update of binary_sensor.netatmo_presence_blabla2_outdoor_human is taking over 10 seconds
7:30:39 AM – __main__.py (WARNING) - message first occurred at 4:11:39 AM and shows up 3 times
Update for binary_sensor.netatmo_presence_blabla_outdoor_human fails
7:11:53 AM – components/netatmo/camera.py (ERROR) - message first occurred at 4:11:59 AM and shows up 2 times
Update for binary_sensor.netatmo_presence_blabla2_outdoor_human fails
5:03:55 AM – components/netatmo/camera.py (ERROR)
Updating netatmo binary_sensor took longer than the scheduled update interval 0:00:30
4:11:59 AM – Binary sensor (WARNING)
Please set the logging for the netatmo integration to debug to gather further information.
Since where now in HomeAssistant update 107. The integration is updated and so the code is different and so probably the above is faults are not accurate anymore. Shall we close this issue? Lets try the new updated version.
Binary sensors have been removed in favour of webhooks anyway.
Yeah too bad the sensors are gone :( I used them to bypass the terrible Netatmo app who’s incapable of not-sending messages when you’re at home. I routet the human-movement sensors of Netatmo via HomeAssistant to HomeKit so HomeKit could message me when I’m actually not at home due it’s presence detection. :)
The same can be done with the webhook based events with the additional benefit of being much quicker.
The same can be done with the webhook based events with the additional benefit of being much quicker.
I'm now replying on the wrong isse, this one is closed. But you're posting here so that's why i reply here. I would like to comment on it one more time: In the documentation your say:
To be able to receive events from Netatmo, your Home Assistant instance needs to be accessible from the web.
Hmm this is is a no go. Not all users open their homeassistant to the web, because you really need to know what you're doing and homeassistant is still cutting edge tech. really need to consider it not fully secured yet. There is almost no data on security updates or firewall (does it even have a firewall, can it stop ddos?) So some people use Apple's homekit-bridge to couple their sensors and stuff to the outside world via their ecosystem, or use nabucasa, or VPN.
So that's a pity since the netatmo sensors where there from the beginning, to use easily :-) But I understand you have limited time, so I take my loss :-) Thanks for your time!
@YRRK I understand that people might not want to expose their instance to the web (directly or indirectly). That is why Nabu Casa is a great option. Webhooks only work with an http(s) endpoint, so there is no way around (that I'm aware of).
Bringing back the binary sensors is not a technical challenge, but I think they are simply not reliable enough. The API has a limit of allowed calls per hour and we need to reduce the number of times we poll it. This would make the already lagging binary sensors even less reliable. Imagine the binary sensors updating only every 5-10 minutes, how much values would that provide? You would probably miss most events during that time.
Most helpful comment
@YRRK thanks for reporting. I'll take a look to handle this more gracefully.