Core: Zwave not starting up

[faspina]

Zwave devices set to unavailable. other not responding

Environment

• Home Assistant release with the issue: 0.107.0
• Last working Home Assistant release (if known): 0.106.x tried going back but no luck
• Operating environment (Hass.io/Docker/Windows/etc.): Unraid docker
• Integration causing this issue: zwave
• Link to integration documentation on our website:

Problem-relevant configuration.yaml

zwave:
usb_path: /dev/ttyACM0
network_key: !secret network_key

Traceback/Error logs

2020-03-21 08:41:48 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 14 not ready after 30 seconds, continuing anyway
2020-03-21 08:41:48 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 14 Sensor (node_id: 14) not ready after 30 seconds, continuing anyway
2020-03-21 08:41:49 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 36 not ready after 30 seconds, continuing anyway
2020-03-21 08:41:49 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 36 Sensor (node_id: 36) not ready after 30 seconds, continuing anyway

Additional information

[faspina]

More info
2020-03-21 08:46:17 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave not ready after 300 seconds, continuing anyway
2020-03-21 08:48:21 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave not ready after 300 seconds, continuing anyway

[faspina]

Here is my ozw_log

OZW Log

[chrisakens]

Having same issue. Logs are essentially identical

Running docker on debian.

Was working fine in 106.x. Tried rolling back to 106.x, was unsuccessful.

[probot-home-assistant[bot]]

Hey there @home-assistant/z-wave, mind taking a look at this issue as its been labeled with a integration (zwave) you are listed as a codeowner for? Thanks!

[faspina]

Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/openzwave/network.py", line 950, in zwcallback
self._handle_value_added(args)
File "/usr/local/lib/python3.7/site-packages/openzwave/network.py", line 1480, in _handle_value_added
'value' : self.nodes[args['nodeId']].values[args['valueId']['id']]})
File "/usr/local/lib/python3.7/site-packages/pydispatch/dispatcher.py", line 338, in send
*named
File "/usr/local/lib/python3.7/site-packages/pydispatch/robustapply.py", line 55, in robustApply
return receiver(arguments, **named)
File "/usr/src/homeassistant/homeassistant/components/zwave/__init__.py", line 422, in value_added
hass, schema, value, config, device_config, registry
File "/usr/src/homeassistant/homeassistant/components/zwave/__init__.py", line 1035, in __init__
self._check_entity_ready()
File "/usr/src/homeassistant/homeassistant/components/zwave/__init__.py", line 1094, in _check_entity_ready
component, DOMAIN, compute_value_unique_id(self._node, self.primary)
File "/usr/src/homeassistant/homeassistant/helpers/entity_registry.py", line 128, in async_get_entity_id
for entity in self.entities.values():
RuntimeError: OrderedDict mutated during iteration

[chrisakens]

Having similar issue where all zwave devices are unavailable. Aside from the 'node not ready' and 'response not received' errors there dont appear to be any logs indicating actual program to me

logs below. aside from

OZW_LOG.txt --> https://pastebin.com/pg12kTNe
home-assistant.log --> https://pastebin.com/bHGdTZH7

[chrisakens]

i removed zwave integration, restarted HA, re-added zwave integration - my zwave network came back and i was able to re-add nodes one by one. Something got corrupted or changed in a recent update as no other configuration changes were made.

[edwinvandalen]

same problem here.
rolling back to 0.106.2 brought everything back to life, for the time being...
thank God for automatic snapshots :-)

[chrisakens]

i ended up finding a 106.2 backup as well and reverted to that. All of my zwave nodes came back as expected.

Removing/re-adding the zwave integration resulted in a bunch of nodes not being found, different names. Was easier to go backwards to 106

[frenck]

An issue with Z-Wave has been addressed in 0.107.6, which made my devices all come back up again.

@faspina Can you let us know if this works for you?

[faspina]

I went back to 106.6 back up got it working then did a test upgrade to 107.5 and everything was fine.

[Betanu701]

The latest 0.107.6 breaks zwave. It seems to remove the driver but does not reinstall
From OZW_Log.txt right after install of 107.6

2020-03-25 01:45:50.436 Info, mgr, Manager::WriteConfig completed for driver with home ID of 0xd020c1f3
2020-03-25 01:45:51.471 Info, mgr, Driver for controller /dev/ttyACM0 pending removal
2020-03-25 01:45:51.471 Detail, Notification: DriverRemoved
2020-03-25 01:45:51.471 Always, ************************
2020-03-25 01:45:51.471 Always, ***** Cumulative Network Statistics *****
2020-03-25 01:45:51.471 Always, General
2020-03-25 01:45:51.471 Always, Driver run time: . . . 0 days, 0 hours, 20 minutes
2020-03-25 01:45:51.471 Always, Frames processed: . . . . . . . . . . . . . . . . . . . . 161
2020-03-25 01:45:51.471 Always, Total messages successfully received: . . . . . . . . . . 161
2020-03-25 01:45:51.471 Always, Total Messages successfully sent: . . . . . . . . . . . . 37
2020-03-25 01:45:51.471 Always, ACKs received from controller: . . . . . . . . . . . . . 64
2020-03-25 01:45:51.471 Always, Errors
2020-03-25 01:45:51.472 Always, Unsolicited messages received while waiting for ACK: . . 0
2020-03-25 01:45:51.472 Always, Reads aborted due to timeouts: . . . . . . . . . . . . . 0
2020-03-25 01:45:51.472 Always, Bad checksum errors: . . . . . . . . . . . . . . . . . . 0
2020-03-25 01:45:51.472 Always, CANs received from controller: . . . . . . . . . . . . . 0
2020-03-25 01:45:51.472 Always, NAKs received from controller: . . . . . . . . . . . . . 0
2020-03-25 01:45:51.472 Always, Out of frame data flow errors: . . . . . . . . . . . . . 0
2020-03-25 01:45:51.472 Always, Messages retransmitted: . . . . . . . . . . . . . . . . . 0
2020-03-25 01:45:51.472 Always, Messages dropped and not delivered: . . . . . . . . . . . 9
2020-03-25 01:45:51.472 Always, ************************
2020-03-25 01:45:51.474 Detail, WriteMsg Wait Timeout m_currentMsg=00000000
2020-03-25 01:45:51.516 Info, mgr, Driver for controller /dev/ttyACM0 removed
2020-03-25 01:45:52.517 Error, mgr, Manager::GetDriver failed - Home ID 0xd020c1f3 is unknown
2020-03-25 01:45:52.517 Warning, Exception: Manager.cpp:373 - 100 - Invalid HomeId passed to GetDriver
2020-03-25 01:45:52.517 Info, mgr, GetSendQueueCount() failed - _homeId -803159565 not found

[kpine]

@Betanu701 those specific messages do not indicate any problem. They are normal when you stop HA or stop the Z-Wave network.

[chrisakens]

I will echo was @faspina said. I reverted to a known good 0.106.2 backup, zwave was fine. I spun up a new docker from 0.106.2 to 0.107.6 and zwave was fine.

[Betanu701]

@kpine Fair enough. I reverted to 107.5 backup I had. I am not sure what killed the z wave component though. If there is anything you need me to try, I can try to recreate it again. Let me know. Otherwise. I will probably wait till 108 and try to do a full upgrade at that point.

Thanks for your time!

[SirGoodenough]

I am at 0.107.5 running fine and went to do the config checker before loading 0.107.7 and the config checker blows up on the zwave install. I will try to actually install it but am ready to fall back if needed. I see that 0.107.6 installed a new zwave software version, IE

Bump OZW fork to 0.1.10 (@pvizeli - #33205) (zwave docs)
My configuration yaml:

  usb_path: /dev/ttyACM0
  network_key: !secret Zwave_Secure_Key

### UPDATE: I added another open issue (#33370) to cover this as it appears to be a configuration checker addon issue, not zwave specific....

I did install but not configure a conbeeII since last did config check, so will remove that and try again.
I think that was showing as ttyACM1
This is the log from config checker. I ran it several times. It looks like it's trying to build but the make file is missing...

ERROR:homeassistant.util.package:Unable to install package homeassistant-pyozw==0.1.10: ERROR: Command errored out with exit status 1:
   command: /usr/local/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py'"'"'; __file__='"'"'/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'

'"'"', '"'"'
'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-us8oql94 --python-tag cp37
       cwd: /tmp/pip-install-w6p5j7v3/homeassistant-pyozw/
  Complete output (17 lines):
  sysargv ['/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py', 'bdist_wheel', '-d', '/tmp/pip-wheel-us8oql94', '--python-tag', 'cp37']
  Found SETUP_DIR : /tmp/pip-install-w6p5j7v3/homeassistant-pyozw
  <pyozw_setup.EmbedTemplate object at 0x7f9234451290>
  {'name': 'libopenzwave', 'sources': ['openzwave-embed/open-zwave-hass/python-openzwave/src-lib/libopenzwave/libopenzwave.cpp'], 'include_dirs': ['src-lib/libopenzwave/', 'openzwave-embed/open-zwave-hass/cpp/src', 'openzwave-embed/open-zwave-hass/cpp/src/value_classes', 'openzwave-embed/open-zwave-hass/cpp/src/platform', 'openzwave-embed/open-zwave-hass/cpp/build/linux'], 'define_macros': [('PY_LIB_VERSION', '0.1.10'), ('PY_SSIZE_T_CLEAN', 1), ('PY_LIB_FLAVOR', 'embed'), ('PY_LIB_BACKEND', 'cpp')], 'libraries': ['udev', 'stdc++', 'resolv'], 'extra_objects': ['openzwave-embed/open-zwave-hass/libopenzwave.a'], 'extra_compile_args': [], 'extra_link_args': [], 'language': 'c++'}
  ['six', 'PyDispatcher>=2.0.5']
  running bdist_wheel
  running build
  running build_openzwave
  Found g++ : None
  Found gcc : None
  Found make : None
  Found gmake : None
  Found cython : None
  Found pkg-config : None
  fetching https://raw.githubusercontent.com/home-assistant/python-openzwave/hass/archives/open-zwave-hass-0.1.10.zip into openzwave-embed/open-zwave.zip for version 0.1.10
  Clean openzwave in openzwave-embed/open-zwave-hass ... be patient ...
  error: [Errno 2] No such file or directory: 'make': 'make'
  ----------------------------------------
  ERROR: Failed building wheel for homeassistant-pyozw
  ERROR: Command errored out with exit status 1:
   command: /usr/local/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py'"'"'; __file__='"'"'/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'

'"'"', '"'"'
'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' clean --all
       cwd: /tmp/pip-install-w6p5j7v3/homeassistant-pyozw
  Complete output (8 lines):
  sysargv ['/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py', 'clean', '--all']
  Found SETUP_DIR : /tmp/pip-install-w6p5j7v3/homeassistant-pyozw
  <pyozw_setup.EmbedTemplate object at 0x7f60bb9e3290>
  {'name': 'libopenzwave', 'sources': ['openzwave-embed/open-zwave-hass/python-openzwave/src-lib/libopenzwave/libopenzwave.cpp'], 'include_dirs': ['src-lib/libopenzwave/', 'openzwave-embed/open-zwave-hass/cpp/src', 'openzwave-embed/open-zwave-hass/cpp/src/value_classes', 'openzwave-embed/open-zwave-hass/cpp/src/platform', 'openzwave-embed/open-zwave-hass/cpp/build/linux'], 'define_macros': [('PY_LIB_VERSION', '0.1.10'), ('PY_SSIZE_T_CLEAN', 1), ('PY_LIB_FLAVOR', 'embed'), ('PY_LIB_BACKEND', 'cpp')], 'libraries': ['udev', 'stdc++', 'resolv'], 'extra_objects': ['openzwave-embed/open-zwave-hass/libopenzwave.a'], 'extra_compile_args': [], 'extra_link_args': [], 'language': 'c++'}
  ['six', 'PyDispatcher>=2.0.5']
  running clean
  Clean openzwave in openzwave-embed/open-zwave-hass ... be patient ...
  error: [Errno 2] No such file or directory: 'make': 'make'
  ----------------------------------------
  ERROR: Failed cleaning build dir for homeassistant-pyozw
    ERROR: Command errored out with exit status 1:
     command: /usr/local/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py'"'"'; __file__='"'"'/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'

'"'"', '"'"'
'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1zl364ef/install-record.txt --single-version-externally-managed --compile
         cwd: /tmp/pip-install-w6p5j7v3/homeassistant-pyozw/
    Complete output (16 lines):
    sysargv ['/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py', 'install', '--record', '/tmp/pip-record-1zl364ef/install-record.txt', '--single-version-externally-managed', '--compile']
    Found SETUP_DIR : /tmp/pip-install-w6p5j7v3/homeassistant-pyozw
    <pyozw_setup.EmbedTemplate object at 0x7fdb6f0543d0>
    {'name': 'libopenzwave', 'sources': ['openzwave-embed/open-zwave-hass/python-openzwave/src-lib/libopenzwave/libopenzwave.cpp'], 'include_dirs': ['src-lib/libopenzwave/', 'openzwave-embed/open-zwave-hass/cpp/src', 'openzwave-embed/open-zwave-hass/cpp/src/value_classes', 'openzwave-embed/open-zwave-hass/cpp/src/platform', 'openzwave-embed/open-zwave-hass/cpp/build/linux'], 'define_macros': [('PY_LIB_VERSION', '0.1.10'), ('PY_SSIZE_T_CLEAN', 1), ('PY_LIB_FLAVOR', 'embed'), ('PY_LIB_BACKEND', 'cpp')], 'libraries': ['udev', 'stdc++', 'resolv'], 'extra_objects': ['openzwave-embed/open-zwave-hass/libopenzwave.a'], 'extra_compile_args': [], 'extra_link_args': [], 'language': 'c++'}
    ['six', 'PyDispatcher>=2.0.5']
    running install
    flavor embed
    running build_openzwave
    Found g++ : None
    Found gcc : None
    Found make : None
    Found gmake : None
    Found cython : None
    Found pkg-config : None
    Clean openzwave in openzwave-embed/open-zwave-hass ... be patient ...
    error: [Errno 2] No such file or directory: 'make': 'make'
    ----------------------------------------
ERROR: Command errored out with exit status 1: /usr/local/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py'"'"'; __file__='"'"'/tmp/pip-install-w6p5j7v3/homeassistant-pyozw/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'

'"'"', '"'"'
'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1zl364ef/install-record.txt --single-version-externally-managed --compile Check the logs for full command output.

         -------------- other stuff

Failed config
  General Errors: 
    - Component error: zwave - Requirements for zwave not found: ['homeassistant-pyozw==0.1.10'].

Successful config (partial)

[SirGoodenough]

Removal of ttyACM1 device above no effect.
Going to try to actually upgrade in case the old version of PIP in the configuration checker is the cause of the error.
Bsed on the fact others are having an issue i doubt it.
UPDATE - same error...

[SirGoodenough]

After install of 0.107.7 zWave appears to function, but the log is getting pounded... Going to try to uninstall and re-install.
These all appear to be recorder errors. The zwave integration just happened to be updating things, but with that removed, the log keeps getting pounded with recorder errors from everything, so not the same problem...
Zwave switches worked after the startup of 0.107.7 so I think that is working, but something else it happening in recorder. No adverse indications in notifications, the log is so full that I can't see any zwave errors there so likely working. The config checker addon may need to update to PIP 20.X as recommended on addon start / log. see #33370

[tprelog]

Moved Here

[pizzapants]

Having the same issue. Im on 107.7 and just installed a few new inovelli switches. A few of them work fine. A 3 others work until I restart hass. Then they become unavailable and throw the following errors you guys are getting:

2020-03-29 12:57:06 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 32 not ready after 30 seconds, continuing anyway
2020-03-29 12:57:06 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave node 33 not ready after 30 seconds, continuing anyway
2020-03-29 12:59:01 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 32 Level (node_id: 32) not ready after 30 seconds, continuing anyway
2020-03-29 12:59:01 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 33 Switch (node_id: 33) not ready after 30 seconds, continuing anyway
2020-03-29 12:59:02 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave entity Unknown Node 33 Power (node_id: 33) not ready after 30 seconds, continuing anyway
2020-03-29 13:01:20 WARNING (MainThread) [homeassistant.components.zwave] Z-Wave not ready after 300 seconds, continuing anyway

[stale[bot]]

There hasn't been any activity on this issue recently. Due to the high number of incoming GitHub notifications, we have to clean some of the old issues, as many of them have already been resolved with the latest updates.
Please make sure to update to the latest Home Assistant version and check if that solves the issue. Let us know if that works for you by adding a comment 👍
This issue now has been marked as stale and will be closed if no further activity occurs. Thank you for your contributions.

[edwinvandalen]

finally had the guts to re-attempt the upgrade. no issues encountered.