Deconz-rest-plugin: Cannot add any new switches

[JasperAlgra]

Describe the bug

I'm trying to add new switched to an already existing setup.
I've tried adding them via

• Phoscon beta
• normal webinterface
• old interface

Three types of hardware:

• IKEA E1743 (rectangular on / off remote) (brand new, don't know firmware)
• IKEA E1524 (round remote) (latest firmware)
• Xiaomi Oplle 3-gang (WXCJKG12LM)

I've already have a few of the E1743 and similar xiaomi switches joined and working fine. But I cannot add any new ones.

Trying to join fails in similar ways, the device can be seen in Deconz GUI but not in phoscon.

Steps to reproduce the behavior

1. open phoscon
2. go to devices -> switches
3. press 'add new switch' select right type
4. reset switch (ikea; press button 4x)
5. wait and get error

Expected behavior

I would expect switches to join the network and be available in phoscon

Screenshots

result in phoscon:

Devices are showing in deconz (but not in phoscon):

firefox console of phoscon;

Environment

• Version: 2.05.86 / 10/15/2020

  • Host system: Raspberry Pi
  • Running method: Raspbian
  • Firmware version: 26580700
  • deCONZ version: 2.05.86
  • Device: ConBee II
  • Do you use an USB extension cable: yes
  • Is there any other USB or serial devices connected to the host system? No

deCONZ Logs

20201023-adding_switch.log

Additional context

If I can get more debug info or other helpfull info please let me know. I'm available to test whatever needs to be done.

[JasperAlgra]

as @Mimiix saw errors regarding a 'blitzwolf bw-shp13 smartplug' in the log I've powered down this plug and tried again to pair without the plug present.
Attached is a new logfile:
20201023-adding_switch_without_blitzwolf.log

[MattWestb]

My last experience of pairing the IKEA E1524 (round remote) is not using switch type "IKEA" then its not working and instead using "other" and after start the paring moving / twisting the device little now and then so its not "falling in sleep".
Its one of the tricky one getting working in deCONZ.

Your "ghost" devices is not successful paired devices and is best deleting then in deCONZ GUI before trying paring them again.

[GeoCyberwolf]

I am having the same issue since updating to 2.05.86. I upgraded because I was unable to add my sonoff switches to groups, and now I cant pair them at all.

[JasperAlgra]

@GeoCyberwolf I'll try to downgrade. Let you know if that helps

Would really like to get it working again. Other then lights I cannot add anything to the network at the moment.

[JasperAlgra]

@GeoCyberwolf Ok that helped!
I'm now at deconz-2.05.83-qt5.deb with firmware 26660700 and it's back to normal.
@Mimiix this probably something interesting for the devs. I suspect something is broken regarding adding switches/sensors after 2.05.83

I've added a logfile of the successful attempt to join a ikea E1743 to the network.
adding_switch_on_2.05.83.log

[GeoCyberwolf]

@JasperAlgra

Interestingly I just managed to add a switch on .86. No idea how. I tried adding it through deconz gui first, which didnt work. I then closed the network in deconz gui, and tried adding a switch through the webapp. That then worked. So something about opening and closing the network in the deconz gui first changed something? I don't have logs I am afraid, as I am running deconz without logging as I dont want to kill yet another raspberry pi SD card.

Sonoff SNZB-01 still cant be added to groups in .86. though I have a separate issue open for that bug.

[JasperAlgra]

I might have been celebrating to early.. I only got the add the one ikea switch and now it's back to the earlier state. Coudn't add another one (the E1743, E1524 or xiaomi opple).

• edit - update. I'm not sure why but now I can add all the switches I have. I do see a big difference between version 2.05.86 and 2.05.83

@GeoCyberwolf
If you want logging just stop the deconz service
sudo systemctl stop deconz

and start deconz by hand:
deCONZ --dbg-info=1 --dbg-zcl=1 --dbg-zdp=2 --dbg-error=1.
You'll get the logging in the terminal so your SD-card is safe. This is the way I do it for logging. After that I'll stop deCONZ and restart the service.

[Smanar]

Hello, can you show your setting panel in deconz, key F9, or compare with this one https://github.com/dresden-elektronik/deconz-rest-plugin/wiki/Network-lost-and-configuration-restore-does-not-help pls.

[SwoopX]

3502

[JasperAlgra]

@Smanar
sure:

That looks pretty similar to the screenshot in the link you've given.

[SwoopX]

@JasperAlgra Your network/devices configuration seems to be a bit fishy. You got quite some entries like this:

neigbor 0x00212effff0593d4 in different pan 0xDDDDDDDDDDDDDDDD

The PAN ID should be differently. As far as I can tell, it should be all zero when you start a fresh network and then become the MAC of your coordinator. You used z2m before? To me it looks like all your routers give that in return. Maybe leaving, changing it to 0xDDDDDDDDDDDDDDDD and joining via deconz GUI can resolve that.

[JasperAlgra]

First of all; thanks for looking into this.

I've seen the messages but I couldn't figure out if these errors are bad or not. I did indeed use z2m before, but nearly all devices are on the new network. I'll try tomorrow to reset of shutdown any devices in my "box full of zigbee stuff" to see if that helps.

As a sidenote: I have to say, and this can be coincidence of course, but after downgrading to 2.05.83 the adding of sensors works pretty much flawlessly at the moment.

I'll keep you posted about the wrong PAN

[JasperAlgra]

So I did a little more digging and I find it hard to figure out what's going on.

Unique occurrences of "in different PAN" logs:

32256846:Oct 27 12:02:55 raspberrypi deCONZ[309]: 12:02:40:390 neigbor   0x000b3cfffef0b641     in different pan 0xDDDDDDDDDDDDDDDD switch  IKEA TRADFRI control outlet woonkamer1                     000b3cfffef0b641-01  True  2.0.022    2020-10-27T11:03.00 Off
32069186:Oct 27 11:54:36 raspberrypi deCONZ[309]: 11:54:21:524 neigbor   0x000b3cfffef7adb1     in different pan 0xDDDDDDDDDDDDDDDD switch  IKEA TRADFRI control outlet     woonkamer-3                    000b3cfffef7adb1-01  True  2.0.024    2020-10-27T10:57.00 Off
31835467:Oct 27 11:46:20 raspberrypi deCONZ[309]: 11:46:14:855 neigbor   0x00158d0002f08b44     in different pan 0xDDDDDDDDDDDDDDDD sensor  Xiaomi lumi.remote.b286acn01    kantoor-dubbel                 00158d0002f08b44-01  True  20180809   2020-10-27T11:00.00
31640195:Oct 27 11:39:37 raspberrypi deCONZ[309]: 11:39:09:609 neigbor   0x00158d00041df996     in different pan 0xDDDDDDDDDDDDDDDD sensor  Xiaomi lumi.sensor_cube.aqgl01  lumi.sensor_cube.aqgl01 16     00158d00042f2035-03  True  20160704   2020-10-27T10:53.00
32263400:Oct 27 12:03:11 raspberrypi deCONZ[309]: 12:02:55:779 neigbor   0x00158d00042f2035     in different pan 0xDDDDDDDDDDDDDDDD sensor  Xiaomi lumi.sensor_cube.aqgl01  lumi.sensor_cube.aqgl01 16     00158d00042f2035-03  True  20160704   2020-10-27T10:53.00
31814419:Oct 27 11:45:53 raspberrypi deCONZ[309]: 11:45:44:058 neigbor   0x00212effff0593d4     in different pan 0xDDDDDDDDDDDDDDDD ?
31834953:Oct 27 11:46:20 raspberrypi deCONZ[309]: 11:46:14:855 neigbor   0x04cf8cdf3c75c5e1     in different pan 0xDDDDDDDDDDDDDDDD sensor  Xiaomi lumi.remote.b286opcn01   OPPLE switch 1-gang            04cf8cdf3c75c5e1-01  True  20190730   2020-10-27T10:20.00
31632917:Oct 27 11:38:53 raspberrypi deCONZ[309]: 11:38:38:791 neigbor   0x086bd7fffe5db459     in different pan 0xDDDDDDDDDDDDDDDD switch  IKEA TRADFRI control outlet     espresso                       086bd7fffe5db459-01  True  2.0.024    2020-10-27T10:58.00 On
32256333:Oct 27 12:02:55 raspberrypi deCONZ[309]: 12:02:40:390 neigbor   0xccccccfffeb2f6be     in different pan 0xDDDDDDDDDDDDDDDD switch  IKEA TRADFRI control outlet     buitenlampjes                  ccccccfffeb2f6be-01  True  2.0.022    2020-10-27T10:59.00 Off
31637475:Oct 27 11:39:37 raspberrypi deCONZ[309]: 11:38:54:156 neigbor   0xccccccfffeb4ada6     in different pan 0xDDDDDDDDDDDDDDDD switch  IKEA TRADFRI control outlet     woonkamer-2                    ccccccfffeb4ada6-01  True  2.0.022    2020-10-27T10:56.00 Off

All my working devices (from API):

switch  SONOFF BASICZBR3                         spiegelverwarming              00124b001da526f5-01  False None       2020-10-27T10:17.00 On
sensor  Xiaomi lumi.remote.b186acn01             schakelaar-spiegel             00158d00040e1259-01  True  20180809   2020-10-27T10:17:08
sensor  Xiaomi lumi.remote.b286opcn01            OPPLE switch 1-gang            04cf8cdf3c75c5e1-01  True  20190730   2020-10-27T10:20.00
sensor  IKEA TRADFRI on/off switch               schakelaar-espresso            588e81fffe3ec5d2-01  True  2.2.010    2020-10-27T10:26.00
sensor  IKEA TRADFRI on/off switch               schakelaar-kledingkast         680ae2fffeaa1bc8-01  True  2.2.010    2020-10-27T10:31.00
sensor  Xiaomi Temperature/Humidity (Round)      temp-humi-5-humidor            00158d0004066edd-01  True  20160516   2020-10-27T10:35:11 19.34C, 72.04%
sensor  Xiaomi Temperature/Humidity (Round)      temp-humi-2-slaapkamer         00158d00041025f6-01  True  20160516   2020-10-27T10:37:34 65.14%, 17.99C
sensor  Xiaomi Temperature/Humidity (Round)      temp-humi-4-buiten             00158d00041df92d-01  True  20160516   2020-10-27T10:41:56 12.93C, 83.05%
sensor  Xiaomi Temperature/Humidity (Round)      temp-humi-6-woonkamer_voor     00158d000413274a-01  True  20160516   2020-10-27T10:48:01 15.84C, 76.01%
sensor  Xiaomi Temperature/Humidity (Round)      temp-humi-1-kantoor            00158d00044b489c-01  True  20160516   2020-10-27T10:48:52 19.68C, 56.85%
sensor  Xiaomi Temperature/Humidity (Round)      temp-humi-3-entree             00158d00041df996-01  True  20160516   2020-10-27T10:49:51 17.77C, 62.73%
sensor  Xiaomi Temperature/Humidity (Round)      temp-humi-8-woonkamer_achter   00158d000410e17a-01  True  20160516   2020-10-27T10:50:15 18.68C, 67.01%
sensor  Xiaomi lumi.sensor_cube.aqgl01           Mi Magic Cube                  00158d00042f2035-02  True  20160704   2020-10-27T10:53.00
sensor  Xiaomi lumi.sensor_cube.aqgl01           lumi.sensor_cube.aqgl01 16     00158d00042f2035-03  True  20160704   2020-10-27T10:53.00
switch  IKEA TRADFRI control outlet              woonkamer-2                    ccccccfffeb4ada6-01  True  2.0.022    2020-10-27T10:56.00 Off
switch  IKEA TRADFRI control outlet              woonkamer-3                    000b3cfffef7adb1-01  True  2.0.024    2020-10-27T10:57.00 Off
switch  IKEA TRADFRI control outlet              espresso                       086bd7fffe5db459-01  True  2.0.024    2020-10-27T10:58.00 On
switch  IKEA TRADFRI control outlet              buitenlampjes                  ccccccfffeb2f6be-01  True  2.0.022    2020-10-27T10:59.00 Off
sensor  Xiaomi lumi.remote.b286acn01             kantoor-dubbel                 00158d0002f08b44-01  True  20180809   2020-10-27T11:00.00
sensor  IKEA TRADFRI remote control              schakelaar-slaapkamer-2        14b457fffe4133fa-01  True  2.3.014    2020-10-27T11:01.00
sensor  IKEA TRADFRI on/off switch               TRÅDFRI on/off switch          680ae2fffe4d924a-01  True  2.2.010    2020-10-27T11:01.00
switch  IKEA TRADFRI control outlet              Lampjes kantoor                086bd7fffe228e8f-01  True  2.0.024    2020-10-27T11:02.00 Off
sensor  Xiaomi Temperature/Humidity (Round)      temp-humi-7-badkamer           00158d0004072f58-01  True  20160516   2020-10-27T11:02:53 20.42C, 63.05%
switch  IKEA TRADFRI control outlet              woonkamer1                     000b3cfffef0b641-01  True  2.0.022    2020-10-27T11:03.00 Off
sensor  IKEA TRADFRI remote control              schakelaar-slaapkamer-1        000d6ffffe4a7dac-01  True  2.3.014    2020-10-27T11:03.00
sensor  IKEA TRADFRI on/off switch               schakelaar woonkamer           90fd9ffffea7f69c-01  True  2.2.010    2020-10-27T11:04.00

So all but one of the devices mentioned in the "different PAN" log are normal working devices.
Can this message be the cause of anything or am I chasing ghosts?

[SwoopX]

Not really my turf, but according to this article, it could be part of the problem, at least theoretically.

Extended PAN IDs (EPIDs) are 64-bit numbers that uniquely identify a PAN. ZigBee communicates using the shorter 16-bit PAN ID for all communication except one. The beacon response issued as the result of a beacon request contains an Extended PAN ID to allow a node that wishes to join a network to pick exactly the right one.

@manup Maybe you can share your thoughts around this?

[manup]

Can you please try again with latest version v2.5.88, quite some fixes in there.