Frr: fail to establish neighbors

[magnate3]

In my test, the spine fail to establish neighbors with two leaves:

spine : 10.10.18.195/24
leaf1: 10.10.16.82/24
leaf2: 10.10.16.81/24
all of they can ping with each other

• my os is as following:

  [root@host-10-10-18-195 ~]# cat /etc/os-release
  NAME="CentOS Linux"
  VERSION="7 (AltArch)"
  ID="centos"
  ID_LIKE="rhel fedora"
  VERSION_ID="7"
  PRETTY_NAME="CentOS Linux 7 (AltArch)"
  ANSI_COLOR="0;31"
  CPE_NAME="cpe:/o:centos:centos:7"
  HOME_URL="https://www.centos.org/"
  BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

• [ ] the spine node's bpg conf:

router bgp 195
bgp router-id 10.10.18.195
bgp bestpath as-path multipath-relax
neighbor fabric peer-group
neighbor fabric update-source 10.10.18.195
neighbor fabric remote-as external
neighbor 10.10.16.81 peer-group fabric
neighbor 10.10.16.82 peer-group fabric
neighbor 10.10.16.81 ebgp-multihop
neighbor 10.10.16.82 ebgp-multihop
!
address-family ipv4 unicast
neighbor fabric activate
exit-address-family
!
address-family l2vpn evpn
neighbor fabric activate
exit-address-family

1. the leaf1's conf is :

router bgp 82
bgp router-id 10.10.16.82
bgp bestpath as-path multipath-relax
neighbor fabric peer-group
neighbor fabric remote-as external
neighbor fabric update-source 10.10.16.82
neighbor 10.10.18.195 peer-group fabric
neighbor 10.10.18.195 ebgp-multihop
!
address-family ipv4 unicast
neighbor fabric activate
exit-address-family
!
address-family l2vpn evpn
neighbor fabric activate
advertise-all-vni
exit-address-family
!
the leaf2's conf is :
router bgp 81
bgp router-id 10.10.16.81
bgp bestpath as-path multipath-relax
neighbor fabric peer-group
neighbor fabric remote-as external
neighbor fabric update-source 10.10.16.81
neighbor 10.10.18.195 peer-group fabric
neighbor 10.10.18.195 ebgp-multihop
!
address-family ipv4 unicast
neighbor fabric activate
exit-address-family
!
address-family l2vpn evpn
neighbor fabric activate
advertise-all-vni
exit-address-family

[Spantik]

Could you please enable logs below and share the logs file?
debug bgp neighbor-events
debug bgp keepalives
debug bgp zebra
debug bgp update-groups
debug bgp updates

[magnate3]

after enable logs and the log is :
2020/02/25 13:31:11 BGP: [EC 100663299] buffer_flush_available: write error on fd 2: Bad file descriptor
2020/02/25 13:31:11 ZEBRA: client 33 says hello and bids fair to announce only ospf routes vrf=0
2020/02/25 13:31:11 ZEBRA: client 38 says hello and bids fair to announce only static routes vrf=0
2020/02/25 13:31:13 BGP: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from 10.10.16.82 in vrf default
2020/02/25 13:31:13 BGP: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from 10.10.16.82 in vrf default
2020/02/25 13:33:42 BGP: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from 10.10.16.82 in vrf default
2020/02/25 13:33:42 BGP: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from 10.10.16.82 in vrf default
2020/02/25 13:33:51 STATIC: Terminating on signal
2020/02/25 13:33:51 OSPF: Terminating on signal
2020/02/25 13:33:51 BGP: Terminating on signal
2020/02/25 13:33:51 ZEBRA: Terminating on signal
2020/02/25 13:33:51 ZEBRA: [EC 4043309121] Client 'static' encountered an error and is shutting down.
2020/02/25 13:33:51 ZEBRA: [EC 4043309121] Client 'ospf' encountered an error and is shutting down.
2020/02/25 13:33:51 ZEBRA: release_daemon_table_chunks: Released 0 table chunks
2020/02/25 13:33:51 ZEBRA: zebra/zebra_ptm.c:1345 failed to find process pid registration
2020/02/25 13:33:51 ZEBRA: client 15 disconnected. 0 bgp routes removed from the rib
2020/02/25 13:33:51 ZEBRA: release_daemon_table_chunks: Released 0 table chunks
2020/02/25 13:33:51 ZEBRA: client 26 disconnected. 0 vnc routes removed from the rib
2020/02/25 13:33:51 ZEBRA: release_daemon_table_chunks: Released 0 table chunks
2020/02/25 13:33:51 ZEBRA: client 33 disconnected. 0 ospf routes removed from the rib
2020/02/25 13:33:51 ZEBRA: release_daemon_table_chunks: Released 0 table chunks
2020/02/25 13:33:51 ZEBRA: client 38 disconnected. 0 static routes removed from the rib
2020/02/25 13:33:51 ZEBRA: Zebra final shutdown
2020/02/25 13:33:52 ZEBRA: client 15 says hello and bids fair to announce only bgp routes vrf=0
2020/02/25 13:33:52 ZEBRA: client 28 says hello and bids fair to announce only vnc routes vrf=0
2020/02/25 13:33:52 BGP: [EC 100663299] buffer_flush_available: write error on fd 2: Bad file descriptor
2020/02/25 13:33:52 BGP: [EC 100663304] ERROR: Command returned Warning Config Failed on config line 21: neighbor fabric activate
2020/02/25 13:33:52 BGP: [EC 100663299] buffer_flush_available: write error on fd 2: Bad file descriptor
2020/02/25 13:33:52 ZEBRA: client 33 says hello and bids fair to announce only ospf routes vrf=0
2020/02/25 13:33:52 ZEBRA: client 38 says hello and bids fair to announce only static routes vrf=0
2020/02/25 13:33:54 BGP: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from 10.10.16.82 in vrf default
2020/02/25 13:33:54 BGP: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from 10.10.16.82 in vrf default
2020/02/25 15:44:53 BGP: 10.10.16.82 KEEPALIVE rcvd
2020/02/25 15:44:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire)
2020/02/25 15:44:53 BGP: 10.10.16.82 sending KEEPALIVE
2020/02/25 15:45:53 BGP: 10.10.16.82 KEEPALIVE rcvd
2020/02/25 15:45:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire)
2020/02/25 15:45:53 BGP: 10.10.16.82 sending KEEPALIVE
2020/02/25 15:46:53 BGP: 10.10.16.82 KEEPALIVE rcvd
2020/02/25 15:46:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire)
2020/02/25 15:46:53 BGP: 10.10.16.82 sending KEEPALIVE
2020/02/25 15:46:53 STATIC: Terminating on signal
2020/02/25 15:46:53 OSPF: Terminating on signal
2020/02/25 15:46:53 BGP: Terminating on signal
2020/02/25 15:46:53 BGP: %NOTIFICATION: sent to neighbor 10.10.16.82 6/3 (Cease/Peer Unconfigured) 0 bytes
2020/02/25 15:46:53 BGP: Deleting Default VRF
2020/02/25 15:46:53 BGP: %NOTIFICATION: sent to neighbor 10.10.16.82 6/2 (Cease/Administratively Shutdown) 0 bytes
2020/02/25 15:46:53 BGP: 10.10.16.82 remove from all update group
2020/02/25 15:46:53 BGP: peer 10.10.16.82 deleted from subgroup s1 peer cnt 0
2020/02/25 15:46:53 ZEBRA: [EC 4043309121] Client 'static' encountered an error and is shutting down.
2020/02/25 15:46:53 BGP: delete subgroup u1:s1
2020/02/25 15:46:53 BGP: delete update group 1
2020/02/25 15:46:53 BGP: peer 10.10.16.82 deleted from subgroup s2 peer cnt 0
2020/02/25 15:46:53 BGP: delete subgroup u2:s2
2020/02/25 15:46:53 BGP: delete update group 2
2020/02/25 15:46:53 BGP: bgp_fsm_change_status : vrf default(0), Status: Deleted established_peers 0
2020/02/25 15:46:53 BGP: 10.10.16.82 went from Established to Deleted
2020/02/25 15:46:53 BGP: sendmsg_zebra_rnh: sending cmd ZEBRA_NEXTHOP_UNREGISTER for 10.10.16.82/32 (vrf VRF default)
2020/02/25 15:46:53 BGP: bgp_fsm_change_status : vrf default(0), Status: Deleted established_peers 0
2020/02/25 15:46:53 BGP: Static announcement went from Idle to Deleted
2020/02/25 15:46:53 ZEBRA: release_daemon_table_chunks: Released 0 table chunks
2020/02/25 15:46:53 BGP: bgp_delete: deregistering this bgp (null) instance from zebra
2020/02/25 15:46:53 BGP: Deregistering VRF 0
2020/02/25 15:46:53 ZEBRA: client 38 disconnected. 0 static routes removed from the rib
2020/02/25 15:46:53 ZEBRA: Terminating on signal
2020/02/25 15:46:53 ZEBRA: [EC 4043309121] Client 'ospf' encountered an error and is shutting down.
2020/02/25 15:46:53 ZEBRA: release_daemon_table_chunks: Released 0 table chunks
2020/02/25 15:46:53 ZEBRA: zebra/zebra_ptm.c:1345 failed to find process pid registration
2020/02/25 15:46:53 ZEBRA: client 15 disconnected. 0 bgp routes removed from the rib
2020/02/25 15:46:53 BGP: VRF Deletion: default(0)
2020/02/25 15:46:53 ZEBRA: release_daemon_table_chunks: Released 0 table chunks
2020/02/25 15:46:53 ZEBRA: client 28 disconnected. 0 vnc routes removed from the rib
2020/02/25 15:46:53 ZEBRA: release_daemon_table_chunks: Released 0 table chunks
2020/02/25 15:46:53 ZEBRA: client 33 disconnected. 0 ospf routes removed from the rib
2020/02/25 15:46:53 ZEBRA: Zebra final shutdown
2020/02/25 15:46:53 ZEBRA: client 15 says hello and bids fair to announce only bgp routes vrf=0
2020/02/25 15:46:53 ZEBRA: client 28 says hello and bids fair to announce only vnc routes vrf=0
2020/02/25 15:46:53 ZEBRA: client 33 says hello and bids fair to announce only ospf routes vrf=0
2020/02/25 15:46:53 ZEBRA: client 38 says hello and bids fair to announce only static routes vrf=0

[Spantik]

It looks like you BGP session with leaf is trying to come up, at least I can see that they are exchanging keepalive (Openconfim and established state) and then there seems to be terminating signal being sent.

2020/02/25 15:44:53 BGP: 10.10.16.82 KEEPALIVE rcvd
2020/02/25 15:44:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire)
2020/02/25 15:44:53 BGP: 10.10.16.82 sending KEEPALIVE
2020/02/25 15:45:53 BGP: 10.10.16.82 KEEPALIVE rcvd
2020/02/25 15:45:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire)
2020/02/25 15:45:53 BGP: 10.10.16.82 sending KEEPALIVE
2020/02/25 15:46:53 BGP: 10.10.16.82 KEEPALIVE rcvd
2020/02/25 15:46:53 BGP: 10.10.16.82 [FSM] Timer (keepalive timer expire)
2020/02/25 15:46:53 BGP: 10.10.16.82 sending KEEPALIVE
2020/02/25 15:46:53 STATIC: Terminating on signal
2020/02/25 15:46:53 OSPF: Terminating on signal
2020/02/25 15:46:53 BGP: Terminating on signal

Could you please let me know what are the triggers here? Why are all clients are being terminated?

[qlyoung]

What does this show:

journalctl -xeu frr.service

All the daemons are being terminated, so systemd is killing them, which usually means watchfrr isn't getting liveness pings from daemons. Journalctl should have some more info about what's going on.

[magnate3]

the log shows : zebra state -> dow、bgpd state -> down、ospfd state -> down、 staticd state -> down。
however,

[root@localhost ~]# systemctl status frr
● frr.service - FRRouting
Loaded: loaded (/usr/lib/systemd/system/frr.service; enabled; vendor preset: disabled)
Active: active (running) since Tue 2020-02-25 15:46:53 CST; 17h ago
Docs: https://frrouting.readthedocs.io/en/latest/setup.html
Process: 34114 ExecStop=/usr/lib/frr/frrinit.sh stop (code=exited, status=0/SUCCESS)
Process: 34139 ExecStart=/usr/lib/frr/frrinit.sh start (code=exited, status=0/SUCCESS)

[root@localhost ~]# netstat -tapnl|grep ':26'
tcp 0 0 127.0.0.1:2604 0.0.0.0:* LISTEN 34175/ospfd
tcp 0 0 127.0.0.1:2605 0.0.0.0:* LISTEN 34168/bgpd
tcp 0 0 127.0.0.1:2616 0.0.0.0:* LISTEN 34178/staticd
tcp 0 0 127.0.0.1:2601 0.0.0.0:* LISTEN 34163/zebra

journalctl -xeu frr.service

533 -- Unit frr.service has begun starting up.
534 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: watchfrr 7.3-MyOwnFRRVersion starting: vty@0
535 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 268435457] zebra state -> down : initial connection attempt failed
536 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 268435457] bgpd state -> down : initial connection attempt failed
537 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 268435457] ospfd state -> down : initial connection attempt failed
538 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 268435457] staticd state -> down : initial connection attempt failed
539 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: [EC 100663303] Forked background command [pid 34146]: / usr/lib/frr/watchfrr.sh restart all
540 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: zebra state -> up : connect succeeded
541 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: bgpd state -> up : connect succeeded
542 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: ospfd state -> up : connect succeeded
543 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: staticd state -> up : connect succeeded
544 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: all daemons up, doing startup-complete notify
545 Feb 25 15:46:53 localhost.localdomain frrinit.sh[34139]: Started watchfrr
546 Feb 25 15:46:53 localhost.localdomain systemd[1]: Started FRRouting.

[penguin02007]

I believe I am having similar issue with frr 7.3.1 with bgp evpn.

frr is fine after I commented out l2vpn section, if not it got a stack trace.

#vrf tenant3
# vni 404003
#vrf tenant2
# vni 404002
#vrf tenant1
# vni 404001
!
interface eth1
 ipv6 nd ra-interval 10
 no ipv6 nd suppress-ra
interface eth2
 ipv6 nd ra-interval 10
 no ipv6 nd suppress-ra

router bgp 65503
 bgp router-id 10.250.250.3
 bgp bestpath as-path multipath-relax
 neighbor FABRIC peer-group
 neighbor FABRIC remote-as external
 neighbor FABRIC timers 1 3
 neighbor eth1 interface peer-group FABRIC
 neighbor eth2 interface peer-group FABRIC
 !
 address-family ipv4 unicast
  redistribute connected route-map loopbacks
 exit-address-family
 !
# address-family l2vpn evpn
#   neighbor FABRIC activate
#   advertise-all-vni
#   advertise ipv4 unicast
#   advertise ipv6 unicast
# exit-address-family
!
route-map loopbacks permit 10
 match interface lo
!
line vty
!

Mar 22 06:47:08 server03 bgpd[6689]: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from eth1 in vrf default
Mar 22 06:47:08 server03 bgpd[6689]: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from eth1 in vrf default
Mar 22 06:47:08 server03 bgpd[6689]: Received signal 11 at 1584859628 (si_addr 0x0, PC 0x55b9c26240d9); aborting...
Mar 22 06:47:08 server03 bgpd[6689]: Backtrace for 12 stack frames:
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(zlog_backtrace_sigsafe+0x60) [0x7ff5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(zlog_signal+0x10c) [0x7ff5b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(+0x6c774) [0x7ff5b44aa774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12890) [0x7ff5b3a80890]774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(bgp_zebra_announce+0x619) [0x55b9c26240d9]890]774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(+0x7b9d6) [0x55b9c25df9d6][0x55b9c26240d9]890]774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(work_queue_run+0xd6) [0x7ff5b44c15a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(thread_call+0x56) [0x7ff5b44b7f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(frr_run+0xd8) [0x7ff5b4487dd8]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(main+0x324) [0x55b9c259ca74]run+0xd8) [0x7ff5b4487dd8]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7ff5b369eb97]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(_start+0x2a) [0x55b9c259eb8a]in+0xe7) [0x7ff5b369eb97]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: in thread work_queue_run scheduled from lib/workqueue.c:140
                                     9c26240d9); aborting...
Mar 22 06:47:08 server03 watchfrr[6594]: [EC 268435457] bgpd state -> down : read returned EOF
Mar 22 06:47:08 server03 zebra[6614]: [EC 4043309121] Client 'vnc' encountered an error and is shutting down.
Mar 22 06:47:08 server03 zebra[6614]: client 26 disconnected. 0 vnc routes removed from the rib
Mar 22 06:47:08 server03 zebra[6614]: [EC 4043309121] Client 'bgp' encountered an error and is shutting down.
Mar 22 06:47:08 server03 zebra[6614]: zebra/zebra_ptm.c:1345 failed to find process pid registration
Mar 22 06:47:08 server03 zebra[6614]: client 15 disconnected. 14 bgp routes removed from the rib

[magnate3]

do you have ways to solve the prolblems

[RobertB93]

I believe I am having similar issue with frr 7.3.1 with bgp evpn.

frr is fine after I commented out l2vpn section, if not it got a stack trace.

Yeah, it's currently the same for me, i can confirm.

[penguin02007]

@RobertB93 can you share your frr.conf and interfaces file?

[RobertB93]

@RobertB93 can you share your frr.conf and interfaces file?

Of course, here we go:

frr version 7.3
frr defaults traditional
hostname prox1
log syslog informational
no ip forwarding
no ipv6 forwarding
service integrated-vtysh-config
!
router-id 10.50.12.1
!
router bgp 4200001011
 no bgp default ipv4-unicast
 coalesce-time 1000
 neighbor EVPN peer-group
 neighbor EVPN remote-as 65001
 neighbor EVPN ebgp-multihop 5
 neighbor EVPN update-source lo
 neighbor UNDERLAY peer-group
 neighbor UNDERLAY remote-as 65001
 neighbor 10.50.10.3 peer-group EVPN
 neighbor 10.50.10.4 peer-group EVPN
 neighbor 10.50.31.8 peer-group UNDERLAY
 neighbor 10.50.31.10 peer-group UNDERLAY
 !
 address-family ipv4 unicast
  redistribute connected
  neighbor UNDERLAY activate
 exit-address-family
 !
 address-family l2vpn evpn
  neighbor EVPN activate
  vni 123
   route-target import 101:1
   route-target export 101:1
  exit-vni
  advertise-all-vni
 exit-address-family
!
line vty
!

auto lo
iface lo inet loopback
    address 10.50.12.1/32
    address 10.50.4.1/32

auto eno1
iface eno1 inet
    mtu 9214

auto eno2
iface eno2 inet
    mtu 9214

auto vmbr0
iface vmbr0
    mtu 9214
        bridge-ports eno1
        bridge-stp off
        bridge-pvid 1
        bridge-vids 1-4094
        bridge-vlan-aware yes

auto vmbr0.200
iface vmbr0.200
    mtu 1500
        address x.x.x.x/y
        gateway x.x.x.x

auto vmbr0.51
iface vmbr0.51
    mtu 9214
    address 10.50.31.9/31
    address 10.50.31.11/31

auto vni123
iface vni123
        vxlan-id 123
        vxlan-local-tunnelip 10.50.4.1
        bridge-learning off
        bridge-arp-nd-suppress on
        bridge-unicast-flood off
        bridge-multicast-flood off

auto vmbr123
iface vmbr123
        bridge-ports vni123
        bridge-stp off
        bridge-fd 0

As an additional note: using frr 7.2.1 seems to be stable and is not crashing

[Spantik]

initial connection attempt failed

Sorry for delay. It seems that FRR service has no issue here as frr service is starting.

541 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: bgpd state -> up : connect succeeded
542 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: ospfd state -> up : connect succeeded
543 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: staticd state -> up : connect succeeded
544 Feb 25 15:46:53 localhost.localdomain watchfrr[34145]: all daemons up, doing startup-complete notify
545 Feb 25 15:46:53 localhost.localdomain frrinit.sh[34139]: Started watchfrr
546 Feb 25 15:46:53 localhost.localdomain systemd[1]: Started FRRouting.

[Spantik]

Mar 22 06:47:08 server03 bgpd[6689]: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from eth1 in vrf default
Mar 22 06:47:08 server03 bgpd[6689]: bgp_update_receive: rcvd End-of-RIB for L2VPN EVPN from eth1 in vrf default
Mar 22 06:47:08 server03 bgpd[6689]: Received signal 11 at 1584859628 (si_addr 0x0, PC 0x55b9c26240d9); aborting...
Mar 22 06:47:08 server03 bgpd[6689]: Backtrace for 12 stack frames:
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(zlog_backtrace_sigsafe+0x60) [0x7ff5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(zlog_signal+0x10c) [0x7ff5b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(+0x6c774) [0x7ff5b44aa774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12890) [0x7ff5b3a80890]774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(bgp_zebra_announce+0x619) [0x55b9c26240d9]890]774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(+0x7b9d6) [0x55b9c25df9d6][0x55b9c26240d9]890]774]b4489fbc]5b4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(work_queue_run+0xd6) [0x7ff5b44c15a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(thread_call+0x56) [0x7ff5b44b7f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0(frr_run+0xd8) [0x7ff5b4487dd8]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(main+0x324) [0x55b9c259ca74]run+0xd8) [0x7ff5b4487dd8]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7ff5b369eb97]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: /usr/lib/frr/bgpd(_start+0x2a) [0x55b9c259eb8a]in+0xe7) [0x7ff5b369eb97]f86]a6]4489b60]
Mar 22 06:47:08 server03 bgpd[6689]: in thread work_queue_run scheduled from lib/workqueue.c:140

Can you please help with core if you have? With L2VPN config BGP does keeps coring? Is there any specific config with in L2VPN which you think is offending?

[Spantik]

@polychaeta autoclose in one week.