Envoy: Dubbo connection is temporarily interrupted when the configuration is updated.

[popomen]

Title: Dubbo connection is temporarily interrupted when the configuration is updated.

Description:

Each time I modify the dubbo_proxy configuration in the envoy, the listener containing the filter is updated. According to the listener update mechanism of the LDS, the old listener enters the draining state and waits to be removed, and the new listener enters the warming state and then the active state. However, when the old listener is removed, the new listener does not take effect immediately. It takes about 30 seconds to start the new listener. The dubbo service is unavailable within 30 seconds.

Envoy logs:

[2019-12-31 02:40:30.998][17][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.105.248.91_20880 hash=17882840085526265571
(Some details of the new listener...)
[2019-12-31 02:40:31.005][17][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] add warming listener: name=10.105.248.91_20880, hash=17882840085526265571, address=10.105.248.91:20880
[2019-12-31 02:40:31.005][17][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] warm complete. updating active listener: name=10.105.248.91_20880, hash=17882840085526265571, address=10.105.248.91:20880
[2019-12-31 02:40:31.005][17][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] draining listener: name=10.105.248.91_20880, hash=16505751281972299251, address=10.105.248.91:20880

(In 45 seconds...)

[2019-12-31 02:41:15.043][17][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] removing listener: name=10.105.248.91_20880, hash=16505751281972299251, address=10.105.248.91:20880
[2019-12-31 02:41:15.043][23][debug][connection] [external/envoy/source/common/network/connection_impl.cc:101] [C297] closing data_to_write=0 type=1
[2019-12-31 02:41:15.043][23][debug][connection] [external/envoy/source/common/network/connection_impl.cc:190] [C297] closing socket: 1
[2019-12-31 02:41:15.043][23][debug][dubbo] [external/envoy/source/extensions/filters/network/dubbo_proxy/conn_manager.cc:31] **ConnectionManager::~ConnectionManager
[2019-12-31 02:41:15.043][17][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] listener removal complete: name=10.105.248.91_20880, hash=16505751281972299251, address=10.105.248.91:20880

(In 30 seconds...)

[2019-12-31 02:41:45.616][23][debug][config] [external/envoy/source/extensions/filters/network/dubbo_proxy/config.cc:136] **ConfigImpl::createProtocol
[2019-12-31 02:41:45.616][23][debug][dubbo] [external/envoy/source/extensions/filters/network/dubbo_proxy/conn_manager.cc:27] **ConnectionManager::ConnectionManager

Dubbo logs:

2020-01-16 08:27:36.140 ERROR 1 --- [nio-9080-exec-1] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [Request processing failed; nested exception is org.apache.dubbo.rpc.RpcException: Failed to invoke remote method: recommend, provider: recommendation:20880/com.popomen.dabb.recommendation.api.Recommendation?application=forecast&check=false&generic=false&interface=com.popomen.dabb.recommendation.api.Recommendation&lazy=false&pid=1&register.ip=10.244.3.38&remote.application=&revision=1.0.1-SNAPSHOT&side=consumer&sticky=false&timeout=1000000, cause: message can not send, because channel is closed . url:recommendation:20880/com.popomen.dabb.recommendation.api.Recommendation?application=forecast&check=false&codec=dubbo&generic=false&heartbeat=60000&interface=com.popomen.dabb.recommendation.api.Recommendation&lazy=false&pid=1&register.ip=10.244.3.38&remote.application=&revision=1.0.1-SNAPSHOT&side=consumer&sticky=false&timeout=1000000] with root cause
org.apache.dubbo.remoting.RemotingException: message can not send, because channel is closed . url:recommendation:20880/com.popomen.dabb.recommendation.api.Recommendation?application=forecast&check=false&codec=dubbo&generic=false&heartbeat=60000&interface=com.popomen.dabb.recommendation.api.Recommendation&lazy=false&pid=1&register.ip=10.244.3.38&remote.application=&revision=1.0.1-SNAPSHOT&side=consumer&sticky=false&timeout=1000000

[bingohuang]

+1 Same problem.

[zyfjeff]

@popomen Could you upload the whole envoy trace log?

[zyfjeff]

/assign @zyfjeff

[popomen]

[2020-01-16 09:00:10.116][19][debug][config] [external/envoy/source/common/config/grpc_mux_impl.cc:132] Received gRPC message for type.googleapis.com/envoy.api.v2.Listener at version 2020-01-16T09:00:10Z/32
[2020-01-16 09:00:10.116][19][debug][config] [external/envoy/source/common/config/grpc_mux_impl.cc:101] Pausing discovery requests for type.googleapis.com/envoy.api.v2.RouteConfiguration
[2020-01-16 09:00:10.116][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:746] begin remove listener: name=6e8bf41d-1b3f-4f30-867b-9ce680bff7e8
[2020-01-16 09:00:10.116][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:754] unknown/locked listener '6e8bf41d-1b3f-4f30-867b-9ce680bff7e8'. no remove
[2020-01-16 09:00:10.117][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.244.3.38_9080 hash=7673960929868624811
[2020-01-16 09:00:10.117][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.244.3.38_9080'. no add/update
[2020-01-16 09:00:10.117][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.244.3.38_15020 hash=18240697577002038327
[2020-01-16 09:00:10.117][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.244.3.38_15020'. no add/update
[2020-01-16 09:00:10.117][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.109.192.161_15029 hash=14165833222769574961
[2020-01-16 09:00:10.117][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.109.192.161_15029'. no add/update
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.100.116.38_6379 hash=7766513077376879158
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.100.116.38_6379'. no add/update
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.98.104.95_20881 hash=4661663114897764
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.98.104.95_20881'. no add/update
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.109.192.161_15443 hash=9010525812596187967
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.109.192.161_15443'. no add/update
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.106.25.97_20880 hash=16274811877132228350
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.106.25.97_20880'. no add/update
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.109.192.161_443 hash=10593898723255843122
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.109.192.161_443'. no add/update
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.103.211.47_443 hash=6371664084190592652
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.103.211.47_443'. no add/update
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.109.192.161_15032 hash=15369889457170035058
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.109.192.161_15032'. no add/update
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.96.0.1_443 hash=13076706859066400394
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.96.0.1_443'. no add/update
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.108.184.209_9000 hash=9539425944796744133
[2020-01-16 09:00:10.118][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.108.184.209_9000'. no add/update
[2020-01-16 09:00:10.119][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.109.192.161_31400 hash=4062997972212896809
[2020-01-16 09:00:10.119][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.109.192.161_31400'. no add/update
[2020-01-16 09:00:10.119][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.111.56.30_20881 hash=12862834683743267431
[2020-01-16 09:00:10.119][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.111.56.30_20881'. no add/update
[2020-01-16 09:00:10.119][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.105.248.91_20880 hash=345980053679949872
[2020-01-16 09:00:10.119][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:57] filter #0:
[2020-01-16 09:00:10.119][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:58] name: mixer
[2020-01-16 09:00:10.119][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:61] config: {}
[2020-01-16 09:00:10.125][19][debug][config] [src/envoy/utils/mixer_control.cc:173] ExtractInfo node metadata missing:NODE_UID fields {
...
[2020-01-16 09:00:10.125][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:57] filter #1:
[2020-01-16 09:00:10.125][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:58] name: envoy.filters.network.dubbo_proxy
[2020-01-16 09:00:10.125][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:61] config: {}
[2020-01-16 09:00:10.126][19][debug][dubbo] [external/envoy/source/extensions/filters/network/dubbo_proxy/router/route_matcher.cc:31] dubbo route matcher: weighted_clusters_size 2
[2020-01-16 09:00:10.126][19][debug][dubbo] [external/envoy/source/extensions/filters/network/dubbo_proxy/router/route_matcher.cc:186] dubbo route matcher: routes list size 1
[2020-01-16 09:00:10.126][19][debug][dubbo] [external/envoy/source/extensions/filters/network/dubbo_proxy/router/route_matcher.cc:31] dubbo route matcher: weighted_clusters_size 2
[2020-01-16 09:00:10.126][19][debug][dubbo] [external/envoy/source/extensions/filters/network/dubbo_proxy/router/route_matcher.cc:186] dubbo route matcher: routes list size 1
[2020-01-16 09:00:10.126][19][debug][dubbo] [external/envoy/source/extensions/filters/network/dubbo_proxy/router/route_matcher.cc:219] route matcher list size 2
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/extensions/filters/network/dubbo_proxy/config.cc:110] using default router filter
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/extensions/filters/network/dubbo_proxy/config.cc:144] dubbo filter #0
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/extensions/filters/network/dubbo_proxy/config.cc:145] name: envoy.filters.dubbo.router
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/extensions/filters/network/dubbo_proxy/config.cc:149] config: {}
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] add warming listener: name=10.105.248.91_20880, hash=345980053679949872, address=10.105.248.91:20880
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] line:608 after new_listener_ref.initialize();: name=10.105.248.91_20880, hash=345980053679949872, address=10.105.248.91:20880
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] warm complete. updating active listener: name=10.105.248.91_20880, hash=345980053679949872, address=10.105.248.91:20880
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] draining listener: name=10.105.248.91_20880, hash=11155164242519234785, address=10.105.248.91:20880
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] line:610 after new_listener_ref.initialize();: name=10.105.248.91_20880, hash=345980053679949872, address=10.105.248.91:20880
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.109.192.161_15031 hash=16855581072399535129
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.109.192.161_15031'. no add/update
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.96.0.10_53 hash=10591784934296408525
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.96.0.10_53'. no add/update
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.106.208.170_443 hash=14544952546773332196
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.106.208.170_443'. no add/update
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.98.151.43_443 hash=7346127626103902085
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.98.151.43_443'. no add/update
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.109.192.161_15030 hash=13158222765463639604
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.109.192.161_15030'. no add/update
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.99.31.162_15011 hash=15180998548318150532
[2020-01-16 09:00:10.126][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.99.31.162_15011'. no add/update
[2020-01-16 09:00:10.127][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.98.151.43_15443 hash=4346197053810508196
[2020-01-16 09:00:10.127][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.98.151.43_15443'. no add/update
[2020-01-16 09:00:10.127][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_15014 hash=15866336662325353105
[2020-01-16 09:00:10.127][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_15014'. no add/update
[2020-01-16 09:00:10.128][26][debug][config] [src/envoy/utils/mixer_control.cc:173] ExtractInfo node metadata missing:NODE_UID fields {
...
[2020-01-16 09:00:10.128][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.99.106.29_20881 hash=17638728219850765834
[2020-01-16 09:00:10.128][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.99.106.29_20881'. no add/update
[2020-01-16 09:00:10.128][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_15010 hash=1075885914505452426
[2020-01-16 09:00:10.128][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_15010'. no add/update
[2020-01-16 09:00:10.129][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.110.97.53_14268 hash=6338815714274005705
[2020-01-16 09:00:10.129][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.110.97.53_14268'. no add/update
[2020-01-16 09:00:10.129][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_8000 hash=8571983533748194430
[2020-01-16 09:00:10.129][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_8000'. no add/update
[2020-01-16 09:00:10.129][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_9555 hash=8840462166335704804
[2020-01-16 09:00:10.129][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_9555'. no add/update
[2020-01-16 09:00:10.129][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_9901 hash=6769688667242573111
[2020-01-16 09:00:10.129][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_9901'. no add/update
[2020-01-16 09:00:10.130][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_5000 hash=15861050667060502850
[2020-01-16 09:00:10.130][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_5000'. no add/update
[2020-01-16 09:00:10.130][28][debug][config] [src/envoy/utils/mixer_control.cc:173] ExtractInfo node metadata missing:NODE_UID fields {
...
[2020-01-16 09:00:10.130][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.110.97.53_14250 hash=11265269227007987849
[2020-01-16 09:00:10.130][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.110.97.53_14250'. no add/update
[2020-01-16 09:00:10.130][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_8080 hash=3399518195252606799
[2020-01-16 09:00:10.130][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_8080'. no add/update
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.109.192.161_15020 hash=2765190426485451733
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.109.192.161_15020'. no add/update
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_5050 hash=12814542077937330149
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_5050'. no add/update
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_80 hash=17739306711842156344
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_80'. no add/update
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_3000 hash=16331582303951039843
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_3000'. no add/update
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_20001 hash=18050329859934360232
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_20001'. no add/update
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_3550 hash=6699166396510953600
[2020-01-16 09:00:10.131][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_3550'. no add/update
[2020-01-16 09:00:10.132][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_7000 hash=11224131873176027840
[2020-01-16 09:00:10.132][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_7000'. no add/update
[2020-01-16 09:00:10.132][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.111.92.220_42422 hash=4444067627767461361
[2020-01-16 09:00:10.132][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.111.92.220_42422'. no add/update
[2020-01-16 09:00:10.132][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_9090 hash=12384742660311281267
[2020-01-16 09:00:10.132][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_9090'. no add/update
[2020-01-16 09:00:10.133][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.98.225.169_16686 hash=204311811491975480
[2020-01-16 09:00:10.133][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.98.225.169_16686'. no add/update
[2020-01-16 09:00:10.133][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=10.110.97.53_14267 hash=12394248318898437492
[2020-01-16 09:00:10.133][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '10.110.97.53_14267'. no add/update
[2020-01-16 09:00:10.133][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_9411 hash=12768722598159185680
[2020-01-16 09:00:10.133][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_9411'. no add/update
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_50051 hash=13502216266022967903
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_50051'. no add/update
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_15004 hash=16816452807393689446
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_15004'. no add/update
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_9091 hash=2210769168583554170
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_9091'. no add/update
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_8060 hash=9668735146788687059
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_8060'. no add/update
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_7070 hash=4375315244493903873
[2020-01-16 09:00:10.134][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_7070'. no add/update
[2020-01-16 09:00:10.135][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=0.0.0.0_9080 hash=8378079875167354930
[2020-01-16 09:00:10.135][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener '0.0.0.0_9080'. no add/update
[2020-01-16 09:00:10.142][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=virtualOutbound hash=15902848354568348468
[2020-01-16 09:00:10.142][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener 'virtualOutbound'. no add/update
[2020-01-16 09:00:10.143][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:499] begin add/update listener: name=virtualInbound hash=2824762179166537073
[2020-01-16 09:00:10.143][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:510] duplicate/locked listener 'virtualInbound'. no add/update
[2020-01-16 09:00:10.143][19][debug][config] [external/envoy/source/common/config/grpc_mux_impl.cc:109] Resuming discovery requests for type.googleapis.com/envoy.api.v2.RouteConfiguration
[2020-01-16 09:00:10.143][19][debug][config] [external/envoy/source/common/config/grpc_mux_subscription_impl.cc:61] gRPC config for type.googleapis.com/envoy.api.v2.Listener accepted with 52 resources with version 2020-01-16T09:00:10Z/32

[zyfjeff]

@popomen The logs look incomplete and I can't make a judgment

[popomen]

[2020-01-16 09:00:54.124][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] removing listener: name=10.105.248.91_20880, hash=11155164242519234785, address=10.105.248.91:20880
[2020-01-16 09:00:54.124][28][debug][dubbo] [external/envoy/source/extensions/filters/network/dubbo_proxy/conn_manager.cc:31] **ConnectionManager::~ConnectionManager
[2020-01-16 09:00:54.124][19][debug][config] [external/envoy/source/server/listener_manager_impl.cc:381] listener removal complete: name=10.105.248.91_20880, hash=11155164242519234785, address=10.105.248.91:20880

[popomen]

[2020-01-16 09:00:57.032][26][debug][config] [external/envoy/source/extensions/filters/network/dubbo_proxy/config.cc:136] **ConfigImpl::createProtocol
[2020-01-16 09:00:57.032][26][debug][dubbo] [external/envoy/source/extensions/filters/network/dubbo_proxy/conn_manager.cc:27] **ConnectionManager::ConnectionManager

[zyfjeff]

@popomen Can you upload the full log file?

[stale[bot]]

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged "help wanted" or other activity occurs. Thank you for your contributions.

[stale[bot]]

This issue has been automatically closed because it has not had activity in the last 37 days. If this issue is still valid, please ping a maintainer and ask them to label it as "help wanted". Thank you for your contributions.