Mosquitto: Broker process running, but not accepting connections

Created on 23 Nov 2017 · 24Comments · Source: eclipse/mosquitto

Hi,

I have one broker process running from long time and with ps I can see the process, but it is not accepting connections.

vinod_kumar@mqtt-broker-2:~$ ps aux|grep -i mosquitto
vinod_k+  3865  0.0  0.0   8212  2164 pts/2    S+   05:11   0:00 grep --color=auto -i mosquitto
mosquit+ 25389  0.1  0.1  39688  5652 ?        R     2016 594:16 mosquitto -c mosquitto.conf -d

vinod_kumar@mqtt-broker-2:~$ mosquitto_sub -t hello -d
Error: Connection refused

The process is using far more than normal cpu usage
Output of top -

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND                                                                                                          
25389 mosquit+  20   0   39688   5652   4188 R 99.9  0.1 584:37.48 mosquitto

I am using old version of mosquitto, so not sure if this issue is fixed in newer releases, though I checked and could not find any fix directly stating the problem I am facing.
Mosquitto version

mosquitto version 1.4.5 (build date Mon, 09 Nov 2015 15:00:46 +0000)
mosquitto is an MQTT v3.1 broker.

OS version

vinod_kumar@mqtt-broker-2:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 15.04
Release:    15.04
Codename:   vivid

Mosquitto conf

vinod_kumar@mqtt-broker-2:~$ cat mosquitto.conf 
autosave_interval 100
persistence true
persistence_file m2.db
persistence_location ./
connection_messages true
log_timestamp true
listener 1883
listener 1884 127.0.0.1
protocol websockets
allow_duplicate_messages false
max_connections -1
max_inflight_messages 50
max_queued_messages 1000
persistent_client_expiration 3m
sys_interval 1

Output of memleax

vinod_kumar@mqtt-broker-2:~$ sudo memleax 25389
Warning: no debug-line found for /usr/sbin/mosquitto
== Begin monitoring process 25389...
CallStack[1]: memory expires with 80 bytes, backtrace:
    0x00007fb3dcc5d4a0  libc-2.21.so  __libc_malloc()+0  /build/buildd/glibc-2.21/malloc/hooks.c:77
    0x000000000040e666  mosquitto
    0x000000000040c291  mosquitto
    0x000000000040c566  mosquitto
    0x000000000041a783  mosquitto
    0x000000000040daac  mosquitto
    0x0000000000404a58  mosquitto
    0x00007fb3dcbf9a40  libc-2.21.so  __libc_start_main()+240  /build/buildd/glibc-2.21/stdio-common/_i18n_number.h:117
    0x0000000000404c87  mosquitto
CallStack[2]: memory expires with 1 bytes, backtrace:
    0x00007fb3dcc5d4a0  libc-2.21.so  __libc_malloc()+0  /build/buildd/glibc-2.21/malloc/hooks.c:77
    0x00007fb3dcc6442a  libc-2.21.so  strdup()+26  /build/buildd/glibc-2.21/string/strdup.c:42
    0x000000000040e736  mosquitto
    0x000000000040c2ba  mosquitto
    0x000000000040c566  mosquitto
    0x000000000041a783  mosquitto
    0x000000000040daac  mosquitto
    0x0000000000404a58  mosquitto
    0x00007fb3dcbf9a40  libc-2.21.so  __libc_start_main()+240  /build/buildd/glibc-2.21/stdio-common/_i18n_number.h:117
    0x0000000000404c87  mosquitto
CallStack[3]: memory expires with 19 bytes, backtrace:
    0x00007fb3dcc5d4a0  libc-2.21.so  __libc_malloc()+0  /build/buildd/glibc-2.21/malloc/hooks.c:77
    0x00007fb3dcc6442a  libc-2.21.so  strdup()+26  /build/buildd/glibc-2.21/string/strdup.c:42
    0x000000000040e736  mosquitto
    0x000000000040c2f8  mosquitto
    0x000000000040c566  mosquitto
    0x000000000041a783  mosquitto
    0x000000000040daac  mosquitto
    0x0000000000404a58  mosquitto
    0x00007fb3dcbf9a40  libc-2.21.so  __libc_start_main()+240  /build/buildd/glibc-2.21/stdio-common/_i18n_number.h:117
    0x0000000000404c87  mosquitto
CallStack[4]: memory expires with 16 bytes, backtrace:
    0x00007fb3dcc5d4a0  libc-2.21.so  __libc_malloc()+0  /build/buildd/glibc-2.21/malloc/hooks.c:77
    0x000000000040e666  mosquitto
    0x000000000040c3c6  mosquitto
    0x000000000040c566  mosquitto
    0x000000000041a783  mosquitto
    0x000000000040daac  mosquitto
    0x0000000000404a58  mosquitto
    0x00007fb3dcbf9a40  libc-2.21.so  __libc_start_main()+240  /build/buildd/glibc-2.21/stdio-common/_i18n_number.h:117
    0x0000000000404c87  mosquitto
CallStack[2]: expired-memory frees after 101 seconds
CallStack[3]: expired-memory frees after 101 seconds
CallStack[4]: expired-memory frees after 101 seconds
CallStack[1]: expired-memory frees after 101 seconds
CallStack[1]: memory expires with 80 bytes, 2 times again
CallStack[2]: memory expires with 1 bytes, 2 times again
CallStack[3]: memory expires with 19 bytes, 2 times again
CallStack[4]: memory expires with 16 bytes, 2 times again
CallStack[2]: expired-memory frees after 101 seconds
CallStack[3]: expired-memory frees after 101 seconds
CallStack[4]: expired-memory frees after 101 seconds
CallStack[1]: expired-memory frees after 101 seconds
CallStack[1]: memory expires with 80 bytes, 3 times again
CallStack[2]: memory expires with 1 bytes, 3 times again
CallStack[3]: memory expires with 19 bytes, 3 times again
CallStack[4]: memory expires with 16 bytes, 3 times again
CallStack[2]: expired-memory frees after 101 seconds
Warning: too many expired-free at CallStack[2]. will not show this CallStack later
CallStack[3]: expired-memory frees after 101 seconds
Warning: too many expired-free at CallStack[3]. will not show this CallStack later
CallStack[4]: expired-memory frees after 101 seconds
Warning: too many expired-free at CallStack[4]. will not show this CallStack later
CallStack[1]: expired-memory frees after 101 seconds
Warning: too many expired-free at CallStack[1]. will not show this CallStack later

Output of strace -

Process 25389 attached
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473126553}) = 0
poll([{fd=6, events=POLLIN}], 1, 0)     = 0 (Timeout)
clock_gettime(CLOCK_MONOTONIC, {34451458, 473166932}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473183767}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473200917}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473217392}) = 0
rt_sigprocmask(SIG_SETMASK, [INT], [], 8) = 0
poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN}, {fd=7, events=POLLIN}, {fd=9, events=POLLIN}], 4, 100) = 1 ([{fd=3, revents=POLLNVAL}])
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473295297}) = 0
poll([{fd=6, events=POLLIN}], 1, 0)     = 0 (Timeout)
clock_gettime(CLOCK_MONOTONIC, {34451458, 473352136}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473379862}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473397232}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473413209}) = 0
rt_sigprocmask(SIG_SETMASK, [INT], [], 8) = 0
poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN}, {fd=7, events=POLLIN}, {fd=9, events=POLLIN}], 4, 100) = 1 ([{fd=3, revents=POLLNVAL}])
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473486496}) = 0
poll([{fd=6, events=POLLIN}], 1, 0)     = 0 (Timeout)
clock_gettime(CLOCK_MONOTONIC, {34451458, 473518710}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473534360}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473550677}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473566255}) = 0
rt_sigprocmask(SIG_SETMASK, [INT], [], 8) = 0
poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN}, {fd=7, events=POLLIN}, {fd=9, events=POLLIN}], 4, 100) = 1 ([{fd=3, revents=POLLNVAL}])
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473637297}) = 0
poll([{fd=6, events=POLLIN}], 1, 0)     = 0 (Timeout)
clock_gettime(CLOCK_MONOTONIC, {34451458, 473677707}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473693527}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473709630}) = 0
clock_gettime(CLOCK_MONOTONIC, {34451458, 473725872}) = 0
rt_sigprocmask(SIG_SETMASK, [INT], [], 8) = 0
poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN}, {fd=7, events=POLLIN}, {fd=9, events=POLLIN}], 4, 100) = 1 ([{fd=3, revents=POLLNVAL}])

Please let me know if I can provide anything else to help debug the issue.

bug mosquitto-broker need-more-information

Source

kumar003vinod

All 24 comments

Is it your first time running mosquitto on this environment?
The mosquitto.conf is too complicated to clarify the issue. Could you replace mosuqitto.conf to "log_type all" only and report the console log?

toast-uz on 23 Nov 2017

@toast-uz this is not first time. This issue does not occur often, I have faced this multiple times in this environment, it randomly occurs when broker is running from a long time (can be months). Once I restart the broker, it works fine.
And I am able to connect fine on 1884 port with websocket, the issue is only with 1883 port.
If I run netstat on instance running the broker fine vs on broker which is not accepting connection, I get this.
Instance with broker working fine

vinod_kumar@mqtt-broker:~$ sudo netstat -tulpn | grep :1883
tcp        0      0 0.0.0.0:1883            0.0.0.0:*               LISTEN      26368/mosquitto 
tcp6       0      0 :::1883                 :::*                    LISTEN      26368/mosquitto 
vinod_kumar@mqtt-broker:~$ sudo netstat -tulpn | grep :1884
tcp        0      0 0.0.0.0:1884            0.0.0.0:*               LISTEN      26368/mosquitto

Instance with broker not working fine

vinod_kumar@mqtt-broker-2:~$ sudo netstat -tulpn | grep :1883
tcp6       0      0 :::1883                 :::*                    LISTEN      25389/mosquitto 
vinod_kumar@mqtt-broker-2:~$ sudo netstat -tulpn | grep :1884
tcp        0      0 0.0.0.0:1884            0.0.0.0:*               LISTEN      25389/mosquitto

Seems like broker is not even listening on 1883 port.

kumar003vinod on 23 Nov 2017

Any valid log of mosquitto?

toast-uz on 23 Nov 2017

Logs were disabled on server, so I do not have any mosquitto logs.

kumar003vinod on 24 Nov 2017

You can find some important hints of resolving your issue after setting logs of mosquitto. I guess some socket errors occurred on your environment. You can see "Error in poll" log with the description of the detailed cause when the issue is reproduced.

toast-uz on 24 Nov 2017

It seems like the first listening socket (with fd=3 which is likely the IPv4 listening socket) is invalid, that is why poll returns [{fd=3, revents=POLLNVAL}])
Maybe it got closed somehow?
Maybe it is related to https://github.com/eclipse/mosquitto/issues/647
Using docker ?

edwin-oetelaar on 10 Dec 2017

@edwin-oetelaar I am not using docker. I have enabled logs on instance. I will update in case I face this issue again.

kumar003vinod on 13 Dec 2017

I'm done a quick looks, and I don't find any reason why Mosquitto could close the listening socket :(
In addition to logs, I would also be interested in:

netstat -tanp | grep :1883 : this will also list established connection. Here I'm interested in the count. If non-zero, the number with and without process associated is interesting. (I don't care about IPs value)
lsof of the process. At least I'm interested to known if FD 3 is still open.

What I'm trying is to confirm is the listening socket is indeed closed or if it's still "open" but no longer listening.

Finally, are you able to reproduce this issue without websockets ? There are issue about Websockets listener that stop working, I would like to eliminate the possibility for Websockets to interfere in this issue.

PierreF on 4 Jan 2018

I did not check the instance for long now as this is backup server and we almost never use it. Today checked and found that broker is again not accepting connections, but this time it's a throwing network protocol error. netstat output looks fine, but in process fds there is no fd 3.

```vinod@mqtt-broker-2:~$ mosquitto_sub -t hello -d
Client mosqsub/24267-mqtt-brok sending CONNECT
Error: A network protocol error occurred when communicating with the broker.
vinod@mqtt-broker-2:~$ sudo netstat -tanp | grep :1883
tcp 0 0 0.0.0.0:1883 0.0.0.0:* LISTEN 4988/mosquitto
tcp 0 0 127.0.0.1:42058 127.0.0.1:1883 ESTABLISHED 15818/nodejs
tcp 0 0 127.0.0.1:1883 127.0.0.1:42058 ESTABLISHED 4988/mosquitto
tcp 0 0 127.0.0.1:42057 127.0.0.1:1883 ESTABLISHED 1432/nodejs
tcp 0 0 127.0.0.1:1883 127.0.0.1:42057 ESTABLISHED 4988/mosquitto
tcp6 0 0 :::1883 :::* LISTEN 4988/mosquitto
vinod@mqtt-broker-2:~$ ps aux|grep -i mosquitto
mosquit+ 4988 0.0 0.1 38908 4788 ? S 2017 67:11 mosquitto -c mosquitto.conf -d
vinod 24287 0.0 0.0 8212 2240 pts/0 S+ 18:34 0:00 grep --color=auto -i mosquitto
vinod@mqtt-broker-2:/var/log/mosquitto$ sudo ls /proc/4988/fd
0 1 11 2 4 5 6 7 8 9
vinod@mqtt-broker-2:~$ sudo ls -l /proc/4988/fd
total 0
lrwx------ 1 root root 64 Mar 2 18:26 0 -> /dev/pts/1 (deleted)
lrwx------ 1 root root 64 Mar 2 18:26 1 -> /dev/pts/1 (deleted)
lrwx------ 1 root root 64 Mar 2 18:26 11 -> socket:[40962151]
lrwx------ 1 root root 64 Mar 2 18:26 2 -> /dev/pts/1 (deleted)
lrwx------ 1 root root 64 Mar 2 18:26 4 -> socket:[40337702]
lrwx------ 1 root root 64 Mar 2 18:26 5 -> socket:[40337703]
lr-x------ 1 root root 64 Mar 2 18:26 6 -> /dev/urandom
lrwx------ 1 root root 64 Mar 2 18:26 7 -> socket:[40337704]
lrwx------ 1 root root 64 Mar 2 18:26 8 -> socket:[40337707]
lrwx------ 1 root root 64 Mar 2 18:26 9 -> socket:[40337708]
vinod@mqtt-broker-2:~$ sudo lsof -i:1883
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
nodejs 1432 vinod_kumar 11u IPv4 40337705 0t0 TCP localhost:42057->localhost:1883 (ESTABLISHED)
mosquitto 4988 mosquitto 4u IPv4 40337702 0t0 TCP *:1883 (LISTEN)
mosquitto 4988 mosquitto 5u IPv6 40337703 0t0 TCP *:1883 (LISTEN)
mosquitto 4988 mosquitto 8u IPv4 40337707 0t0 TCP localhost:1883->localhost:42057 (ESTABLISHED)
mosquitto 4988 mosquitto 9u IPv4 40337708 0t0 TCP localhost:1883->localhost:42058 (ESTABLISHED)
nodejs 15818 vinod_kumar 9u IPv4 40337706 0t0 TCP localhost:42058->localhost:1883 (ESTABLISHED)
vinod@mqtt-broker-2:~$ cd /var/log/mosquitto/
vinod@mqtt-broker-2:/var/log/mosquitto$ ls
mosquitto.log mosquitto.log.1.gz mosquitto.log.2.gz mosquitto.log.3.gz mosquitto.log.4.gz mosquitto.log.5.gz mosquitto.log.6.gz mosquitto.log.7.gz

Somehow it does not have write permission for db file, but that should not stop it from accepting connections ??

1513514556: Saving in-memory database to ./m2.db.
1513514556: Error saving in-memory database, unable to open ./m2.db.new for writing.
1513514556: Error: Permission denied.
1513514657: Saving in-memory database to ./m2.db.
1513514657: Error saving in-memory database, unable to open ./m2.db.new for writing.
1513514657: Error: Permission denied.
1513514701: New connection from 127.0.0.1 on port 1883.
1513514701: New client connected from 127.0.0.1 as mosqsub/13478-mqtt-brok (c1, k60).
1513514701: Sending CONNACK to mosqsub/13478-mqtt-brok (0, 0)
1513514701: Received SUBSCRIBE from mosqsub/13478-mqtt-brok
1513514701: test (QoS 0)
1513514701: mosqsub/13478-mqtt-brok 0 test
1513514701: Sending SUBACK to mosqsub/13478-mqtt-brok
1513514701: Socket error on client mosqsub/13478-mqtt-brok, disconnecting.
1513514758: Saving in-memory database to ./m2.db.
```

kumar003vinod on 2 Mar 2018

I have the same problem, practically periodically.

Mosquitto service is runninq but refuses any new connections.

$ mosquitto_sub -h localhost -u user -P pass -t '#'
Error: A network protocol error occurred when communicating with the broker.

Mosquitto version

mosquitto version 1.4.15 (build date Sun, 04 Mar 2018 21:04:15 +0000)
mosquitto is an MQTT v3.1.1/v3.1 broker.

Last log file lines:

1521158396: Client NODE_165 has exceeded timeout, disconnecting.
**1521158396: Socket error on client NODE_165, disconnecting.** // this one is same as in comment above
1521158396: New connection from 213.192.25.217 on port 1883.
1521158396: Client NODE_165 disconnected.
1521158396: New client connected from 213.192.25.217 as NODE_165 (c0, k60, u'Writer_00165').
1521158396: Sending CONNACK to NODE_165 (1, 0)
1521158397: Received SUBSCRIBE from NODE_165
1521158397:     165/NODE/# (QoS 2)
1521158397: NODE_165 2 165/NODE/#
1521158397: Sending SUBACK to NODE_165
1521158397: Received PUBLISH from NODE_165 (d0, q0, r0, m0, '165/JS/HELLO', ... (26 bytes))
1521158437: accepted new conn  port 2024 on fd=17

Mixerito on 16 Mar 2018

@Mixerito Are you using websockets, and if so which version of libwebsockets do you have?

ralight on 15 Aug 2018

Im able to turn on my sonoff basic via tasmoadmin but when i try to switch it from hassio via mosquitto add in, i get the following error in the log:

1538815077: New connection from 192.168.1.8 on port 1883.
1538815077: Socket error on client , disconnecting.

This is all i can see in the log. over and over.

I have very little coding experience, but Google has gotten me this far and now I'm stuck. Please, if anyone could point me in the right direction i would greatly appreciate it!!

Here is the error im seeing in the sonoff's console:

stat/sonoff/STATUS11 = {"StatusSTS":{"Time":"2018-10-06T09:29:56","Uptime":"0T01:58:06","Vcc":3.225,"POWER":"OFF","Wifi":{"AP":1,"SSId":"myNetwork","RSSI":80,"APMac":"D0:17:C2:8D:8D:11"}}}
09:30:04 MQT: Attempting connection...
09:30:04 MQT: Connect failed to 192.168.1.7:1883, rc 5. Retry in 10 sec

It seems to be doing reads, but then fails the connection for some reason.

QueenAnnie on 6 Oct 2018

I have same issue here.. It worked yesterday after setting it up. Today in the morning Im getting:
Error: Connection refused

pawisoon on 15 Nov 2018

@pawisoon please share logs, it might help locate the issue
Also check if FD 3 is open and share the output of netstat -tanp | grep :1883 to confirm that you are having the same issue as I faced.

kumar003vinod on 15 Nov 2018

I'm having this issue too. No succesful connection yet.

Fresh install of raspbian stretch and mosquitto via apt.

slimcdk on 9 Jan 2019

Same issue here.
I'm using docker with latest image.

TheDevMinerTV on 19 Jan 2019

i use apt to install mosquitto and i have the same problem. But if i start mosquitto with just: mosquitto -v every thing is ok. service mosquitto start not working. stange....

kaneghost on 25 Jan 2019

I'm also seeing this on Ubuntu, where it has been installed through apt. Existing clients are unable to send/receive messages suddenly without any warning. There are about 3 instances of this sudden lock out below from the logs:

ashley@brokerhost:~$ sudo tail -n400 /var/log/mosquitto/mosquitto.log 1549821203: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549821203: Client sensor01_energenie already connected, closing old connection. 1549821203: Client sensor01_energenie disconnected. 1549821203: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549821205: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549821215: Socket error on client sensor01_energenie, disconnecting. 1549821313: New connection from 10.135.35.36 on port 1883. 1549821313: New connection from 10.135.35.36 on port 1883. 1549821313: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549821313: Client sensor01_energenie already connected, closing old connection. 1549821313: Client sensor01_energenie disconnected. 1549821313: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549821327: Socket error on client sensor01_energenie, disconnecting. 1549822038: New connection from 10.135.35.36 on port 1883. 1549822038: New connection from 10.135.35.36 on port 1883. 1549822038: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549822038: Client sensor01_energenie already connected, closing old connection. 1549822038: Client sensor01_energenie disconnected. 1549822038: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549822039: New connection from 10.135.35.36 on port 1883. 1549822039: Client sensor01_energenie already connected, closing old connection. 1549822039: Client sensor01_energenie disconnected. 1549822039: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549822047: Socket error on client sensor01_energenie, disconnecting. 1549822114: New connection from 10.135.35.36 on port 1883. 1549822114: New connection from 10.135.35.36 on port 1883. 1549822114: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549822114: Client sensor01_energenie already connected, closing old connection. 1549822114: Client sensor01_energenie disconnected. 1549822114: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549822126: Socket error on client sensor01_energenie, disconnecting. 1549822670: New connection from 10.135.35.36 on port 1883. 1549822670: New connection from 10.135.35.36 on port 1883. 1549822670: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549822670: Client sensor01_energenie already connected, closing old connection. 1549822670: Client sensor01_energenie disconnected. 1549822670: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549822671: New connection from 10.135.35.36 on port 1883. 1549822671: Client sensor01_energenie already connected, closing old connection. 1549822671: Client sensor01_energenie disconnected. 1549822671: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549823006: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549824518: Socket error on client sensor01_energenie, disconnecting. 1549824807: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549826608: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549826869: New connection from 10.135.35.36 on port 1883. 1549826869: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549826871: Socket error on client sensor01_energenie, disconnecting. 1549827156: New connection from 10.135.35.36 on port 1883. 1549827156: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549827160: Socket error on client sensor01_energenie, disconnecting. 1549827314: New connection from 10.135.35.36 on port 1883. 1549827315: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549827319: Socket error on client sensor01_energenie, disconnecting. 1549827409: New connection from 10.135.35.36 on port 1883. 1549827409: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549827419: Socket error on client sensor01_energenie, disconnecting. 1549827478: New connection from 10.135.35.36 on port 1883. 1549827478: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549827550: Socket error on client sensor01_energenie, disconnecting. 1549827779: New connection from 10.135.35.36 on port 1883. 1549827779: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549827868: Client sensor01_energenie has exceeded timeout, disconnecting. 1549827868: Socket error on client sensor01_energenie, disconnecting. 1549827955: New connection from 10.135.35.36 on port 1883. 1549827955: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549827984: Socket error on client sensor01_energenie, disconnecting. 1549828409: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549830135: New connection from 10.135.35.36 on port 1883. 1549830135: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549830141: Socket error on client sensor01_energenie, disconnecting. 1549830210: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549830270: New connection from 10.135.35.36 on port 1883. 1549830270: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549830360: Client sensor01_energenie has exceeded timeout, disconnecting. 1549830360: Socket error on client sensor01_energenie, disconnecting. 1549830573: New connection from 10.135.35.36 on port 1883. 1549830573: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549830662: Client sensor01_energenie has exceeded timeout, disconnecting. 1549830662: Socket error on client sensor01_energenie, disconnecting. 1549830685: New connection from 10.135.35.36 on port 1883. 1549830685: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549830774: Client sensor01_energenie has exceeded timeout, disconnecting. 1549830774: Socket error on client sensor01_energenie, disconnecting. 1549831107: New connection from 10.135.35.36 on port 1883. 1549831107: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549831149: Socket error on client sensor01_energenie, disconnecting. 1549832011: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549832632: New connection from 10.135.35.36 on port 1883. 1549832632: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549832655: Socket error on client sensor01_energenie, disconnecting. 1549832842: New connection from 10.135.35.36 on port 1883. 1549832842: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549832845: Socket error on client sensor01_energenie, disconnecting. 1549833002: New connection from 10.135.35.36 on port 1883. 1549833002: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549833619: Socket error on client sensor01_energenie, disconnecting. 1549833629: New connection from 10.135.35.36 on port 1883. 1549833629: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549833812: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549834123: Socket error on client sensor01_energenie, disconnecting. 1549834128: New connection from 10.135.35.36 on port 1883. 1549834128: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549834208: Socket error on client sensor01_energenie, disconnecting. 1549834218: New connection from 10.135.35.36 on port 1883. 1549834218: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549834240: Socket error on client sensor01_energenie, disconnecting. 1549834337: New connection from 10.135.35.36 on port 1883. 1549834337: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549834524: Socket error on client sensor01_energenie, disconnecting. 1549834662: New connection from 10.135.35.36 on port 1883. 1549834662: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549834771: Socket error on client sensor01_energenie, disconnecting. 1549834776: New connection from 10.135.35.36 on port 1883. 1549834776: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549835613: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549837414: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549839215: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549841016: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549841542: Socket error on client sensor01_energenie, disconnecting. 1549842644: New connection from 10.135.35.36 on port 1883. 1549842644: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549842817: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549844618: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549846045: Client brokerhost_node-red disconnected. 1549846045: New connection from 127.0.0.1 on port 1883. 1549846045: Client brokerhost_node-red disconnected. 1549846045: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1549846072: Client brokerhost_node-red disconnected. 1549846072: New connection from 127.0.0.1 on port 1883. 1549846072: Client brokerhost_node-red disconnected. 1549846072: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1549846087: Client brokerhost_node-red disconnected. 1549846419: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549848220: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549850021: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549851822: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549853623: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549855424: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549857225: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549859026: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549860274: Client sensor01_energenie has exceeded timeout, disconnecting. 1549860274: Socket error on client sensor01_energenie, disconnecting. 1549860827: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549862628: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549864429: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549866230: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549868031: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549869832: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549871633: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549873434: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549874942: New connection from 10.135.35.36 on port 1883. 1549874942: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549875235: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549877036: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549878837: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549880638: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549880808: Socket error on client sensor01_energenie, disconnecting. 1549880957: New connection from 10.135.35.36 on port 1883. 1549880957: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1549882439: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549884240: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549886041: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549887842: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549889643: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549891444: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549893245: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549895046: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549896847: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549898648: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549900449: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549902250: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549904051: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549905852: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549907653: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549909454: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549911255: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549913056: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549914857: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549916658: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549918459: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549920260: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549922061: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549923862: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549925663: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549927464: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549929265: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549931066: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549932867: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549934668: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549936469: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549938270: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549940071: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549941872: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549943673: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549945474: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549947275: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549949076: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549950877: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1549951921: mosquitto version 1.4.15 (build date Wed, 06 Feb 2019 17:03:31 +0000) starting 1549951921: Config loaded from /etc/mosquitto/mosquitto.conf. 1549951921: Opening ipv4 listen socket on port 1883. 1549951921: Error: Address already in use 1549951921: mosquitto version 1.4.15 terminating 1550065317: mosquitto version 1.4.15 (build date Wed, 06 Feb 2019 17:03:31 +0000) starting 1550065317: Config loaded from /etc/mosquitto/mosquitto.conf. 1550065317: Opening ipv4 listen socket on port 1883. 1550065317: Opening ipv6 listen socket on port 1883. 1550065321: New connection from 127.0.0.1 on port 1883. 1550065321: New client connected from 127.0.0.1 as emoncms (c1, k5, u''). 1550065394: New connection from 10.135.35.36 on port 1883. 1550065394: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1550067117: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550068918: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550070719: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550072520: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550074321: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550076122: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550077923: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550079724: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550081525: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550083326: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550085127: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550086928: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550088729: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550090530: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550092331: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550094132: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550095933: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550097734: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550099535: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550101336: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550102325: New connection from 127.0.0.1 on port 1883. 1550102325: Client brokerhost_node-red disconnected. 1550102325: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550102611: Client brokerhost_node-red disconnected. 1550102611: New connection from 127.0.0.1 on port 1883. 1550102611: Client brokerhost_node-red disconnected. 1550102611: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550102682: Client brokerhost_node-red disconnected. 1550102682: New connection from 127.0.0.1 on port 1883. 1550102682: Client brokerhost_node-red disconnected. 1550102682: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550102711: Client brokerhost_node-red disconnected. 1550102711: New connection from 127.0.0.1 on port 1883. 1550102711: Client brokerhost_node-red disconnected. 1550102711: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550102749: Client brokerhost_node-red disconnected. 1550102749: New connection from 127.0.0.1 on port 1883. 1550102750: Client brokerhost_node-red disconnected. 1550102750: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550102780: Client brokerhost_node-red disconnected. 1550102780: New connection from 127.0.0.1 on port 1883. 1550102780: Client brokerhost_node-red disconnected. 1550102780: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550102882: Client brokerhost_node-red disconnected. 1550102882: New connection from 127.0.0.1 on port 1883. 1550102882: Client brokerhost_node-red disconnected. 1550102882: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550102938: Client brokerhost_node-red disconnected. 1550103137: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550104361: New connection from 127.0.0.1 on port 1883. 1550104361: Client brokerhost_node-red disconnected. 1550104361: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550104398: Client brokerhost_node-red disconnected. 1550104398: New connection from 127.0.0.1 on port 1883. 1550104398: Client brokerhost_node-red disconnected. 1550104398: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550104440: Client brokerhost_node-red disconnected. 1550104440: New connection from 127.0.0.1 on port 1883. 1550104440: Client brokerhost_node-red disconnected. 1550104440: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550104474: Client brokerhost_node-red disconnected. 1550104474: New connection from 127.0.0.1 on port 1883. 1550104474: Client brokerhost_node-red disconnected. 1550104474: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550104502: Client brokerhost_node-red disconnected. 1550104502: New connection from 127.0.0.1 on port 1883. 1550104502: Client brokerhost_node-red disconnected. 1550104502: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550104548: Client brokerhost_node-red disconnected. 1550104549: New connection from 127.0.0.1 on port 1883. 1550104549: Client brokerhost_node-red disconnected. 1550104549: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550104584: Client brokerhost_node-red disconnected. 1550104584: New connection from 127.0.0.1 on port 1883. 1550104584: Client brokerhost_node-red disconnected. 1550104584: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550104643: Client brokerhost_node-red disconnected. 1550104643: New connection from 127.0.0.1 on port 1883. 1550104643: Client brokerhost_node-red disconnected. 1550104643: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550104938: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550105272: Client brokerhost_node-red disconnected. 1550105272: New connection from 127.0.0.1 on port 1883. 1550105272: Client brokerhost_node-red disconnected. 1550105272: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550105316: Client brokerhost_node-red disconnected. 1550105316: New connection from 127.0.0.1 on port 1883. 1550105316: Client brokerhost_node-red disconnected. 1550105316: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550105394: Client brokerhost_node-red disconnected. 1550105394: New connection from 127.0.0.1 on port 1883. 1550105394: Client brokerhost_node-red disconnected. 1550105394: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550105628: Client brokerhost_node-red disconnected. 1550105628: New connection from 127.0.0.1 on port 1883. 1550105628: Client brokerhost_node-red disconnected. 1550105628: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550106739: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550108540: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550110341: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550112142: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550113943: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550115744: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550117545: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550119346: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550121147: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550122948: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550124749: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550126550: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550128351: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550130152: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550131953: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550133754: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550135555: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550136757: Socket error on client sensor01_energenie, disconnecting. 1550136758: New connection from 10.135.35.36 on port 1883. 1550136758: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1550137356: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550139157: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550140958: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550142411: Client brokerhost_node-red disconnected. 1550142411: New connection from 127.0.0.1 on port 1883. 1550142411: Client brokerhost_node-red disconnected. 1550142411: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550142439: Client brokerhost_node-red disconnected. 1550142439: New connection from 127.0.0.1 on port 1883. 1550142439: Client brokerhost_node-red disconnected. 1550142439: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550142759: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550144560: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550146361: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550148162: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550149963: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550151764: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550153565: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550155366: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550157167: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550158968: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550160769: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550162570: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550164371: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550166172: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550167973: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550169774: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550171575: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550173376: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550175177: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550176978: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550178779: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550180580: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550182381: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550184182: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550185724: Client sensor01_energenie has exceeded timeout, disconnecting. 1550185724: Socket error on client sensor01_energenie, disconnecting. 1550185983: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550187784: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550189585: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550191386: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550193187: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550194988: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550196789: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550198590: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550200391: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550202192: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550203993: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550205794: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550207595: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550209396: Saving in-memory database to /var/lib/mosquitto/mosquitto.db. 1550211122: mosquitto version 1.4.15 (build date Wed, 13 Feb 2019 00:27:01 +0000) starting 1550211122: Config loaded from /etc/mosquitto/mosquitto.conf. 1550211122: Opening ipv4 listen socket on port 1883. 1550211122: Error: Address already in use 1550211122: mosquitto version 1.4.15 terminating 1550329161: mosquitto version 1.4.15 (build date Wed, 13 Feb 2019 00:27:01 +0000) starting 1550329161: Config loaded from /etc/mosquitto/mosquitto.conf. 1550329161: Opening ipv4 listen socket on port 1883. 1550329161: Opening ipv6 listen socket on port 1883. 1550329162: New connection from 127.0.0.1 on port 1883. 1550329162: Client brokerhost_node-red disconnected. 1550329162: New client connected from 127.0.0.1 as brokerhost_node-red (c0, k60). 1550329167: New connection from 127.0.0.1 on port 1883. 1550329167: New client connected from 127.0.0.1 as emoncms (c1, k5, u''). 1550329173: New connection from 10.135.35.36 on port 1883. 1550329173: New client connected from 10.135.35.36 as mosqpub/4403-agn-sensor (c1, k60). 1550329173: Client mosqpub/4403-agn-sensor disconnected. 1550329200: New connection from 10.135.35.36 on port 1883. 1550329200: New client connected from 10.135.35.36 as sensor01_energenie (c1, k60). 1550329850: Client brokerhost_node-red disconnected. ashley@brokerhost:~$

The status of the systemd unit at this point is still 'running'
````
ashley@brokerhost:~$ sudo systemctl status mosquitto
● mosquitto.service - LSB: mosquitto MQTT v3.1 message broker
Loaded: loaded (/etc/init.d/mosquitto; generated)
Active: active (running) since Fri 2019-02-15 06:12:02 UTC; 1 day 8h ago
Docs: man:systemd-sysv-generator(8)
Tasks: 0 (limit: 1152)
CGroup: /system.slice/mosquitto.service

Feb 15 06:12:02 brokerhost systemd[1]: Stopped LSB: mosquitto MQTT v3.1 mes
Feb 15 06:12:02 brokerhost systemd[1]: mosquitto.service: Found left-over p
Feb 15 06:12:02 brokerhost systemd[1]: This usually indicates unclean termi
Feb 15 06:12:02 brokerhost systemd[1]: Starting LSB: mosquitto MQTT v3.1 me
Feb 15 06:12:02 brokerhost mosquitto[28854]: * Starting network daemon: mo
Feb 15 06:12:02 brokerhost mosquitto[28854]: ...done.
Feb 15 06:12:02 brokerhost systemd[1]: Started LSB: mosquitto MQTT v3.1 mes
````

Restarting the systemd unit brings the service back up, and everything is fine again, despite no changes.
1550329161: mosquitto version 1.4.15 (build date Wed, 13 Feb 2019 00:27:01 +0000) starting 1550329161: Config loaded from /etc/mosquitto/mosquitto.conf. 1550329161: Opening ipv4 listen socket on port 1883. 1550329161: Opening ipv6 listen socket on port 1883. 1550329162: New connection from 127.0.0.1 on port 1883. 1550329162: Client localhost_node-red disconnected. 1550329162: New client connected from 127.0.0.1 as localhost_node-red (c0, k60). 1550329167: New connection from 127.0.0.1 on port 1883. 1550329167: New client connected from 127.0.0.1 as emoncms (c1, k5, u''). 1550329173: New connection from 10.135.35.36 on port 1883. 1550329173: New client connected from 10.135.35.36 as mosqpub/4403-agn-sensor (c1, k60). 1550329173: Client mosqpub/4403-agn-sensor disconnected. 1550329200: New connection from 10.135.35.36 on port 1883. ashley@brokerhost:~$

webash on 16 Feb 2019

i use apt to install mosquitto and i have the same problem. But if i start mosquitto with just: mosquitto -v every thing is ok. service mosquitto start not working. stange....

I had the same issue, fixed it by comment this line in mosquitto.conf file:
log_dest file /var/log/mosquitto/mosquitto.log

I have Armbian running on NanoPi M1 Plus
Distributor ID: Ubuntu
Description: Ubuntu 18.04.2 LTS
Release: 18.04
Codename: bionic

pauldeng on 18 May 2019

👍1

I had the same problem. After I disabled the WebSocket it is working again like a breeze.

dasbaumwolltier on 30 Aug 2019

Windows 10
Post to thingsboard.

Payload receives endpoint.
Data gets till thingsboard interface.

strautins on 5 Mar 2020

"mosquitto -v -d " works for me -ubuntu 18.4

alexjolly28 on 14 Mar 2020

🎉1

I also have this problem. Sometimes I get a connection failed and the broker does not publish a topic at the time. When I restart the broker it's working normally a few minutes later I got the same problem. `pid_file /var/run/mosquitto.pid

persistence true
persistence_location /var/lib/mosquitto/

log_dest file /var/log/mosquitto/mosquitto.log

include_dir /etc/mosquitto/conf.d

max_connections -1

log_type error
log_type warning
log_type notice

connection_messages true`. I am using the ubuntu 18.04 LTS server and a broker version is 1.6.12. Last one week I try to solve this issue. But I can't get a solution. Please support me and teach the right way to solve this problem.