Just upgraded to latest versions (see below). Now the service is very unstable.
Versions
Pi-hole version is v5.2.1 (Latest: v5.2.1)
AdminLTE version is v5.2.1 (Latest: v5.2.1)
FTL version is v5.3.2 (Latest: v5.3.2)
Platform
Armbian 20.11 Bionic (Linux npik2 5.9.12-meson64 #20.11.1 SMP PREEMPT Fri Dec 4 00:23:48 CET 2020 aarch64 aarch64 aarch64 GNU/Linux)
NanoPi K2
Expected behavior
Don't crash..
Actual behavior / bug
After a while, can be seconds to minutes to hours, the system stops responding.
The following appears as the last line in the pihole-FTL.log each time:
[2020-12-11 07:45:25.013 1210M] FATAL: realloc_shm(): Failed to resize "FTL-queries" (19) to 10485760: Interrupted system call (-1)
Steps to reproduce
Just run the system
Debug Token
Screenshots
_If applicable, add screenshots to help explain your problem._
Additional context
[2047 root@npik2 log]$ pihole status
[鉁梋 DNS service is NOT listening
[2048 root@npik2 log]$ pihole restartdns
[鉁揮 Restarting DNS server
[2049 root@npik2 log]$ pihole status
[鉁揮 DNS service is listening
[鉁揮 UDP (IPv4)
[鉁揮 TCP (IPv4)
[鉁揮 UDP (IPv6)
[鉁揮 TCP (IPv6)
[鉁揮 Pi-hole blocking is enabled
Full runtime log from pihole-FTL.log
[2020-12-11 07:34:44.150 1208M] ########## FTL started! ##########
[2020-12-11 07:34:44.150 1208M] FTL branch: master
[2020-12-11 07:34:44.150 1208M] FTL version: v5.3.2
[2020-12-11 07:34:44.150 1208M] FTL commit: 0790cf7
[2020-12-11 07:34:44.150 1208M] FTL date: 2020-12-02 21:28:39 +0000
[2020-12-11 07:34:44.150 1208M] FTL user: pihole
[2020-12-11 07:34:44.150 1208M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-11 07:34:44.150 1208M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-11 07:34:44.150 1208M] SOCKET_LISTENING: only local
[2020-12-11 07:34:44.150 1208M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-11 07:34:44.150 1208M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-11 07:34:44.150 1208M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-11 07:34:44.150 1208M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-11 07:34:44.150 1208M] DBINTERVAL: saving to DB file every minute
[2020-12-11 07:34:44.150 1208M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-11 07:34:44.150 1208M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-11 07:34:44.150 1208M] PRIVACYLEVEL: Set to 0
[2020-12-11 07:34:44.150 1208M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-11 07:34:44.151 1208M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-11 07:34:44.151 1208M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-11 07:34:44.151 1208M] DBIMPORT: Importing history from database
[2020-12-11 07:34:44.151 1208M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-11 07:34:44.151 1208M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-11 07:34:44.151 1208M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-11 07:34:44.151 1208M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-11 07:34:44.151 1208M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-11 07:34:44.151 1208M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-11 07:34:44.151 1208M] PARSE_ARP_CACHE: Active
[2020-12-11 07:34:44.151 1208M] CNAME_DEEP_INSPECT: Active
[2020-12-11 07:34:44.151 1208M] DELAY_STARTUP: No delay requested.
[2020-12-11 07:34:44.151 1208M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-11 07:34:44.151 1208M] NICE: Set process niceness to -10 (default)
[2020-12-11 07:34:44.151 1208M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-11 07:34:44.151 1208M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-11 07:34:44.151 1208M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-11 07:34:44.151 1208M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-11 07:34:44.151 1208M] Finished config file parsing
[2020-12-11 07:34:44.152 1208M] Creating mutex
[2020-12-11 07:34:44.154 1208M] Database version is 9
[2020-12-11 07:34:44.154 1208M] Imported 0 alias-clients
[2020-12-11 07:34:44.154 1208M] Database successfully initialized
[2020-12-11 07:34:44.155 1208M] New upstream server: 1.1.1.1:53 (0/512)
[2020-12-11 07:34:44.156 1208M] New upstream server: 1.0.0.1:53 (1/512)
[2020-12-11 07:34:44.170 1208M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
[2020-12-11 07:34:44.185 1208M] Resizing "FTL-queries" from 524288 to (12288 * 64) == 786432 (/dev/shm: 892.9KB used, 997.2MB total)
[2020-12-11 07:34:44.199 1208M] Resizing "FTL-queries" from 786432 to (16384 * 64) == 1048576 (/dev/shm: 1.2MB used, 997.2MB total)
[2020-12-11 07:34:44.214 1208M] Resizing "FTL-queries" from 1048576 to (20480 * 64) == 1310720 (/dev/shm: 1.4MB used, 997.2MB total)
[2020-12-11 07:34:44.229 1208M] Resizing "FTL-queries" from 1310720 to (24576 * 64) == 1572864 (/dev/shm: 1.7MB used, 997.2MB total)
[2020-12-11 07:34:44.238 1208M] Resizing "FTL-strings" from 4096 to (8192 * 1) == 8192 (/dev/shm: 1.9MB used, 997.2MB total)
[2020-12-11 07:34:44.246 1208M] Resizing "FTL-queries" from 1572864 to (28672 * 64) == 1835008 (/dev/shm: 1.9MB used, 997.2MB total)
[2020-12-11 07:34:44.262 1208M] Resizing "FTL-queries" from 1835008 to (32768 * 64) == 2097152 (/dev/shm: 2.2MB used, 997.2MB total)
[2020-12-11 07:34:44.280 1208M] Resizing "FTL-strings" from 8192 to (12288 * 1) == 12288 (/dev/shm: 2.5MB used, 997.2MB total)
[2020-12-11 07:34:44.282 1208M] Resizing "FTL-queries" from 2097152 to (36864 * 64) == 2359296 (/dev/shm: 2.5MB used, 997.2MB total)
[2020-12-11 07:34:44.299 1208M] Resizing "FTL-queries" from 2359296 to (40960 * 64) == 2621440 (/dev/shm: 2.7MB used, 997.2MB total)
[2020-12-11 07:34:44.314 1208M] Resizing "FTL-queries" from 2621440 to (45056 * 64) == 2883584 (/dev/shm: 3.0MB used, 997.2MB total)
[2020-12-11 07:34:44.331 1208M] Resizing "FTL-queries" from 2883584 to (49152 * 64) == 3145728 (/dev/shm: 3.3MB used, 997.2MB total)
[2020-12-11 07:34:44.347 1208M] Resizing "FTL-queries" from 3145728 to (53248 * 64) == 3407872 (/dev/shm: 3.5MB used, 997.2MB total)
[2020-12-11 07:34:44.357 1208M] Resizing "FTL-strings" from 12288 to (16384 * 1) == 16384 (/dev/shm: 3.8MB used, 997.2MB total)
[2020-12-11 07:34:44.363 1208M] Resizing "FTL-queries" from 3407872 to (57344 * 64) == 3670016 (/dev/shm: 3.8MB used, 997.2MB total)
[2020-12-11 07:34:44.379 1208M] Resizing "FTL-queries" from 3670016 to (61440 * 64) == 3932160 (/dev/shm: 4.1MB used, 997.2MB total)
[2020-12-11 07:34:44.394 1208M] Resizing "FTL-queries" from 3932160 to (65536 * 64) == 4194304 (/dev/shm: 4.3MB used, 997.2MB total)
[2020-12-11 07:34:44.412 1208M] Resizing "FTL-queries" from 4194304 to (69632 * 64) == 4456448 (/dev/shm: 4.6MB used, 997.2MB total)
[2020-12-11 07:34:44.438 1208M] Resizing "FTL-queries" from 4456448 to (73728 * 64) == 4718592 (/dev/shm: 4.8MB used, 997.2MB total)
[2020-12-11 07:34:44.450 1208M] Resizing "FTL-strings" from 16384 to (20480 * 1) == 20480 (/dev/shm: 5.1MB used, 997.2MB total)
[2020-12-11 07:34:44.459 1208M] Resizing "FTL-queries" from 4718592 to (77824 * 64) == 4980736 (/dev/shm: 5.1MB used, 997.2MB total)
[2020-12-11 07:34:44.478 1208M] Resizing "FTL-queries" from 4980736 to (81920 * 64) == 5242880 (/dev/shm: 5.4MB used, 997.2MB total)
[2020-12-11 07:34:44.503 1208M] Resizing "FTL-queries" from 5242880 to (86016 * 64) == 5505024 (/dev/shm: 5.6MB used, 997.2MB total)
[2020-12-11 07:34:44.523 1208M] Resizing "FTL-queries" from 5505024 to (90112 * 64) == 5767168 (/dev/shm: 5.9MB used, 997.2MB total)
[2020-12-11 07:34:44.536 1208M] Resizing "FTL-strings" from 20480 to (24576 * 1) == 24576 (/dev/shm: 6.2MB used, 997.2MB total)
[2020-12-11 07:34:44.551 1208M] Resizing "FTL-queries" from 5767168 to (94208 * 64) == 6029312 (/dev/shm: 6.2MB used, 997.2MB total)
[2020-12-11 07:34:44.571 1208M] Resizing "FTL-queries" from 6029312 to (98304 * 64) == 6291456 (/dev/shm: 6.4MB used, 997.2MB total)
[2020-12-11 07:34:44.592 1208M] Resizing "FTL-queries" from 6291456 to (102400 * 64) == 6553600 (/dev/shm: 6.7MB used, 997.2MB total)
[2020-12-11 07:34:44.622 1208M] Resizing "FTL-queries" from 6553600 to (106496 * 64) == 6815744 (/dev/shm: 6.9MB used, 997.2MB total)
[2020-12-11 07:34:44.647 1208M] Resizing "FTL-queries" from 6815744 to (110592 * 64) == 7077888 (/dev/shm: 7.2MB used, 997.2MB total)
[2020-12-11 07:34:44.668 1208M] Resizing "FTL-queries" from 7077888 to (114688 * 64) == 7340032 (/dev/shm: 7.5MB used, 997.2MB total)
[2020-12-11 07:34:44.690 1208M] Resizing "FTL-queries" from 7340032 to (118784 * 64) == 7602176 (/dev/shm: 7.7MB used, 997.2MB total)
[2020-12-11 07:34:44.698 1208M] Resizing "FTL-strings" from 24576 to (28672 * 1) == 28672 (/dev/shm: 8.0MB used, 997.2MB total)
[2020-12-11 07:34:44.709 1208M] Resizing "FTL-queries" from 7602176 to (122880 * 64) == 7864320 (/dev/shm: 8.0MB used, 997.2MB total)
[2020-12-11 07:34:44.726 1208M] Resizing "FTL-queries" from 7864320 to (126976 * 64) == 8126464 (/dev/shm: 8.3MB used, 997.2MB total)
[2020-12-11 07:34:44.742 1208M] Resizing "FTL-queries" from 8126464 to (131072 * 64) == 8388608 (/dev/shm: 8.5MB used, 997.2MB total)
[2020-12-11 07:34:44.758 1208M] Resizing "FTL-queries" from 8388608 to (135168 * 64) == 8650752 (/dev/shm: 8.8MB used, 997.2MB total)
[2020-12-11 07:34:44.778 1208M] Resizing "FTL-queries" from 8650752 to (139264 * 64) == 8912896 (/dev/shm: 9.0MB used, 997.2MB total)
[2020-12-11 07:34:44.795 1208M] Resizing "FTL-queries" from 8912896 to (143360 * 64) == 9175040 (/dev/shm: 9.3MB used, 997.2MB total)
[2020-12-11 07:34:44.811 1208M] Resizing "FTL-queries" from 9175040 to (147456 * 64) == 9437184 (/dev/shm: 9.6MB used, 997.2MB total)
[2020-12-11 07:34:44.826 1208M] Resizing "FTL-queries" from 9437184 to (151552 * 64) == 9699328 (/dev/shm: 9.8MB used, 997.2MB total)
[2020-12-11 07:34:44.854 1208M] Resizing "FTL-queries" from 9699328 to (155648 * 64) == 9961472 (/dev/shm: 10.1MB used, 997.2MB total)
[2020-12-11 07:34:44.865 1208M] Imported 154220 queries from the long-term database
[2020-12-11 07:34:44.867 1208M] -> Total DNS queries: 154220
[2020-12-11 07:34:44.867 1208M] -> Cached DNS queries: 140402
[2020-12-11 07:34:44.867 1208M] -> Forwarded DNS queries: 7481
[2020-12-11 07:34:44.867 1208M] -> Blocked DNS queries: 5315
[2020-12-11 07:34:44.867 1208M] -> Unknown DNS queries: 0
[2020-12-11 07:34:44.867 1208M] -> Unique domains: 1257
[2020-12-11 07:34:44.867 1208M] -> Unique clients: 11
[2020-12-11 07:34:44.867 1208M] -> Known forward destinations: 2
[2020-12-11 07:34:44.867 1208M] Successfully accessed setupVars.conf
[2020-12-11 07:34:44.872 1210M] PID of FTL process: 1210
[2020-12-11 07:34:44.873 1210/T1211] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-11 07:34:44.875 1210/T1213] Listening on Unix socket
[2020-12-11 07:34:44.876 1210M] INFO: FTL is running as user pihole (UID 999)
[2020-12-11 07:34:44.876 1210M] Reloading DNS cache
[2020-12-11 07:34:44.877 1210M] Blocking status is enabled
[2020-12-11 07:34:45.007 1210/T1214] Compiled 0 whitelist and 11 blacklist regex filters for 11 clients in 12.2 msec
[2020-12-11 07:37:18.788 1210M] Resizing "FTL-queries" from 9961472 to (159744 * 64) == 10223616 (/dev/shm: 10.4MB used, 997.2MB total)
[2020-12-11 07:45:25.011 1210M] Resizing "FTL-queries" from 10223616 to (163840 * 64) == 10485760 (/dev/shm: 10.6MB used, 997.2MB total)
[2020-12-11 07:45:25.013 1210M] FATAL: realloc_shm(): Failed to resize "FTL-queries" (19) to 10485760: Interrupted system call (-1)
rrrevin
All 35 comments
@rrrevin Please try
pihole checkout ftl tweak/interruptsafe_systemcalls
and check of our proposed fix for these crashes works for you. There is another discussion going on here: https://discourse.pi-hole.net/t/ftlv5-3-2-engine-crash/41392
DL6ER
on 11 Dec 2020
patch installed.. but still crashes. Same error.
Pi-hole version is v5.2.1 (Latest: v5.2.1)
AdminLTE version is v5.2.1 (Latest: v5.2.1)
FTL version is tweak/interruptsafe_systemcalls vDev-85c8af4 (Latest: v5.3.2)
Debug token here : https://tricorder.pi-hole.net/aa688l6ne7
rrrevin
on 11 Dec 2020
Hmm, I still see
[2020-12-11 10:39:44.306 29609M] FATAL: realloc_shm(): Failed to resize "FTL-queries" (18) to 9961472: Interrupted system call (-1)
which shouldn't be possible with the branch you are trying. I will check this out as soon as possible.
DL6ER
on 12 Dec 2020
Same here, random crashes.
pihole-FTL.log
gunnahafta
on 13 Dec 2020
A few more crash logs for you:
https://tricorder.pi-hole.net/jrh8117ktf
https://tricorder.pi-hole.net/qh7gzc1md5
[2020-12-13 06:48:08.993 30894M] Using log file /var/log/pihole-FTL.log
[2020-12-13 06:48:08.993 30894M] ########## FTL started! ##########
[2020-12-13 06:48:08.993 30894M] FTL branch: tweak/interruptsafe_systemcalls
[2020-12-13 06:48:08.993 30894M] FTL version: vDev-85c8af4
[2020-12-13 06:48:08.993 30894M] FTL commit: 85c8af4
[2020-12-13 06:48:08.993 30894M] FTL date: 2020-12-10 22:01:47 +0100
[2020-12-13 06:48:08.993 30894M] FTL user: pihole
[2020-12-13 06:48:08.993 30894M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-13 06:48:08.994 30894M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-13 06:48:08.994 30894M] SOCKET_LISTENING: only local
[2020-12-13 06:48:08.994 30894M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-13 06:48:08.994 30894M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-13 06:48:08.994 30894M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-13 06:48:08.994 30894M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-13 06:48:08.994 30894M] DBINTERVAL: saving to DB file every minute
[2020-12-13 06:48:08.994 30894M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-13 06:48:08.994 30894M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-13 06:48:08.994 30894M] PRIVACYLEVEL: Set to 0
[2020-12-13 06:48:08.994 30894M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-13 06:48:08.994 30894M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-13 06:48:08.994 30894M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-13 06:48:08.994 30894M] DBIMPORT: Importing history from database
[2020-12-13 06:48:08.994 30894M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-13 06:48:08.994 30894M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-13 06:48:08.994 30894M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-13 06:48:08.994 30894M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-13 06:48:08.994 30894M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-13 06:48:08.994 30894M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-13 06:48:08.995 30894M] PARSE_ARP_CACHE: Active
[2020-12-13 06:48:08.995 30894M] CNAME_DEEP_INSPECT: Active
[2020-12-13 06:48:08.995 30894M] DELAY_STARTUP: No delay requested.
[2020-12-13 06:48:08.995 30894M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-13 06:48:08.995 30894M] NICE: Set process niceness to -10 (default)
[2020-12-13 06:48:08.995 30894M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-13 06:48:08.995 30894M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-13 06:48:08.995 30894M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-13 06:48:08.995 30894M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-13 06:48:08.995 30894M] Finished config file parsing
[2020-12-13 06:48:08.995 30894M] Creating mutex
[2020-12-13 06:48:08.998 30894M] Database version is 9
[2020-12-13 06:48:08.998 30894M] Imported 0 alias-clients
[2020-12-13 06:48:08.998 30894M] Database successfully initialized
[2020-12-13 06:48:08.999 30894M] New upstream server: 1.0.0.1:53 (0/512)
[2020-12-13 06:48:09.002 30894M] New upstream server: 1.1.1.1:53 (1/512)
[2020-12-13 06:48:09.017 30894M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
[2020-12-13 06:48:09.030 30894M] Resizing "FTL-strings" from 4096 to (8192 * 1) == 8192 (/dev/shm: 892.9KB used, 997.2MB total)
[2020-12-13 06:48:09.033 30894M] Resizing "FTL-queries" from 524288 to (12288 * 64) == 786432 (/dev/shm: 897.0KB used, 997.2MB total)
[2020-12-13 06:48:09.050 30894M] Resizing "FTL-queries" from 786432 to (16384 * 64) == 1048576 (/dev/shm: 1.2MB used, 997.2MB total)
[2020-12-13 06:48:09.066 30894M] Resizing "FTL-queries" from 1048576 to (20480 * 64) == 1310720 (/dev/shm: 1.4MB used, 997.2MB total)
[2020-12-13 06:48:09.083 30894M] Resizing "FTL-queries" from 1310720 to (24576 * 64) == 1572864 (/dev/shm: 1.7MB used, 997.2MB total)
[2020-12-13 06:48:09.099 30894M] Resizing "FTL-queries" from 1572864 to (28672 * 64) == 1835008 (/dev/shm: 1.9MB used, 997.2MB total)
[2020-12-13 06:48:09.115 30894M] Resizing "FTL-queries" from 1835008 to (32768 * 64) == 2097152 (/dev/shm: 2.2MB used, 997.2MB total)
[2020-12-13 06:48:09.130 30894M] Resizing "FTL-queries" from 2097152 to (36864 * 64) == 2359296 (/dev/shm: 2.5MB used, 997.2MB total)
[2020-12-13 06:48:09.147 30894M] Resizing "FTL-queries" from 2359296 to (40960 * 64) == 2621440 (/dev/shm: 2.7MB used, 997.2MB total)
[2020-12-13 06:48:09.153 30894M] Resizing "FTL-strings" from 8192 to (12288 * 1) == 12288 (/dev/shm: 3.0MB used, 997.2MB total)
[2020-12-13 06:48:09.170 30894M] Resizing "FTL-queries" from 2621440 to (45056 * 64) == 2883584 (/dev/shm: 3.0MB used, 997.2MB total)
[2020-12-13 06:48:09.187 30894M] Resizing "FTL-queries" from 2883584 to (49152 * 64) == 3145728 (/dev/shm: 3.3MB used, 997.2MB total)
[2020-12-13 06:48:09.203 30894M] Resizing "FTL-queries" from 3145728 to (53248 * 64) == 3407872 (/dev/shm: 3.5MB used, 997.2MB total)
[2020-12-13 06:48:09.218 30894M] Resizing "FTL-queries" from 3407872 to (57344 * 64) == 3670016 (/dev/shm: 3.8MB used, 997.2MB total)
[2020-12-13 06:48:09.234 30894M] Resizing "FTL-queries" from 3670016 to (61440 * 64) == 3932160 (/dev/shm: 4.0MB used, 997.2MB total)
[2020-12-13 06:48:09.249 30894M] Resizing "FTL-queries" from 3932160 to (65536 * 64) == 4194304 (/dev/shm: 4.3MB used, 997.2MB total)
[2020-12-13 06:48:09.266 30894M] Resizing "FTL-queries" from 4194304 to (69632 * 64) == 4456448 (/dev/shm: 4.6MB used, 997.2MB total)
[2020-12-13 06:48:09.279 30894M] Resizing "FTL-strings" from 12288 to (16384 * 1) == 16384 (/dev/shm: 4.8MB used, 997.2MB total)
[2020-12-13 06:48:09.288 30894M] Resizing "FTL-queries" from 4456448 to (73728 * 64) == 4718592 (/dev/shm: 4.8MB used, 997.2MB total)
[2020-12-13 06:48:09.311 30894M] Resizing "FTL-queries" from 4718592 to (77824 * 64) == 4980736 (/dev/shm: 5.1MB used, 997.2MB total)
[2020-12-13 06:48:09.329 30894M] Resizing "FTL-queries" from 4980736 to (81920 * 64) == 5242880 (/dev/shm: 5.4MB used, 997.2MB total)
[2020-12-13 06:48:09.344 30894M] Resizing "FTL-queries" from 5242880 to (86016 * 64) == 5505024 (/dev/shm: 5.6MB used, 997.2MB total)
[2020-12-13 06:48:09.360 30894M] Resizing "FTL-queries" from 5505024 to (90112 * 64) == 5767168 (/dev/shm: 5.9MB used, 997.2MB total)
[2020-12-13 06:48:09.379 30894M] Resizing "FTL-queries" from 5767168 to (94208 * 64) == 6029312 (/dev/shm: 6.1MB used, 997.2MB total)
[2020-12-13 06:48:09.400 30894M] Resizing "FTL-queries" from 6029312 to (98304 * 64) == 6291456 (/dev/shm: 6.4MB used, 997.2MB total)
[2020-12-13 06:48:09.417 30894M] Resizing "FTL-queries" from 6291456 to (102400 * 64) == 6553600 (/dev/shm: 6.7MB used, 997.2MB total)
[2020-12-13 06:48:09.432 30894M] Resizing "FTL-queries" from 6553600 to (106496 * 64) == 6815744 (/dev/shm: 6.9MB used, 997.2MB total)
[2020-12-13 06:48:09.447 30894M] Resizing "FTL-queries" from 6815744 to (110592 * 64) == 7077888 (/dev/shm: 7.2MB used, 997.2MB total)
[2020-12-13 06:48:09.462 30894M] Resizing "FTL-queries" from 7077888 to (114688 * 64) == 7340032 (/dev/shm: 7.5MB used, 997.2MB total)
[2020-12-13 06:48:09.478 30894M] Resizing "FTL-queries" from 7340032 to (118784 * 64) == 7602176 (/dev/shm: 7.7MB used, 997.2MB total)
[2020-12-13 06:48:09.504 30894M] Resizing "FTL-queries" from 7602176 to (122880 * 64) == 7864320 (/dev/shm: 8.0MB used, 997.2MB total)
[2020-12-13 06:48:09.519 30894M] Resizing "FTL-queries" from 7864320 to (126976 * 64) == 8126464 (/dev/shm: 8.2MB used, 997.2MB total)
[2020-12-13 06:48:09.533 30894M] Imported 126866 queries from the long-term database
[2020-12-13 06:48:09.534 30894M] -> Total DNS queries: 126866
[2020-12-13 06:48:09.534 30894M] -> Cached DNS queries: 120842
[2020-12-13 06:48:09.534 30894M] -> Forwarded DNS queries: 3324
[2020-12-13 06:48:09.534 30894M] -> Blocked DNS queries: 2074
[2020-12-13 06:48:09.535 30894M] -> Unknown DNS queries: 0
[2020-12-13 06:48:09.535 30894M] -> Unique domains: 747
[2020-12-13 06:48:09.535 30894M] -> Unique clients: 10
[2020-12-13 06:48:09.535 30894M] -> Known forward destinations: 2
[2020-12-13 06:48:09.535 30894M] Successfully accessed setupVars.conf
[2020-12-13 06:48:09.541 30896M] PID of FTL process: 30896
[2020-12-13 06:48:09.541 30896/T30897] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-13 06:48:09.542 30896M] INFO: FTL is running as user pihole (UID 999)
[2020-12-13 06:48:09.542 30896M] Reloading DNS cache
[2020-12-13 06:48:09.543 30896M] Blocking status is enabled
[2020-12-13 06:48:09.544 30896/T30899] Listening on Unix socket
[2020-12-13 06:48:09.676 30896/T30900] Compiled 0 whitelist and 11 blacklist regex filters for 10 clients in 12.1 msec
[2020-12-13 06:48:09.677 30907/F30896] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-13 06:48:09.677 30907/F30896] ----------------------------> FTL crashed! <----------------------------
[2020-12-13 06:48:09.677 30907/F30896] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-13 06:48:09.677 30907/F30896] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-13 06:48:09.677 30907/F30896] and include in your report already the following details:
[2020-12-13 06:48:09.677 30907/F30896] FTL has been running for 1 seconds
[2020-12-13 06:48:09.677 30907/F30896] FTL branch: tweak/interruptsafe_systemcalls
[2020-12-13 06:48:09.677 30907/F30896] FTL version: vDev-85c8af4
[2020-12-13 06:48:09.677 30907/F30896] FTL commit: 85c8af4
[2020-12-13 06:48:09.677 30907/F30896] FTL date: 2020-12-10 22:01:47 +0100
[2020-12-13 06:48:09.677 30907/F30896] FTL user: started as pihole, ended as pihole
[2020-12-13 06:48:09.677 30907/F30896] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-13 06:48:09.678 30907/F30896] Process details: MID: 30896
[2020-12-13 06:48:09.678 30907/F30896] PID: 30907
[2020-12-13 06:48:09.678 30907/F30896] TID: 30907
[2020-12-13 06:48:09.678 30907/F30896] Name: pihole-FTL
[2020-12-13 06:48:09.678 30907/F30896] Received signal: Segmentation fault
[2020-12-13 06:48:09.678 30907/F30896] at address: (nil)
[2020-12-13 06:48:09.678 30907/F30896] with code: SEGV_MAPERR (Address not mapped to object)
[2020-12-13 06:48:09.678 30907/F30896] Backtrace:
[2020-12-13 06:48:09.679 30907/F30896] B[0000]: /usr/bin/pihole-FTL(+0x56114) [0xaaaacf1bc114]
[2020-12-13 06:48:09.701 30907/F30896] L[0000]: /root/project/src/signals.c:191
[2020-12-13 06:48:09.705 30907/F30896] B[0001]: linux-vdso.so.1(__kernel_rt_sigreturn+0) [0xffffabd4f7c0]
[2020-12-13 06:48:09.706 30907/F30896] B[0002]: /usr/bin/pihole-FTL(match_regex+0xf4) [0xaaaacf1b61bc]
[2020-12-13 06:48:09.727 30907/F30896] L[0002]: /root/project/src/regex.c:174
[2020-12-13 06:48:09.731 30907/F30896] B[0003]: /usr/bin/pihole-FTL(+0x48d08) [0xaaaacf1aed08]
[2020-12-13 06:48:09.754 30907/F30896] L[0003]: /root/project/src/dnsmasq_interface.c:123
[2020-12-13 06:48:09.758 30907/F30896] B[0004]: /usr/bin/pihole-FTL(_FTL_CNAME+0x1c0) [0xaaaacf1af888]
[2020-12-13 06:48:09.781 30907/F30896] L[0004]: /root/project/src/dnsmasq_interface.c:345 (discriminator 3)
[2020-12-13 06:48:09.785 30907/F30896] B[0005]: /usr/bin/pihole-FTL(extract_addresses+0x3f8) [0xaaaacf204280]
[2020-12-13 06:48:09.813 30907/F30896] L[0005]: /root/project/src/dnsmasq/rfc1035.c:786
[2020-12-13 06:48:09.818 30907/F30896] B[0006]: /usr/bin/pihole-FTL(+0x7e8e4) [0xaaaacf1e48e4]
[2020-12-13 06:48:09.847 30907/F30896] L[0006]: /root/project/src/dnsmasq/forward.c:736
[2020-12-13 06:48:09.852 30907/F30896] B[0007]: /usr/bin/pihole-FTL(tcp_request+0xb24) [0xaaaacf1e690c]
[2020-12-13 06:48:09.881 30907/F30896] L[0007]: /root/project/src/dnsmasq/forward.c:2252 (discriminator 6)
[2020-12-13 06:48:09.886 30907/F30896] B[0008]: /usr/bin/pihole-FTL(+0x776ac) [0xaaaacf1dd6ac]
[2020-12-13 06:48:09.913 30907/F30896] L[0008]: /root/project/src/dnsmasq/dnsmasq.c:1972
[2020-12-13 06:48:09.918 30907/F30896] B[0009]: /usr/bin/pihole-FTL(main_dnsmasq+0xd30) [0xaaaacf1defe8]
[2020-12-13 06:48:09.945 30907/F30896] L[0009]: /root/project/src/dnsmasq/dnsmasq.c:1206
[2020-12-13 06:48:09.950 30907/F30896] B[0010]: /usr/bin/pihole-FTL(main+0x100) [0xaaaacf1a86b8]
[2020-12-13 06:48:09.971 30907/F30896] L[0010]: /root/project/src/main.c:103
[2020-12-13 06:48:09.975 30907/F30896] B[0011]: /lib/aarch64-linux-gnu/libc.so.6(__libc_start_main+0xe0) [0xffffabadd720]
[2020-12-13 06:48:09.975 30907/F30896] B[0012]: /usr/bin/pihole-FTL(+0x428ac) [0xaaaacf1a88ac]
[2020-12-13 06:48:10.008 30907/F30896] L[0012]: :?
[2020-12-13 06:48:10.017 30907/F30896] ------ Listing content of directory /dev/shm ------
[2020-12-13 06:48:10.017 30907/F30896] File Mode User:Group Filesize Filename
[2020-12-13 06:48:10.017 30907/F30896] rwxrwxrwx root:root 260 .
[2020-12-13 06:48:10.018 30907/F30896] rwxr-xr-x root:root 4K ..
[2020-12-13 06:48:10.018 30907/F30896] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-13 06:48:10.018 30907/F30896] rw------- pihole:pihole 4K FTL-dns-cache
[2020-12-13 06:48:10.018 30907/F30896] rw------- pihole:pihole 45K FTL-overTime
[2020-12-13 06:48:10.018 30907/F30896] rw------- pihole:pihole 8M FTL-queries
[2020-12-13 06:48:10.018 30907/F30896] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-13 06:48:10.018 30907/F30896] rw------- pihole:pihole 176K FTL-clients
[2020-12-13 06:48:10.019 30907/F30896] rw------- pihole:pihole 98K FTL-domains
[2020-12-13 06:48:10.019 30907/F30896] rw------- pihole:pihole 16K FTL-strings
[2020-12-13 06:48:10.019 30907/F30896] rw------- pihole:pihole 12 FTL-settings
[2020-12-13 06:48:10.019 30907/F30896] rw------- pihole:pihole 152 FTL-counters
[2020-12-13 06:48:10.019 30907/F30896] rw------- pihole:pihole 56 FTL-lock
[2020-12-13 06:48:10.019 30907/F30896] ---------------------------------------------------
[2020-12-13 06:48:10.019 30907/F30896] Please also include some lines from above the !!!!!!!!! header.
[2020-12-13 06:48:10.019 30907/F30896] Thank you for helping us to improve our FTL engine!
[2020-12-13 06:48:10.020 30907/F30896] Asking parent pihole-FTL (PID 30896) to shut down
[2020-12-13 06:48:10.020 30907/F30896] FTL fork terminated!
[2020-12-13 06:48:10.020 30896M] Received: Real-time signal 2 (36 -> 2)
[2020-12-13 06:48:10.020 30896M] Shutting down...
[2020-12-13 06:48:10.080 30896M] Finished final database update
[2020-12-13 06:48:10.085 30896M] ########## FTL terminated after 1s 92ms ! ##########
Another..
https://tricorder.pi-hole.net/0a51majal2
[2020-12-13 07:12:01.574 15525M] Using log file /var/log/pihole-FTL.log
[2020-12-13 07:12:01.574 15525M] ########## FTL started! ##########
[2020-12-13 07:12:01.574 15525M] FTL branch: tweak/interruptsafe_systemcalls
[2020-12-13 07:12:01.574 15525M] FTL version: vDev-85c8af4
[2020-12-13 07:12:01.574 15525M] FTL commit: 85c8af4
[2020-12-13 07:12:01.574 15525M] FTL date: 2020-12-10 22:01:47 +0100
[2020-12-13 07:12:01.574 15525M] FTL user: pihole
[2020-12-13 07:12:01.574 15525M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-13 07:12:01.574 15525M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-13 07:12:01.574 15525M] SOCKET_LISTENING: only local
[2020-12-13 07:12:01.574 15525M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-13 07:12:01.574 15525M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-13 07:12:01.575 15525M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-13 07:12:01.575 15525M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-13 07:12:01.575 15525M] DBINTERVAL: saving to DB file every minute
[2020-12-13 07:12:01.575 15525M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-13 07:12:01.575 15525M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-13 07:12:01.575 15525M] PRIVACYLEVEL: Set to 0
[2020-12-13 07:12:01.575 15525M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-13 07:12:01.575 15525M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-13 07:12:01.575 15525M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-13 07:12:01.575 15525M] DBIMPORT: Importing history from database
[2020-12-13 07:12:01.575 15525M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-13 07:12:01.575 15525M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-13 07:12:01.575 15525M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-13 07:12:01.575 15525M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-13 07:12:01.575 15525M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-13 07:12:01.575 15525M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-13 07:12:01.575 15525M] PARSE_ARP_CACHE: Active
[2020-12-13 07:12:01.575 15525M] CNAME_DEEP_INSPECT: Active
[2020-12-13 07:12:01.575 15525M] DELAY_STARTUP: No delay requested.
[2020-12-13 07:12:01.576 15525M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-13 07:12:01.576 15525M] NICE: Set process niceness to -10 (default)
[2020-12-13 07:12:01.576 15525M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-13 07:12:01.576 15525M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-13 07:12:01.576 15525M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-13 07:12:01.576 15525M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-13 07:12:01.576 15525M] Finished config file parsing
[2020-12-13 07:12:01.576 15525M] Creating mutex
[2020-12-13 07:12:01.590 15525M] Database version is 9
[2020-12-13 07:12:01.590 15525M] Imported 0 alias-clients
[2020-12-13 07:12:01.590 15525M] Database successfully initialized
[2020-12-13 07:12:01.595 15525M] New upstream server: 1.0.0.1:53 (0/512)
[2020-12-13 07:12:01.604 15525M] New upstream server: 1.1.1.1:53 (1/512)
[2020-12-13 07:12:01.636 15525M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
[2020-12-13 07:12:01.664 15525M] Resizing "FTL-strings" from 4096 to (8192 * 1) == 8192 (/dev/shm: 892.9KB used, 997.2MB total)
[2020-12-13 07:12:01.667 15525M] Resizing "FTL-queries" from 524288 to (12288 * 64) == 786432 (/dev/shm: 897.0KB used, 997.2MB total)
[2020-12-13 07:12:01.690 15525M] Resizing "FTL-queries" from 786432 to (16384 * 64) == 1048576 (/dev/shm: 1.2MB used, 997.2MB total)
[2020-12-13 07:12:01.717 15525M] Resizing "FTL-queries" from 1048576 to (20480 * 64) == 1310720 (/dev/shm: 1.4MB used, 997.2MB total)
[2020-12-13 07:12:01.741 15525M] Resizing "FTL-queries" from 1310720 to (24576 * 64) == 1572864 (/dev/shm: 1.7MB used, 997.2MB total)
[2020-12-13 07:12:01.762 15525M] Resizing "FTL-queries" from 1572864 to (28672 * 64) == 1835008 (/dev/shm: 1.9MB used, 997.2MB total)
[2020-12-13 07:12:01.793 15525M] Resizing "FTL-queries" from 1835008 to (32768 * 64) == 2097152 (/dev/shm: 2.2MB used, 997.2MB total)
[2020-12-13 07:12:01.812 15525M] Resizing "FTL-queries" from 2097152 to (36864 * 64) == 2359296 (/dev/shm: 2.5MB used, 997.2MB total)
[2020-12-13 07:12:01.849 15525M] Resizing "FTL-queries" from 2359296 to (40960 * 64) == 2621440 (/dev/shm: 2.7MB used, 997.2MB total)
[2020-12-13 07:12:01.855 15525M] Resizing "FTL-strings" from 8192 to (12288 * 1) == 12288 (/dev/shm: 3.0MB used, 997.2MB total)
[2020-12-13 07:12:01.874 15525M] Resizing "FTL-queries" from 2621440 to (45056 * 64) == 2883584 (/dev/shm: 3.0MB used, 997.2MB total)
[2020-12-13 07:12:01.909 15525M] Resizing "FTL-queries" from 2883584 to (49152 * 64) == 3145728 (/dev/shm: 3.3MB used, 997.2MB total)
[2020-12-13 07:12:01.941 15525M] Resizing "FTL-queries" from 3145728 to (53248 * 64) == 3407872 (/dev/shm: 3.5MB used, 997.2MB total)
[2020-12-13 07:12:01.965 15525M] Resizing "FTL-queries" from 3407872 to (57344 * 64) == 3670016 (/dev/shm: 3.8MB used, 997.2MB total)
[2020-12-13 07:12:02.001 15525M] Resizing "FTL-queries" from 3670016 to (61440 * 64) == 3932160 (/dev/shm: 4.0MB used, 997.2MB total)
[2020-12-13 07:12:02.024 15525M] Resizing "FTL-queries" from 3932160 to (65536 * 64) == 4194304 (/dev/shm: 4.3MB used, 997.2MB total)
[2020-12-13 07:12:02.046 15525M] Resizing "FTL-queries" from 4194304 to (69632 * 64) == 4456448 (/dev/shm: 4.6MB used, 997.2MB total)
[2020-12-13 07:12:02.070 15525M] Resizing "FTL-strings" from 12288 to (16384 * 1) == 16384 (/dev/shm: 4.8MB used, 997.2MB total)
[2020-12-13 07:12:02.084 15525M] Resizing "FTL-queries" from 4456448 to (73728 * 64) == 4718592 (/dev/shm: 4.8MB used, 997.2MB total)
[2020-12-13 07:12:02.118 15525M] Resizing "FTL-queries" from 4718592 to (77824 * 64) == 4980736 (/dev/shm: 5.1MB used, 997.2MB total)
[2020-12-13 07:12:02.140 15525M] Resizing "FTL-queries" from 4980736 to (81920 * 64) == 5242880 (/dev/shm: 5.4MB used, 997.2MB total)
[2020-12-13 07:12:02.166 15525M] Resizing "FTL-queries" from 5242880 to (86016 * 64) == 5505024 (/dev/shm: 5.6MB used, 997.2MB total)
[2020-12-13 07:12:02.193 15525M] Resizing "FTL-queries" from 5505024 to (90112 * 64) == 5767168 (/dev/shm: 5.9MB used, 997.2MB total)
[2020-12-13 07:12:02.215 15525M] Resizing "FTL-queries" from 5767168 to (94208 * 64) == 6029312 (/dev/shm: 6.1MB used, 997.2MB total)
[2020-12-13 07:12:02.259 15525M] Resizing "FTL-queries" from 6029312 to (98304 * 64) == 6291456 (/dev/shm: 6.4MB used, 997.2MB total)
[2020-12-13 07:12:02.278 15525M] Resizing "FTL-queries" from 6291456 to (102400 * 64) == 6553600 (/dev/shm: 6.7MB used, 997.2MB total)
[2020-12-13 07:12:02.313 15525M] Resizing "FTL-queries" from 6553600 to (106496 * 64) == 6815744 (/dev/shm: 6.9MB used, 997.2MB total)
[2020-12-13 07:12:02.336 15525M] Resizing "FTL-queries" from 6815744 to (110592 * 64) == 7077888 (/dev/shm: 7.2MB used, 997.2MB total)
[2020-12-13 07:12:02.356 15525M] Resizing "FTL-queries" from 7077888 to (114688 * 64) == 7340032 (/dev/shm: 7.5MB used, 997.2MB total)
[2020-12-13 07:12:02.384 15525M] Resizing "FTL-queries" from 7340032 to (118784 * 64) == 7602176 (/dev/shm: 7.7MB used, 997.2MB total)
[2020-12-13 07:12:02.412 15525M] Resizing "FTL-queries" from 7602176 to (122880 * 64) == 7864320 (/dev/shm: 8.0MB used, 997.2MB total)
[2020-12-13 07:12:02.439 15525M] Resizing "FTL-queries" from 7864320 to (126976 * 64) == 8126464 (/dev/shm: 8.2MB used, 997.2MB total)
[2020-12-13 07:12:02.470 15525M] Resizing "FTL-queries" from 8126464 to (131072 * 64) == 8388608 (/dev/shm: 8.5MB used, 997.2MB total)
[2020-12-13 07:12:02.477 15525M] Resizing "FTL-strings" from 16384 to (20480 * 1) == 20480 (/dev/shm: 8.8MB used, 997.2MB total)
[2020-12-13 07:12:02.491 15525M] Imported 130820 queries from the long-term database
[2020-12-13 07:12:02.492 15525M] -> Total DNS queries: 130820
[2020-12-13 07:12:02.492 15525M] -> Cached DNS queries: 124457
[2020-12-13 07:12:02.492 15525M] -> Forwarded DNS queries: 3569
[2020-12-13 07:12:02.492 15525M] -> Blocked DNS queries: 2137
[2020-12-13 07:12:02.492 15525M] -> Unknown DNS queries: 0
[2020-12-13 07:12:02.492 15525M] -> Unique domains: 773
[2020-12-13 07:12:02.492 15525M] -> Unique clients: 10
[2020-12-13 07:12:02.492 15525M] -> Known forward destinations: 2
[2020-12-13 07:12:02.492 15525M] Successfully accessed setupVars.conf
[2020-12-13 07:12:02.501 15527M] PID of FTL process: 15527
[2020-12-13 07:12:02.502 15527/T15528] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-13 07:12:02.502 15527/T15530] Listening on Unix socket
[2020-12-13 07:12:02.502 15527M] INFO: FTL is running as user pihole (UID 999)
[2020-12-13 07:12:02.503 15527M] Reloading DNS cache
[2020-12-13 07:12:02.503 15527M] Blocking status is enabled
[2020-12-13 07:12:02.934 15527/T15531] Compiled 0 whitelist and 11 blacklist regex filters for 10 clients in 31.3 msec
[2020-12-13 07:12:02.940 15538/F15527] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-13 07:12:02.940 15538/F15527] ----------------------------> FTL crashed! <----------------------------
[2020-12-13 07:12:02.940 15538/F15527] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-13 07:12:02.940 15538/F15527] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-13 07:12:02.940 15538/F15527] and include in your report already the following details:
[2020-12-13 07:12:02.940 15538/F15527] FTL has been running for 1 seconds
[2020-12-13 07:12:02.941 15538/F15527] FTL branch: tweak/interruptsafe_systemcalls
[2020-12-13 07:12:02.941 15538/F15527] FTL version: vDev-85c8af4
[2020-12-13 07:12:02.941 15538/F15527] FTL commit: 85c8af4
[2020-12-13 07:12:02.941 15538/F15527] FTL date: 2020-12-10 22:01:47 +0100
[2020-12-13 07:12:02.941 15538/F15527] FTL user: started as pihole, ended as pihole
[2020-12-13 07:12:02.942 15538/F15527] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-13 07:12:02.942 15538/F15527] Process details: MID: 15527
[2020-12-13 07:12:02.942 15538/F15527] PID: 15538
[2020-12-13 07:12:02.942 15538/F15527] TID: 15538
[2020-12-13 07:12:02.942 15538/F15527] Name: pihole-FTL
[2020-12-13 07:12:02.942 15538/F15527] Received signal: Segmentation fault
[2020-12-13 07:12:02.942 15538/F15527] at address: (nil)
[2020-12-13 07:12:02.942 15538/F15527] with code: SEGV_MAPERR (Address not mapped to object)
[2020-12-13 07:12:02.944 15538/F15527] Backtrace:
[2020-12-13 07:12:02.946 15538/F15527] B[0000]: /usr/bin/pihole-FTL(+0x56114) [0xaaaab1e65114]
[2020-12-13 07:12:03.515 15538/F15527] L[0000]: /root/project/src/signals.c:191
[2020-12-13 07:12:03.522 15538/F15527] B[0001]: linux-vdso.so.1(__kernel_rt_sigreturn+0) [0xffff8512d7c0]
[2020-12-13 07:12:03.523 15538/F15527] B[0002]: /usr/bin/pihole-FTL(match_regex+0xf4) [0xaaaab1e5f1bc]
[2020-12-13 07:12:03.571 15538/F15527] L[0002]: /root/project/src/regex.c:174
[2020-12-13 07:12:03.577 15538/F15527] B[0003]: /usr/bin/pihole-FTL(+0x48d08) [0xaaaab1e57d08]
[2020-12-13 07:12:03.614 15538/F15527] L[0003]: /root/project/src/dnsmasq_interface.c:123
[2020-12-13 07:12:03.619 15538/F15527] B[0004]: /usr/bin/pihole-FTL(_FTL_new_query+0x7b4) [0xaaaab1e5920c]
[2020-12-13 07:12:03.653 15538/F15527] L[0004]: /root/project/src/dnsmasq_interface.c:478
[2020-12-13 07:12:03.657 15538/F15527] B[0005]: /usr/bin/pihole-FTL(tcp_request+0x69c) [0xaaaab1e8f484]
[2020-12-13 07:12:03.690 15538/F15527] L[0005]: /root/project/src/dnsmasq/forward.c:1963
[2020-12-13 07:12:03.695 15538/F15527] B[0006]: /usr/bin/pihole-FTL(+0x776ac) [0xaaaab1e866ac]
[2020-12-13 07:12:03.723 15538/F15527] L[0006]: /root/project/src/dnsmasq/dnsmasq.c:1972
[2020-12-13 07:12:03.728 15538/F15527] B[0007]: /usr/bin/pihole-FTL(main_dnsmasq+0xd30) [0xaaaab1e87fe8]
[2020-12-13 07:12:03.755 15538/F15527] L[0007]: /root/project/src/dnsmasq/dnsmasq.c:1206
[2020-12-13 07:12:03.759 15538/F15527] B[0008]: /usr/bin/pihole-FTL(main+0x100) [0xaaaab1e516b8]
[2020-12-13 07:12:03.780 15538/F15527] L[0008]: /root/project/src/main.c:103
[2020-12-13 07:12:03.784 15538/F15527] B[0009]: /lib/aarch64-linux-gnu/libc.so.6(__libc_start_main+0xe0) [0xffff84ebb720]
[2020-12-13 07:12:03.784 15538/F15527] B[0010]: /usr/bin/pihole-FTL(+0x428ac) [0xaaaab1e518ac]
[2020-12-13 07:12:03.816 15538/F15527] L[0010]: :?
[2020-12-13 07:12:03.824 15538/F15527] ------ Listing content of directory /dev/shm ------
[2020-12-13 07:12:03.824 15538/F15527] File Mode User:Group Filesize Filename
[2020-12-13 07:12:03.824 15538/F15527] rwxrwxrwx root:root 260 .
[2020-12-13 07:12:03.824 15538/F15527] rwxr-xr-x root:root 4K ..
[2020-12-13 07:12:03.824 15538/F15527] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-13 07:12:03.825 15538/F15527] rw------- pihole:pihole 4K FTL-dns-cache
[2020-12-13 07:12:03.825 15538/F15527] rw------- pihole:pihole 45K FTL-overTime
[2020-12-13 07:12:03.825 15538/F15527] rw------- pihole:pihole 8M FTL-queries
[2020-12-13 07:12:03.825 15538/F15527] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-13 07:12:03.825 15538/F15527] rw------- pihole:pihole 176K FTL-clients
[2020-12-13 07:12:03.826 15538/F15527] rw------- pihole:pihole 98K FTL-domains
[2020-12-13 07:12:03.826 15538/F15527] rw------- pihole:pihole 20K FTL-strings
[2020-12-13 07:12:03.826 15538/F15527] rw------- pihole:pihole 12 FTL-settings
[2020-12-13 07:12:03.826 15538/F15527] rw------- pihole:pihole 152 FTL-counters
[2020-12-13 07:12:03.826 15538/F15527] rw------- pihole:pihole 56 FTL-lock
[2020-12-13 07:12:03.826 15538/F15527] ---------------------------------------------------
[2020-12-13 07:12:03.826 15538/F15527] Please also include some lines from above the !!!!!!!!! header.
[2020-12-13 07:12:03.826 15538/F15527] Thank you for helping us to improve our FTL engine!
[2020-12-13 07:12:03.826 15538/F15527] Asking parent pihole-FTL (PID 15527) to shut down
[2020-12-13 07:12:03.826 15538/F15527] FTL fork terminated!
[2020-12-13 07:12:03.827 15527M] Received: Real-time signal 2 (36 -> 2)
[2020-12-13 07:12:03.827 15527M] Shutting down...
[2020-12-13 07:12:04.530 15527M] Finished final database update
[2020-12-13 07:12:04.544 15527M] ########## FTL terminated after 2s 969ms ! ##########
@rrrevin Could you please also try
pihole ftl checkout development
Installed... will let you know how it goes. Thanks!
rrrevin
on 14 Dec 2020
Still crashing regularly..
https://tricorder.pi-hole.net/ooylt7v057
[2020-12-15 20:58:21.875 20288M] Using log file /var/log/pihole-FTL.log
[2020-12-15 20:58:21.875 20288M] ########## FTL started! ##########
[2020-12-15 20:58:21.875 20288M] FTL branch: development
[2020-12-15 20:58:21.875 20288M] FTL version: vDev-0c245ae
[2020-12-15 20:58:21.875 20288M] FTL commit: 0c245ae
[2020-12-15 20:58:21.875 20288M] FTL date: 2020-12-10 06:40:50 +0100
[2020-12-15 20:58:21.875 20288M] FTL user: pihole
[2020-12-15 20:58:21.875 20288M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-15 20:58:21.875 20288M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-15 20:58:21.875 20288M] SOCKET_LISTENING: only local
[2020-12-15 20:58:21.876 20288M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-15 20:58:21.876 20288M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-15 20:58:21.876 20288M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-15 20:58:21.876 20288M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-15 20:58:21.876 20288M] DBINTERVAL: saving to DB file every minute
[2020-12-15 20:58:21.876 20288M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-15 20:58:21.876 20288M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-15 20:58:21.876 20288M] PRIVACYLEVEL: Set to 0
[2020-12-15 20:58:21.876 20288M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-15 20:58:21.876 20288M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-15 20:58:21.876 20288M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-15 20:58:21.876 20288M] DBIMPORT: Importing history from database
[2020-12-15 20:58:21.876 20288M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-15 20:58:21.876 20288M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-15 20:58:21.876 20288M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-15 20:58:21.876 20288M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-15 20:58:21.876 20288M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-15 20:58:21.876 20288M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-15 20:58:21.876 20288M] PARSE_ARP_CACHE: Active
[2020-12-15 20:58:21.876 20288M] CNAME_DEEP_INSPECT: Active
[2020-12-15 20:58:21.876 20288M] DELAY_STARTUP: No delay requested.
[2020-12-15 20:58:21.877 20288M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-15 20:58:21.877 20288M] NICE: Set process niceness to -10 (default)
[2020-12-15 20:58:21.877 20288M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-15 20:58:21.877 20288M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-15 20:58:21.877 20288M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-15 20:58:21.877 20288M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-15 20:58:21.877 20288M] Finished config file parsing
[2020-12-15 20:58:21.877 20288M] Creating mutex
[2020-12-15 20:58:21.879 20288M] Database version is 9
[2020-12-15 20:58:21.880 20288M] Imported 0 alias-clients
[2020-12-15 20:58:21.880 20288M] Database successfully initialized
[2020-12-15 20:58:21.881 20288M] New upstream server: 1.0.0.1:53 (0/512)
[2020-12-15 20:58:21.895 20288M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
[2020-12-15 20:58:21.910 20288M] Resizing "FTL-queries" from 524288 to (12288 * 64) == 786432 (/dev/shm: 892.9KB used, 997.2MB total)
[2020-12-15 20:58:21.916 20288M] New upstream server: 1.1.1.1:53 (1/512)
[2020-12-15 20:58:21.925 20288M] Resizing "FTL-queries" from 786432 to (16384 * 64) == 1048576 (/dev/shm: 1.2MB used, 997.2MB total)
[2020-12-15 20:58:21.940 20288M] Resizing "FTL-queries" from 1048576 to (20480 * 64) == 1310720 (/dev/shm: 1.4MB used, 997.2MB total)
... many Resizing lines removed ...
[2020-12-15 20:58:23.427 20288M] Resizing "FTL-queries" from 20709376 to (327680 * 64) == 20971520 (/dev/shm: 21.1MB used, 997.2MB total)
[2020-12-15 20:58:23.432 20288M] Imported 323862 queries from the long-term database
[2020-12-15 20:58:23.433 20288M] -> Total DNS queries: 323862
[2020-12-15 20:58:23.433 20288M] -> Cached DNS queries: 296378
[2020-12-15 20:58:23.433 20288M] -> Forwarded DNS queries: 13457
[2020-12-15 20:58:23.433 20288M] -> Blocked DNS queries: 13165
[2020-12-15 20:58:23.433 20288M] -> Unknown DNS queries: 0
[2020-12-15 20:58:23.433 20288M] -> Unique domains: 1698
[2020-12-15 20:58:23.433 20288M] -> Unique clients: 13
[2020-12-15 20:58:23.433 20288M] -> Known forward destinations: 2
[2020-12-15 20:58:23.433 20288M] Successfully accessed setupVars.conf
[2020-12-15 20:58:23.439 20291M] PID of FTL process: 20291
[2020-12-15 20:58:23.440 20291/T20292] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-15 20:58:23.440 20291/T20294] Listening on Unix socket
[2020-12-15 20:58:23.441 20291M] INFO: FTL is running as user pihole (UID 999)
[2020-12-15 20:58:23.441 20291M] Reloading DNS cache
[2020-12-15 20:58:23.442 20291M] Blocking status is enabled
[2020-12-15 20:58:23.587 20291/T20295] Compiled 0 whitelist and 11 blacklist regex filters for 13 clients in 23.8 msec
[2020-12-15 20:59:00.458 20291/T20297] Resizing "FTL-strings" from 36864 to (40960 * 1) == 40960 (/dev/shm: 21.4MB used, 997.2MB total)
[2020-12-15 21:35:50.245 20291M] Resizing "FTL-queries" from 20971520 to (331776 * 64) == 21233664 (/dev/shm: 21.4MB used, 997.2MB total)
[2020-12-15 21:35:50.246 20291M] FATAL: realloc_shm(): Failed to resize "FTL-queries" (18) to 21233664: Interrupted system call (-1)
[2020-12-15 18:44:29.056 18733M] Using log file /var/log/pihole-FTL.log
[2020-12-15 18:44:29.056 18733M] ########## FTL started! ##########
[2020-12-15 18:44:29.056 18733M] FTL branch: development
[2020-12-15 18:44:29.056 18733M] FTL version: vDev-0c245ae
[2020-12-15 18:44:29.056 18733M] FTL commit: 0c245ae
[2020-12-15 18:44:29.056 18733M] FTL date: 2020-12-10 06:40:50 +0100
[2020-12-15 18:44:29.056 18733M] FTL user: pihole
[2020-12-15 18:44:29.056 18733M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-15 18:44:29.056 18733M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-15 18:44:29.056 18733M] SOCKET_LISTENING: only local
[2020-12-15 18:44:29.056 18733M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-15 18:44:29.056 18733M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-15 18:44:29.056 18733M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-15 18:44:29.057 18733M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-15 18:44:29.057 18733M] DBINTERVAL: saving to DB file every minute
[2020-12-15 18:44:29.057 18733M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-15 18:44:29.057 18733M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-15 18:44:29.057 18733M] PRIVACYLEVEL: Set to 0
[2020-12-15 18:44:29.057 18733M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-15 18:44:29.057 18733M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-15 18:44:29.057 18733M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-15 18:44:29.057 18733M] DBIMPORT: Importing history from database
[2020-12-15 18:44:29.057 18733M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-15 18:44:29.057 18733M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-15 18:44:29.057 18733M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-15 18:44:29.057 18733M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-15 18:44:29.057 18733M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-15 18:44:29.057 18733M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-15 18:44:29.057 18733M] PARSE_ARP_CACHE: Active
[2020-12-15 18:44:29.057 18733M] CNAME_DEEP_INSPECT: Active
[2020-12-15 18:44:29.057 18733M] DELAY_STARTUP: No delay requested.
[2020-12-15 18:44:29.057 18733M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-15 18:44:29.057 18733M] NICE: Set process niceness to -10 (default)
[2020-12-15 18:44:29.057 18733M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-15 18:44:29.057 18733M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-15 18:44:29.057 18733M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-15 18:44:29.058 18733M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-15 18:44:29.058 18733M] Finished config file parsing
[2020-12-15 18:44:29.058 18733M] Creating mutex
[2020-12-15 18:44:29.060 18733M] Database version is 9
[2020-12-15 18:44:29.060 18733M] Imported 0 alias-clients
[2020-12-15 18:44:29.060 18733M] Database successfully initialized
[2020-12-15 18:44:29.061 18733M] New upstream server: 1.1.1.1:53 (0/512)
[2020-12-15 18:44:29.066 18733M] New upstream server: 1.0.0.1:53 (1/512)
[2020-12-15 18:44:29.077 18733M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
... many Resizing lines removed ...
[2020-12-15 18:44:30.560 18733M] Resizing "FTL-queries" from 19660800 to (311296 * 64) == 19922944 (/dev/shm: 20.1MB used, 997.2MB total)
[2020-12-15 18:44:30.580 18733M] Imported 311006 queries from the long-term database
[2020-12-15 18:44:30.581 18733M] -> Total DNS queries: 311006
[2020-12-15 18:44:30.581 18733M] -> Cached DNS queries: 284204
[2020-12-15 18:44:30.581 18733M] -> Forwarded DNS queries: 13078
[2020-12-15 18:44:30.581 18733M] -> Blocked DNS queries: 13117
[2020-12-15 18:44:30.581 18733M] -> Unknown DNS queries: 0
[2020-12-15 18:44:30.581 18733M] -> Unique domains: 1520
[2020-12-15 18:44:30.581 18733M] -> Unique clients: 13
[2020-12-15 18:44:30.581 18733M] -> Known forward destinations: 2
[2020-12-15 18:44:30.581 18733M] Successfully accessed setupVars.conf
[2020-12-15 18:44:30.586 18736M] PID of FTL process: 18736
[2020-12-15 18:44:30.587 18736/T18739] Listening on Unix socket
[2020-12-15 18:44:30.588 18736/T18737] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-15 18:44:30.588 18736M] INFO: FTL is running as user pihole (UID 999)
[2020-12-15 18:44:30.588 18736M] Reloading DNS cache
[2020-12-15 18:44:30.589 18736M] Blocking status is enabled
[2020-12-15 18:44:30.721 18736/T18740] Compiled 0 whitelist and 11 blacklist regex filters for 13 clients in 15.1 msec
[2020-12-15 18:44:30.722 18746/F18736] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-15 18:44:30.723 18746/F18736] ----------------------------> FTL crashed! <----------------------------
[2020-12-15 18:44:30.723 18746/F18736] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-15 18:44:30.723 18746/F18736] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-15 18:44:30.723 18746/F18736] and include in your report already the following details:
[2020-12-15 18:44:30.723 18746/F18736] FTL has been running for 1 seconds
[2020-12-15 18:44:30.723 18746/F18736] FTL branch: development
[2020-12-15 18:44:30.723 18746/F18736] FTL version: vDev-0c245ae
[2020-12-15 18:44:30.723 18746/F18736] FTL commit: 0c245ae
[2020-12-15 18:44:30.723 18746/F18736] FTL date: 2020-12-10 06:40:50 +0100
[2020-12-15 18:44:30.723 18746/F18736] FTL user: started as pihole, ended as pihole
[2020-12-15 18:44:30.723 18746/F18736] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-15 18:44:30.723 18746/F18736] Process details: MID: 18736
[2020-12-15 18:44:30.723 18746/F18736] PID: 18746
[2020-12-15 18:44:30.723 18746/F18736] TID: 18746
[2020-12-15 18:44:30.724 18746/F18736] Name: pihole-FTL
[2020-12-15 18:44:30.724 18746/F18736] Received signal: Segmentation fault
[2020-12-15 18:44:30.724 18746/F18736] at address: (nil)
[2020-12-15 18:44:30.724 18746/F18736] with code: SEGV_MAPERR (Address not mapped to object)
[2020-12-15 18:44:30.724 18746/F18736] Backtrace:
[2020-12-15 18:44:30.725 18746/F18736] B[0000]: /usr/bin/pihole-FTL(+0x55660) [0xaaaad3806660]
[2020-12-15 18:44:30.750 18746/F18736] L[0000]: /root/project/src/signals.c:193
[2020-12-15 18:44:30.754 18746/F18736] B[0001]: linux-vdso.so.1(__kernel_rt_sigreturn+0) [0xffff8ebfb7c0]
[2020-12-15 18:44:30.754 18746/F18736] B[0002]: /usr/bin/pihole-FTL(match_regex+0xf4) [0xaaaad380071c]
[2020-12-15 18:44:30.776 18746/F18736] L[0002]: /root/project/src/regex.c:201
[2020-12-15 18:44:30.781 18746/F18736] B[0003]: /usr/bin/pihole-FTL(+0x48388) [0xaaaad37f9388]
[2020-12-15 18:44:30.803 18746/F18736] L[0003]: /root/project/src/dnsmasq_interface.c:124
[2020-12-15 18:44:30.806 18746/F18736] B[0004]: /usr/bin/pihole-FTL(_FTL_CNAME+0x1c0) [0xaaaad37f9f08]
[2020-12-15 18:44:30.828 18746/F18736] L[0004]: /root/project/src/dnsmasq_interface.c:346 (discriminator 3)
[2020-12-15 18:44:30.832 18746/F18736] B[0005]: /usr/bin/pihole-FTL(answer_request+0xcf8) [0xaaaad384f9f8]
[2020-12-15 18:44:30.859 18746/F18736] L[0005]: /root/project/src/dnsmasq/rfc1035.c:1823
[2020-12-15 18:44:30.864 18746/F18736] B[0006]: /usr/bin/pihole-FTL(tcp_request+0x5d4) [0xaaaad382f54c]
[2020-12-15 18:44:30.892 18746/F18736] L[0006]: /root/project/src/dnsmasq/forward.c:2038
[2020-12-15 18:44:30.897 18746/F18736] B[0007]: /usr/bin/pihole-FTL(+0x7583c) [0xaaaad382683c]
[2020-12-15 18:44:30.922 18746/F18736] L[0007]: /root/project/src/dnsmasq/dnsmasq.c:1972
[2020-12-15 18:44:30.926 18746/F18736] B[0008]: /usr/bin/pihole-FTL(main_dnsmasq+0xd30) [0xaaaad3828178]
[2020-12-15 18:44:30.953 18746/F18736] L[0008]: /root/project/src/dnsmasq/dnsmasq.c:1206
[2020-12-15 18:44:30.956 18746/F18736] B[0009]: /usr/bin/pihole-FTL(main+0x100) [0xaaaad37f3478]
[2020-12-15 18:44:30.977 18746/F18736] L[0009]: /root/project/src/main.c:103
[2020-12-15 18:44:30.980 18746/F18736] B[0010]: /lib/aarch64-linux-gnu/libc.so.6(__libc_start_main+0xe0) [0xffff8e989720]
[2020-12-15 18:44:30.980 18746/F18736] B[0011]: /usr/bin/pihole-FTL(+0x4266c) [0xaaaad37f366c]
[2020-12-15 18:44:31.010 18746/F18736] L[0011]: :?
[2020-12-15 18:44:31.017 18746/F18736] ------ Listing content of directory /dev/shm ------
[2020-12-15 18:44:31.018 18746/F18736] File Mode User:Group Filesize Filename
[2020-12-15 18:44:31.018 18746/F18736] rwxrwxrwx root:root 280 .
[2020-12-15 18:44:31.018 18746/F18736] rwxr-xr-x root:root 4K ..
[2020-12-15 18:44:31.018 18746/F18736] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-15 18:44:31.018 18746/F18736] rw------- pihole:pihole 4K FTL-dns-cache
[2020-12-15 18:44:31.018 18746/F18736] rw------- pihole:pihole 45K FTL-overTime
[2020-12-15 18:44:31.019 18746/F18736] rw------- pihole:pihole 20M FTL-queries
[2020-12-15 18:44:31.019 18746/F18736] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-15 18:44:31.019 18746/F18736] rw------- pihole:pihole 176K FTL-clients
[2020-12-15 18:44:31.019 18746/F18736] rw------- pihole:pihole 98K FTL-domains
[2020-12-15 18:44:31.019 18746/F18736] rw------- pihole:pihole 37K FTL-strings
[2020-12-15 18:44:31.019 18746/F18736] rw------- pihole:pihole 12 FTL-settings
[2020-12-15 18:44:31.020 18746/F18736] rw------- pihole:pihole 152 FTL-counters
[2020-12-15 18:44:31.020 18746/F18736] rw------- pihole:pihole 56 FTL-lock
[2020-12-15 18:44:31.020 18746/F18736] rw-r----- qbt:qbt 4K mono.2581
[2020-12-15 18:44:31.020 18746/F18736] ---------------------------------------------------
[2020-12-15 18:44:31.020 18746/F18736] Please also include some lines from above the !!!!!!!!! header.
[2020-12-15 18:44:31.020 18746/F18736] Thank you for helping us to improve our FTL engine!
[2020-12-15 18:44:31.020 18746/F18736] Asking parent pihole-FTL (PID 18736) to shut down
[2020-12-15 18:44:31.020 18746/F18736] FTL fork terminated!
[2020-12-15 18:44:31.020 18736M] Received: Real-time signal 2 (36 -> 2)
[2020-12-15 18:44:31.020 18736M] Shutting down...
[2020-12-15 18:44:31.064 18736M] Finished final database update
[2020-12-15 18:44:31.075 18736M] ########## FTL terminated after 2s 19ms ! ##########
[2020-12-15 18:44:17.087 18650M] Using log file /var/log/pihole-FTL.log
[2020-12-15 18:44:17.087 18650M] ########## FTL started! ##########
[2020-12-15 18:44:17.087 18650M] FTL branch: development
[2020-12-15 18:44:17.087 18650M] FTL version: vDev-0c245ae
[2020-12-15 18:44:17.087 18650M] FTL commit: 0c245ae
[2020-12-15 18:44:17.087 18650M] FTL date: 2020-12-10 06:40:50 +0100
[2020-12-15 18:44:17.087 18650M] FTL user: pihole
[2020-12-15 18:44:17.087 18650M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-15 18:44:17.087 18650M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-15 18:44:17.087 18650M] SOCKET_LISTENING: only local
[2020-12-15 18:44:17.087 18650M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-15 18:44:17.087 18650M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-15 18:44:17.087 18650M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-15 18:44:17.087 18650M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-15 18:44:17.087 18650M] DBINTERVAL: saving to DB file every minute
[2020-12-15 18:44:17.087 18650M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-15 18:44:17.087 18650M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-15 18:44:17.087 18650M] PRIVACYLEVEL: Set to 0
[2020-12-15 18:44:17.087 18650M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-15 18:44:17.087 18650M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-15 18:44:17.088 18650M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-15 18:44:17.088 18650M] DBIMPORT: Importing history from database
[2020-12-15 18:44:17.088 18650M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-15 18:44:17.088 18650M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-15 18:44:17.088 18650M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-15 18:44:17.088 18650M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-15 18:44:17.088 18650M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-15 18:44:17.088 18650M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-15 18:44:17.088 18650M] PARSE_ARP_CACHE: Active
[2020-12-15 18:44:17.088 18650M] CNAME_DEEP_INSPECT: Active
[2020-12-15 18:44:17.088 18650M] DELAY_STARTUP: No delay requested.
[2020-12-15 18:44:17.088 18650M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-15 18:44:17.088 18650M] NICE: Set process niceness to -10 (default)
[2020-12-15 18:44:17.088 18650M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-15 18:44:17.088 18650M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-15 18:44:17.088 18650M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-15 18:44:17.088 18650M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-15 18:44:17.088 18650M] Finished config file parsing
[2020-12-15 18:44:17.089 18650M] Creating mutex
[2020-12-15 18:44:17.091 18650M] Database version is 9
[2020-12-15 18:44:17.091 18650M] Imported 0 alias-clients
[2020-12-15 18:44:17.091 18650M] Database successfully initialized
[2020-12-15 18:44:17.092 18650M] New upstream server: 1.1.1.1:53 (0/512)
[2020-12-15 18:44:17.096 18650M] New upstream server: 1.0.0.1:53 (1/512)
[2020-12-15 18:44:17.106 18650M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
... many Resizing lines removed ...
[2020-12-15 18:44:18.464 18650M] Resizing "FTL-queries" from 19660800 to (311296 * 64) == 19922944 (/dev/shm: 20.1MB used, 997.2MB total)
[2020-12-15 18:44:18.482 18650M] Imported 311020 queries from the long-term database
[2020-12-15 18:44:18.483 18650M] -> Total DNS queries: 311020
[2020-12-15 18:44:18.483 18650M] -> Cached DNS queries: 284219
[2020-12-15 18:44:18.483 18650M] -> Forwarded DNS queries: 13076
[2020-12-15 18:44:18.483 18650M] -> Blocked DNS queries: 13118
[2020-12-15 18:44:18.483 18650M] -> Unknown DNS queries: 0
[2020-12-15 18:44:18.483 18650M] -> Unique domains: 1520
[2020-12-15 18:44:18.484 18650M] -> Unique clients: 13
[2020-12-15 18:44:18.484 18650M] -> Known forward destinations: 2
[2020-12-15 18:44:18.484 18650M] Successfully accessed setupVars.conf
[2020-12-15 18:44:18.488 18653M] PID of FTL process: 18653
[2020-12-15 18:44:18.489 18653/T18654] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-15 18:44:18.489 18653/T18656] Listening on Unix socket
[2020-12-15 18:44:18.490 18653M] INFO: FTL is running as user pihole (UID 999)
[2020-12-15 18:44:18.490 18653M] Reloading DNS cache
[2020-12-15 18:44:18.491 18653M] Blocking status is enabled
[2020-12-15 18:44:18.673 18653/T18657] Compiled 0 whitelist and 11 blacklist regex filters for 13 clients in 22.9 msec
[2020-12-15 18:44:18.674 18664/F18653] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-15 18:44:18.674 18664/F18653] ----------------------------> FTL crashed! <----------------------------
[2020-12-15 18:44:18.674 18664/F18653] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-15 18:44:18.674 18664/F18653] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-15 18:44:18.674 18664/F18653] and include in your report already the following details:
[2020-12-15 18:44:18.675 18664/F18653] FTL has been running for 1 seconds
[2020-12-15 18:44:18.675 18664/F18653] FTL branch: development
[2020-12-15 18:44:18.675 18664/F18653] FTL version: vDev-0c245ae
[2020-12-15 18:44:18.675 18664/F18653] FTL commit: 0c245ae
[2020-12-15 18:44:18.675 18664/F18653] FTL date: 2020-12-10 06:40:50 +0100
[2020-12-15 18:44:18.675 18664/F18653] FTL user: started as pihole, ended as pihole
[2020-12-15 18:44:18.675 18664/F18653] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-15 18:44:18.675 18664/F18653] Process details: MID: 18653
[2020-12-15 18:44:18.675 18664/F18653] PID: 18664
[2020-12-15 18:44:18.675 18664/F18653] TID: 18664
[2020-12-15 18:44:18.675 18664/F18653] Name: pihole-FTL
[2020-12-15 18:44:18.675 18664/F18653] Received signal: Segmentation fault
[2020-12-15 18:44:18.675 18664/F18653] at address: (nil)
[2020-12-15 18:44:18.675 18664/F18653] with code: SEGV_MAPERR (Address not mapped to object)
[2020-12-15 18:44:18.676 18664/F18653] Backtrace:
[2020-12-15 18:44:18.940 18664/F18653] ------ Listing content of directory /dev/shm ------
[2020-12-15 18:44:18.940 18664/F18653] File Mode User:Group Filesize Filename
[2020-12-15 18:44:18.941 18664/F18653] rwxrwxrwx root:root 280 .
[2020-12-15 18:44:18.941 18664/F18653] rwxr-xr-x root:root 4K ..
[2020-12-15 18:44:18.941 18664/F18653] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-15 18:44:18.941 18664/F18653] rw------- pihole:pihole 4K FTL-dns-cache
[2020-12-15 18:44:18.941 18664/F18653] rw------- pihole:pihole 45K FTL-overTime
[2020-12-15 18:44:18.941 18664/F18653] rw------- pihole:pihole 20M FTL-queries
[2020-12-15 18:44:18.942 18664/F18653] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-15 18:44:18.942 18664/F18653] rw------- pihole:pihole 176K FTL-clients
[2020-12-15 18:44:18.942 18664/F18653] rw------- pihole:pihole 98K FTL-domains
[2020-12-15 18:44:18.942 18664/F18653] rw------- pihole:pihole 37K FTL-strings
[2020-12-15 18:44:18.942 18664/F18653] rw------- pihole:pihole 12 FTL-settings
[2020-12-15 18:44:18.942 18664/F18653] rw------- pihole:pihole 152 FTL-counters
[2020-12-15 18:44:18.943 18664/F18653] rw------- pihole:pihole 56 FTL-lock
[2020-12-15 18:44:18.943 18664/F18653] rw-r----- qbt:qbt 4K mono.2581
[2020-12-15 18:44:18.943 18664/F18653] ---------------------------------------------------
[2020-12-15 18:44:18.943 18664/F18653] Please also include some lines from above the !!!!!!!!! header.
[2020-12-15 18:44:18.943 18664/F18653] Thank you for helping us to improve our FTL engine!
[2020-12-15 18:44:18.943 18664/F18653] Asking parent pihole-FTL (PID 18653) to shut down
[2020-12-15 18:44:18.943 18664/F18653] FTL fork terminated!
[2020-12-15 18:44:18.943 18653M] Received: Real-time signal 2 (36 -> 2)
[2020-12-15 18:44:18.945 18653M] Shutting down...
[2020-12-15 18:44:18.989 18653M] Finished final database update
[2020-12-15 18:44:19.000 18653M] ########## FTL terminated after 1s 913ms ! ##########
Hmm, okay. The good part is: We have seen all these bugs and have fixes set up for them already. The "less good" part is that the fixes are - partially - complex and haven't been merged to development yet because I'm still waiting for feedback from affected users if the fixes worked or not.
[2020-12-15 21:35:50.246 20291M] FATAL: realloc_shm(): Failed to resize "FTL-queries" (18) to 21233664: Interrupted system call (-1)
is a crash due to an interrupted system call.
It may (read as: should) be fixed by tweak/interruptsafe_systemcalls (https://github.com/pi-hole/FTL/pull/969)
[2020-12-15 18:44:30.589 18736M] Blocking status is enabled [2020-12-15 18:44:30.721 18736/T18740] Compiled 0 whitelist and 11 blacklist regex filters for 13 clients in 15.1 msec
Is a crash due to a changed regex not propagating properly down to forked TCP workers.
This bug may (read as: should) be fixed by tweak/interruptsafe_systemcalls (https://github.com/pi-hole/FTL/pull/969)
I'm writing may/should because I'm unable to reproduce these crashes myself, so my fixes are theoretical (even if best-effort) so far.
It would be awesome if you could try these fixes. Since you are affected by both bugs, I created a special branch containing all the proposed bug fixes at once so you can test them and - hopefully - see no further crashes. As soon as I have at least some few confirmations of the proposed fix (and zero regressions/objections), this should soon become a point release of FTL. Ideally, this can be a Christmas present.
Please try
pihole checkout ftl fix/all_the_things
Installing now.. will let you know the results
rrrevin
on 17 Dec 2020
Oh no. Crashed again after about a week.
[2020-12-20 03:48:17.996 616M] Reloading DNS cache
[2020-12-20 03:48:18.096 616M] Blocking status is enabled
[2020-12-20 03:48:18.096 616/T620] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-20 03:48:18.096 616/T620] ----------------------------> FTL crashed! <----------------------------
[2020-12-20 03:48:18.096 616/T620] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-20 03:48:18.096 616/T620] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-20 03:48:18.096 616/T620] and include in your report already the following details:
[2020-12-20 03:48:18.096 616/T620] FTL has been running for 351033 seconds
[2020-12-20 03:48:18.096 616/T620] FTL branch: master
[2020-12-20 03:48:18.096 616/T620] FTL version: v5.3.2
[2020-12-20 03:48:18.096 616/T620] FTL commit: 0790cf7
[2020-12-20 03:48:18.096 616/T620] FTL date: 2020-12-02 21:28:39 +0000
[2020-12-20 03:48:18.164 616/T620] FTL user: started as pihole, ended as pihole
[2020-12-20 03:48:18.164 616/T620] Compiled for x86_64 (compiled on CI) using gcc (Debian 6.3.0-18+deb9u1) 6.3.0 20170516
[2020-12-20 03:48:18.164 616/T620] Process details: MID: 616
[2020-12-20 03:48:18.164 616/T620] PID: 616
[2020-12-20 03:48:18.164 616/T620] TID: 620
[2020-12-20 03:48:18.164 616/T620] Name: database
[2020-12-20 03:48:18.164 616/T620] Received signal: Segmentation fault
[2020-12-20 03:48:18.165 616/T620] at address: 0x7
[2020-12-20 03:48:18.165 616/T620] with code: SEGV_MAPERR (Address not mapped to object)
[2020-12-20 03:48:18.407 616/T620] Backtrace:
[2020-12-20 03:48:18.742 616/T620] ------ Listing content of directory /dev/shm ------
[2020-12-20 03:48:18.742 616/T620] File Mode User:Group Filesize Filename
[2020-12-20 03:48:18.742 616/T620] rwxrwxrwx root:root 260 .
[2020-12-20 03:48:18.742 616/T620] rwxr-xr-x root:root 4K ..
[2020-12-20 03:48:18.742 616/T620] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-20 03:48:18.742 616/T620] rw------- pihole:pihole 262K FTL-dns-cache
[2020-12-20 03:48:18.742 616/T620] rw------- pihole:pihole 45K FTL-overTime
[2020-12-20 03:48:18.742 616/T620] rw------- pihole:pihole 5M FTL-queries
[2020-12-20 03:48:18.742 616/T620] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-20 03:48:18.742 616/T620] rw------- pihole:pihole 176K FTL-clients
[2020-12-20 03:48:18.742 616/T620] rw------- pihole:pihole 197K FTL-domains
[2020-12-20 03:48:18.742 616/T620] rw------- pihole:pihole 279K FTL-strings
[2020-12-20 03:48:18.743 616/T620] rw------- pihole:pihole 12 FTL-settings
[2020-12-20 03:48:18.743 616/T620] rw------- pihole:pihole 152 FTL-counters
[2020-12-20 03:48:18.743 616/T620] rw------- pihole:pihole 48 FTL-lock
[2020-12-20 03:48:18.743 616/T620] ---------------------------------------------------
[2020-12-20 03:48:18.743 616/T620] Please also include some lines from above the !!!!!!!!! header.
[2020-12-20 03:48:18.743 616/T620] Thank you for helping us to improve our FTL engine!
[2020-12-20 03:48:18.743 616/T620] FTL terminated!
[2020-12-20 09:59:43.965 20395M] Using log file /var/log/pihole-FTL.log
[2020-12-20 09:59:43.965 20395M] ########## FTL started! ##########
[2020-12-20 09:59:43.966 20395M] FTL branch: master
[2020-12-20 09:59:43.966 20395M] FTL version: v5.3.2
[2020-12-20 09:59:43.966 20395M] FTL commit: 0790cf7
[2020-12-20 09:59:43.966 20395M] FTL date: 2020-12-02 21:28:39 +0000
[2020-12-20 09:59:43.966 20395M] FTL user: pihole
[2020-12-20 09:59:43.966 20395M] Compiled for x86_64 (compiled on CI) using gcc (Debian 6.3.0-18+deb9u1) 6.3.0 20170516
[2020-12-20 09:59:43.966 20395M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-20 09:59:43.966 20395M] SOCKET_LISTENING: only local
[2020-12-20 09:59:43.966 20395M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-20 09:59:43.966 20395M] MAXDBDAYS: max age for stored queries is 60 days
[2020-12-20 09:59:43.966 20395M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-20 09:59:43.966 20395M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-20 09:59:43.966 20395M] DBINTERVAL: saving to DB file every minute
[2020-12-20 09:59:43.966 20395M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-20 09:59:43.966 20395M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-20 09:59:43.966 20395M] PRIVACYLEVEL: Set to 0
[2020-12-20 09:59:43.966 20395M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-20 09:59:43.966 20395M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-20 09:59:43.966 20395M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-20 09:59:43.966 20395M] DBIMPORT: Importing history from database
[2020-12-20 09:59:43.966 20395M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-20 09:59:43.966 20395M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-20 09:59:43.966 20395M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-20 09:59:43.966 20395M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-20 09:59:43.966 20395M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-20 09:59:43.966 20395M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-20 09:59:43.966 20395M] PARSE_ARP_CACHE: Active
[2020-12-20 09:59:43.966 20395M] CNAME_DEEP_INSPECT: Active
[2020-12-20 09:59:43.966 20395M] DELAY_STARTUP: No delay requested.
[2020-12-20 09:59:43.966 20395M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-20 09:59:43.967 20395M] NICE: Set process niceness to -10 (default)
[2020-12-20 09:59:43.967 20395M] MAXNETAGE: Removing IP addresses and host names from network table after 60 days
[2020-12-20 09:59:43.967 20395M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-20 09:59:43.967 20395M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-20 09:59:43.967 20395M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-20 09:59:43.967 20395M] Finished config file parsing
[2020-12-20 09:59:43.967 20395M] Creating mutex
[2020-12-20 09:59:43.001 20395M] Database version is 9
[2020-12-20 09:59:44.011 20395M] Imported 0 alias-clients
[2020-12-20 09:59:44.011 20395M] Database successfully initialized
[2020-12-20 09:59:44.213 20395M] New upstream server: 208.67.222.222:53 (0/512)
[2020-12-20 09:59:44.213 20395M] New upstream server: 208.67.220.220:53 (1/512)
[2020-12-20 09:59:44.232 20395M] Resizing "FTL-strings" from 4096 to (8192 * 1) == 8192 (/dev/shm: 626.7KB used, 252.3MB total)
[2020-12-20 09:59:44.246 20395M] Resizing "FTL-strings" from 8192 to (12288 * 1) == 12288 (/dev/shm: 630.8KB used, 252.3MB total)
[2020-12-20 09:59:44.270 20395M] Resizing "FTL-strings" from 12288 to (16384 * 1) == 16384 (/dev/shm: 634.9KB used, 252.3MB total)
[2020-12-20 09:59:44.297 20395M] Resizing "FTL-strings" from 16384 to (20480 * 1) == 20480 (/dev/shm: 639.0KB used, 252.3MB total)
[2020-12-20 09:59:44.300 20395M] Resizing "FTL-strings" from 20480 to (24576 * 1) == 24576 (/dev/shm: 643.1KB used, 252.3MB total)
[2020-12-20 09:59:44.323 20395M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 647.2KB used, 252.3MB total)
[2020-12-20 09:59:44.324 20395M] Resizing "FTL-strings" from 24576 to (28672 * 1) == 28672 (/dev/shm: 909.3KB used, 252.3MB total)
[2020-12-20 09:59:44.328 20395M] Resizing "FTL-strings" from 28672 to (32768 * 1) == 32768 (/dev/shm: 913.4KB used, 252.3MB total)
[2020-12-20 09:59:44.374 20395M] Resizing "FTL-strings" from 32768 to (36864 * 1) == 36864 (/dev/shm: 917.5KB used, 252.3MB total)
[2020-12-20 09:59:44.378 20395M] Resizing "FTL-queries" from 524288 to (12288 * 64) == 786432 (/dev/shm: 921.6KB used, 252.3MB total)
[2020-12-20 09:59:44.431 20395M] Resizing "FTL-strings" from 36864 to (40960 * 1) == 40960 (/dev/shm: 1.2MB used, 252.3MB total)
[2020-12-20 09:59:44.441 20395M] Resizing "FTL-strings" from 40960 to (45056 * 1) == 45056 (/dev/shm: 1.2MB used, 252.3MB total)
[2020-12-20 09:59:44.470 20395M] Resizing "FTL-queries" from 786432 to (16384 * 64) == 1048576 (/dev/shm: 1.2MB used, 252.3MB total)
[2020-12-20 09:59:44.511 20395M] Resizing "FTL-queries" from 1048576 to (20480 * 64) == 1310720 (/dev/shm: 1.5MB used, 252.3MB total)
[2020-12-20 09:59:44.583 20395M] Resizing "FTL-strings" from 45056 to (49152 * 1) == 49152 (/dev/shm: 1.7MB used, 252.3MB total)
[2020-12-20 09:59:44.607 20395M] Resizing "FTL-strings" from 49152 to (53248 * 1) == 53248 (/dev/shm: 1.7MB used, 252.3MB total)
[2020-12-20 09:59:44.610 20395M] Resizing "FTL-strings" from 53248 to (57344 * 1) == 57344 (/dev/shm: 1.7MB used, 252.3MB total)
[2020-12-20 09:59:44.621 20395M] Resizing "FTL-queries" from 1310720 to (24576 * 64) == 1572864 (/dev/shm: 1.7MB used, 252.3MB total)
[2020-12-20 09:59:44.621 20395M] Resizing "FTL-strings" from 57344 to (61440 * 1) == 61440 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 09:59:44.624 20395M] Resizing "FTL-strings" from 61440 to (65536 * 1) == 65536 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 09:59:44.630 20395M] Resizing "FTL-strings" from 65536 to (69632 * 1) == 69632 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 09:59:44.643 20395M] Resizing "FTL-strings" from 69632 to (73728 * 1) == 73728 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 09:59:44.673 20395M] Resizing "FTL-queries" from 1572864 to (28672 * 64) == 1835008 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 09:59:44.674 20395M] Resizing "FTL-strings" from 73728 to (77824 * 1) == 77824 (/dev/shm: 2.3MB used, 252.3MB total)
[2020-12-20 09:59:44.732 20395M] Resizing "FTL-strings" from 77824 to (81920 * 1) == 81920 (/dev/shm: 2.3MB used, 252.3MB total)
[2020-12-20 09:59:44.732 20395M] Resizing "FTL-queries" from 1835008 to (32768 * 64) == 2097152 (/dev/shm: 2.3MB used, 252.3MB total)
[2020-12-20 09:59:44.800 20395M] Resizing "FTL-queries" from 2097152 to (36864 * 64) == 2359296 (/dev/shm: 2.5MB used, 252.3MB total)
[2020-12-20 09:59:44.822 20395M] Resizing "FTL-strings" from 81920 to (86016 * 1) == 86016 (/dev/shm: 2.8MB used, 252.3MB total)
[2020-12-20 09:59:44.855 20395M] Imported 36524 queries from the long-term database
[2020-12-20 09:59:44.855 20395M] -> Total DNS queries: 36524
[2020-12-20 09:59:44.855 20395M] -> Cached DNS queries: 2943
[2020-12-20 09:59:44.855 20395M] -> Forwarded DNS queries: 18674
[2020-12-20 09:59:44.855 20395M] -> Blocked DNS queries: 11130
[2020-12-20 09:59:44.855 20395M] -> Unknown DNS queries: 0
[2020-12-20 09:59:44.855 20395M] -> Unique domains: 2595
[2020-12-20 09:59:44.855 20395M] -> Unique clients: 15
[2020-12-20 09:59:44.855 20395M] -> Known forward destinations: 2
[2020-12-20 09:59:44.855 20395M] Successfully accessed setupVars.conf
[2020-12-20 09:59:44.895 20397M] PID of FTL process: 20397
[2020-12-20 09:59:44.896 20397M] INFO: FTL is running as user pihole (UID 999)
[2020-12-20 09:59:44.896 20397M] Reloading DNS cache
[2020-12-20 09:59:44.897 20397M] Blocking status is enabled
[2020-12-20 09:59:44.897 20397/T20400] Listening on Unix socket
[2020-12-20 09:59:44.898 20397/T20399] Listening on port 4711 for incoming IPv6 telnet connections
[2020-12-20 09:59:44.898 20397/T20398] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-20 09:59:45.112 20397/T20401] Compiled 0 whitelist and 0 blacklist regex filters for 15 clients in 0.3 msec
[2020-12-20 09:59:59.241 20397M] Shutting down...
[2020-12-20 09:59:59.493 20397M] Finished final database update
[2020-12-20 09:59:59.494 20397M] ########## FTL terminated after 15s ! ##########
[2020-12-20 10:00:00.367 20461M] Using log file /var/log/pihole-FTL.log
[2020-12-20 10:00:00.367 20461M] ########## FTL started! ##########
[2020-12-20 10:00:00.367 20461M] FTL branch: master
[2020-12-20 10:00:00.367 20461M] FTL version: v5.3.2
[2020-12-20 10:00:00.367 20461M] FTL commit: 0790cf7
[2020-12-20 10:00:00.367 20461M] FTL date: 2020-12-02 21:28:39 +0000
[2020-12-20 10:00:00.367 20461M] FTL user: pihole
[2020-12-20 10:00:00.367 20461M] Compiled for x86_64 (compiled on CI) using gcc (Debian 6.3.0-18+deb9u1) 6.3.0 20170516
[2020-12-20 10:00:00.367 20461M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-20 10:00:00.367 20461M] SOCKET_LISTENING: only local
[2020-12-20 10:00:00.367 20461M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-20 10:00:00.367 20461M] MAXDBDAYS: max age for stored queries is 60 days
[2020-12-20 10:00:00.367 20461M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-20 10:00:00.367 20461M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-20 10:00:00.367 20461M] DBINTERVAL: saving to DB file every minute
[2020-12-20 10:00:00.367 20461M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-20 10:00:00.367 20461M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-20 10:00:00.367 20461M] PRIVACYLEVEL: Set to 0
[2020-12-20 10:00:00.367 20461M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-20 10:00:00.367 20461M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-20 10:00:00.368 20461M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-20 10:00:00.368 20461M] DBIMPORT: Importing history from database
[2020-12-20 10:00:00.368 20461M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-20 10:00:00.368 20461M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-20 10:00:00.368 20461M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-20 10:00:00.368 20461M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-20 10:00:00.368 20461M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-20 10:00:00.368 20461M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-20 10:00:00.368 20461M] PARSE_ARP_CACHE: Active
[2020-12-20 10:00:00.368 20461M] CNAME_DEEP_INSPECT: Active
[2020-12-20 10:00:00.368 20461M] DELAY_STARTUP: No delay requested.
[2020-12-20 10:00:00.368 20461M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-20 10:00:00.368 20461M] NICE: Set process niceness to -10 (default)
[2020-12-20 10:00:00.368 20461M] MAXNETAGE: Removing IP addresses and host names from network table after 60 days
[2020-12-20 10:00:00.368 20461M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-20 10:00:00.368 20461M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-20 10:00:00.368 20461M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-20 10:00:00.368 20461M] Finished config file parsing
[2020-12-20 10:00:00.368 20461M] Creating mutex
[2020-12-20 10:00:00.369 20461M] Database version is 9
[2020-12-20 10:00:00.370 20461M] Imported 0 alias-clients
[2020-12-20 10:00:00.370 20461M] Database successfully initialized
[2020-12-20 10:00:00.370 20461M] New upstream server: 208.67.222.222:53 (0/512)
[2020-12-20 10:00:00.370 20461M] New upstream server: 208.67.220.220:53 (1/512)
[2020-12-20 10:00:00.371 20461M] Resizing "FTL-strings" from 4096 to (8192 * 1) == 8192 (/dev/shm: 626.7KB used, 252.3MB total)
[2020-12-20 10:00:00.372 20461M] Resizing "FTL-strings" from 8192 to (12288 * 1) == 12288 (/dev/shm: 630.8KB used, 252.3MB total)
[2020-12-20 10:00:00.374 20461M] Resizing "FTL-strings" from 12288 to (16384 * 1) == 16384 (/dev/shm: 634.9KB used, 252.3MB total)
[2020-12-20 10:00:00.377 20461M] Resizing "FTL-strings" from 16384 to (20480 * 1) == 20480 (/dev/shm: 639.0KB used, 252.3MB total)
[2020-12-20 10:00:00.380 20461M] Resizing "FTL-strings" from 20480 to (24576 * 1) == 24576 (/dev/shm: 643.1KB used, 252.3MB total)
[2020-12-20 10:00:00.385 20461M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 647.2KB used, 252.3MB total)
[2020-12-20 10:00:00.385 20461M] Resizing "FTL-strings" from 24576 to (28672 * 1) == 28672 (/dev/shm: 909.3KB used, 252.3MB total)
[2020-12-20 10:00:00.390 20461M] Resizing "FTL-strings" from 28672 to (32768 * 1) == 32768 (/dev/shm: 913.4KB used, 252.3MB total)
[2020-12-20 10:00:00.399 20461M] Resizing "FTL-strings" from 32768 to (36864 * 1) == 36864 (/dev/shm: 917.5KB used, 252.3MB total)
[2020-12-20 10:00:00.403 20461M] Resizing "FTL-queries" from 524288 to (12288 * 64) == 786432 (/dev/shm: 921.6KB used, 252.3MB total)
[2020-12-20 10:00:00.409 20461M] Resizing "FTL-strings" from 36864 to (40960 * 1) == 40960 (/dev/shm: 1.2MB used, 252.3MB total)
[2020-12-20 10:00:00.419 20461M] Resizing "FTL-strings" from 40960 to (45056 * 1) == 45056 (/dev/shm: 1.2MB used, 252.3MB total)
[2020-12-20 10:00:00.419 20461M] Resizing "FTL-queries" from 786432 to (16384 * 64) == 1048576 (/dev/shm: 1.2MB used, 252.3MB total)
[2020-12-20 10:00:00.434 20461M] Resizing "FTL-queries" from 1048576 to (20480 * 64) == 1310720 (/dev/shm: 1.5MB used, 252.3MB total)
[2020-12-20 10:00:00.443 20461M] Resizing "FTL-strings" from 45056 to (49152 * 1) == 49152 (/dev/shm: 1.7MB used, 252.3MB total)
[2020-12-20 10:00:00.449 20461M] Resizing "FTL-strings" from 49152 to (53248 * 1) == 53248 (/dev/shm: 1.7MB used, 252.3MB total)
[2020-12-20 10:00:00.452 20461M] Resizing "FTL-strings" from 53248 to (57344 * 1) == 57344 (/dev/shm: 1.7MB used, 252.3MB total)
[2020-12-20 10:00:00.455 20461M] Resizing "FTL-queries" from 1310720 to (24576 * 64) == 1572864 (/dev/shm: 1.7MB used, 252.3MB total)
[2020-12-20 10:00:00.455 20461M] Resizing "FTL-strings" from 57344 to (61440 * 1) == 61440 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 10:00:00.458 20461M] Resizing "FTL-strings" from 61440 to (65536 * 1) == 65536 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 10:00:00.463 20461M] Resizing "FTL-strings" from 65536 to (69632 * 1) == 69632 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 10:00:00.469 20461M] Resizing "FTL-strings" from 69632 to (73728 * 1) == 73728 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 10:00:00.480 20461M] Resizing "FTL-queries" from 1572864 to (28672 * 64) == 1835008 (/dev/shm: 2.0MB used, 252.3MB total)
[2020-12-20 10:00:00.481 20461M] Resizing "FTL-strings" from 73728 to (77824 * 1) == 77824 (/dev/shm: 2.3MB used, 252.3MB total)
[2020-12-20 10:00:00.503 20461M] Resizing "FTL-strings" from 77824 to (81920 * 1) == 81920 (/dev/shm: 2.3MB used, 252.3MB total)
[2020-12-20 10:00:00.503 20461M] Resizing "FTL-queries" from 1835008 to (32768 * 64) == 2097152 (/dev/shm: 2.3MB used, 252.3MB total)
[2020-12-20 10:00:00.524 20461M] Resizing "FTL-queries" from 2097152 to (36864 * 64) == 2359296 (/dev/shm: 2.5MB used, 252.3MB total)
[2020-12-20 10:00:00.527 20461M] Resizing "FTL-strings" from 81920 to (86016 * 1) == 86016 (/dev/shm: 2.8MB used, 252.3MB total)
[2020-12-20 10:00:00.536 20461M] Imported 36538 queries from the long-term database
[2020-12-20 10:00:00.536 20461M] -> Total DNS queries: 36538
[2020-12-20 10:00:00.536 20461M] -> Cached DNS queries: 2943
[2020-12-20 10:00:00.536 20461M] -> Forwarded DNS queries: 18684
[2020-12-20 10:00:00.536 20461M] -> Blocked DNS queries: 11134
[2020-12-20 10:00:00.536 20461M] -> Unknown DNS queries: 0
[2020-12-20 10:00:00.536 20461M] -> Unique domains: 2597
[2020-12-20 10:00:00.536 20461M] -> Unique clients: 15
[2020-12-20 10:00:00.536 20461M] -> Known forward destinations: 2
[2020-12-20 10:00:00.536 20461M] Successfully accessed setupVars.conf
[2020-12-20 10:00:00.547 20465M] PID of FTL process: 20465
[2020-12-20 10:00:00.547 20465M] INFO: FTL is running as user pihole (UID 999)
[2020-12-20 10:00:00.548 20465M] Reloading DNS cache
[2020-12-20 10:00:00.548 20465M] Blocking status is enabled
[2020-12-20 10:00:00.549 20465/T20468] Listening on Unix socket
[2020-12-20 10:00:00.549 20465/T20467] Listening on port 4711 for incoming IPv6 telnet connections
[2020-12-20 10:00:00.549 20465/T20466] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-20 10:00:00.683 20465/T20469] Compiled 0 whitelist and 0 blacklist regex filters for 15 clients in 0.2 msec
[2020-12-20 10:07:46.497 20465M] Resizing "FTL-dns-cache" from 4096 to (512 * 16) == 8192 (/dev/shm: 2.8MB used, 252.3MB total)
[2020-12-20 10:07:47.764 20465M] Resizing "FTL-queries" from 2359296 to (40960 * 64) == 2621440 (/dev/shm: 2.8MB used, 252.3MB total)
[2020-12-20 10:11:47.004 20465M] Resizing "FTL-dns-cache" from 8192 to (768 * 16) == 12288 (/dev/shm: 3.1MB used, 252.3MB total)
[2020-12-20 10:18:24.775 20465M] Resizing "FTL-strings" from 86016 to (90112 * 1) == 90112 (/dev/shm: 3.1MB used, 252.3MB total)
gunnahafta
on 20 Dec 2020
@guideloom Good catch, you managed to find the one remaining system call I forgot to make resistant against interruptions :slightly_smiling_face:
Please try again with updating your branch.
DL6ER
on 20 Dec 2020
@gunnahafta We have a set of fixes we're currently evaluating with users, please try
pihole checkout ftl fix/all_the_things
For what it's worth my issue was similar or equal to all of this and I've gone 24 hours without my primary Pihole or Pihole backup crashing.
derekcentrico
on 20 Dec 2020
Installed latest and am now testing..
rrrevin
on 21 Dec 2020
One unit crashed. But instead of like 8 crashes in a day it only had 1. I wasn't able to catch a log. Just noticed the big dead space on graphs. Progress.
derekcentrico
on 21 Dec 2020
Crashing quite a bit.. all at the same spot.
[2020-12-20 07:58:34.622 15587M] ########## FTL started! ##########
[2020-12-20 07:58:34.622 15587M] FTL branch: fix/all_the_things
[2020-12-20 07:58:34.622 15587M] FTL version: vDev-2e0d740
[2020-12-20 07:58:34.622 15587M] FTL commit: 2e0d740
[2020-12-20 07:58:34.622 15587M] FTL date: 2020-12-20 11:07:28 +0100
[2020-12-20 07:58:34.622 15587M] FTL user: pihole
[2020-12-20 07:58:34.622 15587M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-20 07:58:34.622 15587M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-20 07:58:34.622 15587M] SOCKET_LISTENING: only local
[2020-12-20 07:58:34.622 15587M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-20 07:58:34.622 15587M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-20 07:58:34.622 15587M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-20 07:58:34.622 15587M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-20 07:58:34.622 15587M] DBINTERVAL: saving to DB file every minute
[2020-12-20 07:58:34.622 15587M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-20 07:58:34.622 15587M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-20 07:58:34.623 15587M] PRIVACYLEVEL: Set to 0
[2020-12-20 07:58:34.623 15587M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-20 07:58:34.623 15587M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-20 07:58:34.623 15587M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-20 07:58:34.623 15587M] DBIMPORT: Importing history from database
[2020-12-20 07:58:34.623 15587M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-20 07:58:34.623 15587M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-20 07:58:34.623 15587M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-20 07:58:34.623 15587M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-20 07:58:34.623 15587M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-20 07:58:34.623 15587M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-20 07:58:34.623 15587M] PARSE_ARP_CACHE: Active
[2020-12-20 07:58:34.623 15587M] CNAME_DEEP_INSPECT: Active
[2020-12-20 07:58:34.623 15587M] DELAY_STARTUP: No delay requested.
[2020-12-20 07:58:34.623 15587M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-20 07:58:34.624 15587M] NICE: Set process niceness to -10 (default)
[2020-12-20 07:58:34.624 15587M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-20 07:58:34.624 15587M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-20 07:58:34.624 15587M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-20 07:58:34.624 15587M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-20 07:58:34.624 15587M] Finished config file parsing
[2020-12-20 07:58:34.624 15587M] Creating mutex
[2020-12-20 07:58:34.627 15587M] Database version is 9
[2020-12-20 07:58:34.628 15587M] Imported 0 alias-clients
[2020-12-20 07:58:34.628 15587M] Database successfully initialized
[2020-12-20 07:58:34.632 15587M] New upstream server: 1.1.1.1:53 (0/512)
[2020-12-20 07:58:34.633 15587M] New upstream server: 1.0.0.1:53 (1/512)
[2020-12-20 07:58:34.672 15587M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
...
[2020-12-20 07:58:36.295 15587M] Resizing "FTL-queries" from 17301504 to (274432 * 64) == 17563648 (/dev/shm: 17.7MB used, 997.2MB total)
[2020-12-20 07:58:36.300 15587M] Imported 270813 queries from the long-term database
[2020-12-20 07:58:36.301 15587M] -> Total DNS queries: 270813
[2020-12-20 07:58:36.301 15587M] -> Cached DNS queries: 260573
[2020-12-20 07:58:36.301 15587M] -> Forwarded DNS queries: 6141
[2020-12-20 07:58:36.301 15587M] -> Blocked DNS queries: 3978
[2020-12-20 07:58:36.301 15587M] -> Unknown DNS queries: 1
[2020-12-20 07:58:36.301 15587M] -> Unique domains: 652
[2020-12-20 07:58:36.301 15587M] -> Unique clients: 12
[2020-12-20 07:58:36.301 15587M] -> Known forward destinations: 2
[2020-12-20 07:58:36.301 15587M] Successfully accessed setupVars.conf
[2020-12-20 07:58:36.311 15590M] PID of FTL process: 15590
[2020-12-20 07:58:36.312 15590M] INFO: FTL is running as user pihole (UID 999)
[2020-12-20 07:58:36.312 15590/T15591] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-20 07:58:36.313 15590/T15593] Listening on Unix socket
[2020-12-20 07:58:36.313 15590M] Reloading DNS cache
[2020-12-20 07:58:36.314 15590M] Blocking status is enabled
[2020-12-20 07:58:36.446 15590/T15594] Compiled 0 whitelist and 11 blacklist regex filters for 12 clients in 14.3 msec
[2020-12-20 08:17:23.951 15590M] Resizing "FTL-strings" from 16384 to (20480 * 1) == 20480 (/dev/shm: 17.9MB used, 997.2MB total)
[2020-12-20 08:36:31.874 15590M] Resizing "FTL-dns-cache" from 4096 to (512 * 16) == 8192 (/dev/shm: 17.9MB used, 997.2MB total)
[2020-12-20 12:59:26.930 15590M] Resizing "FTL-strings" from 20480 to (24576 * 1) == 24576 (/dev/shm: 18.0MB used, 997.2MB total)
[2020-12-20 13:40:21.769 15590M] Resizing "FTL-dns-cache" from 8192 to (768 * 16) == 12288 (/dev/shm: 18.0MB used, 997.2MB total)
[2020-12-20 13:49:29.015 15590M] Resizing "FTL-queries" from 17563648 to (278528 * 64) == 17825792 (/dev/shm: 18.0MB used, 997.2MB total)
[2020-12-20 13:49:29.033 25460/F15590] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-20 13:49:29.033 25460/F15590] ----------------------------> FTL crashed! <----------------------------
[2020-12-20 13:49:29.033 25460/F15590] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-20 13:49:29.033 25460/F15590] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-20 13:49:29.033 25460/F15590] and include in your report already the following details:
[2020-12-20 13:49:29.034 25460/F15590] FTL has been running for 21055 seconds
[2020-12-20 13:49:29.034 25460/F15590] FTL branch: fix/all_the_things
[2020-12-20 13:49:29.034 25460/F15590] FTL version: vDev-2e0d740
[2020-12-20 13:49:29.034 25460/F15590] FTL commit: 2e0d740
[2020-12-20 13:49:29.034 25460/F15590] FTL date: 2020-12-20 11:07:28 +0100
[2020-12-20 13:49:29.034 25460/F15590] FTL user: started as pihole, ended as pihole
[2020-12-20 13:49:29.034 25460/F15590] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-20 13:49:29.035 25460/F15590] Process details: MID: 15590
[2020-12-20 13:49:29.035 25460/F15590] PID: 25460
[2020-12-20 13:49:29.035 25460/F15590] TID: 25460
[2020-12-20 13:49:29.035 25460/F15590] Name: pihole-FTL
[2020-12-20 13:49:29.035 25460/F15590] Received signal: Bus error
[2020-12-20 13:49:29.035 25460/F15590] at address: 0xffff8f4a0000
[2020-12-20 13:49:29.036 25460/F15590] with code: BUS_ADRERR (Non-existant physical address)
[2020-12-20 13:49:29.037 25460/F15590] Backtrace:
[2020-12-20 13:49:29.038 25460/F15590] B[0000]: /usr/bin/pihole-FTL(+0x569f4) [0xaaaaaeb6a9f4]
[2020-12-20 13:49:29.170 25460/F15590] L[0000]: /root/project/src/signals.c:191
[2020-12-20 13:49:29.179 25460/F15590] B[0001]: linux-vdso.so.1(__kernel_rt_sigreturn+0) [0xffff93cb77c0]
[2020-12-20 13:49:29.180 25460/F15590] B[0002]: /usr/bin/pihole-FTL(_getQuery+0x48) [0xaaaaaeb6a470]
[2020-12-20 13:49:29.222 25460/F15590] L[0002]: /root/project/src/shmem.c:945
[2020-12-20 13:49:29.228 25460/F15590] B[0003]: /usr/bin/pihole-FTL(_FTL_new_query+0x41c) [0xaaaaaeb5df84]
[2020-12-20 13:49:29.267 25460/F15590] L[0003]: /root/project/src/dnsmasq_interface.c:609
[2020-12-20 13:49:29.271 25460/F15590] B[0004]: /usr/bin/pihole-FTL(tcp_request+0x69c) [0xaaaaaeb93dd4]
[2020-12-20 13:49:29.305 25460/F15590] L[0004]: /root/project/src/dnsmasq/forward.c:1963
[2020-12-20 13:49:29.311 25460/F15590] B[0005]: /usr/bin/pihole-FTL(+0x76ffc) [0xaaaaaeb8affc]
[2020-12-20 13:49:29.338 25460/F15590] L[0005]: /root/project/src/dnsmasq/dnsmasq.c:1972
[2020-12-20 13:49:29.343 25460/F15590] B[0006]: /usr/bin/pihole-FTL(main_dnsmasq+0xd30) [0xaaaaaeb8c938]
[2020-12-20 13:49:29.368 25460/F15590] L[0006]: /root/project/src/dnsmasq/dnsmasq.c:1206
[2020-12-20 13:49:29.372 25460/F15590] B[0007]: /usr/bin/pihole-FTL(main+0xfc) [0xaaaaaeb56784]
[2020-12-20 13:49:29.394 25460/F15590] L[0007]: /root/project/src/main.c:97
[2020-12-20 13:49:29.398 25460/F15590] B[0008]: /lib/aarch64-linux-gnu/libc.so.6(__libc_start_main+0xe0) [0xffff93a45720]
[2020-12-20 13:49:29.398 25460/F15590] B[0009]: /usr/bin/pihole-FTL(+0x42978) [0xaaaaaeb56978]
[2020-12-20 13:49:29.437 25460/F15590] L[0009]: :?
[2020-12-20 13:49:29.446 25460/F15590] ------ Listing content of directory /dev/shm ------
[2020-12-20 13:49:29.446 25460/F15590] File Mode User:Group Filesize Filename
[2020-12-20 13:49:29.446 25460/F15590] rwxrwxrwx root:root 280 .
[2020-12-20 13:49:29.446 25460/F15590] rwxr-xr-x root:root 4K ..
[2020-12-20 13:49:29.446 25460/F15590] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-20 13:49:29.446 25460/F15590] rw------- pihole:pihole 12K FTL-dns-cache
[2020-12-20 13:49:29.447 25460/F15590] rw------- pihole:pihole 45K FTL-overTime
[2020-12-20 13:49:29.447 25460/F15590] rw------- pihole:pihole 18M FTL-queries
[2020-12-20 13:49:29.447 25460/F15590] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-20 13:49:29.447 25460/F15590] rw------- pihole:pihole 176K FTL-clients
[2020-12-20 13:49:29.447 25460/F15590] rw------- pihole:pihole 98K FTL-domains
[2020-12-20 13:49:29.447 25460/F15590] rw------- pihole:pihole 25K FTL-strings
[2020-12-20 13:49:29.448 25460/F15590] rw------- pihole:pihole 12 FTL-settings
[2020-12-20 13:49:29.448 25460/F15590] rw------- pihole:pihole 144 FTL-counters
[2020-12-20 13:49:29.448 25460/F15590] rw------- pihole:pihole 56 FTL-lock
[2020-12-20 13:49:29.448 25460/F15590] rw-r----- qbt:qbt 4K mono.2581
[2020-12-20 13:49:29.448 25460/F15590] ---------------------------------------------------
[2020-12-20 13:49:29.448 25460/F15590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-20 13:49:29.448 25460/F15590] Thank you for helping us to improve our FTL engine!
[2020-12-20 13:49:29.448 25460/F15590] Asking parent pihole-FTL (PID 15590) to shut down
[2020-12-20 13:49:29.448 25460/F15590] FTL fork terminated!
[2020-12-20 13:49:29.448 15590M] Received: Real-time signal 2 (36 -> 2)
[2020-12-20 13:49:29.449 15590M] Shutting down...
[2020-12-20 13:49:29.504 15590M] Finished final database update
[2020-12-20 13:49:29.520 15590M] ########## FTL terminated after 5h 50m 54s ! ##########
[2020-12-20 13:49:30.720 25525M] ########## FTL started! ##########
[2020-12-20 13:49:30.720 25525M] FTL branch: fix/all_the_things
[2020-12-20 13:49:30.720 25525M] FTL version: vDev-2e0d740
[2020-12-20 13:49:30.720 25525M] FTL commit: 2e0d740
[2020-12-20 13:49:30.720 25525M] FTL date: 2020-12-20 11:07:28 +0100
[2020-12-20 13:49:30.720 25525M] FTL user: pihole
[2020-12-20 13:49:30.720 25525M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-20 13:49:30.720 25525M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-20 13:49:30.720 25525M] SOCKET_LISTENING: only local
[2020-12-20 13:49:30.720 25525M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-20 13:49:30.720 25525M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-20 13:49:30.720 25525M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-20 13:49:30.720 25525M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-20 13:49:30.720 25525M] DBINTERVAL: saving to DB file every minute
[2020-12-20 13:49:30.721 25525M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-20 13:49:30.721 25525M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-20 13:49:30.721 25525M] PRIVACYLEVEL: Set to 0
[2020-12-20 13:49:30.721 25525M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-20 13:49:30.721 25525M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-20 13:49:30.721 25525M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-20 13:49:30.721 25525M] DBIMPORT: Importing history from database
[2020-12-20 13:49:30.721 25525M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-20 13:49:30.721 25525M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-20 13:49:30.721 25525M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-20 13:49:30.721 25525M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-20 13:49:30.721 25525M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-20 13:49:30.721 25525M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-20 13:49:30.721 25525M] PARSE_ARP_CACHE: Active
[2020-12-20 13:49:30.722 25525M] CNAME_DEEP_INSPECT: Active
[2020-12-20 13:49:30.722 25525M] DELAY_STARTUP: No delay requested.
[2020-12-20 13:49:30.722 25525M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-20 13:49:30.722 25525M] NICE: Set process niceness to -10 (default)
[2020-12-20 13:49:30.722 25525M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-20 13:49:30.722 25525M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-20 13:49:30.722 25525M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-20 13:49:30.722 25525M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-20 13:49:30.722 25525M] Finished config file parsing
[2020-12-20 13:49:30.722 25525M] Creating mutex
[2020-12-20 13:49:30.725 25525M] Database version is 9
[2020-12-20 13:49:30.726 25525M] Imported 0 alias-clients
[2020-12-20 13:49:30.726 25525M] Database successfully initialized
[2020-12-20 13:49:30.732 25525M] New upstream server: 1.1.1.1:53 (0/512)
[2020-12-20 13:49:30.749 25525M] New upstream server: 1.0.0.1:53 (1/512)
[2020-12-20 13:49:30.767 25525M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
...
[2020-12-20 13:49:32.413 25525M] Resizing "FTL-queries" from 17563648 to (278528 * 64) == 17825792 (/dev/shm: 17.9MB used, 997.2MB total)
[2020-12-20 13:49:32.425 25525M] Imported 276944 queries from the long-term database
[2020-12-20 13:49:32.427 25525M] -> Total DNS queries: 276944
[2020-12-20 13:49:32.427 25525M] -> Cached DNS queries: 268052
[2020-12-20 13:49:32.427 25525M] -> Forwarded DNS queries: 5482
[2020-12-20 13:49:32.427 25525M] -> Blocked DNS queries: 3024
[2020-12-20 13:49:32.427 25525M] -> Unknown DNS queries: 2
[2020-12-20 13:49:32.427 25525M] -> Unique domains: 549
[2020-12-20 13:49:32.427 25525M] -> Unique clients: 11
[2020-12-20 13:49:32.427 25525M] -> Known forward destinations: 2
[2020-12-20 13:49:32.427 25525M] Successfully accessed setupVars.conf
[2020-12-20 13:49:32.457 25528M] PID of FTL process: 25528
[2020-12-20 13:49:32.457 25528/T25529] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-20 13:49:32.458 25528M] INFO: FTL is running as user pihole (UID 999)
[2020-12-20 13:49:32.458 25528/T25531] Listening on Unix socket
[2020-12-20 13:49:32.458 25528M] Reloading DNS cache
[2020-12-20 13:49:32.459 25528M] Blocking status is enabled
[2020-12-20 13:49:32.597 25528/T25532] Compiled 0 whitelist and 11 blacklist regex filters for 11 clients in 17.8 msec
[2020-12-20 13:49:48.557 25528M] Resizing "FTL-strings" from 12288 to (16384 * 1) == 16384 (/dev/shm: 18.2MB used, 997.2MB total)
[2020-12-20 13:55:35.912 25528M] Resizing "FTL-queries" from 17825792 to (282624 * 64) == 18087936 (/dev/shm: 18.2MB used, 997.2MB total)
[2020-12-20 13:55:35.925 27092/F25528] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-20 13:55:35.925 27092/F25528] ----------------------------> FTL crashed! <----------------------------
[2020-12-20 13:55:35.925 27092/F25528] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-20 13:55:35.925 27092/F25528] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-20 13:55:35.925 27092/F25528] and include in your report already the following details:
[2020-12-20 13:55:35.925 27092/F25528] FTL has been running for 365 seconds
[2020-12-20 13:55:35.925 27092/F25528] FTL branch: fix/all_the_things
[2020-12-20 13:55:35.925 27092/F25528] FTL version: vDev-2e0d740
[2020-12-20 13:55:35.926 27092/F25528] FTL commit: 2e0d740
[2020-12-20 13:55:35.926 27092/F25528] FTL date: 2020-12-20 11:07:28 +0100
[2020-12-20 13:55:35.926 27092/F25528] FTL user: started as pihole, ended as pihole
[2020-12-20 13:55:35.926 27092/F25528] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-20 13:55:35.926 27092/F25528] Process details: MID: 25528
[2020-12-20 13:55:35.926 27092/F25528] PID: 27092
[2020-12-20 13:55:35.926 27092/F25528] TID: 27092
[2020-12-20 13:55:35.926 27092/F25528] Name: pihole-FTL
[2020-12-20 13:55:35.926 27092/F25528] Received signal: Bus error
[2020-12-20 13:55:35.927 27092/F25528] at address: 0xffffa5cfe000
[2020-12-20 13:55:35.927 27092/F25528] with code: BUS_ADRERR (Non-existant physical address)
[2020-12-20 13:55:35.928 27092/F25528] Backtrace:
[2020-12-20 13:55:35.929 27092/F25528] B[0000]: /usr/bin/pihole-FTL(+0x569f4) [0xaaaab0f7c9f4]
[2020-12-20 13:55:35.968 27092/F25528] L[0000]: /root/project/src/signals.c:191
[2020-12-20 13:55:35.973 27092/F25528] B[0001]: linux-vdso.so.1(__kernel_rt_sigreturn+0) [0xffffa6ecc7c0]
[2020-12-20 13:55:35.973 27092/F25528] B[0002]: /usr/bin/pihole-FTL(_getQuery+0x48) [0xaaaab0f7c470]
[2020-12-20 13:55:36.000 27092/F25528] L[0002]: /root/project/src/shmem.c:945
[2020-12-20 13:55:36.005 27092/F25528] B[0003]: /usr/bin/pihole-FTL(_FTL_new_query+0x41c) [0xaaaab0f6ff84]
[2020-12-20 13:55:36.033 27092/F25528] L[0003]: /root/project/src/dnsmasq_interface.c:609
[2020-12-20 13:55:36.038 27092/F25528] B[0004]: /usr/bin/pihole-FTL(tcp_request+0x69c) [0xaaaab0fa5dd4]
[2020-12-20 13:55:36.067 27092/F25528] L[0004]: /root/project/src/dnsmasq/forward.c:1963
[2020-12-20 13:55:36.071 27092/F25528] B[0005]: /usr/bin/pihole-FTL(+0x76ffc) [0xaaaab0f9cffc]
[2020-12-20 13:55:36.098 27092/F25528] L[0005]: /root/project/src/dnsmasq/dnsmasq.c:1972
[2020-12-20 13:55:36.102 27092/F25528] B[0006]: /usr/bin/pihole-FTL(main_dnsmasq+0xd30) [0xaaaab0f9e938]
[2020-12-20 13:55:36.127 27092/F25528] L[0006]: /root/project/src/dnsmasq/dnsmasq.c:1206
[2020-12-20 13:55:36.131 27092/F25528] B[0007]: /usr/bin/pihole-FTL(main+0xfc) [0xaaaab0f68784]
[2020-12-20 13:55:36.151 27092/F25528] L[0007]: /root/project/src/main.c:97
[2020-12-20 13:55:36.154 27092/F25528] B[0008]: /lib/aarch64-linux-gnu/libc.so.6(__libc_start_main+0xe0) [0xffffa6c5a720]
[2020-12-20 13:55:36.154 27092/F25528] B[0009]: /usr/bin/pihole-FTL(+0x42978) [0xaaaab0f68978]
[2020-12-20 13:55:36.186 27092/F25528] L[0009]: :?
[2020-12-20 13:55:36.193 27092/F25528] ------ Listing content of directory /dev/shm ------
[2020-12-20 13:55:36.193 27092/F25528] File Mode User:Group Filesize Filename
[2020-12-20 13:55:36.194 27092/F25528] rwxrwxrwx root:root 280 .
[2020-12-20 13:55:36.194 27092/F25528] rwxr-xr-x root:root 4K ..
[2020-12-20 13:55:36.194 27092/F25528] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-20 13:55:36.194 27092/F25528] rw------- pihole:pihole 4K FTL-dns-cache
[2020-12-20 13:55:36.194 27092/F25528] rw------- pihole:pihole 45K FTL-overTime
[2020-12-20 13:55:36.194 27092/F25528] rw------- pihole:pihole 18M FTL-queries
[2020-12-20 13:55:36.195 27092/F25528] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-20 13:55:36.195 27092/F25528] rw------- pihole:pihole 176K FTL-clients
[2020-12-20 13:55:36.195 27092/F25528] rw------- pihole:pihole 98K FTL-domains
[2020-12-20 13:55:36.195 27092/F25528] rw------- pihole:pihole 16K FTL-strings
[2020-12-20 13:55:36.195 27092/F25528] rw------- pihole:pihole 12 FTL-settings
[2020-12-20 13:55:36.195 27092/F25528] rw------- pihole:pihole 144 FTL-counters
[2020-12-20 13:55:36.196 27092/F25528] rw------- pihole:pihole 56 FTL-lock
[2020-12-20 13:55:36.196 27092/F25528] rw-r----- qbt:qbt 4K mono.2581
[2020-12-20 13:55:36.196 27092/F25528] ---------------------------------------------------
[2020-12-20 13:55:36.196 27092/F25528] Please also include some lines from above the !!!!!!!!! header.
[2020-12-20 13:55:36.196 27092/F25528] Thank you for helping us to improve our FTL engine!
[2020-12-20 13:55:36.196 27092/F25528] Asking parent pihole-FTL (PID 25528) to shut down
[2020-12-20 13:55:36.196 27092/F25528] FTL fork terminated!
[2020-12-20 13:55:36.196 25528M] Received: Real-time signal 2 (36 -> 2)
[2020-12-20 13:55:36.196 25528M] Shutting down...
[2020-12-20 13:55:36.249 25528M] Finished final database update
[2020-12-20 13:55:36.261 25528M] ########## FTL terminated after 6m 5s ! ##########
[2020-12-20 13:55:40.119 27156M] ########## FTL started! ##########
[2020-12-20 13:55:40.119 27156M] FTL branch: fix/all_the_things
[2020-12-20 13:55:40.119 27156M] FTL version: vDev-2e0d740
[2020-12-20 13:55:40.119 27156M] FTL commit: 2e0d740
[2020-12-20 13:55:40.119 27156M] FTL date: 2020-12-20 11:07:28 +0100
[2020-12-20 13:55:40.119 27156M] FTL user: pihole
[2020-12-20 13:55:40.119 27156M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-20 13:55:40.119 27156M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-20 13:55:40.119 27156M] SOCKET_LISTENING: only local
[2020-12-20 13:55:40.119 27156M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-20 13:55:40.119 27156M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-20 13:55:40.120 27156M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-20 13:55:40.120 27156M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-20 13:55:40.120 27156M] DBINTERVAL: saving to DB file every minute
[2020-12-20 13:55:40.120 27156M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-20 13:55:40.120 27156M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-20 13:55:40.120 27156M] PRIVACYLEVEL: Set to 0
[2020-12-20 13:55:40.120 27156M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-20 13:55:40.120 27156M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-20 13:55:40.120 27156M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-20 13:55:40.120 27156M] DBIMPORT: Importing history from database
[2020-12-20 13:55:40.120 27156M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-20 13:55:40.120 27156M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-20 13:55:40.120 27156M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-20 13:55:40.120 27156M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-20 13:55:40.120 27156M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-20 13:55:40.120 27156M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-20 13:55:40.120 27156M] PARSE_ARP_CACHE: Active
[2020-12-20 13:55:40.120 27156M] CNAME_DEEP_INSPECT: Active
[2020-12-20 13:55:40.120 27156M] DELAY_STARTUP: No delay requested.
[2020-12-20 13:55:40.120 27156M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-20 13:55:40.120 27156M] NICE: Set process niceness to -10 (default)
[2020-12-20 13:55:40.121 27156M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-20 13:55:40.121 27156M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-20 13:55:40.121 27156M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-20 13:55:40.121 27156M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-20 13:55:40.121 27156M] Finished config file parsing
[2020-12-20 13:55:40.121 27156M] Creating mutex
[2020-12-20 13:55:40.123 27156M] Database version is 9
[2020-12-20 13:55:40.123 27156M] Imported 0 alias-clients
[2020-12-20 13:55:40.123 27156M] Database successfully initialized
[2020-12-20 13:55:40.125 27156M] New upstream server: 1.1.1.1:53 (0/512)
[2020-12-20 13:55:40.129 27156M] New upstream server: 1.0.0.1:53 (1/512)
[2020-12-20 13:55:40.139 27156M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
...
[2020-12-20 13:55:41.133 27156M] Resizing "FTL-queries" from 17563648 to (278528 * 64) == 17825792 (/dev/shm: 17.9MB used, 997.2MB total)
[2020-12-20 13:55:41.145 27156M] Imported 276927 queries from the long-term database
[2020-12-20 13:55:41.146 27156M] -> Total DNS queries: 276927
[2020-12-20 13:55:41.146 27156M] -> Cached DNS queries: 268063
[2020-12-20 13:55:41.146 27156M] -> Forwarded DNS queries: 5486
[2020-12-20 13:55:41.146 27156M] -> Blocked DNS queries: 2986
[2020-12-20 13:55:41.146 27156M] -> Unknown DNS queries: 2
[2020-12-20 13:55:41.146 27156M] -> Unique domains: 548
[2020-12-20 13:55:41.146 27156M] -> Unique clients: 11
[2020-12-20 13:55:41.147 27156M] -> Known forward destinations: 2
[2020-12-20 13:55:41.147 27156M] Successfully accessed setupVars.conf
[2020-12-20 13:55:41.151 27159M] PID of FTL process: 27159
[2020-12-20 13:55:41.152 27159/T27162] Listening on Unix socket
[2020-12-20 13:55:41.152 27159M] INFO: FTL is running as user pihole (UID 999)
[2020-12-20 13:55:41.153 27159/T27160] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-20 13:55:41.153 27159M] Reloading DNS cache
[2020-12-20 13:55:41.153 27159M] Blocking status is enabled
[2020-12-20 13:55:41.292 27159/T27163] Compiled 0 whitelist and 11 blacklist regex filters for 11 clients in 19.1 msec
[2020-12-20 13:56:03.923 27159/T27165] Resizing "FTL-strings" from 12288 to (16384 * 1) == 16384 (/dev/shm: 18.2MB used, 997.2MB total)
[2020-12-20 14:24:02.511 27159M] Resizing "FTL-queries" from 17825792 to (282624 * 64) == 18087936 (/dev/shm: 18.2MB used, 997.2MB total)
[2020-12-20 14:37:54.708 27159M] Resizing "FTL-queries" from 18087936 to (286720 * 64) == 18350080 (/dev/shm: 18.5MB used, 997.2MB total)
[2020-12-20 14:37:54.721 7740/F27159] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-20 14:37:54.721 7740/F27159] ----------------------------> FTL crashed! <----------------------------
[2020-12-20 14:37:54.721 7740/F27159] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-20 14:37:54.721 7740/F27159] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-20 14:37:54.721 7740/F27159] and include in your report already the following details:
[2020-12-20 14:37:54.721 7740/F27159] FTL has been running for 2534 seconds
[2020-12-20 14:37:54.721 7740/F27159] FTL branch: fix/all_the_things
[2020-12-20 14:37:54.721 7740/F27159] FTL version: vDev-2e0d740
[2020-12-20 14:37:54.721 7740/F27159] FTL commit: 2e0d740
[2020-12-20 14:37:54.722 7740/F27159] FTL date: 2020-12-20 11:07:28 +0100
[2020-12-20 14:37:54.722 7740/F27159] FTL user: started as pihole, ended as pihole
[2020-12-20 14:37:54.722 7740/F27159] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-20 14:37:54.722 7740/F27159] Process details: MID: 27159
[2020-12-20 14:37:54.722 7740/F27159] PID: 7740
[2020-12-20 14:37:54.722 7740/F27159] TID: 7740
[2020-12-20 14:37:54.722 7740/F27159] Name: pihole-FTL
[2020-12-20 14:37:54.722 7740/F27159] Received signal: Bus error
[2020-12-20 14:37:54.722 7740/F27159] at address: 0xffffa5de1000
[2020-12-20 14:37:54.722 7740/F27159] with code: BUS_ADRERR (Non-existant physical address)
[2020-12-20 14:37:54.730 7740/F27159] Backtrace:
[2020-12-20 14:37:54.731 7740/F27159] B[0000]: /usr/bin/pihole-FTL(+0x569f4) [0xaaaab174c9f4]
[2020-12-20 14:37:55.274 7740/F27159] L[0000]: /root/project/src/signals.c:191
[2020-12-20 14:37:55.283 7740/F27159] B[0001]: linux-vdso.so.1(__kernel_rt_sigreturn+0) [0xffffa6f6f7c0]
[2020-12-20 14:37:55.283 7740/F27159] B[0002]: /usr/bin/pihole-FTL(_getQuery+0x48) [0xaaaab174c470]
[2020-12-20 14:37:55.331 7740/F27159] L[0002]: /root/project/src/shmem.c:945
[2020-12-20 14:37:55.336 7740/F27159] B[0003]: /usr/bin/pihole-FTL(_FTL_new_query+0x41c) [0xaaaab173ff84]
[2020-12-20 14:37:55.374 7740/F27159] L[0003]: /root/project/src/dnsmasq_interface.c:609
[2020-12-20 14:37:55.380 7740/F27159] B[0004]: /usr/bin/pihole-FTL(tcp_request+0x69c) [0xaaaab1775dd4]
[2020-12-20 14:37:55.421 7740/F27159] L[0004]: /root/project/src/dnsmasq/forward.c:1963
[2020-12-20 14:37:55.428 7740/F27159] B[0005]: /usr/bin/pihole-FTL(+0x76ffc) [0xaaaab176cffc]
[2020-12-20 14:37:55.458 7740/F27159] L[0005]: /root/project/src/dnsmasq/dnsmasq.c:1972
[2020-12-20 14:37:55.463 7740/F27159] B[0006]: /usr/bin/pihole-FTL(main_dnsmasq+0xd30) [0xaaaab176e938]
[2020-12-20 14:37:55.488 7740/F27159] L[0006]: /root/project/src/dnsmasq/dnsmasq.c:1206
[2020-12-20 14:37:55.492 7740/F27159] B[0007]: /usr/bin/pihole-FTL(main+0xfc) [0xaaaab1738784]
[2020-12-20 14:37:55.513 7740/F27159] L[0007]: /root/project/src/main.c:97
[2020-12-20 14:37:55.516 7740/F27159] B[0008]: /lib/aarch64-linux-gnu/libc.so.6(__libc_start_main+0xe0) [0xffffa6cfd720]
[2020-12-20 14:37:55.517 7740/F27159] B[0009]: /usr/bin/pihole-FTL(+0x42978) [0xaaaab1738978]
[2020-12-20 14:37:55.549 7740/F27159] L[0009]: :?
[2020-12-20 14:37:55.557 7740/F27159] ------ Listing content of directory /dev/shm ------
[2020-12-20 14:37:55.557 7740/F27159] File Mode User:Group Filesize Filename
[2020-12-20 14:37:55.558 7740/F27159] rwxrwxrwx root:root 280 .
[2020-12-20 14:37:55.558 7740/F27159] rwxr-xr-x root:root 4K ..
[2020-12-20 14:37:55.558 7740/F27159] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-20 14:37:55.558 7740/F27159] rw------- pihole:pihole 4K FTL-dns-cache
[2020-12-20 14:37:55.558 7740/F27159] rw------- pihole:pihole 45K FTL-overTime
[2020-12-20 14:37:55.558 7740/F27159] rw------- pihole:pihole 18M FTL-queries
[2020-12-20 14:37:55.559 7740/F27159] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-20 14:37:55.559 7740/F27159] rw------- pihole:pihole 176K FTL-clients
[2020-12-20 14:37:55.559 7740/F27159] rw------- pihole:pihole 98K FTL-domains
[2020-12-20 14:37:55.559 7740/F27159] rw------- pihole:pihole 16K FTL-strings
[2020-12-20 14:37:55.559 7740/F27159] rw------- pihole:pihole 12 FTL-settings
[2020-12-20 14:37:55.559 7740/F27159] rw------- pihole:pihole 144 FTL-counters
[2020-12-20 14:37:55.560 7740/F27159] rw------- pihole:pihole 56 FTL-lock
[2020-12-20 14:37:55.560 7740/F27159] rw-r----- qbt:qbt 4K mono.2581
[2020-12-20 14:37:55.560 7740/F27159] ---------------------------------------------------
[2020-12-20 14:37:55.560 7740/F27159] Please also include some lines from above the !!!!!!!!! header.
[2020-12-20 14:37:55.560 7740/F27159] Thank you for helping us to improve our FTL engine!
[2020-12-20 14:37:55.560 7740/F27159] Asking parent pihole-FTL (PID 27159) to shut down
[2020-12-20 14:37:55.560 7740/F27159] FTL fork terminated!
[2020-12-20 14:37:55.560 27159M] Received: Real-time signal 2 (36 -> 2)
[2020-12-20 14:37:55.560 27159M] Shutting down...
[2020-12-20 14:37:55.627 27159M] Finished final database update
[2020-12-20 14:37:55.644 27159M] ########## FTL terminated after 42m 15s ! ##########
@derekcentrico
I wasn't able to catch a log.
There should be older files in /var/log/ like pihole-FTL.log.1, etc.
@rrrevin
Okay, so it's always the same thing. I'm pretty sure we haven't seen this before:
[2020-12-20 14:37:54.708 27159M] Resizing "FTL-queries" from 18087936 to (286720 * 64) == 18350080 (/dev/shm: 18.5MB used, 997.2MB total) [2020-12-20 14:37:54.721 7740/F27159] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! [2020-12-20 14:37:54.721 7740/F27159] ----------------------------> FTL crashed! <---------------------------- [2020-12-20 14:37:54.721 7740/F27159] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
The memory is resized in the main process 27159M and then a fork of it (TCP worker) 7740/F27159 crashes when trying to access the memory. The reason for crashing is that 0xffffa5de1000 leads to BUS_ADRERR (Non-existant physical address). I'll check for possible reasons for this crash.
DL6ER
on 21 Dec 2020
@rrrevin Please add
DEBUG_SHMEM=true
to the file /etc/pihole/pihole-FTL.conf (create if it does not exist) and run
pihole restartdns
Next time the crash happens, please include again the crash report from /var/log/pihole-FTL.conf. This may help us getting a better picture of where/why exactly the issue happens. Currently, my assumption is that the remapping of shared memory into forks isn't happening properly. Maybe there is a hidden timing issue somewhere which is only triggered in some special edge-cases.
DL6ER
on 21 Dec 2020
Here you go. Crashed last night.
[2020-12-22 02:30:22.139 20766/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.139 20766/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.139 20766/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.139 20766/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.139 20766/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.139 20766/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.139 20766/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.139 20766/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.139 20766/F13590] FTL fork terminated!
[2020-12-22 02:30:22.170 20764/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.170 20764/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.170 20764/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.170 20764/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.170 20764/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.170 20723/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.170 20764/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.170 20723/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.170 20764/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.170 20764/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.171 20764/F13590] FTL fork terminated!
[2020-12-22 02:30:22.171 20723/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.171 20723/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.171 20723/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.171 20723/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.171 20723/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.171 20723/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.171 20723/F13590] FTL fork terminated!
[2020-12-22 02:30:22.180 20717/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.181 20717/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.181 20717/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.181 20717/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.181 20717/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.181 20717/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.181 20717/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.181 20717/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.181 20717/F13590] FTL fork terminated!
[2020-12-22 02:30:22.186 20737/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.186 20737/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.186 20737/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.186 20737/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.186 20737/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.186 20737/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.187 20737/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.187 20737/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.187 20737/F13590] FTL fork terminated!
[2020-12-22 02:30:22.189 20735/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.189 20735/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.190 20735/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.190 20735/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.190 20735/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.190 20735/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.190 20735/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.190 20735/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.190 20735/F13590] FTL fork terminated!
[2020-12-22 02:30:22.191 20679/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.191 20679/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.191 20679/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.191 20679/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.191 20679/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.191 20679/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.191 20679/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.191 20679/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.191 20679/F13590] FTL fork terminated!
[2020-12-22 02:30:22.197 20675/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.197 20675/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.197 20675/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.198 20675/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.198 20675/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.198 20675/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.198 20675/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.198 20675/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.198 20675/F13590] FTL fork terminated!
[2020-12-22 02:30:22.201 20631/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.201 20631/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.201 20631/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.202 20631/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.202 20631/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.202 20631/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.202 20631/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.202 20631/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.202 20631/F13590] FTL fork terminated!
[2020-12-22 02:30:22.197 20675/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.197 20675/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.197 20675/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.198 20675/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.198 20675/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.198 20675/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.198 20675/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.198 20675/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.198 20675/F13590] FTL fork terminated!
[2020-12-22 02:30:22.201 20631/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.201 20631/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.201 20631/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.202 20631/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.202 20631/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.202 20631/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.202 20631/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.202 20631/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.202 20631/F13590] FTL fork terminated!
[2020-12-22 02:30:22.214 20622/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.214 20622/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.215 20622/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.215 20622/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.215 20622/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.215 20622/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.215 20622/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.215 20622/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.215 20622/F13590] FTL fork terminated!
[2020-12-22 02:30:22.224 20659/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.224 20659/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.224 20659/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.224 20659/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.224 20659/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.224 20659/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.225 20659/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.225 20659/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.225 20659/F13590] FTL fork terminated!
[2020-12-22 02:30:22.231 20771/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.231 20771/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.231 20771/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.231 20771/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.231 20771/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.232 20771/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.232 20771/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.232 20771/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.232 20771/F13590] FTL fork terminated!
[2020-12-22 02:30:22.233 20769/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.233 20769/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.233 20769/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.233 20769/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.233 20769/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.233 20769/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.233 20769/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.233 20769/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.233 20769/F13590] FTL fork terminated!
[2020-12-22 02:30:22.235 20557/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.235 20557/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.235 20557/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.235 20557/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.235 20557/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.235 20557/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.235 20557/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.236 20557/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.236 20557/F13590] FTL fork terminated!
[2020-12-22 02:30:22.240 20633/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.240 20633/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.240 20633/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.240 20633/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.240 20633/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.240 20633/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.240 20633/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.240 20633/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.240 20633/F13590] FTL fork terminated!
[2020-12-22 02:30:22.264 20773/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.264 20773/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.264 20773/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.265 20773/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.265 20773/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.265 20773/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.265 20773/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.265 20773/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.265 20773/F13590] FTL fork terminated!
[2020-12-22 02:30:22.265 20611/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.265 20611/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.265 20611/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.265 20611/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.265 20611/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.265 20611/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.265 20611/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.265 20611/F13590] Asking parent pihole-FTL (PID 13590) to shut down
[2020-12-22 02:30:22.265 20611/F13590] FTL fork terminated!
[2020-12-22 02:30:22.267 20692/F13590] ------ Listing content of directory /dev/shm ------
[2020-12-22 02:30:22.267 20692/F13590] File Mode User:Group Filesize Filename
[2020-12-22 02:30:22.267 20692/F13590] rwxrwxrwx root:root 40 .
[2020-12-22 02:30:22.267 20692/F13590] rwxr-xr-x root:root 3K ..
[2020-12-22 02:30:22.267 20692/F13590] ---------------------------------------------------
[2020-12-22 02:30:22.267 20692/F13590] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 02:30:22.267 20692/F13590] Thank you for helping us to improve our FTL engine!
[2020-12-22 02:30:22.267 20692/F13590] Asking parent pihole-FTL (PID 13590) to shut down
derekcentrico
on 22 Dec 2020
@rrrevin Please add
DEBUG_SHMEM=trueto the file
/etc/pihole/pihole-FTL.conf(create if it does not exist) and runpihole restartdnsNext time the crash happens, please include again the crash report from
/var/log/pihole-FTL.conf.
Added.. Wow.. that really enables a whole lot of logs! Now we wait.. (I think you mean logs from /var/log/pihole-FTL.log :)
rrrevin
on 22 Dec 2020
OK.. I have a crash log. It's 148649 lines long; 14,641,269 bytes. Compressed (7z format) it's 557,290 bytes. Link
excerpt of the last few lines:
[2020-12-22 18:43:13.248 28069/F10777] TCP worker terminating (client disconnected)
[2020-12-22 18:43:13.252 28070/F10777] TCP worker forked for client 192.168.0.11 on interface eth0 (192.168.0.9)
[2020-12-22 18:43:13.259 28070/F10777] TCP worker terminating (client disconnected)
[2020-12-22 18:43:13.266 28071/F10777] TCP worker forked for client 192.168.0.11 on interface eth0 (192.168.0.9)
[2020-12-22 18:43:13.273 28071/F10777] TCP worker terminating (client disconnected)
[2020-12-22 18:43:13.274 10777M] Resizing "FTL-queries" from 17301504 to (274432 * 64) == 17563648 (/dev/shm: 17.8MB used, 997.2MB total)
[2020-12-22 18:43:13.280 28072/F10777] TCP worker forked for client 192.168.0.11 on interface eth0 (192.168.0.9)
[2020-12-22 18:43:13.286 28072/F10777] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-22 18:43:13.286 28072/F10777] ----------------------------> FTL crashed! <----------------------------
[2020-12-22 18:43:13.286 28072/F10777] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-22 18:43:13.286 28072/F10777] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-22 18:43:13.287 28072/F10777] and include in your report already the following details:
[2020-12-22 18:43:13.287 28072/F10777] FTL has been running for 41345 seconds
[2020-12-22 18:43:13.287 28072/F10777] FTL branch: fix/all_the_things
[2020-12-22 18:43:13.287 28072/F10777] FTL version: vDev-2e0d740
[2020-12-22 18:43:13.287 28072/F10777] FTL commit: 2e0d740
[2020-12-22 18:43:13.287 28072/F10777] FTL date: 2020-12-20 11:07:28 +0100
[2020-12-22 18:43:13.288 28072/F10777] FTL user: started as pihole, ended as pihole
[2020-12-22 18:43:13.288 28072/F10777] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-22 18:43:13.288 28072/F10777] Process details: MID: 10777
[2020-12-22 18:43:13.288 28072/F10777] PID: 28072
[2020-12-22 18:43:13.288 28072/F10777] TID: 28072
[2020-12-22 18:43:13.288 28072/F10777] Name: pihole-FTL
[2020-12-22 18:43:13.288 28072/F10777] Received signal: Bus error
[2020-12-22 18:43:13.288 28072/F10777] at address: 0xffffa7764000
[2020-12-22 18:43:13.288 28072/F10777] with code: BUS_ADRERR (Non-existant physical address)
[2020-12-22 18:43:13.303 28072/F10777] Backtrace:
[2020-12-22 18:43:13.304 28072/F10777] B[0000]: /usr/bin/pihole-FTL(+0x569f4) [0xaaaacd1539f4]
[2020-12-22 18:43:13.972 28072/F10777] L[0000]: /root/project/src/signals.c:191
[2020-12-22 18:43:13.982 28072/F10777] B[0001]: linux-vdso.so.1(__kernel_rt_sigreturn+0) [0xffffa89327c0]
[2020-12-22 18:43:13.982 28072/F10777] B[0002]: /usr/bin/pihole-FTL(_getQuery+0x48) [0xaaaacd153470]
[2020-12-22 18:43:14.034 28072/F10777] L[0002]: /root/project/src/shmem.c:945
[2020-12-22 18:43:14.041 28072/F10777] B[0003]: /usr/bin/pihole-FTL(_FTL_new_query+0x41c) [0xaaaacd146f84]
[2020-12-22 18:43:14.086 28072/F10777] L[0003]: /root/project/src/dnsmasq_interface.c:609
[2020-12-22 18:43:14.091 28072/F10777] B[0004]: /usr/bin/pihole-FTL(tcp_request+0x69c) [0xaaaacd17cdd4]
[2020-12-22 18:43:14.124 28072/F10777] L[0004]: /root/project/src/dnsmasq/forward.c:1963
[2020-12-22 18:43:14.130 28072/F10777] B[0005]: /usr/bin/pihole-FTL(+0x76ffc) [0xaaaacd173ffc]
[2020-12-22 18:43:14.157 28072/F10777] L[0005]: /root/project/src/dnsmasq/dnsmasq.c:1972
[2020-12-22 18:43:14.162 28072/F10777] B[0006]: /usr/bin/pihole-FTL(main_dnsmasq+0xd30) [0xaaaacd175938]
[2020-12-22 18:43:14.188 28072/F10777] L[0006]: /root/project/src/dnsmasq/dnsmasq.c:1206
[2020-12-22 18:43:14.193 28072/F10777] B[0007]: /usr/bin/pihole-FTL(main+0xfc) [0xaaaacd13f784]
[2020-12-22 18:43:14.215 28072/F10777] L[0007]: /root/project/src/main.c:97
[2020-12-22 18:43:14.219 28072/F10777] B[0008]: /lib/aarch64-linux-gnu/libc.so.6(__libc_start_main+0xe0) [0xffffa86c0720]
[2020-12-22 18:43:14.219 28072/F10777] B[0009]: /usr/bin/pihole-FTL(+0x42978) [0xaaaacd13f978]
[2020-12-22 18:43:14.259 28072/F10777] L[0009]: :?
[2020-12-22 18:43:14.268 28072/F10777] ------ Listing content of directory /dev/shm ------
[2020-12-22 18:43:14.268 28072/F10777] File Mode User:Group Filesize Filename
[2020-12-22 18:43:14.268 28072/F10777] rwxrwxrwx root:root 280 .
[2020-12-22 18:43:14.268 28072/F10777] rwxr-xr-x root:root 4K ..
[2020-12-22 18:43:14.268 28072/F10777] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-22 18:43:14.268 28072/F10777] rw------- pihole:pihole 45K FTL-dns-cache
[2020-12-22 18:43:14.269 28072/F10777] rw------- pihole:pihole 45K FTL-overTime
[2020-12-22 18:43:14.269 28072/F10777] rw------- pihole:pihole 17M FTL-queries
[2020-12-22 18:43:14.269 28072/F10777] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-22 18:43:14.269 28072/F10777] rw------- pihole:pihole 176K FTL-clients
[2020-12-22 18:43:14.269 28072/F10777] rw------- pihole:pihole 98K FTL-domains
[2020-12-22 18:43:14.269 28072/F10777] rw------- pihole:pihole 78K FTL-strings
[2020-12-22 18:43:14.270 28072/F10777] rw------- pihole:pihole 12 FTL-settings
[2020-12-22 18:43:14.270 28072/F10777] rw------- pihole:pihole 144 FTL-counters
[2020-12-22 18:43:14.270 28072/F10777] rw------- pihole:pihole 56 FTL-lock
[2020-12-22 18:43:14.270 28072/F10777] rw-r----- qbt:qbt 4K mono.2581
[2020-12-22 18:43:14.270 28072/F10777] ---------------------------------------------------
[2020-12-22 18:43:14.270 28072/F10777] Please also include some lines from above the !!!!!!!!! header.
[2020-12-22 18:43:14.270 28072/F10777] Thank you for helping us to improve our FTL engine!
[2020-12-22 18:43:14.270 28072/F10777] Asking parent pihole-FTL (PID 10777) to shut down
[2020-12-22 18:43:14.270 28072/F10777] FTL fork terminated!
[2020-12-22 18:43:14.270 10777M] Received: Real-time signal 2 (36 -> 2)
[2020-12-22 18:43:14.271 28072/F10777] TCP worker terminating (timeout)
[2020-12-22 18:43:14.271 10777M] Shutting down...
[2020-12-22 18:43:14.338 10777M] Finished final database update
[2020-12-22 18:43:14.362 10777M] ########## FTL terminated after 11h 29m 6s ! ##########
@rrrevin Thanks, the excerpt you posted is enough. I pushed another small update with more debug lines. Please try again...
DL6ER
on 23 Dec 2020
Updated. Waiting for another crash.
Side note : This was in the log file from last night.
[2020-12-23 03:54:59.971 9876M] Resizing "FTL-queries" from 19922944 to (315392 * 64) == 20185088 (/dev/shm: 20.3MB used, 997.2MB total)
[2020-12-23 03:54:59.988 23821/F9876] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-23 03:54:59.988 23821/F9876] ----------------------------> FTL crashed! <----------------------------
[2020-12-23 03:54:59.988 23821/F9876] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
[2020-12-23 03:54:59.988 23821/F9876] Please report a bug at https://github.com/pi-hole/FTL/issues
[2020-12-23 03:54:59.989 23821/F9876] and include in your report already the following details:
[2020-12-23 03:54:59.989 23821/F9876] FTL has been running for 23176 seconds
[2020-12-23 03:54:59.989 23821/F9876] FTL branch: fix/all_the_things
[2020-12-23 03:54:59.989 23821/F9876] FTL version: vDev-2e0d740
[2020-12-23 03:54:59.989 23821/F9876] FTL commit: 2e0d740
[2020-12-23 03:54:59.989 23821/F9876] FTL date: 2020-12-20 11:07:28 +0100
[2020-12-23 03:54:59.990 23821/F9876] FTL user: started as pihole, ended as pihole
[2020-12-23 03:54:59.990 23821/F9876] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-23 03:54:59.990 23821/F9876] Process details: MID: 9876
[2020-12-23 03:54:59.990 23821/F9876] PID: 23821
[2020-12-23 03:54:59.990 23821/F9876] TID: 23821
[2020-12-23 03:54:59.990 23821/F9876] Name: pihole-FTL
[2020-12-23 03:54:59.990 23821/F9876] Received signal: Bus error
[2020-12-23 03:54:59.990 23821/F9876] at address: 0xffff9ceed000
[2020-12-23 03:54:59.990 23821/F9876] with code: BUS_ADRERR (Non-existant physical address)
[2020-12-23 03:55:00.003 23821/F9876] Backtrace:
[2020-12-23 03:55:00.005 23821/F9876] B[0000]: /usr/bin/pihole-FTL(+0x569f4) [0xaaaae7ba79f4]
[2020-12-23 03:55:00.656 23821/F9876] L[0000]: /root/project/src/signals.c:191
[2020-12-23 03:55:00.663 23821/F9876] B[0001]: linux-vdso.so.1(__kernel_rt_sigreturn+0) [0xffff9de3b7c0]
[2020-12-23 03:55:00.663 23821/F9876] B[0002]: /usr/bin/pihole-FTL(_getQuery+0x48) [0xaaaae7ba7470]
[2020-12-23 03:55:00.713 23821/F9876] L[0002]: /root/project/src/shmem.c:945
[2020-12-23 03:55:00.720 23821/F9876] B[0003]: /usr/bin/pihole-FTL(_FTL_new_query+0x41c) [0xaaaae7b9af84]
[2020-12-23 03:55:00.755 23821/F9876] L[0003]: /root/project/src/dnsmasq_interface.c:609
[2020-12-23 03:55:00.759 23821/F9876] B[0004]: /usr/bin/pihole-FTL(tcp_request+0x69c) [0xaaaae7bd0dd4]
[2020-12-23 03:55:00.792 23821/F9876] L[0004]: /root/project/src/dnsmasq/forward.c:1963
[2020-12-23 03:55:00.797 23821/F9876] B[0005]: /usr/bin/pihole-FTL(+0x76ffc) [0xaaaae7bc7ffc]
[2020-12-23 03:55:00.825 23821/F9876] L[0005]: /root/project/src/dnsmasq/dnsmasq.c:1972
[2020-12-23 03:55:00.829 23821/F9876] B[0006]: /usr/bin/pihole-FTL(main_dnsmasq+0xd30) [0xaaaae7bc9938]
[2020-12-23 03:55:00.855 23821/F9876] L[0006]: /root/project/src/dnsmasq/dnsmasq.c:1206
[2020-12-23 03:55:00.860 23821/F9876] B[0007]: /usr/bin/pihole-FTL(main+0xfc) [0xaaaae7b93784]
[2020-12-23 03:55:00.880 23821/F9876] L[0007]: /root/project/src/main.c:97
[2020-12-23 03:55:00.884 23821/F9876] B[0008]: /lib/aarch64-linux-gnu/libc.so.6(__libc_start_main+0xe0) [0xffff9dbc9720]
[2020-12-23 03:55:00.884 23821/F9876] B[0009]: /usr/bin/pihole-FTL(+0x42978) [0xaaaae7b93978]
[2020-12-23 03:55:00.922 23821/F9876] L[0009]: :?
[2020-12-23 03:55:00.929 23821/F9876] ------ Listing content of directory /dev/shm ------
[2020-12-23 03:55:00.929 23821/F9876] File Mode User:Group Filesize Filename
[2020-12-23 03:55:00.930 23821/F9876] rwxrwxrwx root:root 280 .
[2020-12-23 03:55:00.930 23821/F9876] rwxr-xr-x root:root 4K ..
[2020-12-23 03:55:00.930 23821/F9876] rw------- pihole:pihole 4K FTL-per-client-regex
[2020-12-23 03:55:00.930 23821/F9876] rw------- pihole:pihole 4K FTL-dns-cache
[2020-12-23 03:55:00.930 23821/F9876] rw------- pihole:pihole 45K FTL-overTime
[2020-12-23 03:55:00.930 23821/F9876] rw------- pihole:pihole 20M FTL-queries
[2020-12-23 03:55:00.931 23821/F9876] rw------- pihole:pihole 20K FTL-upstreams
[2020-12-23 03:55:00.931 23821/F9876] rw------- pihole:pihole 176K FTL-clients
[2020-12-23 03:55:00.931 23821/F9876] rw------- pihole:pihole 98K FTL-domains
[2020-12-23 03:55:00.931 23821/F9876] rw------- pihole:pihole 41K FTL-strings
[2020-12-23 03:55:00.931 23821/F9876] rw------- pihole:pihole 12 FTL-settings
[2020-12-23 03:55:00.931 23821/F9876] rw------- pihole:pihole 144 FTL-counters
[2020-12-23 03:55:00.932 23821/F9876] rw------- pihole:pihole 56 FTL-lock
[2020-12-23 03:55:00.932 23821/F9876] rw-r----- qbt:qbt 4K mono.2581
[2020-12-23 03:55:00.932 23821/F9876] ---------------------------------------------------
[2020-12-23 03:55:00.932 23821/F9876] Please also include some lines from above the !!!!!!!!! header.
[2020-12-23 03:55:00.932 23821/F9876] Thank you for helping us to improve our FTL engine!
[2020-12-23 03:55:00.932 23821/F9876] Asking parent pihole-FTL (PID 9876) to shut down
[2020-12-23 03:55:00.932 23821/F9876] FTL fork terminated!
[2020-12-23 03:55:00.932 9876M] Received: Real-time signal 2 (36 -> 2)
[2020-12-23 03:55:00.932 9876M] Shutting down...
[2020-12-23 03:55:00.934 9876M] SQLite3 message: statement aborts at 1: [BEGIN TRANSACTION IMMEDIATE] cannot start a transaction within a transaction (1)
[2020-12-23 03:55:00.934 9876M] ERROR: SQL query "BEGIN TRANSACTION IMMEDIATE" failed: SQL logic error
[2020-12-23 03:55:00.934 9876M] Encountered error while trying to close database: database is locked
[2020-12-23 03:55:00.934 9876M] ERROR: Storing queries in long-term database failed: SQL logic error
[2020-12-23 03:55:00.934 9876M] Finished final database update
[2020-12-23 03:55:00.936 9876/T9880] dbquery("END TRANSACTION") called but database is not available!
[2020-12-23 03:55:00.936 9876/T9880] END TRANSACTION failed when trying to store queries to long-term database
[2020-12-23 03:55:00.937 9876/T9880] parse_neighbor_cache() - Database is not available
[2020-12-23 03:55:00.951 9876M] ########## FTL terminated after 6h 26m 17s ! ##########
FTL v5.3.3 has been released containing a number of fixes, unfortunately, I don't think the issue you're seeing (and I failed to reproduce on Ubuntu 20.04 on a Raspberry Pi 3B+) isn't fixed in this. Could you send me a teleporter file via mail (my username @ pi-hole.net) ? Maybe it has to do with your particular set of regex filters or ... I don't know.
DL6ER
on 24 Dec 2020
Link sent
_Edit : updated to 5.3.3 master.. crashed again :(_
rrrevin
on 24 Dec 2020
I have the same issues on 5.3.3/ https://tricorder.pi-hole.net/mk4jdjwj8e
mitchross
on 28 Dec 2020
Use 5.3.4.
dschaper
on 28 Dec 2020
I have the same issues on 5.3.3
Yours is different, please open a new issue and fill out the information. Include
[2020-12-28 13:27:00.454 7914M] Resizing "FTL-queries" from 700710912 to (10952704 * 64) == 700973056 (/dev/shm: 701.2MB used, 1.3GB total)
[2020-12-28 13:27:13.475 7914M] Resizing "FTL-queries" from 700973056 to (10956800 * 64) == 701235200 (/dev/shm: 701.5MB used, 1.3GB total)
[2020-12-28 13:27:16.016 7914M] FATAL: realloc_shm(): Failed to resize "FTL-queries" (86) to 701235200: Success (4)
I upgraded to 5.3.4 and it's still crashing. All have the same FATAL error.
[2020-12-30 01:19:13.469 5749M] ########## FTL started! ##########
[2020-12-30 01:19:13.469 5749M] FTL branch: master
[2020-12-30 01:19:13.470 5749M] FTL version: v5.3.4
[2020-12-30 01:19:13.470 5749M] FTL commit: fc3bb0f
[2020-12-30 01:19:13.470 5749M] FTL date: 2020-12-25 19:23:09 +0100
[2020-12-30 01:19:13.470 5749M] FTL user: pihole
[2020-12-30 01:19:13.470 5749M] Compiled for aarch64 (compiled on CI) using aarch64-linux-gnu-gcc (Debian 6.3.0-18) 6.3.0 20170516
[2020-12-30 01:19:13.470 5749M] Starting config file parsing (/etc/pihole/pihole-FTL.conf)
[2020-12-30 01:19:13.470 5749M] SOCKET_LISTENING: only local
[2020-12-30 01:19:13.470 5749M] AAAA_QUERY_ANALYSIS: Show AAAA queries
[2020-12-30 01:19:13.470 5749M] MAXDBDAYS: max age for stored queries is 365 days
[2020-12-30 01:19:13.470 5749M] RESOLVE_IPV6: Resolve IPv6 addresses
[2020-12-30 01:19:13.470 5749M] RESOLVE_IPV4: Resolve IPv4 addresses
[2020-12-30 01:19:13.470 5749M] DBINTERVAL: saving to DB file every minute
[2020-12-30 01:19:13.470 5749M] DBFILE: Using /etc/pihole/pihole-FTL.db
[2020-12-30 01:19:13.470 5749M] MAXLOGAGE: Importing up to 24.0 hours of log data
[2020-12-30 01:19:13.470 5749M] PRIVACYLEVEL: Set to 0
[2020-12-30 01:19:13.470 5749M] IGNORE_LOCALHOST: Show queries from localhost
[2020-12-30 01:19:13.470 5749M] BLOCKINGMODE: Null IPs for blocked domains
[2020-12-30 01:19:13.470 5749M] ANALYZE_ONLY_A_AND_AAAA: Disabled. Analyzing all queries
[2020-12-30 01:19:13.470 5749M] DBIMPORT: Importing history from database
[2020-12-30 01:19:13.470 5749M] PIDFILE: Using /run/pihole-FTL.pid
[2020-12-30 01:19:13.470 5749M] PORTFILE: Using /run/pihole-FTL.port
[2020-12-30 01:19:13.470 5749M] SOCKETFILE: Using /run/pihole/FTL.sock
[2020-12-30 01:19:13.471 5749M] SETUPVARSFILE: Using /etc/pihole/setupVars.conf
[2020-12-30 01:19:13.471 5749M] MACVENDORDB: Using /etc/pihole/macvendor.db
[2020-12-30 01:19:13.471 5749M] GRAVITYDB: Using /etc/pihole/gravity.db
[2020-12-30 01:19:13.471 5749M] PARSE_ARP_CACHE: Active
[2020-12-30 01:19:13.471 5749M] CNAME_DEEP_INSPECT: Active
[2020-12-30 01:19:13.471 5749M] DELAY_STARTUP: No delay requested.
[2020-12-30 01:19:13.471 5749M] BLOCK_ESNI: Enabled, blocking _esni.{blocked domain}
[2020-12-30 01:19:13.471 5749M] NICE: Set process niceness to -10 (default)
[2020-12-30 01:19:13.471 5749M] MAXNETAGE: Removing IP addresses and host names from network table after 365 days
[2020-12-30 01:19:13.471 5749M] NAMES_FROM_NETDB: Enabled, trying to get names from network database
[2020-12-30 01:19:13.471 5749M] EDNS0_ECS: Overwrite client from ECS information
[2020-12-30 01:19:13.471 5749M] REFRESH_HOSTNAMES: Periodically refreshing IPv4 names
[2020-12-30 01:19:13.471 5749M] Finished config file parsing
[2020-12-30 01:19:13.471 5749M] Creating mutex
[2020-12-30 01:19:13.473 5749M] Database version is 9
[2020-12-30 01:19:13.474 5749M] Imported 0 alias-clients
[2020-12-30 01:19:13.474 5749M] Database successfully initialized
[2020-12-30 01:19:13.475 5749M] New upstream server: 1.1.1.1:53 (0/512)
[2020-12-30 01:19:13.476 5749M] New upstream server: 1.0.0.1:53 (1/512)
[2020-12-30 01:19:13.489 5749M] Resizing "FTL-queries" from 262144 to (8192 * 64) == 524288 (/dev/shm: 630.8KB used, 997.2MB total)
... many resize lines removed ...
[2020-12-30 01:19:14.209 5749M] Resizing "FTL-queries" from 10747904 to (172032 * 64) == 11010048 (/dev/shm: 11.1MB used, 997.2MB total)
[2020-12-30 01:19:14.223 5749M] Imported 171505 queries from the long-term database
[2020-12-30 01:19:14.224 5749M] -> Total DNS queries: 171505
[2020-12-30 01:19:14.224 5749M] -> Cached DNS queries: 160237
[2020-12-30 01:19:14.224 5749M] -> Forwarded DNS queries: 6789
[2020-12-30 01:19:14.224 5749M] -> Blocked DNS queries: 4102
[2020-12-30 01:19:14.224 5749M] -> Unknown DNS queries: 1
[2020-12-30 01:19:14.224 5749M] -> Unique domains: 942
[2020-12-30 01:19:14.224 5749M] -> Unique clients: 12
[2020-12-30 01:19:14.224 5749M] -> Known forward destinations: 2
[2020-12-30 01:19:14.224 5749M] Successfully accessed setupVars.conf
[2020-12-30 01:19:14.229 5751M] PID of FTL process: 5751
[2020-12-30 01:19:14.230 5751/T5752] Listening on port 4711 for incoming IPv4 telnet connections
[2020-12-30 01:19:14.230 5751/T5754] Listening on Unix socket
[2020-12-30 01:19:14.231 5751M] INFO: FTL is running as user pihole (UID 999)
[2020-12-30 01:19:14.231 5751M] Reloading DNS cache
[2020-12-30 01:19:14.231 5751M] Blocking status is enabled
[2020-12-30 01:19:14.409 5751/T5755] Compiled 0 whitelist and 11 blacklist regex filters for 12 clients in 19.9 msec
[2020-12-30 01:21:32.219 6269/F5751] Resizing "FTL-queries" from 11010048 to (176128 * 64) == 11272192 (/dev/shm: 11.4MB used, 997.2MB total)
[2020-12-30 01:21:33.168 5751M] Remapping "FTL-queries" from 11010048 to (176128 * 64) == 11272192
[2020-12-30 01:42:59.630 10736/F5751] Resizing "FTL-queries" from 11272192 to (180224 * 64) == 11534336 (/dev/shm: 11.7MB used, 997.2MB total)
[2020-12-30 01:42:59.636 5751M] Remapping "FTL-queries" from 11272192 to (180224 * 64) == 11534336
[2020-12-30 01:46:50.757 13224/F5751] Resizing "FTL-queries" from 11534336 to (184320 * 64) == 11796480 (/dev/shm: 11.9MB used, 997.2MB total)
[2020-12-30 01:46:50.761 5751M] Remapping "FTL-queries" from 11534336 to (184320 * 64) == 11796480
[2020-12-30 01:56:41.050 16358/F5751] Resizing "FTL-queries" from 11796480 to (188416 * 64) == 12058624 (/dev/shm: 12.2MB used, 997.2MB total)
[2020-12-30 01:56:43.001 5751M] Remapping "FTL-queries" from 11796480 to (188416 * 64) == 12058624
[2020-12-30 02:45:16.006 5751M] Resizing "FTL-queries" from 12058624 to (192512 * 64) == 12320768 (/dev/shm: 12.4MB used, 997.2MB total)
[2020-12-30 02:45:16.008 5751M] FATAL: realloc_shm(): Failed to resize "FTL-queries" (19) to 12320768: Success (4)
@rrrevin Please try what I suggested in https://github.com/pi-hole/FTL/issues/1008#issuecomment-751962064
DL6ER
on 31 Dec 2020
Updated. Will let you know what happens.
rrrevin
on 31 Dec 2020
Solid now for 6 days! No crashes 馃憤
_Edit: It's now been over a week.. Solid! I think you got it._
rrrevin
on 6 Jan 2021
Issue seems fixed, I'll close this as we just released FTL v5.4. Thanks for your support in getting this solved!
DL6ER
on 15 Jan 2021
Related issues
KommX
路
11Comments
maniackcrudelis
路
17Comments
JOHRY
路
17Comments
DarkDimius
路
18Comments
DL6ER
路
26Comments