Prior to placing the issue, please check following: (fill out each checkbox with an X once done)
Description of the bug:
Since the upgrade from c7e17c7fd117409a90866329ea68c13a32be5ffb I haven't had any rejected spam mail in the quarantine. The rspamd instance rejected quite a lot of mails from various sources with various different scores but none of those ended up in any of my users quarantine.
Docker container logs of affected containers:
I attached 250 lines of rspamd logs.
Attaching to mailcowdockerized_rspamd-mailcow_1
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:38 #39(controller) <61f9e2>; csession; rspamd_symcache_disable_symbol_checkpoint: cannot disable ARC: not found
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:38 #39(controller) <61f9e2>; csession; rspamd_symcache_disable_symbol_checkpoint: cannot disable DKIM: not found
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:38 #39(controller) <61f9e2>; csession; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 0 regexps matched, 3062 regexps total, 2355 regexps cached, 0B scanned using pcre, 102B scanned total
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:38 #38(rspamd_proxy) <09a588>; proxy; proxy_accept_socket: accepted milter connection from 172.22.1.6 port 44244
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:38 #38(rspamd_proxy) <09a588>; proxy; proxy_milter_error_handler: abnormally closing milter connection from: 172.22.1.6:44244, error: HTTP GET request is not supported in milter mode
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:39 #38(rspamd_proxy) <4cfb87>; milter; rspamd_milter_process_command: got connection from 212.70.149.69:53232
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:39 #38(rspamd_proxy) <4cfb87>; proxy; proxy_milter_finish_handler: finished milter connection
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:44 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:55 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:55 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:55 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:55 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:57 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:57 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #38(rspamd_proxy) <3755e0>; proxy; proxy_accept_socket: accepted milter connection from 172.22.1.6 port 44296
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:33:58 #38(rspamd_proxy) <3755e0>; proxy; proxy_milter_error_handler: abnormally closing milter connection from: 172.22.1.6:44296, error: HTTP GET request is not supported in milter mode
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:04 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:04 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:04 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:04 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:05 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:05 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:16 #39(controller) <34j8fz>; map; http_map_finish: data is not modified for server www.invaluement.com, next check at Tue, 27 Oct 2020 17:34:46 GMT (timer based)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:23 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:27 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:31 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:37 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:37 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:47 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:48 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:48 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:48 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:48 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:49 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:49 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:52 #39(controller) <34j8fz>; map; http_map_finish: data is not modified for server www.invaluement.com, next check at Tue, 27 Oct 2020 17:35:22 GMT (timer based)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:34:55 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:04 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:06 #38(rspamd_proxy) <80ac56>; proxy; proxy_accept_socket: accepted milter connection from 172.22.1.11 port 60020
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:08 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:08 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:08 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:08 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller) <6682c2>; csession; rspamd_controller_check_password: allow unauthorized connection from a unix socket
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller) <6682c2>; csession; rspamd_mime_parse_message: cannot find content-type for a message, assume text/plain
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller) <6682c2>; csession; rspamd_mime_part_get_cte: detected missing CTE for part as: 7bit
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller) <6682c2>; csession; rspamd_message_parse: loaded message; id:
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller) <6682c2>; lua; settings.lua:373:
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller) <6682c2>; csession; rspamd_symcache_disable_symbol_checkpoint: cannot disable ARC: not found
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller) <6682c2>; csession; rspamd_symcache_disable_symbol_checkpoint: cannot disable DKIM: not found
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #39(controller) <6682c2>; csession; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 0 regexps matched, 3062 regexps total, 2355 regexps cached, 0B scanned using pcre, 102B scanned total
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #38(rspamd_proxy) <09a78d>; proxy; proxy_accept_socket: accepted milter connection from 172.22.1.6 port 44868
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:09 #38(rspamd_proxy) <09a78d>; proxy; proxy_milter_error_handler: abnormally closing milter connection from: 172.22.1.6:44868, error: HTTP GET request is not supported in milter mode
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:10 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:11 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:14 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:26 #39(controller) <34j8fz>; map; http_map_finish: data is not modified for server www.invaluement.com, next check at Tue, 27 Oct 2020 17:35:56 GMT (timer based)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:36 #38(rspamd_proxy) <80ac56>; milter; rspamd_milter_process_command: got connection from 212.70.149.69:4730
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:36 #38(rspamd_proxy) <80ac56>; proxy; proxy_milter_finish_handler: finished milter connection
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:39 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:39 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:39 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:39 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:44 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:44 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:44 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:48 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:53 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:35:53 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:05 #39(controller) <34j8fz>; map; http_map_finish: data is not modified for server www.invaluement.com, next check at Tue, 27 Oct 2020 17:36:35 GMT (timer based)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:08 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller) <6b5692>; csession; rspamd_controller_check_password: allow unauthorized connection from a unix socket
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller) <6b5692>; csession; rspamd_mime_parse_message: cannot find content-type for a message, assume text/plain
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller) <6b5692>; csession; rspamd_mime_part_get_cte: detected missing CTE for part as: 7bit
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller) <6b5692>; csession; rspamd_message_parse: loaded message; id:
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller) <6b5692>; lua; settings.lua:373:
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller) <6b5692>; csession; rspamd_symcache_disable_symbol_checkpoint: cannot disable ARC: not found
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller) <6b5692>; csession; rspamd_symcache_disable_symbol_checkpoint: cannot disable DKIM: not found
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #39(controller) <6b5692>; csession; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 0 regexps matched, 3062 regexps total, 2355 regexps cached, 0B scanned using pcre, 102B scanned total
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #38(rspamd_proxy) <08bc3d>; proxy; proxy_accept_socket: accepted milter connection from 172.22.1.6 port 45040
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:19 #38(rspamd_proxy) <08bc3d>; proxy; proxy_milter_error_handler: abnormally closing milter connection from: 172.22.1.6:45040, error: HTTP GET request is not supported in milter mode
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:32 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:32 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:39 #39(controller) <34j8fz>; map; http_map_finish: data is not modified for server www.invaluement.com, next check at Tue, 27 Oct 2020 17:37:09 GMT (timer based)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:39 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:40 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:40 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:40 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:40 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:40 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:40 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:42 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:48 #39(controller) <7m3drg>; map; http_map_finish: data is not modified for server urlhaus.abuse.ch, next check at Tue, 27 Oct 2020 17:36:48 GMT (http cache based)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #38(rspamd_proxy) <7320d0>; proxy; proxy_accept_socket: accepted milter connection from 172.22.1.6 port 45128
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #38(rspamd_proxy) <7320d0>; proxy; proxy_milter_error_handler: abnormally closing milter connection from: 172.22.1.6:45128, error: HTTP GET request is not supported in milter mode
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:54 #39(controller) <7m3drg>; map; http_map_finish: need to reread map from https://urlhaus.abuse.ch/downloads/text_online/
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:54 #39(controller) <7m3drg>; map; http_map_finish: https://urlhaus.abuse.ch/downloads/text_online/(151.101.14.49:443): read map data 566278 bytes, next check at Tue, 27 Oct 2020 17:41:48 GMT
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:54 #39(controller) <7m3drg>; map; rspamd_map_save_http_cached_file: saved data from https://urlhaus.abuse.ch/downloads/text_online/ in /var/lib/rspamd/7de5410c328c7272aba5ee8b4afa11cfb92ab008.map, 566339 bytes
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:54 #39(controller) <7m3drg>; map; rspamd_kv_list_fin: read hash of 12738 elements
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:56 #40(normal) <7m3drg>; map; rspamd_map_read_cached: https://urlhaus.abuse.ch/downloads/text_online/: read map data cached 566278 bytes
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:36:56 #40(normal) <7m3drg>; map; rspamd_kv_list_fin: read hash of 12738 elements
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:05 #38(rspamd_proxy)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:07 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:07 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:07 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:07 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:11 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:11 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:17 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:18 #39(controller) <7m3drg>; map; rspamd_map_cache_cb: cached data is now expired (gen mismatch 206 != 207) for https://urlhaus.abuse.ch/downloads/text_online/
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:18 #38(rspamd_proxy)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:18 #38(rspamd_proxy)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:24 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:24 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:24 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:24 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:29 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:29 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #38(rspamd_proxy) <3dfd04>; proxy; proxy_accept_socket: accepted milter connection from 172.22.1.6 port 45338
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #38(rspamd_proxy) <3dfd04>; proxy; proxy_milter_error_handler: abnormally closing milter connection from: 172.22.1.6:45338, error: HTTP GET request is not supported in milter mode
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:30 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:36 #39(controller) <34j8fz>; map; http_map_finish: data is not modified for server www.invaluement.com, next check at Tue, 27 Oct 2020 17:38:06 GMT (timer based)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:40 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:43 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:43 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:57 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:57 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:57 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:57 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:57 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:37:57 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:03 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:07 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:24 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:33 #39(controller) <34j8fz>; map; http_map_finish: data is not modified for server www.invaluement.com, next check at Tue, 27 Oct 2020 17:39:03 GMT (timer based)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:39 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:39 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #38(rspamd_proxy)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:41 #38(rspamd_proxy)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:45 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:45 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:45 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:45 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:46 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:47 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:47 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:38:57 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:02 #38(rspamd_proxy)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:14 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:14 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:14 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:14 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:18 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:18 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:19 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:26 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:26 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:26 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:26 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:29 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:29 #40(normal)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:30 #39(controller) <34j8fz>; map; http_map_finish: data is not modified for server www.invaluement.com, next check at Tue, 27 Oct 2020 17:40:00 GMT (timer based)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:31 #38(rspamd_proxy)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:31 #38(rspamd_proxy)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller) <4251c8>; csession; rspamd_controller_check_password: allow unauthorized connection from a unix socket
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller) <4251c8>; csession; rspamd_mime_parse_message: cannot find content-type for a message, assume text/plain
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller) <4251c8>; csession; rspamd_mime_part_get_cte: detected missing CTE for part as: 7bit
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller) <4251c8>; csession; rspamd_message_parse: loaded message; id:
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller) <4251c8>; lua; settings.lua:373:
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller) <4251c8>; csession; rspamd_symcache_disable_symbol_checkpoint: cannot disable ARC: not found
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller) <4251c8>; csession; rspamd_symcache_disable_symbol_checkpoint: cannot disable DKIM: not found
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #39(controller) <4251c8>; csession; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 0 regexps matched, 3062 regexps total, 2355 regexps cached, 0B scanned using pcre, 102B scanned total
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #38(rspamd_proxy) <183160>; proxy; proxy_accept_socket: accepted milter connection from 172.22.1.6 port 45702
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:34 #38(rspamd_proxy) <183160>; proxy; proxy_milter_error_handler: abnormally closing milter connection from: 172.22.1.6:45702, error: HTTP GET request is not supported in milter mode
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:36 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:45 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:50 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:54 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:54 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:54 #39(controller)
[36mrspamd-mailcow_1 |[0m 2020-10-27 18:39:54 #39(controller)
Reproduction of said bug:
I did try to upgrade to the very latest version to potentially update my version to the "fixed" version. But without any luck.
System information:
| Question | Answer |
| --- | --- |
| My operating system | ArchLinux |
| Is Apparmor, SELinux or similar active? | yes |
| Virtualization technlogy (KVM, VMware, Xen, etc - LXC and OpenVZ are not supported | no |
| Server/VM specifications (Memory, CPU Cores) | 4 |
| Docker Version (docker version) | 19.03.13-ce |
| Docker-Compose Version (docker-compose version) | 1.27.4 |
| Reverse proxy (custom solution) | I_DO_REPLY_HERE |
git diff origin/master, any other changes to the code? If so, please post them.iptables -L -vn, ip6tables -L -vn, iptables -L -vn -t nat and ip6tables -L -vn -t nat.docker exec -it $(docker ps -qf name=acme-mailcow) dig +short stackoverflow.com @172.22.1.254 (set the IP accordingly, if you changed the internal mailcow network) and post the output.Please update first and try again. :)
I also encounter that some (not all) mails rspamd reported as spam are not stored in quarantine. I can reproduce this error when sending a test message while the sender is blacklisted.
The instance is running on https://github.com/mailcow/mailcow-dockerized/commit/33f6f0c4b03d27105d3095cb39c7eda019bb6feb
I'm going to update my instance tonight and report back!
I also see sometimes an error like
Nov 2 09:11:56 localhost 4a22518a2da2[608]: PHP message: QUARANTINE: SQLSTATE[23000]: Integrity constraint violation: 4025 CONSTRAINT `quarantine.fuzzy_hashes` failed for `mailcow`.`quarantine`" while reading response header from upstream, client: 172.22.1.12, server: _, request: "POST /pipe.php HTTP/1.1", upstream: "fastcgi://[fd4d:6169:6c63:6f77::c]:9001", host: "nginx"
Blacklisted elements are not put into quarantine. This is described in the info box above the table.
The constraint validation is something I can fix later.
Ah! thanks. Overlooked this update
I think it would be good if this is also mentioned in the blacklist/whitelist UI. Will look into it
Yes, we should add it there.
//edit: Added it and will push it later. :)
@mightyBroccoli Please update to the latest version to check if the error persists.
@andryyy thankfully fixed a bug where spam emails could not be stored into quarantine when there couldn't be found any existing fuzzy hashes inside mailcows own DB.
In this case, rspamd reports correctly that this is spam and mailcow then tries to store those into your quarantine. And this is the point where it fails, as described above. So, no error on rspamd side which we could see in your attached rspamd logs above.
If your error was related to #3837 and was fixed, and I think it is, then please close this issue. Thanks! :)
EDIT: Fortget to link the commit that fixed it https://github.com/mailcow/mailcow-dockerized/commit/7dc21e036d0f5286d06136632c69a06499b6c63b
I did upgrade to the latest version a few hours ago. I currently watching if the quarentine does its job properly. I will update this post in a few hours if there are conclusions.
Edit:
It seems that he quaratine problem is fixed now and works as expected. Thank you for this fix and the project all together.
/close
Thank you guys. :)