Server: flow.log filesize grows without truncation

Created on 26 Apr 2020  路  3Comments  路  Source: nextcloud/server

How to use GitHub

  • Please use the 馃憤 reaction to show that you are affected by the same issue.
  • Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
  • Subscribe to receive notifications on status change and new comments.

Steps to reproduce

  1. install Nextcloud 18
  2. use normally

I didn't actively used Flow at all.

Expected behaviour

flow.log-file gets trunkated on a regular basis

Actual behaviour

flow.log grows in two month to 140GB without any truncation, but logs for every file access that it searches for a rule (and that no rule was found)

Server configuration

Operating system:
Debian 10

Web server:
Apache 2.4.41
Database:

PHP version:
7.4.3

Nextcloud version: (see Nextcloud admin page)
18.0.4

Updated from an older Nextcloud/ownCloud or fresh install:
updated from older version

Where did you install Nextcloud from:

Signing status:


Signing status

No errors have been found.

List of activated apps:


App list

Enabled:
  - accessibility: 1.4.0
  - activity: 2.11.0
  - admin_audit: 1.8.0
  - announcementcenter: 3.7.0
  - apporder: 0.9.0
  - audioplayer: 2.10.0
  - bruteforcesettings: 1.6.0
  - calendar: 2.0.3
  - camerarawpreviews: 0.7.3
  - checksum: 0.4.4
  - cloud_federation_api: 1.1.0
  - cms_pico: 1.0.5
  - comments: 1.8.0
  - contacts: 3.3.0
  - cookbook: 0.6.3
  - cospend: 0.4.6
  - dav: 1.14.0
  - documentserver_community: 0.1.5
  - emlviewer: 0.0.5
  - extract: 1.2.4
  - federatedfilesharing: 1.8.0
  - federation: 1.8.0
  - files: 1.13.1
  - files_accesscontrol: 1.8.1
  - files_downloadactivity: 1.7.0
  - files_external: 1.9.0
  - files_linkeditor: 1.0.13
  - files_markdown: 2.2.0
  - files_pdfviewer: 1.7.0
  - files_readmemd: 1.1.4
  - files_rightclick: 0.15.2
  - files_sharing: 1.10.1
  - files_trashbin: 1.8.0
  - files_versions: 1.11.0
  - files_videoplayer: 1.7.0
  - firstrunwizard: 2.7.0
  - flowupload: 0.1.8
  - forms: 1.1.1
  - fulltextsearch: 1.4.1
  - guests: 1.4.3
  - impersonate: 1.5.0
  - joplin: 0.0.25
  - logreader: 2.3.0
  - lookup_server_connector: 1.6.0
  - mail: 1.3.3
  - metadata: 0.11.1
  - music: 0.14.0
  - nextcloud_announcements: 1.7.0
  - notes: 3.2.0
  - notifications: 2.6.0
  - oauth2: 1.6.0
  - onlyoffice: 4.1.4
  - password_policy: 1.8.0
  - phonetrack: 0.6.2
  - photos: 1.0.0
  - polls: 1.3.0
  - previewgenerator: 2.3.0
  - privacy: 1.2.0
  - provisioning_api: 1.8.0
  - recommendations: 0.6.0
  - serverinfo: 1.8.0
  - settings: 1.0.0
  - sharebymail: 1.8.0
  - sharingpath: 0.2.1
  - socialsharing_email: 2.0.0
  - spreed: 8.0.8
  - systemtags: 1.8.0
  - talk_simple_poll: 1.1.1
  - tasks: 0.12.1
  - text: 2.0.0
  - theming: 1.9.0
  - twofactor_admin: 2.1.0
  - twofactor_backupcodes: 1.7.0
  - twofactor_gateway: 0.16.0
  - twofactor_nextcloud_notification: 2.3.0
  - twofactor_totp: 4.1.3
  - twofactor_u2f: 5.1.0
  - updatenotification: 1.8.0
  - video_converter: 0.1.4
  - viewer: 1.2.0
  - workflowengine: 2.0.0

Nextcloud configuration:


Config report

{
    "system": {
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "***REMOVED SENSITIVE VALUE***",
            "***REMOVED SENSITIVE VALUE***",
            "***REMOVED SENSITIVE VALUE***"
        ],
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***",
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "overwrite.cli.url": "https:\/\/***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "18.0.4.2",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "skeletondirectory": "",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpmode": "smtp",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "loglevel": 0,
        "maintenance": false,
        "memcache.local": "\\OC\\Memcache\\APCu",
        "memcache.distributed": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "filelocking.enabled": "true",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 1.5
        },
        "theme": "",
        "htaccess.RewriteBase": "\/",
        "updater.release.channel": "stable",
        "appstore.experimental.enabled": true,
        "versions_retention_obligation": "60, auto",
        "mail_smtpauthtype": "LOGIN",
        "mail_smtpsecure": "tls",
        "mail_smtpauth": 1,
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpport": "587",
        "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
        "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
        "mysql.utf8mb4": true,
        "mail_sendmailmode": "smtp",
        "simpleSignUpLink.shown": false,
        "app_install_overwrite": [
            "files_readmemd",
            "joplin"
        ],
        "updater.secret": "***REMOVED SENSITIVE VALUE***"
    }
}

Are you using external storage, if yes which one: local/smb/sftp/...
no

Are you using encryption: yes/no
no

Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...
no

Logs

Web server error log


Web server error log
not relevant

Insert your webserver log here

Nextcloud log (data/nextcloud.log)


Nextcloud log

{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"Flow activation: rules were requested for operation Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}
{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"No flow configurations is going to run Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}
{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"Flow activation: rules were requested for operation Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}
{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"No flow configurations is going to run Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}
{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"Flow activation: rules were requested for operation Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}
{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"No flow configurations is going to run Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}
{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"Flow activation: rules were requested for operation Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}
{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"No flow configurations is going to run Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}
{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"Flow activation: rules were requested for operation Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}
{"reqId":"fkhEboMUYm1Q82dbMDQF","level":0,"time":"2020-04-26T00:12:59+00:00","remoteAddr":"IPADDRESS","user":"USERNAME","app":"workflowengine","method":"PROPFIND","url":"/remote.php/dav/files/USERNAME/","message":"No flow configurations is going to run Zugriff auf Datei verhindern","userAgent":"Mozilla/5.0 (Windows) mirall/2.6.4stable-Win64 (build 20200303) (Nextcloud)","version":"18.0.4.2"}

0. Needs triage bug
Source
picture alexdetsch
👍4

Most helpful comment

As reference: #20100

Your loglevel is set to debug. That's the reason flow is so talkative.

I agree with you that flow log should respect the truncation settings.

picture kesselb on 26 Apr 2020
👍2

All 3 comments

As reference: #20100

Your loglevel is set to debug. That's the reason flow is so talkative.

I agree with you that flow log should respect the truncation settings.

kesselb picture kesselb on 26 Apr 2020
👍2

Your loglevel is set to debug. That's the reason flow is so talkative.

Thanks, I realized, loglevel was set to 0 (Debug), while it should be set to 2 (Warning).

pongraczi picture pongraczi on 28 Apr 2020

Your loglevel is set to debug. That's the reason flow is so talkative.
Thank you, solved it for me!

alexdetsch picture alexdetsch on 28 Apr 2020
Was this page helpful?
0 / 5 - 0 ratings

Related issues

j-ed picture j-ed  路  3Comments
MariusBluem picture MariusBluem  路  3Comments
georgehrke picture georgehrke  路  3Comments
ThomasLeister picture ThomasLeister  路  3Comments
mama21mama picture mama21mama  路  3Comments