Server: OCP\Files\NotFoundException related to user's avatar
Actual behaviour
This error message keeps appearing in the logs.
Server configuration
Operating system: Ubuntu 16.04 with all updates applied
Web server: Apache 2.4
Database: MariaDB 10.x
PHP version: 7.0
Nextcloud version: (see Nextcloud admin page) 13.0
Updated from an older Nextcloud/ownCloud or fresh install: Updated from existing install
Where did you install Nextcloud from: Originally from downloaded .tar.gz package from nextcloud.com
Signing status:
Signing status
Login as admin user into your Nextcloud and access
http://example.com/index.php/settings/integrity/failed
paste the results here.
List of activated apps:
App list
Enabled:
- activity: 2.6.1
- admin_audit: 1.3.0
- bruteforcesettings: 1.0.3
- comments: 1.3.0
- dav: 1.4.6
- federatedfilesharing: 1.3.1
- federation: 1.3.0
- files: 1.8.0
- files_downloadactivity: 1.2.0
- files_fulltextsearch: 0.6.0
- files_sharing: 1.5.0
- files_texteditor: 2.5.1
- files_trashbin: 1.3.0
- files_versions: 1.6.0
- files_videoplayer: 1.2.0
- firstrunwizard: 2.2.1
- fulltextsearch: 0.6.1
- fulltextsearch_elasticsearch: 0.6.1
- gallery: 18.0.0
- groupfolders: 1.2.0
- impersonate: 1.0.2
- logreader: 2.0.0
- lookup_server_connector: 1.1.0
- nextcloud_announcements: 1.2.0
- notifications: 2.1.2
- oauth2: 1.1.0
- password_policy: 1.3.0
- provisioning_api: 1.3.0
- serverinfo: 1.3.0
- sharebymail: 1.3.0
- survey_client: 1.1.0
- systemtags: 1.3.0
- twofactor_backupcodes: 1.2.3
- updatenotification: 1.3.0
- user_ldap: 1.3.1
- workflowengine: 1.3.0
Disabled: - encryption
- files_external
- files_pdfviewer
- theming
- user_external
If you have access to your command line run e.g.:
sudo -u www-data php occ app:list
from within your Nextcloud installation folder
Nextcloud configuration:
Config report
{
"system": {
"instanceid": "REMOVED SENSITIVE VALUE",
"passwordsalt": "REMOVED SENSITIVE VALUE",
"secret": "REMOVED SENSITIVE VALUE",
"trusted_domains": [
"localhost",
"cloud.domain.com"
],
"datadirectory": "REMOVED SENSITIVE VALUE",
"overwrite.cli.url": "https:\/\/cloud.domain.com",
"htaccess.RewriteBase": "\/",
"dbtype": "mysql",
"version": "13.0.0.14",
"dbname": "REMOVED SENSITIVE VALUE",
"dbhost": "REMOVED SENSITIVE VALUE",
"dbport": "",
"dbtableprefix": "oc_",
"dbuser": "REMOVED SENSITIVE VALUE",
"dbpassword": "REMOVED SENSITIVE VALUE",
"logtimezone": "UTC",
"installed": true,
"check_for_working_htaccess": true,
"memcache.local": "\OC\Memcache\APCu",
"filelocking.enabled": "true",
"memcache.locking": "\OC\Memcache\Redis",
"redis": {
"host": "REMOVED SENSITIVE VALUE",
"port": 0,
"timeout": 0
},
"mail_smtpmode": "smtp",
"mail_from_address": "REMOVED SENSITIVE VALUE",
"mail_domain": "REMOVED SENSITIVE VALUE",
"ldapIgnoreNamingRules": false,
"ldapProviderFactory": "\OCA\User_LDAP\LDAPProviderFactory",
"loglevel": 2,
"trashbin_retention_obligation": "auto",
"mail_smtphost": "REMOVED SENSITIVE VALUE",
"mail_smtpport": "25",
"maintenance": false,
"share_folder": "\/Shared With You",
"theme": "",
"updater.release.channel": "stable"
}
}
If you have access to your command line run e.g.:
sudo -u www-data php occ config:list system
from within your Nextcloud installation folder
or
Insert your config.php content here.
Make sure to remove all sensitive content such as passwords. (e.g. database password, passwordsalt, secret, smtp password, …)
Are you using external storage, if yes which one: local
Are you using encryption: no
Are you using an external user-backend, if yes which one: ActiveDirectory
So the server log seems to be possibly related to LDAP, and has something to do with not being able to find a generated avatar image I think. This issue sounds very similar to #5204 but I'm not sure it's the same. I'm not sure where to go from here.
Error Log
Error no app in context OCP\Files\NotFoundException:
/var/www/nextcloud/lib/private/Files/Node/Node.php - line 217: OC\Files\Node\Node->getFileInfo()
/var/www/nextcloud/lib/private/Files/Node/Node.php - line 117: OC\Files\Node\Node->getPermissions()
/var/www/nextcloud/lib/private/Files/Node/Folder.php - line 336: OC\Files\Node\Node->checkPermissions(8)
/var/www/nextcloud/lib/private/Files/SimpleFS/SimpleFolder.php - line 65: OC\Files\Node\Folder->delete()
/var/www/nextcloud/apps/dav/lib/CardDAV/PhotoCache.php - line 265: OC\Files\SimpleFS\SimpleFolder->delete()
/var/www/nextcloud/apps/dav/lib/AppInfo/Application.php - line 143: OCA\DAV\CardDAV\PhotoCache->delete('1', 'LDAP username....')
[internal function] OCA\DAV\AppInfo\Application->OCA\DAV\AppInfo{closure}(* sensitive parameters replaced )
/var/www/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php - line 212: call_user_func(Object(Closure), Object(Symfony\Component\EventDispatcher\GenericEvent), '\OCA\DAV\CardDA...', Object(Symfony\Component\EventDispatcher\EventDispatcher))
/var/www/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php - line 44: Symfony\Component\EventDispatcher\EventDispatcher->doDispatch(Array, '\OCA\DAV\CardDA...', Object(Symfony\Component\EventDispatcher\GenericEvent))
/var/www/nextcloud/apps/dav/lib/CardDAV/CardDavBackend.php - line 683: Symfony\Component\EventDispatcher\EventDispatcher->dispatch('\OCA\DAV\CardDA...', Object(Symfony\Component\EventDispatcher\GenericEvent))
/var/www/nextcloud/apps/dav/lib/CardDAV/SyncService.php - line 285: OCA\DAV\CardDAV\CardDavBackend->updateCard('1', 'LDAP username....', 'BEGIN VCARD\r\nVE...')
/var/www/nextcloud/apps/dav/lib/HookManager.php - line 124: OCA\DAV\CardDAV\SyncService->updateUser(Object(OC\User\User))
/var/www/nextcloud/lib/private/legacy/hook.php - line 106: OCA\DAV\HookManager->changeUser(Array)
/var/www/nextcloud/lib/private/Server.php - line 399: OC_Hook emit('OC_User', 'changeUser', Array)
[internal function] OC\Server->OC{closure}( sensitive parameters replaced )
/var/www/nextcloud/lib/private/Hooks/EmitterTrait.php - line 99: call_user_func_array(Object(Closure), Array)
/var/www/nextcloud/lib/private/Hooks/PublicEmitter.php - line 36: OC\Hooks\BasicEmitter->emit('\OC\User', 'changeUser', Array)
/var/www/nextcloud/lib/private/User/User.php - line 456: OC\Hooks\PublicEmitter->emit('\OC\User', 'changeUser', Array)
/var/www/nextcloud/lib/private/Avatar.php - line 149: OC\User\User->triggerChange('avatar', Object(OC\Files\SimpleFS\SimpleFile))
/var/www/nextcloud/apps/user_ldap/lib/User/User.php - line 596: OC\Avatar->set('\xFF\xD8\xFF\xE0\x00\x10JFIF\x00\x01\x01\x01\x00...')
/var/www/nextcloud/apps/user_ldap/lib/User/User.php - line 571: OCA\User_LDAP\User\User->setOwnCloudAvatar()
/var/www/nextcloud/apps/user_ldap/lib/User/User.php - line 553: OCA\User_LDAP\User\User->updateAvatar()
/var/www/nextcloud/lib/private/legacy/hook.php - line 106: OCA\User_LDAP\User\User->updateAvatarPostLogin(Array)
/var/www/nextcloud/lib/private/Server.php - line 388: OC_Hook emit('OC_User', 'post_login', Array)
[internal function] OC\Server->OC{closure}( sensitive parameters replaced )
/var/www/nextcloud/lib/private/Hooks/EmitterTrait.php - line 99: call_user_func_array(Object(Closure), Array)
/var/www/nextcloud/lib/private/Hooks/PublicEmitter.php - line 36: OC\Hooks\BasicEmitter->emit('\OC\User', 'postLogin', Array)
/var/www/nextcloud/lib/private/User/Session.php - line 362: OC\Hooks\PublicEmitter->emit('\OC\User', 'postLogin', Array)
/var/www/nextcloud/lib/private/User/Session.php - line 553: OC\User\Session->completeLogin( sensitive parameters replaced )
/var/www/nextcloud/lib/private/User/Session.php - line 329: OC\User\Session->loginWithPassword( sensitive parameters replaced )
/var/www/nextcloud/lib/private/User/Session.php - line 403: OC\User\Session->login( sensitive parameters replaced )
/var/www/nextcloud/lib/private/User/Session.php - line 514: OC\User\Session->logClientIn( sensitive parameters replaced *)
/var/www/nextcloud/lib/base.php - line 1052: OC\User\Session->tryBasicAuthLogin(Object(OC\AppFramework\Http\Request), Object(OC\Security\Bruteforce\Throttler))
/var/www/nextcloud/ocs/v1.php - line 76: OC handleLogin(Object(OC\AppFramework\Http\Request))
/var/www/nextcloud/ocs/v2.php - line 24: require_once('/var/www/nextcl...')
{main}
linucksrox
All 39 comments
I'm still seeing the same issue after upgrading to Nextcloud 13.0.1
linucksrox
on 21 Mar 2018
Same here.
vahem2lu
on 7 Jun 2018
how are the permissions set for and withing data/appdata_$INSTANCEID and data/appdata_$INSTANCEID/avatar and data/appdata_$INSTANCEID/avatar/$AFFECTEDUSER?
blizzz
on 18 Jun 2018
All of them belong to user http and has rw- rights.
vahem2lu
on 18 Jun 2018
- data/appdata_$INSTANCEID: owner/group are all www-data, and permissions are all 750 except for the identityproof directory which has permissions set to 755
- data/appdata_$INSTANCEID/avatar: owner/group are all www-data, permissions for older users are 750, and newer users vary with either 755 or 775. The affected users all have 750 set.
- data/appdata_$INSTANCEID/avatar/$AFFECTEDUSER: owner/group are www-data, permissions are 644 for avatar.jpg and avatar.png, no other files or directories present.
linucksrox
on 18 Jun 2018
I also see other log messages that appear to be related:
unlink(/var/www/nextcloud/data/appdata_INSTANCEID/avatar/AFFECTEDUSER/generated): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#225
rmdir(/var/www/nextcloud/data/appdata_INSTANCEID/dav-photocache/4ee3e497e4a66d68636744566ed95589): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#116
unlink(/var/www/nextcloud/data/appdata_INSTANCEID/avatar/AFFECTEDUSER/avatar.jpg): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#225
unlink(/var/www/nextcloud/data/appdata_INSTANCEID/avatar/AFFECTEDUSER/avatar.png): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#225
The last two files exist when I just checked, but not the "generated" directory.
linucksrox
on 18 Jun 2018
Me too has this "problem".
OS Debian 9.5, Nextcloud 13.0.5. PHP 7.0 (php-fpm) and Apache 2.4
Problem seems to be related between Windows LDAP and CardDAV Plugin.
Bundesferkel
on 11 Aug 2018
Also happens with OpenLDAP
Using official nextcloud 13.0.5-apache docker-image with MySQL 5.7.23
ChristophGr
on 29 Aug 2018
Also seeing this Error Message in 14.0.4 and OpenLDAP
rkl110
on 19 Dec 2018
do all of you have a second displayname configured? could you all post your LDAP config, please?
blizzz
on 3 Jan 2019
Here's my config, copy-pasted from the Issue Reporting App and anonymized (the formatting looks somewhat borked to me, but it's straight from the Issue Reporting App and wasn't messed up by me, so I guess it's actually intended this way.)
_lastChange: 1546530454background_sync_interval: 1800background_sync_offset: 0background_sync_prefix: cleanUpJobOffset: 0enabled: yeshas_memberof_filter_support: 1installed_version: 1.4.0ldap_agent_password: XXXXXXXXX=ldap_base: dc=example,dc=comldap_base_groups: dc=example,dc=comldap_base_users: dc=example,dc=comldap_cache_ttl: 600ldap_configuration_active: 1ldap_display_name: cnldap_dn: cn=nextcloud,ou=system,dc=example,dc=comldap_email_attr: mailldap_expert_username_attr: uidldap_group_filter: (&(|(objectclass=groupOfNames)))ldap_group_filter_mode: 0ldap_group_member_assoc_attribute: memberldap_groupfilter_groups: ldap_groupfilter_objectclass: groupOfNamesldap_host: ldaps://localhost/ldap_login_filter: (&(&(|(objectclass=inetOrgPerson))(|(memberof=cn=example-person,ou=gruppen,ou=Example-Org,dc=example,dc=com)(memberof=cn=example-user-group,ou=gruppen,ou=Example-Org,dc=example,dc=com)))(|(uid=%uid)(|(mailPrimaryAddress=%uid)(mail=%uid))))ldap_loginfilter_email: 1ldap_loginfilter_username: 1ldap_nested_groups: 1ldap_port: 636ldap_user_filter_mode: 0ldap_userfilter_groups: example-person
example-user-groupldap_userfilter_objectclass: inetOrgPersonldap_userlist_filter: (&(|(objectclass=inetOrgPerson))(|(memberof=cn=example-person,ou=gruppen,ou=Example-Org,dc=example,dc=com)(memberof=cn=example-user-group,ou=gruppen,ou=Example-Org,dc=example,dc=com)))types: authentication
What do you mean by "second displayname"?
(Damn, anonymization was incomplete... :-/ Now I have to change my password again...)
gohrner
on 3 Jan 2019
@gohrner Try running occ ldap:show-config to get an anonymized export of your ldap configuration. You may still want to change the domain and other things, but it will not output your actual password. I'm not sure about the issue reporting app (that should probably be fixed btw).
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Configuration | |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| hasMemberOfFilterSupport | 1 |
| hasPagedResultSupport | |
| homeFolderNamingRule | |
| lastJpegPhotoLookup | 0 |
| ldapAgentName | CN=ldap-user,OU=AdministrativeUsers,OU=User&Groups,DC=example,DC=local |
| ldapAgentPassword | *** |
| ldapAttributesForGroupSearch | |
| ldapAttributesForUserSearch | sAMAccountName;mail;givenName;sn |
| ldapBackupHost | 10.10.2.82 |
| ldapBackupPort | 389 |
| ldapBase | DC=example,DC=local |
| ldapBaseGroups | OU=SecurityGroups,OU=Groups,OU=User&Groups,DC=example,DC=local |
| ldapBaseUsers | OU=AdministrativeUsers,OU=User&Groups,DC=example,DC=local;OU=BoardMembers,OU=User&Groups,DC=example,DC=local;OU=UsersLocal,OU=Users,OU=User&Groups,DC=example,DC=local;OU=UsersRemote,OU=Users,OU=User&Groups,DC=example,DC=local;OU=Contractors,OU=Users,OU=User&Groups,DC=example,DC=local |
| ldapCacheTTL | 3600 |
| ldapConfigurationActive | 1 |
| ldapDefaultPPolicyDN | |
| ldapDynamicGroupMemberURL | |
| ldapEmailAttribute | mail |
| ldapExperiencedAdmin | 0 |
| ldapExpertUUIDGroupAttr | |
| ldapExpertUUIDUserAttr | |
| ldapExpertUsernameAttr | sAMAccountName |
| ldapGidNumber | gidNumber |
| ldapGroupDisplayName | cn |
| ldapGroupFilter | |
| ldapGroupFilterGroups | |
| ldapGroupFilterMode | 1 |
| ldapGroupFilterObjectclass | |
| ldapGroupMemberAssocAttr | member |
| ldapHost | 10.10.2.81 |
| ldapIgnoreNamingRules | |
| ldapLoginFilter | (&(&(|(objectclass=user))(|(|(memberof=CN=OwnCloud,OU=SecurityGroups,OU=Groups,OU=User&Groups,DC=example,DC=local)(primaryGroupID=2741))))(samaccountname=%uid)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) |
| ldapLoginFilterAttributes | |
| ldapLoginFilterEmail | 0 |
| ldapLoginFilterMode | 1 |
| ldapLoginFilterUsername | 1 |
| ldapNestedGroups | 0 |
| ldapOverrideMainServer | |
| ldapPagingSize | 500 |
| ldapPort | 389 |
| ldapQuotaAttribute | |
| ldapQuotaDefault | |
| ldapTLS | 0 |
| ldapUserAvatarRule | default |
| ldapUserDisplayName | displayname |
| ldapUserDisplayName2 | |
| ldapUserFilter | (&(|(objectclass=user))(|(|(memberof=CN=OwnCloud,OU=SecurityGroups,OU=Groups,OU=User&Groups,DC=example,DC=local)(primaryGroupID=2741)))(!(userAccountControl:1.2.840.113556.1.4.803:=2))) |
| ldapUserFilterGroups | OwnCloud |
| ldapUserFilterMode | 1 |
| ldapUserFilterObjectclass | user |
| ldapUuidGroupAttribute | auto |
| ldapUuidUserAttribute | auto |
| turnOffCertCheck | 0 |
| turnOnPasswordChange | 0 |
| useMemberOfToDetectMembership | 1 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
That's my current Config:
Click to expand
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Configuration | s01 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| hasMemberOfFilterSupport | |
| hasPagedResultSupport | |
| homeFolderNamingRule | |
| lastJpegPhotoLookup | 0 |
| ldapAgentName | uid=ldapowncloud,ou=System,ou=Users,dc=SUB,dc=DOMAIN,dc=de |
| ldapAgentPassword | *** |
| ldapAttributesForGroupSearch | cn |
| ldapAttributesForUserSearch | |
| ldapBackupHost | |
| ldapBackupPort | |
| ldapBase | dc=SUB,dc=DOMAIN,dc=de |
| ldapBaseGroups | ou=Groups,dc=SUB,dc=DOMAIN,dc=de |
| ldapBaseUsers | ou=Users,dc=SUB,dc=DOMAIN,dc=de |
| ldapCacheTTL | 60 |
| ldapConfigurationActive | 1 |
| ldapDefaultPPolicyDN | |
| ldapDynamicGroupMemberURL | |
| ldapEmailAttribute | mail |
| ldapExperiencedAdmin | 0 |
| ldapExpertUUIDGroupAttr | |
| ldapExpertUUIDUserAttr | |
| ldapExpertUsernameAttr | uid |
| ldapGidNumber | gidNumber |
| ldapGroupDisplayName | cn |
| ldapGroupFilter | (&(|(objectclass=posixGroup))(|(cn=ag-11)(cn=ag-12)(cn=ag-13)(cn=ag-14)(cn=ag-15)(cn=ag-16)(cn=ag-17)(cn=ag-18)(cn=ag-19)(cn=ag-20)(cn=ag-21)(cn=ag-22)(cn=ag-23)(cn=ag-24))) |
| ldapGroupFilterGroups | ag-11;ag-12;ag-13;ag-14;ag-15;ag-16;ag-17;ag-18;ag-19;ag-20;ag-21;ag-22;ag-23;ag-24 |
| ldapGroupFilterMode | 0 |
| ldapGroupFilterObjectclass | posixGroup |
| ldapGroupMemberAssocAttr | memberUid |
| ldapHost | ldap1.SUB.DOMAIN.de |
| ldapIgnoreNamingRules | |
| ldapLoginFilter | (&(|(objectclass=posixAccount))(uid=%uid)) |
| ldapLoginFilterAttributes | |
| ldapLoginFilterEmail | 0 |
| ldapLoginFilterMode | 0 |
| ldapLoginFilterUsername | 1 |
| ldapNestedGroups | 0 |
| ldapOverrideMainServer | |
| ldapPagingSize | 600 |
| ldapPort | 389 |
| ldapQuotaAttribute | |
| ldapQuotaDefault | |
| ldapTLS | 1 |
| ldapUserAvatarRule | default |
| ldapUserDisplayName | cn |
| ldapUserDisplayName2 | mail |
| ldapUserFilter | (|(objectclass=posixAccount)) |
| ldapUserFilterGroups | |
| ldapUserFilterMode | 0 |
| ldapUserFilterObjectclass | posixAccount |
| ldapUuidGroupAttribute | auto |
| ldapUuidUserAttribute | auto |
| turnOffCertCheck | 0 |
| turnOnPasswordChange | 0 |
| useMemberOfToDetectMembership | 1 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------+
Do you know when this happens? For instance regularly, or just once per user, or only when an avatar was read for the first time?
It seems it could be triggered on every login (besides caching), but the Exception could be thrown just once per user.
blizzz
on 3 Jan 2019
It's difficult to say, there isn't a pattern that I recognize. It does seem to primarily affect two specific users who are both in my UsersLocal OU. Today there was one error logged for the one user in the morning, then 18 errors logged for the other user throughout the day, some of which happened back to back within a couple seconds.
linucksrox
on 3 Jan 2019
In my case always several errors / log entries seem to happen at once, possibly during login / logout:
gohrner
on 3 Jan 2019
That's almost exactly how my logs look. I attempted to log in as today's afflicted user through the browser and through the client and sync data. Then I logged out and removed the account from the client, none of which triggered any new errors, for what that's worth.
By the way I'm willing to add temporary debugging statements into the code in order to diagnose this in more depth if you can provide some guidance on what to look for.
linucksrox
on 3 Jan 2019
Meanwhile I can reproduce it by manually deleting everything in /path/to/data/appdata_oc1aiufaw3gw/avatar/$uid/ logging out and in by the client.
blizzz
on 3 Jan 2019
oh, not exactly. At least not as the trace from the thread opener.
@gohrner It seems that you're missing the whole folder in fact? Can click in the arrow pointing down next to one of the big Exception entries and provide us the details (or the log file), please?
@linucksrox may you check as well?
blizzz
on 3 Jan 2019
Same problem here:
It stopped at once by removing my avatar through Outlook. An own nextcloud-avatar works fine. I think it has nothing to do with login (I didn´t login every ~20 minutes. Perhaps it depends on cronjob? I´m using nextcloud beta Android-app. Perhaps there´s a cyclic login?
Interesting thing by the way - in our company another user has an AD-avatar through Outlook set. No problems there ...
Saving nextcloud-logs failed due another bug in NC15 (https://github.com/nextcloud/server/issues/13285). If you need them - I could save them through ssh-access.
Thanks for your support!
AndyFx12
on 4 Jan 2019
AndyFx12
on 4 Jan 2019
According to the timestamps, most log entries actually might be caused by logins from the Android CalDav or CardDav sync.
Actually, there is no "generated" subdirectory in the avatar/go folder:
# find $(pwd)
/mnt/cstore/nextcloud_data/appdata_ocvgcqniu1rh/avatar/go
/mnt/cstore/nextcloud_data/appdata_ocvgcqniu1rh/avatar/go/avatar.png
/mnt/cstore/nextcloud_data/appdata_ocvgcqniu1rh/avatar/go/avatar.jpg
/mnt/cstore/nextcloud_data/appdata_ocvgcqniu1rh/avatar/go/avatar.32.jpg
Unfortunately, the log definitely contains sensitive personal data (full vcards, email adresses and the like) and possibly also still sensitive configuration information (not sure, as it's pretty much unformatted) and I'm not sure if I would catch all of those if I try to anonymize it manually.
Is there any tool to format and/or preferably properly anonymize the log before sending it in, but without rendering it useless?
So for now I resorted to screenshots which only show truncated information (having to change my LDAP password once because I published it is enough for me... ;) The screenshots still reveal user IDs, but I hope that's ok...)
I tried to PDF print the log page, but unfortunately the expanded stack traces are not rescued into the output and half of the generated pages consist of the sidebar menu... Maybe a better print stylesheet could help here...
gohrner
on 4 Jan 2019
same problem after nextcloud from 13.0.6 upgrade to 13.0.8
whisper1021
on 4 Jan 2019
@AndyFx12 @gohrner thanks for the backtrace, that helped already understand it better. What the code will do is to get a different folder within appdata, not /mnt/cstore/nextcloud_data/appdata_ocvgcqniu1rh/avatar/go but something like /mnt/cstore/nextcloud_data/appdata_ocvgcqniu1rh/dav-photocache/1234567890abcdef1234567890abcdef1/. If it does not exist, it will be created (which is a bit useless within delete(), but well).
If the proper permissions are set on the appdata dir, Nextcloud will create the folder. The result of mkdir is not being checked, if the Local storage implementation is being used, errors for mkdir are suppressed. That might the point were we start working with a Folder instance despite creation failed (for whatever reasons…).
It seems everyone here is having the data directory on a mount.
Can you try as web user following (adjust the path accordingly): mkdir /path/to/data/appdata_$INSTANCEID/dav-photocache/test-1337
blizzz
on 4 Jan 2019
@blizzz I do not have the data directory on a mount, it is on local storage in the default location /var/www/nextcloud/data.
The folder /var/www/nextcloud/data/appdata_$INSTANCEID/avatar/%UID does exist and contains two files, avatar.jpg and avatar.png.
In my case, www-data is the owner and group of all files and folders within appdata recursively, so I can't imagine permissions being the issue.
I ran sudo -u www-data mkdir /var/www/nextcloud/appdata_oc4pcz8fdbmy/dav-photocache/test-1337 and it succeeded.
linucksrox
on 4 Jan 2019
@blizzz
same here:
sudo -u www-data mkdir /mnt/ncdataexp/appdata_oczmkboktq1y/dav-photocache/test-1337
without problems.
AndyFx12
on 4 Jan 2019
No permission issues here as well:
www-data@host:~$ id
uid=133(www-data) gid=133(www-data) Gruppen=133(www-data)
www-data@host:~$ mkdir /mnt/cstore/nextcloud_data/appdata_ocvgcqniu1rh/dav-photocache/test-1337
www-data@host:~$ echo $?
0
www-data@host:~$ rmdir /mnt/cstore/nextcloud_data/appdata_ocvgcqniu1rh/dav-photocache/test-1337
www-data@host:~$ echo $?
0
www-data@host:~$
Having the same issue but not with avatars, instead with some css-files...
Permissions seem fine, as the folder-creation worked out well...
GrayGhost93
on 21 Jan 2019
I ran into the same problem, suddenly my Collabora office stopped working. I found, that the app crashed on getting file info, and it crashed od accessing avatar (that was provided previously from LDAP):
Log
{"reqId":"uAMU4VBF7nUwTcZjw3Oo","level":3,"time":"2019-01-22T08:43:18+00:00","remoteAddr":"10.67.164.44","user":"--","app":"objectstore","method":"GET","url":"\/index.php\/apps\/richdocuments\/wopi\/files\/24196434_ocdn3mtk0j94?access_token=QgM7AfPRZbYBlGSclXBhnQ8JczZglXaS&access_token_ttl=0&permission=edit","message":"Could not get object id:24434663 for file appdata_ocdn3mtk0j94\/avatar\/775DA7E6-9157-48EE-92AD-DE87D45E22F1\/avatar.jpg: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"object id:24434663 not found in object store\",\"Code\":0,\"Trace\":\"#0 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/ObjectStore\\\/ObjectStoreStorage.php(277): OC\\\\Files\\\\ObjectStore\\\\Swift->readObject('id:24434663')\\n#1 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Common.php(190): OC\\\\Files\\\\ObjectStore\\\\ObjectStoreStorage->fopen('appdata_ocdn3mt...', 'r')\\n#2 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(244): OC\\\\Files\\\\Storage\\\\Common->file_get_contents('appdata_ocdn3mt...')\\n#3 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Availability.php(266): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->file_get_contents('appdata_ocdn3mt...')\\n#4 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(244): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Availability->file_get_contents('appdata_ocdn3mt...')\\n#5 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/View.php(1148): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->file_get_contents('appdata_ocdn3mt...')\\n#6 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/View.php(589): OC\\\\Files\\\\View->basicOperation('file_get_conten...', '\\\/appdata_ocdn3m...', Array)\\n#7 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Node\\\/File.php(51): OC\\\\Files\\\\View->file_get_contents('\\\/appdata_ocdn3m...')\\n#8 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/SimpleFS\\\/SimpleFile.php(88): OC\\\\Files\\\\Node\\\\File->getContent()\\n#9 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Avatar.php(92): OC\\\\Files\\\\SimpleFS\\\\SimpleFile->getContent()\\n#10 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/User\\\/User.php(419): OC\\\\Avatar->get(-1)\\n#11 \\\/www\\\/nextcloud\\\/apps\\\/richdocuments\\\/lib\\\/Controller\\\/WopiController.php(151): OC\\\\User\\\\User->getAvatarImage(32)\\n#12 [internal function]: OCA\\\\Richdocuments\\\\Controller\\\\WopiController->checkFileInfo('24196434')\\n#13 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/AppFramework\\\/Http\\\/Dispatcher.php(161): call_user_func_array(Array, Array)\\n#14 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/AppFramework\\\/Http\\\/Dispatcher.php(91): OC\\\\AppFramework\\\\Http\\\\Dispatcher->executeController(Object(OCA\\\\Richdocuments\\\\Controller\\\\WopiController), 'checkFileInfo')\\n#15 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/AppFramework\\\/App.php(115): OC\\\\AppFramework\\\\Http\\\\Dispatcher->dispatch(Object(OCA\\\\Richdocuments\\\\Controller\\\\WopiController), 'checkFileInfo')\\n#16 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/AppFramework\\\/Routing\\\/RouteActionHandler.php(47): OC\\\\AppFramework\\\\App::main('OCA\\\\\\\\Richdocumen...', 'checkFileInfo', Object(OC\\\\AppFramework\\\\DependencyInjection\\\\DIContainer), Array)\\n#17 [internal function]: OC\\\\AppFramework\\\\Routing\\\\RouteActionHandler->__invoke(Array)\\n#18 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Route\\\/Router.php(297): call_user_func(Object(OC\\\\AppFramework\\\\Routing\\\\RouteActionHandler), Array)\\n#19 \\\/www\\\/nextcloud\\\/lib\\\/base.php(999): OC\\\\Route\\\\Router->match('\\\/apps\\\/richdocum...')\\n#20 \\\/www\\\/nextcloud\\\/index.php(42): OC::handleRequest()\\n#21 {main}\",\"File\":\"\\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/ObjectStore\\\/Swift.php\",\"Line\":286}","userAgent":"curl\/7.47.0","version":"13.0.8.2"}
{"reqId":"uAMU4VBF7nUwTcZjw3Oo","level":3,"time":"2019-01-22T08:43:18+00:00","remoteAddr":"10.67.164.44","user":"--","app":"index","method":"GET","url":"\/index.php\/apps\/richdocuments\/wopi\/files\/24196434_ocdn3mtk0j94?access_token=QgM7AfPRZbYBlGSclXBhnQ8JczZglXaS&access_token_ttl=0&permission=edit","message":"Exception: {\"Exception\":\"OCP\\\\Files\\\\NotFoundException\",\"Message\":\"object id:24434663 not found in object store\",\"Code\":0,\"Trace\":\"#0 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/ObjectStore\\\/ObjectStoreStorage.php(277): OC\\\\Files\\\\ObjectStore\\\\Swift->readObject('id:24434663')\\n#1 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Common.php(190): OC\\\\Files\\\\ObjectStore\\\\ObjectStoreStorage->fopen('appdata_ocdn3mt...', 'r')\\n#2 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(244): OC\\\\Files\\\\Storage\\\\Common->file_get_contents('appdata_ocdn3mt...')\\n#3 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Availability.php(266): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->file_get_contents('appdata_ocdn3mt...')\\n#4 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(244): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Availability->file_get_contents('appdata_ocdn3mt...')\\n#5 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/View.php(1148): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->file_get_contents('appdata_ocdn3mt...')\\n#6 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/View.php(589): OC\\\\Files\\\\View->basicOperation('file_get_conten...', '\\\/appdata_ocdn3m...', Array)\\n#7 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Node\\\/File.php(51): OC\\\\Files\\\\View->file_get_contents('\\\/appdata_ocdn3m...')\\n#8 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/SimpleFS\\\/SimpleFile.php(88): OC\\\\Files\\\\Node\\\\File->getContent()\\n#9 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Avatar.php(92): OC\\\\Files\\\\SimpleFS\\\\SimpleFile->getContent()\\n#10 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/User\\\/User.php(419): OC\\\\Avatar->get(-1)\\n#11 \\\/www\\\/nextcloud\\\/apps\\\/richdocuments\\\/lib\\\/Controller\\\/WopiController.php(151): OC\\\\User\\\\User->getAvatarImage(32)\\n#12 [internal function]: OCA\\\\Richdocuments\\\\Controller\\\\WopiController->checkFileInfo('24196434')\\n#13 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/AppFramework\\\/Http\\\/Dispatcher.php(161): call_user_func_array(Array, Array)\\n#14 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/AppFramework\\\/Http\\\/Dispatcher.php(91): OC\\\\AppFramework\\\\Http\\\\Dispatcher->executeController(Object(OCA\\\\Richdocuments\\\\Controller\\\\WopiController), 'checkFileInfo')\\n#15 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/AppFramework\\\/App.php(115): OC\\\\AppFramework\\\\Http\\\\Dispatcher->dispatch(Object(OCA\\\\Richdocuments\\\\Controller\\\\WopiController), 'checkFileInfo')\\n#16 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/AppFramework\\\/Routing\\\/RouteActionHandler.php(47): OC\\\\AppFramework\\\\App::main('OCA\\\\\\\\Richdocumen...', 'checkFileInfo', Object(OC\\\\AppFramework\\\\DependencyInjection\\\\DIContainer), Array)\\n#17 [internal function]: OC\\\\AppFramework\\\\Routing\\\\RouteActionHandler->__invoke(Array)\\n#18 \\\/www\\\/nextcloud\\\/lib\\\/private\\\/Route\\\/Router.php(297): call_user_func(Object(OC\\\\AppFramework\\\\Routing\\\\RouteActionHandler), Array)\\n#19 \\\/www\\\/nextcloud\\\/lib\\\/base.php(999): OC\\\\Route\\\\Router->match('\\\/apps\\\/richdocum...')\\n#20 \\\/www\\\/nextcloud\\\/index.php(42): OC::handleRequest()\\n#21 {main}\",\"File\":\"\\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/ObjectStore\\\/Swift.php\",\"Line\":286}","userAgent":"curl\/7.47.0","version":"13.0.8.2"}
When I listed what is in the database, I found:
MySQL [nextcloud_v13]> select * from oc_filecache where storage=1 and path like "%avatar%775DA7E6-9157-48EE-92AD-DE87D45E22F1%";
+----------+---------+-----------------------------------------------------------------------------+----------------------------------+----------+--------------------------------------+----------+----------+------+------------+---------------+-----------+------------------+---------------+-------------+----------+
| fileid | storage | path | path_hash | parent | name | mimetype | mimepart | size | mtime | storage_mtime | encrypted | unencrypted_size | etag | permissions | checksum |
+----------+---------+-----------------------------------------------------------------------------+----------------------------------+----------+--------------------------------------+----------+----------+------+------------+---------------+-----------+------------------+---------------+-------------+----------+
| 21329415 | 1 | appdata_ocdn3mtk0j94/avatar/775DA7E6-9157-48EE-92AD-DE87D45E22F1 | b0ecb9b122c2145e244cbeb5b012719d | 17 | 775DA7E6-9157-48EE-92AD-DE87D45E22F1 | 2 | 1 | 0 | 1548146968 | 1548146968 | 0 | 0 | 5c46d918e490a | 31 | NULL |
| 24115889 | 1 | appdata_ocdn3mtk0j94/avatar/775DA7E6-9157-48EE-92AD-DE87D45E22F1/generated | 170da5acb98e915ef961e30ec2fd023c | 21329415 | generated | 12 | 3 | 0 | 1547711539 | 1542821187 | 0 | 0 | 5bf5954509c3d | 27 | NULL |
| 24434663 | 1 | appdata_ocdn3mtk0j94/avatar/775DA7E6-9157-48EE-92AD-DE87D45E22F1/avatar.jpg | c192aff198c96859758e16b016456d4d | 21329415 | avatar.jpg | 6 | 5 | 0 | 1548146968 | 1547711539 | 0 | 0 | 5c40343367156 | 27 | NULL |
+----------+---------+-----------------------------------------------------------------------------+----------------------------------+----------+--------------------------------------+----------+----------+------+------------+---------------+-----------+------------------+---------------+-------------+----------+
Strange, there is generated and avatar.jpg as well. I deleted both records and now it works! Nextcloud regenerated all and the records seems as follows:
MySQL [nextcloud_v13]> select * from oc_filecache where storage=1 and path like "%avatar%775DA7E6-9157-48EE-92AD-DE87D45E22F1%";
+----------+---------+---------------------------------------------------------------------------------+----------------------------------+----------+--------------------------------------+----------+----------+-------+------------+---------------+-----------+------------------+---------------+-------------+----------+
| fileid | storage | path | path_hash | parent | name | mimetype | mimepart | size | mtime | storage_mtime | encrypted | unencrypted_size | etag | permissions | checksum |
+----------+---------+---------------------------------------------------------------------------------+----------------------------------+----------+--------------------------------------+----------+----------+-------+------------+---------------+-----------+------------------+---------------+-------------+----------+
| 24457852 | 1 | appdata_ocdn3mtk0j94/avatar/775DA7E6-9157-48EE-92AD-DE87D45E22F1/avatar.32.jpg | 6c9e8aea39aeb4261bc3b42c6dda8dac | 21329415 | avatar.32.jpg | 6 | 5 | 1470 | 1548147047 | 1548147047 | 0 | 0 | 5c46d967e7723 | 27 | NULL |
| 24457850 | 1 | appdata_ocdn3mtk0j94/avatar/775DA7E6-9157-48EE-92AD-DE87D45E22F1/avatar.jpg | c192aff198c96859758e16b016456d4d | 21329415 | avatar.jpg | 6 | 5 | 2950 | 1548147047 | 1548147047 | 0 | 0 | 5c46d9671d339 | 27 | NULL |
| 24457853 | 1 | appdata_ocdn3mtk0j94/avatar/775DA7E6-9157-48EE-92AD-DE87D45E22F1/avatar.145.jpg | 27487fa41773ff8ba8c79219c6bd7d3d | 21329415 | avatar.145.jpg | 6 | 5 | 9313 | 1548147048 | 1548147048 | 0 | 0 | 5c46d9682511b | 27 | NULL |
| 24457847 | 1 | appdata_ocdn3mtk0j94/avatar/775DA7E6-9157-48EE-92AD-DE87D45E22F1/avatar.png | 8df8ad838c53847daebde7bf1832caa5 | 21329415 | avatar.png | 7 | 5 | 10262 | 1548147046 | 1548147046 | 0 | 0 | 5c46d96677b16 | 27 | NULL |
| 21329415 | 1 | appdata_ocdn3mtk0j94/avatar/775DA7E6-9157-48EE-92AD-DE87D45E22F1 | b0ecb9b122c2145e244cbeb5b012719d | 17 | 775DA7E6-9157-48EE-92AD-DE87D45E22F1 | 2 | 1 | 23995 | 1548147048 | 1548147048 | 0 | 0 | 5c46d96838446 | 31 | NULL |
+----------+---------+---------------------------------------------------------------------------------+----------------------------------+----------+--------------------------------------+----------+----------+-------+------------+---------------+-----------+------------------+---------------+-------------+----------+
My nextcloud version is 13.0.8.2. The problem with avatar may be present for some time cause since 13.0.0 I still see avatar or cached js/css related storage errors
vpecinka
on 22 Jan 2019
@vpecinka thanks for the observation. seems as if the filecache is out of sync for some reason :-/
One who still suffers, could you please do a "php occ files:scan
blizzz
on 24 Jan 2019
On a fresh new install of NC15, I was missing avatar.jpg... in the /nextcloud/data/appdata_xxxx/avatar/user/avatar.jpg... added the file with the right permissions and error went away... Funny that is it looking for avatar.jpg that does not exist....
Cheers
lightngn
on 29 Mar 2019
@blizzz Sorry for the late response. I'm still seeing these errors every day, and I have run "php occ files:scan --all" plenty of times, including last Friday. Still more errors today.
When I downloaded the logs, there is more detail available, and I noticed the user agent that is connecting when these errors occur is the Android app (the current 3.5.1 version). I think that might be significant to solving this issue.
I just checked again based on @lightngn's comment, but those files already exist in my case.
linucksrox
on 1 Apr 2019
If someone is adventurous, she may try out https://github.com/nextcloud/server/pull/15290 and see whether it fixes this bug.
blizzz
on 29 Apr 2019
@blizzz After upgrading to 16.0.1 it seems like the OCP\Files\NotFoundException issue is resolved, but I'm still seeing the accompanying unlink(/var/www/nextcloud/data/appdata_oc***my/avatar/username/avatar.png): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227 messages repeatedly. This is only happening for the same two users I was seeing before.
linucksrox
on 17 May 2019
@linucksrox does it have a stack trace? Try an occ files:scan-app-data. If it does not help, would you be so kind to open a new issue with all the requested information?
blizzz
on 17 May 2019
Sure, I'll open a new issue. There is no stack trace and I believe I've tried doing a files:scan several times before with no success. @blizzz just opened #15608
linucksrox
on 17 May 2019
@linucksrox not scan, but scan-app-data!
blizzz
on 17 May 2019
Sorry, I did run scan-app-data right after you mentioned it a few days ago, and actually I haven't seen any new entries in the logs since then. I'll wait a few more days and check again, otherwise I think it's finally resolved!
linucksrox
on 20 May 2019
Worked for me on a Nextcloud 18.0.0.10 instance.
deajan
on 12 Feb 2020
Related issues
williambargent
·
3Comments
juliushaertl
·
3Comments
MorrisJobke
·
3Comments
mfechner
·
3Comments
ghost
·
3Comments