Android: Upload fails since upgrade to 3.5.0RC

[WebSpider]

Actual behaviour

• Android client with auto upload turned on fails uploading since upgrade to 3.5.0RC, upgrading to GA doesnt work. Files stay queued at client, Error is 'Folder Error'.
• Downloading files using android client works fine, all uploads (also manual ones) are stuck

Expected behaviour

• Auto upload to work seamlessly like it did before

Steps to reproduce

1. Use client < 3.5 and setup auto upload with server 12
2. Upgrade client
3. Upgrade server to 13
4. Client can no longer upload files, but can still download

Environment data

Android version: 9.1

Device model: OnePlus 6

Stock or customized system: Stock

Nextcloud app version: 3.5.0

Nextcloud server version: 13.0.8.2

Logs

Web server error log

error log is empty

Nextcloud log (data/nextcloud.log)

{"reqId":"69FJng7wB8kCC0ruPtYU","level":4,"time":"2019-02-16T22:37:46+00:00","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"webdav","method":"MKCOL","url":"\/remote.php\/dav\/uploads\/<REDACTED>\/1625030564","message":"Exception: {\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\MethodNotAllowed\",\"Message\":\"The resource you tried to create already exists\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(594): Sabre\\\\DAV\\\\Server->createCollection('uploads\\\/<REDACTED>\\\/16...', Object(Sabre\\\\DAV\\\\MkCol))\\n#1 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpMkcol(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#2 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#3 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:MKCOL', Array)\\n#4 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#5 \\\/var\\\/www\\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Server.php(293): Sabre\\\\DAV\\\\Server->exec()\\n#6 \\\/var\\\/www\\\/nextcloud\\\/apps\\\/dav\\\/appinfo\\\/v2\\\/remote.php(35): OCA\\\\DAV\\\\Server->exec()\\n#7 \\\/var\\\/www\\\/nextcloud\\\/remote.php(164): require_once('\\\/var\\\/www\\\/nextcl...')\\n#8 {main}\",\"File\":\"\\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php\",\"Line\":1181}","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"13.0.8.2"}

[nextcloud-android-bot]

GitMate.io thinks possibly related issues are https://github.com/nextcloud/android/issues/3631 (upload fails), https://github.com/nextcloud/android/pull/3525 ([stable-3.5] Direct upload fix), https://github.com/nextcloud/android/pull/3519 ([stable-3.5] Fail if findbugs increased), https://github.com/nextcloud/android/issues/85 (Auto-uploading pictures fails sometimes), and https://github.com/nextcloud/android/issues/3400 (Auto upload of photos fail everytime due to unexpected size).

[floe]

Exact same issue here, on Sony G8441 with Android 9. Auto upload worked fine before, always fails since update to app version 3.5 (with "Folder error").

[mhzawadi]

afternoon all,

I too have this issue and have the same log lines
Android 8.0.0; ONEPLUS A3003 Build\/OPR1.170623.032 (3T)
Nextcloud App is 3.5.0
Nextcloud: 15.0.2.0

[PTamis]

The same issue I reported also with #3635.
This issue is escalating fast and needs to be fixed soon.

[WebSpider]

At least the error message is different, and I can still download fine... It maybe related, but on the surface this seems like a different issue... Or is your nextcloud.log showing the same errors?

[mhzawadi]

Not sure if this helps, have tried to upload to a folder from OnePlus Photos app. That also failes with a permission denied from the NextcLoud app.

{"reqId":"ZURBVBKHU9YlvpP4L8P4","level":0,"time":"2019-02-18 09:06:16","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"HEAD","url":"\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","message":"No cache entry found for \/<REDACTED>\/files\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg (storage: home::<REDACTED>, internalPath: files\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"ZURBVBKHU9YlvpP4L8P4","level":0,"time":"2019-02-18 09:06:16","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"webdav","method":"HEAD","url":"\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","message":{"Exception":"Sabre\\DAV\\Exception\\NotFound","Message":"File with name Photos\/<REDACTED>\/IMG_20190217_085454.jpg could not be located","Code":0,"Trace":[{"file":"\/srv\/www\/horwood-nextcloud\/3rdparty\/sabre\/dav\/lib\/DAV\/CorePlugin.php","line":81,"function":"getNodeForPath","class":"OCA\\DAV\\Connector\\Sabre\\ObjectTree","type":"->","args":["Photos\/<REDACTED>\/IMG_20190217_085454.jpg"]},{"function":"httpGet","class":"Sabre\\DAV\\CorePlugin","type":"->","args":[{"absoluteUrl":"https:\/\/owncloud.horwood.biz\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"\/srv\/www\/horwood-nextcloud\/3rdparty\/sabre\/event\/lib\/EventEmitterTrait.php","line":105,"function":"call_user_func_array","args":[[{"__class__":"Sabre\\DAV\\CorePlugin"},"httpGet"],[{"absoluteUrl":"https:\/\/owncloud.horwood.biz\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]]},{"file":"\/srv\/www\/horwood-nextcloud\/3rdparty\/sabre\/dav\/lib\/DAV\/Server.php","line":479,"function":"emit","class":"Sabre\\Event\\EventEmitter","type":"->","args":["method:GET",[{"absoluteUrl":"https:\/\/owncloud.horwood.biz\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]]},{"file":"\/srv\/www\/horwood-nextcloud\/3rdparty\/sabre\/dav\/lib\/DAV\/CorePlugin.php","line":253,"function":"invokeMethod","class":"Sabre\\DAV\\Server","type":"->","args":[{"absoluteUrl":"https:\/\/owncloud.horwood.biz\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"},false]},{"function":"httpHead","class":"Sabre\\DAV\\CorePlugin","type":"->","args":[{"absoluteUrl":"https:\/\/owncloud.horwood.biz\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"\/srv\/www\/horwood-nextcloud\/3rdparty\/sabre\/event\/lib\/EventEmitterTrait.php","line":105,"function":"call_user_func_array","args":[[{"__class__":"Sabre\\DAV\\CorePlugin"},"httpHead"],[{"absoluteUrl":"https:\/\/owncloud.horwood.biz\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]]},{"file":"\/srv\/www\/horwood-nextcloud\/3rdparty\/sabre\/dav\/lib\/DAV\/Server.php","line":479,"function":"emit","class":"Sabre\\Event\\EventEmitter","type":"->","args":["method:HEAD",[{"absoluteUrl":"https:\/\/owncloud.horwood.biz\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]]},{"file":"\/srv\/www\/horwood-nextcloud\/3rdparty\/sabre\/dav\/lib\/DAV\/Server.php","line":254,"function":"invokeMethod","class":"Sabre\\DAV\\Server","type":"->","args":[{"absoluteUrl":"https:\/\/owncloud.horwood.biz\/remote.php\/webdav\/Photos\/<REDACTED>\/IMG_20190217_085454.jpg","__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"\/srv\/www\/horwood-nextcloud\/apps\/dav\/appinfo\/v1\/webdav.php","line":80,"function":"exec","class":"Sabre\\DAV\\Server","type":"->","args":[]},{"file":"\/srv\/www\/horwood-nextcloud\/remote.php","line":163,"args":["\/srv\/www\/horwood-nextcloud\/apps\/dav\/appinfo\/v1\/webdav.php"],"function":"require_once"}],"File":"\/srv\/www\/horwood-nextcloud\/apps\/dav\/lib\/Connector\/Sabre\/ObjectTree.php","Line":173,"CustomMessage":"--"},"userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"Ouh2yUfT5g5blNbEGnvV","level":0,"time":"2019-02-18 09:06:16","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"MKCOL","url":"\/remote.php\/dav\/uploads\/<REDACTED>\/-1197179374","message":"No cache entry found for \/<REDACTED>\/uploads\/-1197179374 (storage: home::<REDACTED>, internalPath: uploads\/-1197179374)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"Ouh2yUfT5g5blNbEGnvV","level":0,"time":"2019-02-18 09:06:16","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"MKCOL","url":"\/remote.php\/dav\/uploads\/<REDACTED>\/-1197179374","message":"No cache entry found for \/<REDACTED>\/uploads\/-1197179374 (storage: home::<REDACTED>, internalPath: uploads\/-1197179374)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"MgoAzJp1jrIXXWFHy1Bc","level":0,"time":"2019-02-18 09:06:17","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"PUT","url":"\/remote.php\/dav\/uploads\/<REDACTED>\/-1197179374\/0000000000000000-0000000004734171","message":"No cache entry found for \/<REDACTED>\/uploads\/-1197179374\/0000000000000000-0000000004734171 (storage: home::<REDACTED>, internalPath: uploads\/-1197179374\/0000000000000000-0000000004734171)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"MgoAzJp1jrIXXWFHy1Bc","level":0,"time":"2019-02-18 09:06:17","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"PUT","url":"\/remote.php\/dav\/uploads\/<REDACTED>\/-1197179374\/0000000000000000-0000000004734171","message":"No cache entry found for \/<REDACTED>\/uploads\/-1197179374\/0000000000000000-0000000004734171 (storage: home::<REDACTED>, internalPath: uploads\/-1197179374\/0000000000000000-0000000004734171)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}

However I just got a screenshot of the app notification and that uploaded fine.

{"reqId":"DpryM6YmNMvzaFIhZLMq","level":0,"time":"2019-02-18 09:10:52","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"PUT","url":"\/remote.php\/webdav\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/<REDACTED>\/files\/Photos\/OP3T-screenshots\/2019\/02\/Screenshot_20190218-091039.jpg (storage: home::<REDACTED>, internalPath: files\/Photos\/OP3T-screenshots\/2019\/02\/Screenshot_20190218-091039.jpg)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"DpryM6YmNMvzaFIhZLMq","level":0,"time":"2019-02-18 09:10:52","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"PUT","url":"\/remote.php\/webdav\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/<REDACTED>\/files\/Photos\/OP3T-screenshots\/2019\/02\/Screenshot_20190218-091039.jpg (storage: home::<REDACTED>, internalPath: files\/Photos\/OP3T-screenshots\/2019\/02\/Screenshot_20190218-091039.jpg)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"DpryM6YmNMvzaFIhZLMq","level":0,"time":"2019-02-18 09:10:52","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"PUT","url":"\/remote.php\/webdav\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/<REDACTED>\/files\/Photos\/OP3T-screenshots\/2019\/02\/Screenshot_20190218-091039.jpg (storage: home::<REDACTED>, internalPath: files\/Photos\/OP3T-screenshots\/2019\/02\/Screenshot_20190218-091039.jpg)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"DpryM6YmNMvzaFIhZLMq","level":0,"time":"2019-02-18 09:10:52","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"PUT","url":"\/remote.php\/webdav\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/<REDACTED>\/files\/Photos\/OP3T-screenshots\/2019\/02\/Screenshot_20190218-091039.jpg (storage: home::<REDACTED>, internalPath: files\/Photos\/OP3T-screenshots\/2019\/02\/Screenshot_20190218-091039.jpg)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"DpryM6YmNMvzaFIhZLMq","level":0,"time":"2019-02-18 09:10:53","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"PUT","url":"\/remote.php\/webdav\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/appdata_oc0xc6xq5cff\/preview\/318227 (storage: local::\/var\/data\/horwood_owncloud\/, internalPath: appdata_oc0xc6xq5cff\/preview\/318227)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"pWWUUrjC2snjc6SqrtaU","level":0,"time":"2019-02-18 09:10:53","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"GET","url":"\/index.php\/apps\/files\/api\/v1\/thumbnail\/256\/256\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/appdata_oc0xc6xq5cff\/preview\/318227 (storage: local::\/var\/data\/horwood_owncloud\/, internalPath: appdata_oc0xc6xq5cff\/preview\/318227)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"pWWUUrjC2snjc6SqrtaU","level":0,"time":"2019-02-18 09:10:55","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"core","method":"GET","url":"\/index.php\/apps\/files\/api\/v1\/thumbnail\/256\/256\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"OC_Image->fixOrientation() Orientation: -1","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"pWWUUrjC2snjc6SqrtaU","level":0,"time":"2019-02-18 09:10:56","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"GET","url":"\/index.php\/apps\/files\/api\/v1\/thumbnail\/256\/256\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/appdata_oc0xc6xq5cff\/preview\/318229 (storage: local::\/var\/data\/horwood_owncloud\/, internalPath: appdata_oc0xc6xq5cff\/preview\/318229)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"pWWUUrjC2snjc6SqrtaU","level":0,"time":"2019-02-18 09:10:56","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"GET","url":"\/index.php\/apps\/files\/api\/v1\/thumbnail\/256\/256\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/appdata_oc0xc6xq5cff\/preview\/318229 (storage: local::\/var\/data\/horwood_owncloud\/, internalPath: appdata_oc0xc6xq5cff\/preview\/318229)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"pWWUUrjC2snjc6SqrtaU","level":0,"time":"2019-02-18 09:10:56","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"GET","url":"\/index.php\/apps\/files\/api\/v1\/thumbnail\/256\/256\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/appdata_oc0xc6xq5cff\/preview\/318227\/256-256-crop.jpg (storage: local::\/var\/data\/horwood_owncloud\/, internalPath: appdata_oc0xc6xq5cff\/preview\/318227\/256-256-crop.jpg)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"pWWUUrjC2snjc6SqrtaU","level":0,"time":"2019-02-18 09:10:56","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"GET","url":"\/index.php\/apps\/files\/api\/v1\/thumbnail\/256\/256\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/appdata_oc0xc6xq5cff\/preview\/318230 (storage: local::\/var\/data\/horwood_owncloud\/, internalPath: appdata_oc0xc6xq5cff\/preview\/318230)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"pWWUUrjC2snjc6SqrtaU","level":0,"time":"2019-02-18 09:10:56","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"no app in context","method":"GET","url":"\/index.php\/apps\/files\/api\/v1\/thumbnail\/256\/256\/Photos\/OP3T-screenshots\/\/2019\/02\/Screenshot_20190218-091039.jpg","message":"No cache entry found for \/appdata_oc0xc6xq5cff\/preview\/318230 (storage: local::\/var\/data\/horwood_owncloud\/, internalPath: appdata_oc0xc6xq5cff\/preview\/318230)","userAgent":"Mozilla\/5.0 (Android) ownCloud-android\/3.5.0","version":"15.0.2.0"}
{"reqId":"psmRWZVCOxgeKGis1OUi","level":0,"time":"2019-02-18 09:13:57","remoteAddr":"<REDACTED>","user":"<REDACTED>","app":"gallery","method":"GET","url":"\/apps\/gallery\/files\/download\/318227?c=1c941ad61d8d797babdbe27973d468ce&requesttoken=ooYRxi%2BvKhoD34NHC2%2F9o0JViiT88PqQ5ojT73gJV3E%3D%3AialaslbbeXdErPkLZwSymnMGsl21gb2hg6OynD1GBhM%3D","message":"[DownloadService] File to Download: Screenshot_20190218-091039.jpg","userAgent":"Mozilla\/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/71.0.3578.98 Safari\/537.36 OPR\/58.0.3135.65","version":"15.0.2.0"}

[franck-eyraud]

I also have issue uploading files greater than 1Mbyte (either auto or manual upload since last upgrade to 3.5.0). Could it be linked to the new upload via chunk #1026. On the server side (13.0.6) I found the files in paths like data/user/uploads/-213396919/0000000000000000-0000000001286276/

When the client tries, I find messages like this one in the server logs (HTTP error 405) :

MKCOL /remote.php/dav/uploads/user/-213396919 HTTP/1.1" 405 883 "-" "Mozilla/5.0 (Android) ownCloud-android/3.5.0"

Is there a necessity to upgrade the server to new version to use this feature ? If yes, couldn't it use the old way to upload if server is too old ?

[fearedbliss]

I'm also experiencing the same issue on my phone. I've been using nextcloud server and nextcloud android client for years and no issues. While debugging this issue, I also upgraded my server from NC 13.0.6 to NC -> 14.0.# -> 15.0.4 and it still occurs (With NC Android Client 3.5.0).

Info:
Server: Debian 9, Nextcloud Server 15.0.4 (Latest Stable at the time of writing)
Client: Android 9 (Stock) with Nextcloud Client 3.5.0

When trying to manually upload a photo: "Upload failed - Could not complete operation. Server unavailable", "Connection error".

Downloading works fine. I also tried to remove and reinstall the app from another post (https://github.com/nextcloud/android/issues/3631) but did not solve the issue.

[syntron]

Could this be related to the folder creation? I just tested it with the auto upload function (subfolders with year and month activated) - there is an error if the folder does not exists; it is working well after I created the folder manually.

Information:

• NC version: 15.0.4.0
• NC app version: android 3.5.0 installed via F-droid

It was working well before; however I can not state the exact version. However, I updated the NC server way before the NC app. Thus, I suspect a change in the app.

[fearedbliss]

@syntron Not in my situation. All my pictures have been going to the same "InstantUpload/Camera" folder for years.

[franck-eyraud]

While debugging this issue, I also upgraded my server from NC 13.0.6 to NC -> 14.0.# -> 15.0.4 and it still occurs (With NC Android Client 3.5.0).

Thank you for this information, at least I learn that upgrading the server will not solve the issue.

It is a pity that it is not possible to downgrade an app on Android; unless someone knows a way ?

[AndyScherzinger]

@franck-eyraud you would need to manually downgrade by deinstalling the current app and re-installing (from unknown source), the APK files being the app can be found at the release tags, e.g.https://github.com/nextcloud/android/releases/tag/stable-3.4.2

[fearedbliss]

@andyscherzinger Thanks Andy. I downgraded for now and it's working again.

[WebSpider]

Great news! So we have a good idea the client is acting up indeed :)

[fearedbliss]

@webspider yup! 3.4.2 works for me but when i select multiple images/videos and try to upload, either only a part of them get uploaded or nextcloud app crashes, but that's a different bug haha

[franck-eyraud]

@franck-eyraud you would need to manually downgrade by deinstalling the current app and re-installing (from unknown source), the APK files being the app can be found at the release tags, e.g.https://github.com/nextcloud/android/releases/tag/stable-3.4.2

Thank you @AndyScherzinger, it does indeed works to downgrade this way, and uploads now correctly works again. Noting that this procedure loses all previous parameters, so requires to set them again, including the automatic uploads settings, and manually upload pictures that failed with 3.5.0.

[InfamousUser]

Auto uploads were not working for me before the upgrade either, I just added a comment on this on issue: #3296

[WebSpider]

Thanks to the opener of #3669 I have been made aware that this is only true for me for larger files, and I am now looking where that threshold lies.

Pictures (3-10MB) are not uploading, screenshots (ca 250kB) are.

[mhzawadi]

If it helps, I have a screenshot of 717kb that uploaded, could it be the chucked upload that killed it?

[floe]

Yes, I just double-checked this and can confirm that images < 1000 kB do still upload, anything larger fails. Is there any way to temporarily disable chunked upload?

[tobiasKaminsky]

There was a change to use a new endpoint on uploading chunked files (> 1Mb).
The question is now why does this fail.

Do you have special userIds (not displayname)?

Can you create us a test account, test if the problem occurs also there and if so send the credentials to tobias at nextcloud dot com with a reference to this issue?

[WebSpider]

I have no special userids, all lowercase ASCII chars.

Just created a testaccount, attached to it from the same phone that has this problem, and it doesn't make any difference.

access logs of the sync attempt:

192.168.108.20 - testuset [28/Feb/2019:23:07:29 +0100] "PROPFIND /remote.php/webdav/ HTTP/1.0" 207 357 "-" "Mozilla/5.0 (Android) ownCloud-android/3.5.0"
192.168.108.20 - testuset [28/Feb/2019:23:14:24 +0100] "GET /index.php/avatar/testuset/304 HTTP/1.0" 304 0 "-" "Mozilla/5.0 (Android) ownCloud-android/3.5.0"
192.168.108.20 - testuset [28/Feb/2019:23:14:24 +0100] "GET /index.php/avatar/testuset/304 HTTP/1.0" 304 0 "-" "Mozilla/5.0 (Android) ownCloud-android/3.5.0"
192.168.108.20 - testuset [28/Feb/2019:23:15:38 +0100] "HEAD /remote.php/webdav/2018-12-31%2014.32.29.jpg HTTP/1.0" 404 0 "-" "Mozilla/5.0 (Android) ownCloud-android/3.5.0"
192.168.108.20 - testuset [28/Feb/2019:23:15:38 +0100] "MKCOL /remote.php/dav/uploads/testuset/-1348801709 HTTP/1.0" 201 0 "-" "Mozilla/5.0 (Android) ownCloud-android/3.5.0"
192.168.108.20 - testuset [28/Feb/2019:23:15:39 +0100] "PROPFIND /remote.php/dav/uploads/testuset/-1348801709 HTTP/1.0" 207 1277 "-" "Mozilla/5.0 (Android) ownCloud-android/3.5.0"
192.168.108.20 - testuset [28/Feb/2019:23:15:40 +0100] "PUT /remote.php/dav/uploads/testuset/-1348801709/0000000000000000-0000000005099557 HTTP/1.0" 201 0 "-" "Mozilla/5.0 (Android) ownCloud-android/3.5.0"

[tobiasKaminsky]

@WebSpider Can you create us a test account, test if the problem occurs also there and if so send the credentials to tobias at nextcloud dot com with a reference to this issue?

[tobiasKaminsky]

Or anyone else with a failing account/server?

[WebSpider]

I had an issue to solve with users getting blacklisted first, but that's now solved. Just created a testaccount, and will mail you the details!

[tobiasKaminsky]

Thanks @WebSpider.

We are using this https://docs.nextcloud.com/server/stable/developer_manual/client_apis/WebDAV/chunking.html for chunked upload.

According to test account by WebSpider, the upload of chunks work fine.
After that there is a move ".file" to $destination.

For some reason ".file" is not found (404) and thus returning the (maybe) wrong folder error code.

About the environment: This is an NGINX reverse proxy, proxying to an nginx php7-fpm, both on Ubuntu 16.

Do you have any htaccess rules that might prevent accessing ".file"?

[tobiasKaminsky]

Creating a ".2.txt" file via web UI is failing silently on your server, whereas it works on my test machine.

[WebSpider]

I think I've found the culprit.

Part of my nginx setup for nextcloud contains:

location ~ ^/(?:\.|autotest|occ|issue|indie|db_|console) {
        deny all;
    }

Now, my regex is rusty, but I think this matches anything starting with /. ?

[tobiasKaminsky]

Now, my regex is rusty, but I think this matches anything starting with /. ?

This denies everything which is /autotest, /occ, /issue, etc.:
https://regex101.com/r/L4jRLb/1

As you can see here ".2.txt" is not matched.

[tobiasKaminsky]

Hm.
I was too fast: "/.2.txt" is matched partly ("/.").

[tobiasKaminsky]

But the path in question is e.g. /remote.php/dav/uploads/testuset/1909379716/.file which does not match…

[WebSpider]

Removing that first statement didnt work.

Found another one, that seems to be the culprit, removing this allows me to create .2.txt:

        # Disallow access to hidden files and directories
        location ~ /\. {
                return 404;
        }

So now the question remains ... was that statement actually needed to block abusive actors?

[tobiasKaminsky]

Wow, this was even mentioned on forum: https://help.nextcloud.com/t/nextcloud-13-chunking-upload-not-working/28755/31

The big question is, where is this statement coming from?
It is not in official doc…

[tobiasKaminsky]

Yes, I can confirm that it works also for me with your test account @WebSpider.

[WebSpider]

Wow, this was even mentioned on forum: https://help.nextcloud.com/t/nextcloud-13-chunking-upload-not-working/28755/31

The big question is, where is this statement coming from?
It is not in official doc…

Apologies, my search-fu must have been lacking :/

[tobiasKaminsky]

To be fair I only found it after copying the exact config snippet with "nextcloud" in google.

[fearedbliss]

Not sure if this should be closed yet. In my situation I'm only using the default htaccess provided by nextcloud and also using the nextcloud htaccess in root of web server for nextcloud configurations that are installed in a subfolder (To allow DAV services to find the correct resource). I'm also using Apache not nginx. The nextcloud documentation should provide clear documentation of how to allow this to work on nextcloud servers so that clients upgrading to 3.5.0 or greater will understand why their uploads are now magically breaking.

[AndyScherzinger]

@fearedbliss the errors posted in your comments differ from the one posted by @WebSpider so I would guess that your error and thus the needed solution differs from this one. cc @tobiasKaminsky

[mhzawadi]

Can confirm that the below from the nginx install notes does bust uploads, image of 5.4MB uploaded fine.

    # Deny all attempts to access hidden files such as .htaccess, .htpasswd, .DS_Store (Mac).
#    location ~ /\. {
#        deny all;
#        access_log off;
#        log_not_found off;
#    }

[WebSpider]

@tobiasKaminsky So, this turned from one issue to another. For some reason, some temp uploaded files are stored in a directory with a '-' as an initial character. For those directories, the move fails, as the file cannot be found on the filesystem (the - may be misinterpreted here). Other ones work just fine .. so I have 50% of my files uploaded now :+1

Is the help.nextcloud.com a better place to open up these issues?

[tobiasKaminsky]

@fearedbliss
Can you create us a test account, test if the problem occurs also there and if so send the credentials to tobias at nextcloud dot com with a reference to this issue?

[fearedbliss]

I can. How do I that? I'll need to do it once I come back home from work tonight.

[tobiasKaminsky]

Admin can do this, they have a user management on top right.

[fearedbliss]

Alright, once admin creates test account, please lmk credentials.

[tobiasKaminsky]

Not sure if we misunderstand each other here:
I asked you to create a test account on your server as this is the one that leads to a failing upload.
So if you cannot create a test account, please ask your admin.

[fearedbliss]

Yes there is a misunderstanding since you did not specify which server to create it on. For all I know the nextcloud project had their own containers where you test.

[tobiasKaminsky]

On my test own server, productive server and on NC test server (where the integration tests run) it works.
So it must be something faulty on your server (maybe similar to @WebSpider), so please (if you want) create me a test account on your server where it is failing.
Then test if the problem still occurs with the new created account and if so, please mail me the credentials, so that I can debug.

[fearedbliss]

@tobiasKaminsky Hey Tobias, I emailed you the credentials, Thank you!

[tobiasKaminsky]

@fearedbliss thank you.
This works for my with latest changes.
I'll release now 3.5.1 RC1, which you can get via google play store beta program.

[fearedbliss]

Thanks Tobias. I upgraded to 3.5.1 RC1 but error is still happening. I also tried to switch my upload folder from /InstantUpload/Camera to / but the issue continues

[WebSpider]

3.5.1 RC 1 solved all for me

[fearedbliss]

Retested, I switched my account from using my redirect : cloud.xyinn.org to xyinn.org/cloud and now it works. I thought I already fixed this problem before but seems it's happening with this new version.

Tobias, when you tested, did you use the cloud.xyinn.org I sent you (since it worked for you) or did you swap to xyinn.org/cloud ? Error in the former is same as before "could not complete operation: server unavailable", as I said before this works before 3.5.0 but not now. So I'm wondering if there is any different logic in terms of endpoints or expectations in http redirects etc that would cause it to work pre 3.5.0 but not after that. Either way problem is solved without the redirect so we can close this and I'll deal with the issue myself, just wanted to keep you guys updated. Thanks.

[soofstad]

Have had this issue after an upgrade as well (can't remember what version I upgraded from...).
But with server version 15.0.7 and android client 3.6.0, uploads over 1MB gives the "permission denied" error.
Just wan't to confirm @mhzawadi findings that if you have a proxy that denies access to hidden files, i.e;

location ~ /\. {
    deny all;
}

that is most likely the cause. Fixed it for me at least.

[mhzawadi]

@soofstad thanks for checking, I did find that fix

https://github.com/nextcloud/android/issues/3641#issuecomment-470617822