Core: 10.0.8RC1 - FINAL smoke test results
Smoke test
Previous requirements
Prepare two servers with ssl activated and trusted certificates.
Enable LDAP and external storage apps.
Have a LDAP server ready to be used with owncloud.
Have ready two external storages of your choice SMB, SFTP, Dropbox, Google Drive, FTP, S3, ownCloud, local.
Testing setup
TestID | Test Case | Expected Result | Result | Related Comment
------------ | ------------- | -------------- | ----- | ------
1 | Enable encryption app and encryption default module | Encryption is enabled correctly | ✅ |
2 | Populate owncloud server with users and groups | Users and groups are correctly created | ✅ |
3 | Share a folder remotely using federated sharing with admin user of the other server. | folder can be opened in recipient server without problems | ✅ |
4 | Set up LDAP, as admin check users. log in with a LDAP user, if possible one with an avatar. | Users are loaded. LDAP user logs in without problems. Avatar is shown if it exists. | ✅ |
5 | Set up two external storages different, disable encryption in one of them.| No errors in this process | ✅ |
Testing functionality
TestID | Test Case | Expected Result | Result | Related Comment
------------ | ------------- | -------------- | ----- | ------
1 | Share a file using federated sharing from an external unencrypted external storage in server #1 using a LDAP user to the admin user in server #2. | Admin user in server #2 can see the file. | ✅ |
2 | Open internet explorer or edge and upload a new avatar for a regular user not LDAP | Interface can be used, avatar is uploaded, check that personal page has a scroll bar and scrolls fine. | ✅ |
3 | Upload several files and folders inside external storages, open some. | No problems uploading, files can be downloaded and opened. | ✅ |
4 | Delete files inside both external storages. Recover some after from the trashbin. | Files are correctly deleted and restored. | :construction: |
5 | Using webdav upload a 100MiB file.| No errors in this process | ✅ |
patrickjahns
All 10 comments
@phil-davis @individual-it
Last nights automated smoke tests had errors: https://travis-ci.org/owncloud/core/builds/365222767?utm_source=email&utm_medium=notification
Please check and comment here if these issues persist - or are "false" positives
patrickjahns
on 12 Apr 2018
Smoke test iOS [WIP]
Device & iOS version: iPhone 6SPlus v11
Server version: 10.0.8RC1
OAuth2 version: 0.2.2
Login
Test Case | Expected Result | Result | Related Comment
| :------- | :---------------: | :------ | :-----------------: |
Login with one account (HTTPS) | It is possible to access | :white_check_mark: |
Login with one account (HTTP) | It is possible to access | :white_check_mark: |
Login with one account (SHIB Autoprovisioned user)| It is possible to access| |
Login with one account (SHIB SSO user ) | It is posible to access |:white_check_mark: |
Folder
TestID | Test Case | Steps | Expected Result | Result | Related Comment
------------ | ------------- | ----------- | -------------- | ----- | ------
1 | Create a new folder | 1. Tap on create a new folder |The folder is created| :white_check_mark: OAuth
:white_check_mark: basic
|
2 | Create a folder with special character | 1. Tap on create a new folder
2. Use a name with special characters (e.g $%&¨)| The folder is created with special character | :white_check_mark: OAuth
:white_check_mark: basic
|
3 | Rename a folder | 1. Create a new folder
2. Rename the folder| Folder is renamed| :white_check_mark: OAuth
:white_check_mark: basic
4 | Move a folder | 1. Create a new folder
2. Move the folder| Folder is moved to the specifield location | :white_check_mark: OAuth
:white_check_mark: basic
5 | Upload a file into a folder | 1. Create a new folder
2. Upload a file| File is uploaded into the folder | :white_check_mark: OAuth
:white_check_mark: basic
6 | Delete a folder | 1. Access to a folder, the folder has deep structure inside
2. Download some files
3. Select delete that folder | 2. The files are downloaded
3. The folder is removed| :white_check_mark: OAuth
:white_check_mark: basic
7| Copy Folder | 1. Long press to copy a folder
2. Select a location to paste | The folder and all its content is copied in the location, and remains too in the original| NA
8 | Share the folder by link | 1. Create a new folder
2. Long press to share the folder by link
| The link is generated and works| :white_check_mark: OAuth
:white_check_mark: basic
9 | Share the folder by link with pass| 1. Create a new folder
2. Long press to share the folder by link
3. Enable the password protection and set a password | The link is generated and only works if the correct password is typed|:white_check_mark: OAuth
:white_check_mark: basic
10| Unshare the folder by link | 1. Unshare the folder of previous test cases| The link is no more available |:white_check_mark: OAuth
:white_check_mark: basic
11 | Share the folder with users or groups| 1. Create a new folder
2. Long press to share with users/groups
3. Type one user/group to share with | The user/group can access to the folder | :white_check_mark: OAuth
:white_check_mark: basic
12| Unshare the folder with users or groups| 1. Unshare the folder in the previous test case | The folder is not more available for the sharees | :white_check_mark: OAuth
:white_check_mark: basic
File
TestID | Test Case | Steps | Expected Result | Result | Related Comment
------------ | ------------- | ------------- | -------------- | ----- | ------
1 | Upload a new file | 1. Upload a new file | The file is uploaded | :white_check_mark: OAuth
:white_check_mark: basic
2 | Upload a file with special character | 1. Upload a new file (e.g f%&¨)| The file is uploaded | :white_check_mark: OAuth
:white_check_mark: basic
3 | Rename a file | 1. Create a new file
2. Rename the file | The file is renamed |:white_check_mark: OAuth
:white_check_mark: basic
4 | Move a file | 1. Create a new file
2. Move the file | The file is renamed |:white_check_mark: OAuth
:white_check_mark: basic
5 | Copy a file | 1. Create a new file
2. Copy the file | The file is copied to the selected location | NA
6 | Delete a file | 1. Create a new file
2. Delete the file | The file is deleted |:white_check_mark: OAuth
:white_check_mark: basic
7 | Share the file by link | 1. Create a file
2. Long press to share the file by link | The link is generated and works|:white_check_mark: OAuth
:white_check_mark: basic
8 | Share the file by link with pass| 1. Create a file
2. Long press to share the file by link
3. Set a password| The link is generated and works when the correct pass is typed|:white_check_mark: OAuth
:white_check_mark: basic
9 | Unshare the file by link | 1. Unshare the file of previous test cases | The link is no more available|:white_check_mark: OAuth
:white_check_mark: basic
10 | Share the file with users or groups| 1. Create a new file
2. Long press to share with users/groups
3. Type one user/group to share with | The user/group can access to the file | :white_check_mark: OAuth
:white_check_mark: OAuth
:white_check_mark: basic
11| Unshare the file with users or groups| 1. Unshare the file in the previous test case | The file is not more available for the sharees | :white_check_mark: OAuth
:white_check_mark: basic
12| Download a file| 1. Tap to download a file | The file is downloaded and marked with green tick|:white_check_mark: OAuth
:white_check_mark: basic
13| Av Offline file | 1. Long press to set as av offline a file | The file is downloaded and set as av off with the yellow arrow |:white_check_mark: OAuth
:white_check_mark: basic
14| Av Offline file | 1. Long press to set as no av offline a file | The file has no more the yellow arrow | :white_check_mark: OAuth
:white_check_mark: basic
jesmrec
on 13 Apr 2018
Smoke test Android [WIP]
Device & Android version: Nexus 6 V6
Server version: 10.0.8RC1
OAuth2 version: 0.2.2
Login
Test Case | Expected Result | Result | Related Comment
| :------- | :---------------: | :------ | :-----------------: |
Login with one account (HTTPS) | It is possible to access | :white_check_mark: |
Login with one account (HTTP) | It is possible to access | :white_check_mark: |
Login with one account (SHIB Autoprovisioned user)| It is possible to access| |
Login with one account OAuth2 | It is possible to access| :white_check_mark:|
Folder
TestID | Test Case | Steps | Expected Result | Result | Related Comment
------------ | ------------- | ----------- | -------------- | ----- | ------
1 | Create a new folder | 1. Tap on create a new folder |The folder is created| :white_check_mark: basic
:white_check_mark: OAuth2 |
2 | Create a folder with special character | 1. Tap on create a new folder
2. Use a name with special characters (e.g $%&¨)| The folder is created with special character | :white_check_mark: basic
:white_check_mark: OAuth2 |
3 | Rename a folder | 1. Create a new folder
2. Rename the folder| Folder is renamed|:white_check_mark: basic
:white_check_mark: OAuth2
4 | Move a folder | 1. Create a new folder
2. Move the folder| Folder is moved to the specifield location |:white_check_mark: basic
:white_check_mark: OAuth2
5 | Upload a file into a folder | 1. Create a new folder
2. Upload a file| File is uploaded into the folder |:white_check_mark: basic
:white_check_mark: OAuth2
6 | Delete a folder | 1. Access to a folder, the folder has deep structure inside
2. Download some files
3. Select delete that folder | 2. The files are downloaded
3. The folder is removed|:white_check_mark: basic
:white_check_mark: OAuth2
7| Copy Folder | 1. Long press to copy a folder
2. Select a location to paste | The folder and all its content is copied in the location, and remains too in the original|:white_check_mark: basic
:white_check_mark: OAuth2
8 | Share the folder by link | 1. Create a new folder
2. Long press to share the folder by link
| The link is generated and works|:white_check_mark: basic
:white_check_mark: OAuth2
9 | Share the folder by link with pass| 1. Create a new folder
2. Long press to share the folder by link
3. Enable the password protection and set a password | The link is generated and only works if the correct password is typed|:white_check_mark: basic
:white_check_mark: OAuth2
10| Unshare the folder by link | 1. Unshare the folder of previous test cases| The link is no more available |:white_check_mark: basic
:white_check_mark: OAuth2
11 | Share the folder with users or groups| 1. Create a new folder
2. Long press to share with users/groups
3. Type one user/group to share with | The user/group can access to the folder|:white_check_mark: basic
:white_check_mark: OAuth2
12| Unshare the folder with users or groups| 1. Unshare the folder in the previous test case | The folder is not more available for the sharees |:white_check_mark: basic
:white_check_mark: OAuth2
13| Sync a folder| 1. Create a folder
2. In web app, upload some files in the folder
3. Long press to sync the folder | The folder is sync with the content on server|:white_check_mark: basic
:white_check_mark: OAuth2
File
TestID | Test Case | Steps | Expected Result | Result | Related Comment
------------ | ------------- | ------------- | -------------- | ----- | ------
1 | Upload a new file | 1. Upload a new file | The file is uploaded | :white_check_mark: basic
:white_check_mark: OAuth2
2 | Upload a file with special character | 1. Upload a new file (e.g f%&¨)| The file is uploaded |:white_check_mark: basic
:white_check_mark: basic
:white_check_mark: OAuth2
3 | Rename a file | 1. Create a new file
2. Rename the file | The file is renamed |:white_check_mark: basic
:white_check_mark: OAuth2
4 | Move a file | 1. Create a new file
2. Move the file | The file is renamed |:white_check_mark: basic
:white_check_mark: OAuth2
5 | Copy a file | 1. Create a new file
2. Copy the file | The file is copied to the selected location |:white_check_mark: basic
:white_check_mark: OAuth2
6 | Delete a file | 1. Create a new file
2. Delete the file | The file is deleted |:white_check_mark: basic
:white_check_mark: OAuth2
7 | Share the file by link | 1. Create a file
2. Long press to share the file by link | The link is generated and works|:white_check_mark: basic
:white_check_mark: OAuth2
8 | Share the file by link with pass| 1. Create a file
2. Long press to share the file by link
3. Set a password| The link is generated and works when the correct pass is typed|:white_check_mark: basic
:white_check_mark: OAuth2
9 | Unshare the file by link | 1. Unshare the file of previous test cases | The link is no more available|:white_check_mark: basic
:white_check_mark: OAuth2
10 | Share the file with users or groups| 1. Create a new file
2. Long press to share with users/groups
3. Type one user/group to share with | The user/group can access to the file|:white_check_mark: basic
:white_check_mark: OAuth2
11| Unshare the file with users or groups| 1. Unshare the file in the previous test case | The file is not more available for the sharees |:white_check_mark: basic
:white_check_mark: OAuth2
12| Download a file| 1. Tap to download a file | The file is downloaded and marked with green arrow|:white_check_mark: basic
:white_check_mark: OAuth2
13| Av Offline file | 1. Long press to set as Av Offline a file | The file is downloaded and set as Av Offline with the yellow arrow |:white_check_mark: basic
:white_check_mark: OAuth2
14| Av Offline file | 1. Long press to unset an Av Offline a Av Offline file | The file has no more the yellow arrow |:white_check_mark: basic
:white_check_mark: OAuth2
jesmrec
on 13 Apr 2018
Last nights automated smoke tests had errors: https://travis-ci.org/owncloud/core/builds/365222767?utm_source=email&utm_medium=notification
All good - they all pass after restarts. "the usual" mix of Travis-SauceLabs intermittent hassles and webdriver timeouts on IE11...
phil-davis
on 13 Apr 2018
Smoke test - FINAL
Previous requirements
Prepare two servers with ssl activated and trusted certificates.
Enable LDAP and external storage apps.
Have a LDAP server ready to be used with owncloud.
Have ready two external storages of your choice SMB, SFTP, Dropbox, Google Drive, FTP, S3, ownCloud, local.
Testing setup
TestID | Test Case | Expected Result | Result | Related Comment
------------ | ------------- | -------------- | ----- | ------
1 | Enable encryption app and encryption default module | Encryption is enabled correctly |
- - [x]
2 | Populate owncloud server with users and groups | Users and groups are correctly created |
- - [x]
3 | Share a folder remotely using federated sharing with admin user of the other server. | folder can be opened in recipient server without problems |
- - [x]
4 | Set up LDAP, as admin check users. log in with a LDAP user, if possible one with an avatar. | Users are loaded. LDAP user logs in without problems. Avatar is shown if it exists. |
- - [x]
5 | Set up two external storages different, disable encryption in one of them.| No errors in this process |
- - [x]
Testing functionality
TestID | Test Case | Expected Result | Result | Related Comment
------------ | ------------- | -------------- | ----- | ------
1 | Share a file using federated sharing from an external unencrypted external storage in server #1 using a LDAP user to the admin user in server #2. | Admin user in server #2 can see the file. |
- - [ ]
2 | Open internet explorer or edge and upload a new avatar for a regular user not LDAP | Interface can be used, avatar is uploaded, check that personal page has a scroll bar and scrolls fine. |
- - [ ]
3 | Upload several files and folders inside external storages, open some. | No problems uploading, files can be downloaded and opened. |
- - [x]
4 | Delete files inside both external storages. Recover some after from the trashbin. | Files are correctly deleted and restored. | :construction: |
5 | Using webdav upload a 100MiB file.| No errors in this process |
- - [x]
patrickjahns
on 19 Apr 2018
- [x] Tested expiration fix that made it post RC4: https://github.com/owncloud/core/pull/31212 @PVince81 works
PVince81
on 19 Apr 2018
- [x] "Using webdav upload a 100MiB file." tested via webui, syncclient and macosxfinder
patrickjahns
on 19 Apr 2018
automated UI tests on 10.0.8 final tarball
- install 10.0.8 final
- copy testing app from git
- enable testing app
- from inside a git clone of stable10 branch run tests against 10.0.8 final on chrome (we need the git clone because the tests live there and we don't want to copy them into the tarball installation)
suites:
- [x] webUIFavorites - 6 scenarios (6 passed)
- [x] webUIFiles - 21 scenarios (21 passed)
- [x] webUIManageQuota - 15 scenarios (15 passed)
- [x] webUIManageUsersGroups - 19 scenarios (19 passed)
- [x] webUIMoveFilesFolders - 11 scenarios (11 passed)
- [x] webUIPersonalSettings - 5 scenarios (5 passed)
- [x] webUIRenameFiles - 18 scenarios (18 passed)
- [x] webUIRenameFolders - 13 scenarios (13 passed)
- [x] webUIRestrictSharing - 7 scenarios (7 passed)
- [x] webUISharingExternal - 15 scenarios (15 passed)
- [x] webUISharingInternalGroups - 6 scenarios (6 passed)
- [x] webUISharingInternalUsers - 15 scenarios (15 passed)
- [x] webUITrashbin - 12 scenarios (12 passed)
- [x] webUIUpload - 18 scenarios (18 passed)
individual-it
on 20 Apr 2018
Smoke tests completed for final - 🎉
patrickjahns
on 20 Apr 2018
This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.
![lock[bot] picture](https://avatars.githubusercontent.com/in/6672?v=4&s=40)
lock[bot]
on 30 Jul 2019
Related issues
dataflake
·
113Comments
Revisor01
·
205Comments
Wikinaut
·
86Comments
ghost
·
78Comments
bcutter
·
61Comments
Most helpful comment
Smoke test iOS [WIP]
Device & iOS version: iPhone 6SPlus v11
Server version: 10.0.8RC1
OAuth2 version: 0.2.2
Login
Test Case | Expected Result | Result | Related Comment
| :------- | :---------------: | :------ | :-----------------: |
Login with one account (HTTPS) | It is possible to access | :white_check_mark: |
Login with one account (HTTP) | It is possible to access | :white_check_mark: |
Login with one account (SHIB Autoprovisioned user)| It is possible to access| |
Login with one account (SHIB SSO user ) | It is posible to access |:white_check_mark: |
Folder
TestID | Test Case | Steps | Expected Result | Result | Related Comment
------------ | ------------- | ----------- | -------------- | ----- | ------
1 | Create a new folder | 1. Tap on create a new folder |The folder is created| :white_check_mark: OAuth
:white_check_mark: basic
|
2 | Create a folder with special character | 1. Tap on create a new folder
2. Use a name with special characters (e.g $%&¨)| The folder is created with special character | :white_check_mark: OAuth
:white_check_mark: basic
|
3 | Rename a folder | 1. Create a new folder
2. Rename the folder| Folder is renamed| :white_check_mark: OAuth
:white_check_mark: basic
4 | Move a folder | 1. Create a new folder
2. Move the folder| Folder is moved to the specifield location | :white_check_mark: OAuth
:white_check_mark: basic
5 | Upload a file into a folder | 1. Create a new folder
2. Upload a file| File is uploaded into the folder | :white_check_mark: OAuth
:white_check_mark: basic
6 | Delete a folder | 1. Access to a folder, the folder has deep structure inside
2. Download some files
3. Select delete that folder | 2. The files are downloaded
3. The folder is removed| :white_check_mark: OAuth
:white_check_mark: basic
7| Copy Folder | 1. Long press to copy a folder
2. Select a location to paste | The folder and all its content is copied in the location, and remains too in the original| NA
8 | Share the folder by link | 1. Create a new folder
2. Long press to share the folder by link
| The link is generated and works| :white_check_mark: OAuth
:white_check_mark: basic
9 | Share the folder by link with pass| 1. Create a new folder
2. Long press to share the folder by link
3. Enable the password protection and set a password | The link is generated and only works if the correct password is typed|:white_check_mark: OAuth
:white_check_mark: basic
10| Unshare the folder by link | 1. Unshare the folder of previous test cases| The link is no more available |:white_check_mark: OAuth
:white_check_mark: basic
11 | Share the folder with users or groups| 1. Create a new folder
2. Long press to share with users/groups
3. Type one user/group to share with | The user/group can access to the folder | :white_check_mark: OAuth
:white_check_mark: basic
12| Unshare the folder with users or groups| 1. Unshare the folder in the previous test case | The folder is not more available for the sharees | :white_check_mark: OAuth
:white_check_mark: basic
File
TestID | Test Case | Steps | Expected Result | Result | Related Comment
------------ | ------------- | ------------- | -------------- | ----- | ------
1 | Upload a new file | 1. Upload a new file | The file is uploaded | :white_check_mark: OAuth
:white_check_mark: basic
2 | Upload a file with special character | 1. Upload a new file (e.g f%&¨)| The file is uploaded | :white_check_mark: OAuth
:white_check_mark: basic
3 | Rename a file | 1. Create a new file
2. Rename the file | The file is renamed |:white_check_mark: OAuth
:white_check_mark: basic
4 | Move a file | 1. Create a new file
2. Move the file | The file is renamed |:white_check_mark: OAuth
:white_check_mark: basic
5 | Copy a file | 1. Create a new file
2. Copy the file | The file is copied to the selected location | NA
6 | Delete a file | 1. Create a new file
2. Delete the file | The file is deleted |:white_check_mark: OAuth
:white_check_mark: basic
7 | Share the file by link | 1. Create a file
2. Long press to share the file by link | The link is generated and works|:white_check_mark: OAuth
:white_check_mark: basic
8 | Share the file by link with pass| 1. Create a file
2. Long press to share the file by link
3. Set a password| The link is generated and works when the correct pass is typed|:white_check_mark: OAuth
:white_check_mark: basic
9 | Unshare the file by link | 1. Unshare the file of previous test cases | The link is no more available|:white_check_mark: OAuth
:white_check_mark: basic
10 | Share the file with users or groups| 1. Create a new file
2. Long press to share with users/groups
3. Type one user/group to share with | The user/group can access to the file | :white_check_mark: OAuth
:white_check_mark: OAuth
:white_check_mark: basic
11| Unshare the file with users or groups| 1. Unshare the file in the previous test case | The file is not more available for the sharees | :white_check_mark: OAuth
:white_check_mark: basic
12| Download a file| 1. Tap to download a file | The file is downloaded and marked with green tick|:white_check_mark: OAuth
:white_check_mark: basic
13| Av Offline file | 1. Long press to set as av offline a file | The file is downloaded and set as av off with the yellow arrow |:white_check_mark: OAuth
:white_check_mark: basic
14| Av Offline file | 1. Long press to set as no av offline a file | The file has no more the yellow arrow | :white_check_mark: OAuth
:white_check_mark: basic