Fastlane-plugin-test_center: Crash when using xcresult output type

Created on 11 Feb 2021 · 14Comments · Source: lyndsey-ferguson/fastlane-plugin-test_center

New Issue Checklist

[x] Updated fastlane-plugin-test_center to the latest version
[x] I read the README.md
[x] I reviewed the example(s) for the action(s) I am using
[x] I have removed any sensitive data such as passwords, authentication tokens, or anything else I do not want to world to see
[x] I have reviewed the Discussions forum to see my question has already been addressed.

Issue Description

multi_scan crashes for me every time if I use xcresult in output_types.

My full command looks like below, however, the same happens even without setting collate_reports and without junit in output_types:

    multi_scan(
                project: "Anonymised.xcodeproj",
                scheme: target.name,
                device: "iPhone 11",
                try_count: 2,
                output_types: "junit,xcresult",
                collate_reports: true,
                testplan: "MultiScanTest"
    )

The error looks like this:

Invalid argument @ rb_file_s_rename - (/AnonymisedPath/Fastlane/test_output/report.xcresult, /AnonymisedPath/fastlane/test_output/report.xcresult/report.xcresult)

I tried also updating Ruby version (from 2.6.5. to 2.7.2) but the error is the same.

Complete output when running fastlane, including the stack trace and command used

Aistes-MBP:Anonymised-app-ios aistes$ bundle exec fastlane Test app:Anonymised --verbose
[✔] 🚀
DEBUG [2021-02-11 19:55:42.14]: Checking if there are any plugins that should be loaded...
DEBUG [2021-02-11 19:55:42.14]: Loading 'fastlane-plugin-test_center' plugin
INFO [2021-02-11 19:55:42.14]: gem 'fastlane-plugin-test_center' is already installed
+-----------------------------+---------+---------------------------------------------+
| Used plugins |
+-----------------------------+---------+---------------------------------------------+
| Plugin | Version | Action |
+-----------------------------+---------+---------------------------------------------+
| fastlane-plugin-test_center | 3.15.2 | suppressed_tests suppress_tests |
| | | tests_from_xcresult |
| | | suppress_tests_from_junit |
| | | tests_from_xctestrun |
| | | quit_core_simulator_service |
| | | collate_test_result_bundles |
| | | tests_from_junit multi_scan |
| | | test_options_from_testplan |
| | | collate_html_reports collate_junit_reports |
| | | collate_json_reports testplans_from_scheme |
| | | collate_xcresults |
+-----------------------------+---------+---------------------------------------------+

DEBUG [2021-02-11 19:55:42.98]: Using app: Anonymised
INFO [2021-02-11 19:55:42.99]: gem 'parallel' is already installed
INFO [2021-02-11 19:55:42.99]: ------------------------------
INFO [2021-02-11 19:55:42.99]: --- Step: default_platform ---
INFO [2021-02-11 19:55:42.99]: ------------------------------
INFO [2021-02-11 19:55:42.99]: gem 'xcodeproj' is already installed
INFO [2021-02-11 19:55:43.12]: Driving the lane 'ios Test' 🚀
INFO [2021-02-11 19:55:43.12]: ----------------------------------
INFO [2021-02-11 19:55:43.12]: --- Step: rm -rf "test_output" ---
INFO [2021-02-11 19:55:43.12]: ----------------------------------
INFO [2021-02-11 19:55:43.12]: $ rm -rf "test_output"
INFO [2021-02-11 19:55:43.14]: ------------------------
INFO [2021-02-11 19:55:43.14]: --- Step: multi_scan ---
INFO [2021-02-11 19:55:43.14]: ------------------------

+-----------------------+----------------------+
| Summary for multi_scan (test_center v3.15.2) |
+-----------------------+----------------------+
| try_count | 2 |
+-----------------------+----------------------+

ERROR [2021-02-11 19:55:43.17]: Using deprecated option: '--custom_report_file_name' (Use --output_files instead)
DEBUG [2021-02-11 19:55:43.17]: Building the project in preparation for multi_scan testing
ERROR [2021-02-11 19:55:43.18]: Using deprecated option: '--custom_report_file_name' (Use --output_files instead)
WARN [2021-02-11 19:55:43.18]: Resolving Swift Package Manager dependencies...
INFO [2021-02-11 19:55:43.18]: $ xcodebuild -resolvePackageDependencies -scheme Anonymised -project Anonymised.xcodeproj
INFO [2021-02-11 19:55:43.81]: ▸ Command line invocation:
INFO [2021-02-11 19:55:43.81]: ▸ /Applications/Xcode.app/Contents/Developer/usr/bin/xcodebuild -resolvePackageDependencies -scheme Anonymised -project Anonymised.xcodeproj
INFO [2021-02-11 19:55:45.41]: ▸ Resolve Package Graph
INFO [2021-02-11 19:56:01.98]: ▸ Resolve Package Graph
INFO [2021-02-11 19:56:08.79]: ▸ Resolved source packages:
INFO [2021-02-11 19:56:08.79]: ▸ SlideOutable: [email protected]:trafi/SlideOutable.git @ 0.2.3
INFO [2021-02-11 19:56:08.79]: ▸ Facebook: [email protected]:facebook/facebook-ios-sdk.git @ 7.1.1
INFO [2021-02-11 19:56:08.79]: ▸ RatingSlider: [email protected]:trafi/RatingSlider.git @ 0.4.2
INFO [2021-02-11 19:56:08.79]: ▸ NimbleFeedback: [email protected]:trafi/nimble-feedback @ master
INFO [2021-02-11 19:56:08.79]: ▸ Promises: https://github.com/google/promises.git @ 1.2.12
INFO [2021-02-11 19:56:08.79]: ▸ nanopb: https://github.com/firebase/nanopb.git @ 2.30906.0
INFO [2021-02-11 19:56:08.79]: ▸ gRPC: https://github.com/firebase/grpc-SwiftPM.git @ 1.28.2
INFO [2021-02-11 19:56:08.79]: ▸ CwlPreconditionTesting: https://github.com/mattgallagher/CwlPreconditionTesting.git @ 2.0.0
INFO [2021-02-11 19:56:08.79]: ▸ API: [email protected]:trafi/trafi-api-ios.git @ develop
INFO [2021-02-11 19:56:08.79]: ▸ StoryFlow: [email protected]:trafi/StoryFlow.git @ 1.5.5
INFO [2021-02-11 19:56:08.79]: ▸ CwlCatchException: https://github.com/mattgallagher/CwlCatchException.git @ 2.0.0
INFO [2021-02-11 19:56:08.79]: ▸ Bugsnag: [email protected]:bugsnag/bugsnag-cocoa.git @ 6.5.0
INFO [2021-02-11 19:56:08.79]: ▸ Veriff: [email protected]:Veriff/veriff-ios-spm.git @ 4.3.0
INFO [2021-02-11 19:56:08.79]: ▸ BoringSSL-GRPC: https://github.com/firebase/boringssl-SwiftPM.git @ 0.0.7
INFO [2021-02-11 19:56:08.79]: ▸ leveldb: https://github.com/firebase/leveldb.git @ 1.22.1
INFO [2021-02-11 19:56:08.79]: ▸ abseil: https://github.com/firebase/abseil-cpp-SwiftPM.git @ 0.20200225.0
INFO [2021-02-11 19:56:08.79]: ▸ TextStyle: [email protected]:trafi/TextStyle.git @ 0.6.1
INFO [2021-02-11 19:56:08.79]: ▸ Resources: [email protected]:trafi/trafi-resources-ios.git @ develop
INFO [2021-02-11 19:56:08.79]: ▸ Firebase: [email protected]:firebase/firebase-ios-sdk.git @ 7.3.1
INFO [2021-02-11 19:56:08.79]: ▸ ImageMod: [email protected]:trafi/ImageMod.git @ 0.2.0
INFO [2021-02-11 19:56:08.79]: ▸ KeychainAccess: [email protected]:kishikawakatsumi/KeychainAccess.git @ 3.2.1
INFO [2021-02-11 19:56:08.79]: ▸ Nimble: [email protected]:quick/nimble.git @ 9.0.0
INFO [2021-02-11 19:56:08.79]: ▸ LayoutKit: [email protected]:trafi/LayoutKit.git @ 10.2.0
INFO [2021-02-11 19:56:08.79]: ▸ Quick: [email protected]:quick/quick @ 3.0.0
INFO [2021-02-11 19:56:08.79]: ▸ RxSwift: [email protected]:ReactiveX/RxSwift.git @ 5.1.1
INFO [2021-02-11 19:56:08.79]: ▸ mParticle-Apple-SDK: [email protected]:mParticle/mparticle-apple-sdk.git @ 8.1.3
INFO [2021-02-11 19:56:08.79]: ▸ RxFeedback: [email protected]:NoTests/RxFeedback.git @ 3.0.0
INFO [2021-02-11 19:56:08.79]: ▸ GTMSessionFetcher: https://github.com/google/gtm-session-fetcher.git @ 1.5.0
INFO [2021-02-11 19:56:08.81]: ▸ resolved source packages: SlideOutable, Facebook, RatingSlider, NimbleFeedback, Promises, nanopb, gRPC, CwlPreconditionTesting, API, StoryFlow, CwlCatchException, Bugsnag, Veriff, BoringSSL-GRPC, leveldb, abseil, TextStyle, Resources, Firebase, ImageMod, KeychainAccess, Nimble, LayoutKit, Quick, RxSwift, mParticle-Apple-SDK, RxFeedback, GTMSessionFetcher
INFO [2021-02-11 19:56:08.84]: $ xcodebuild -showBuildSettings -scheme Anonymised -project Anonymised.xcodeproj
DEBUG [2021-02-11 19:56:25.74]: Fetching available simulator devices
DEBUG [2021-02-11 19:56:26.02]: Detected derived data path '/Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq'

DEBUG [2021-02-11 19:56:26.03]: Before building, removing pre-existing xctestrun files: ["/Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq/Build/Products/Anonymised_Anonymised Prod Smoke Tests (DE)_iphonesimulator14.2-x86_64.xctestrun", "/Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq/Build/Products/Anonymised_Anonymised E2E Smoke Tests (EN)_iphonesimulator14.2-x86_64.xctestrun", "/Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq/Build/Products/Anonymised_Anonymised E2E Smoke Tests (DE)_iphonesimulator14.2-x86_64.xctestrun", "/Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq/Build/Products/Anonymised_MultiScanTest_iphonesimulator14.2-x86_64.xctestrun"]
DEBUG [2021-02-11 19:56:26.03]: Fetching available simulator devices
INFO [2021-02-11 19:56:26.30]: Disabling 'Slide to Type' iPhone 11
INFO [2021-02-11 19:56:26.30]: $ /usr/libexec/PlistBuddy -c "Add :KeyboardContinuousPathEnabled bool false" /Users/aistes/Library/Developer/CoreSimulator/Devices/701116F7-41F1-4204-A59B-AB2DA73BDCEA/data/Library/Preferences/com.apple.keyboard.ContinuousPath.plist >/dev/null 2>&1
INFO [2021-02-11 19:56:26.32]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -scheme Anonymised -project Anonymised.xcodeproj -derivedDataPath /Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq -destination 'platform=iOS Simulator,id=701116F7-41F1-4204-A59B-AB2DA73BDCEA' build-for-testing | tee '/Users/aistes/Library/Logs/scan/Jelbi-Anonymised.log' | xcpretty --report junit --output '/Users/aistes/Anonymised-app-ios/fastlane/test_output/report.junit' --report junit --output '/var/folders/1y/vn6grmgx1dl74ly29rsgc6yh0000gn/T/junit_report20210211-75338-z7t2dh'
INFO [2021-02-11 19:56:26.32]: ▸ Loading...
INFO [2021-02-11 19:57:05.26]: ▸ Running script 'Copy GoogleService-Info.plist'
INFO [2021-02-11 19:57:05.34]: ▸ The iOS Simulator deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 8.0, but the range of supported deployment target versions is 9.0 to 14.2.99. (in target 'RxCocoa' from project 'RxSwift')
INFO [2021-02-11 19:57:05.34]: ▸ The iOS Simulator deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 8.0, but the range of supported deployment target versions is 9.0 to 14.2.99. (in target 'RxCocoa' from project 'RxSwift')
INFO [2021-02-11 19:57:05.34]: ▸ The iOS Simulator deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 8.0, but the range of supported deployment target versions is 9.0 to 14.2.99. (in target 'RxSwift' from project 'RxSwift')
INFO [2021-02-11 19:57:05.42]: ▸ The iOS Simulator deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 8.0, but the range of supported deployment target versions is 9.0 to 14.2.99. (in target 'RxRelay' from project 'RxSwift')
INFO [2021-02-11 19:57:05.42]: ▸ The iOS Simulator deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 8.0, but the range of supported deployment target versions is 9.0 to 14.2.99. (in target 'RxCocoaRuntime' from project 'RxSwift')
INFO [2021-02-11 19:57:05.42]: ▸ The iOS Simulator deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 8.0, but the range of supported deployment target versions is 9.0 to 14.2.99. (in target 'RxSwift' from project 'RxSwift')
INFO [2021-02-11 19:57:05.42]: ▸ The iOS Simulator deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 8.0, but the range of supported deployment target versions is 9.0 to 14.2.99. (in target 'KeychainAccess' from project 'KeychainAccess')
INFO [2021-02-11 19:57:05.52]: ▸ The iOS Simulator deployment target 'IPHONEOS_DEPLOYMENT_TARGET' is set to 8.0, but the range of supported deployment target versions is 9.0 to 14.2.99. (in target 'KeychainAccess' from project 'KeychainAccess')
INFO [2021-02-11 19:57:05.52]: ▸ Test build Succeeded
+--------------------+---+
| Test Results |
+--------------------+---+
| Number of tests | 0 |
| Number of failures | 0 |
+--------------------+---+

DEBUG [2021-02-11 19:57:05.56]: After building, found xctestrun files ["/Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq/Build/Products/Anonymised_MultiScanTest_iphonesimulator14.2-x86_64.xctestrun"] (choosing 1st)
DEBUG [2021-02-11 19:57:05.56]: Removing report files generated by the build
DEBUG [2021-02-11 19:57:05.56]: ./fastlane/test_output/report.junit
DEBUG [2021-02-11 19:57:05.56]: Looking in Scheme 'Anonymised.xcodeproj/xcshareddata/xcschemes/Anonymised.xcscheme' for any testplans
DEBUG [2021-02-11 19:57:05.58]: found testplan '/Users/aistes/Anonymised-app-ios/UITests/TestPlans/Anonymised E2E Smoke Tests (EN).xctestplan'
DEBUG [2021-02-11 19:57:05.58]: found testplan '/Users/aistes/Anonymised-app-ios/UITests/TestPlans/Anonymised E2E Smoke Tests (DE).xctestplan'
DEBUG [2021-02-11 19:57:05.58]: found testplan '/Users/aistes/Anonymised-app-ios/UITests/TestPlans/Anonymised Prod Smoke Tests (DE).xctestplan'
DEBUG [2021-02-11 19:57:05.58]: found testplan '/Users/aistes/Anonymised-app-ios/UITests/TestPlans/MultiScanTest.xctestplan'
DEBUG [2021-02-11 19:57:05.58]: TestCollector found testplans: ["/Users/aistes/Anonymised-app-ios/UITests/TestPlans/Anonymised E2E Smoke Tests (EN).xctestplan", "/Users/aistes/Anonymised-app-ios/UITests/TestPlans/Anonymised E2E Smoke Tests (DE).xctestplan", "/Users/aistes/Anonymised-app-ios/UITests/TestPlans/Anonymised Prod Smoke Tests (DE).xctestplan", "/Users/aistes/Anonymised-app-ios/UITests/TestPlans/MultiScanTest.xctestplan"]
DEBUG [2021-02-11 19:57:05.58]: using :testplan option, MultiScanTest, using found one: /Users/aistes/Anonymised-app-ios/UITests/TestPlans/MultiScanTest.xctestplan
DEBUG [2021-02-11 19:57:05.58]: Examining testplan JSON: {"configurations"=>[{"id"=>"56568E2D-9A24-48FB-8199-88381B4DC66F", "name"=>"Configuration 1", "options"=>{}}], "defaultOptions"=>{"codeCoverage"=>false, "commandLineArgumentEntries"=>[{"argument"=>"-de"}], "environmentVariableEntries"=>[{"key"=>"rollout_id", "value"=>"Anonymised"}], "language"=>"de", "locationScenario"=>{"identifier"=>"../../Rollouts/Anonymised/Supporting Files/Berlin.gpx"}, "region"=>"DE", "targetForVariableExpansion"=>{"containerPath"=>"container:Anonymised.xcodeproj", "identifier"=>"D3739DDD2189FD7A00E2C2BB", "name"=>"Anonymised"}}, "testTargets"=>[{"skippedTests"=>[AnonymisedList], "target"=>{"containerPath"=>"container:Anonymised.xcodeproj", "identifier"=>"080C715D22B7A59E002C90C0", "name"=>"UITests"}}], "version"=>1}
DEBUG [2021-02-11 19:57:05.58]: No selected tests, using testable 'UITests'
DEBUG [2021-02-11 19:57:05.58]: Getting tests from xctestrun file at '/Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq/Build/Products/Anonymised_MultiScanTest_iphonesimulator14.2-x86_64.xctestrun'
DEBUG [2021-02-11 19:57:05.74]: Found the following tests: AnonymisedList
DEBUG [2021-02-11 19:57:05.74]: Removing skipped tests: AnonymisedListOfTests
DEBUG [2021-02-11 19:57:05.74]: Identifiers after removing skipped tests: TestObserver/testCaseDidFinish
TestObserver/testBundleWillStart
DiscoverTests/test_checkDisks
LocalizationsHelper/testingTerms
DEBUG [2021-02-11 19:57:05.74]: > setup_logcollection
DEBUG [2021-02-11 19:57:05.74]: < done in TestCenter::Helper::MultiScanManager.initialize
INFO [2021-02-11 19:57:05.89]: Testing batches for device 'iPhone 11'
INFO [2021-02-11 19:57:05.89]: Starting test run 1
DEBUG [2021-02-11 19:57:05.89]: Restarting Simulator 701116F7-41F1-4204-A59B-AB2DA73BDCEA
DEBUG [2021-02-11 19:57:12.70]: retrying_scan #update_scan_options
DEBUG [2021-02-11 19:57:12.70]: Setting project to Anonymised.xcodeproj
DEBUG [2021-02-11 19:57:12.70]: Setting scheme to Anonymised
DEBUG [2021-02-11 19:57:12.70]: Setting output_types to junit
DEBUG [2021-02-11 19:57:12.70]: Setting skip_detect_devices to false
DEBUG [2021-02-11 19:57:12.70]: Setting reset_simulator to false
DEBUG [2021-02-11 19:57:12.70]: Setting disable_slide_to_type to true
DEBUG [2021-02-11 19:57:12.70]: Setting reinstall_app to false
DEBUG [2021-02-11 19:57:12.71]: Setting only_testing to ["UITests/TestObserver/testCaseDidFinish", "UITests/TestObserver/testBundleWillStart", "UITests/DiscoverTests/test_checkDisks", "UITests/LocalizationsHelper/testingTerms"]
DEBUG [2021-02-11 19:57:12.71]: Setting xctestrun to /Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq/Build/Products/Anonymised_MultiScanTest_iphonesimulator14.2-x86_64.xctestrun
DEBUG [2021-02-11 19:57:12.71]: Setting clean to false
DEBUG [2021-02-11 19:57:12.71]: Setting open_report to false
DEBUG [2021-02-11 19:57:12.71]: Setting output_directory to /Users/aistes/Anonymised-app-ios/fastlane/test_output
DEBUG [2021-02-11 19:57:12.71]: Setting output_files to report.junit
DEBUG [2021-02-11 19:57:12.71]: Setting buildlog_path to ~/Library/Logs/scan
DEBUG [2021-02-11 19:57:12.71]: Setting include_simulator_logs to false
DEBUG [2021-02-11 19:57:12.71]: Setting derived_data_path to /Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq
DEBUG [2021-02-11 19:57:12.71]: Setting should_zip_build_products to false
DEBUG [2021-02-11 19:57:12.71]: Setting result_bundle to false
DEBUG [2021-02-11 19:57:12.71]: Setting use_clang_report_name to false
DEBUG [2021-02-11 19:57:12.71]: Setting disable_concurrent_testing to true
DEBUG [2021-02-11 19:57:12.71]: Setting build_for_testing to false
DEBUG [2021-02-11 19:57:12.71]: Setting xcargs to -parallel-testing-enabled NO -resultBundlePath '/Users/aistes/Anonymised-app-ios/fastlane/test_output/report.xcresult'
DEBUG [2021-02-11 19:57:12.71]: Setting slack_use_webhook_configured_username_and_icon to false
DEBUG [2021-02-11 19:57:12.71]: Setting slack_username to fastlane
DEBUG [2021-02-11 19:57:12.71]: Setting slack_icon_url to https://fastlane.tools/assets/img/fastlane_icon.png
DEBUG [2021-02-11 19:57:12.71]: Setting skip_slack to false
DEBUG [2021-02-11 19:57:12.71]: Setting slack_only_on_failure to false
DEBUG [2021-02-11 19:57:12.71]: Setting destination to ["platform=iOS Simulator,id=701116F7-41F1-4204-A59B-AB2DA73BDCEA"]
DEBUG [2021-02-11 19:57:12.71]: Setting xcodebuild_command to env NSUnbufferedIO=YES xcodebuild
DEBUG [2021-02-11 19:57:12.71]: Setting skip_package_dependencies_resolution to false
DEBUG [2021-02-11 19:57:12.71]: Setting disable_package_automatic_updates to false
DEBUG [2021-02-11 19:57:12.71]: Setting use_system_scm to false
DEBUG [2021-02-11 19:57:12.71]: Setting fail_build to true
DEBUG [2021-02-11 19:57:12.71]: Setting skip_build to false

INFO [2021-02-11 19:57:12.76]: Starting scan #1 with 4 tests.
DEBUG [2021-02-11 19:57:12.76]: Fetching available simulator devices
INFO [2021-02-11 19:57:14.40]: Disabling 'Slide to Type' iPhone 11
INFO [2021-02-11 19:57:14.40]: $ /usr/libexec/PlistBuddy -c "Add :KeyboardContinuousPathEnabled bool false" /Users/aistes/Library/Developer/CoreSimulator/Devices/701116F7-41F1-4204-A59B-AB2DA73BDCEA/data/Library/Preferences/com.apple.keyboard.ContinuousPath.plist >/dev/null 2>&1
INFO [2021-02-11 19:57:14.43]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -destination 'platform=iOS Simulator,id=701116F7-41F1-4204-A59B-AB2DA73BDCEA' -derivedDataPath /Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq -disable-concurrent-testing -xctestrun '/Users/aistes/Library/Developer/Xcode/DerivedData/Anonymised-atlknlvdgipgvdeoheakdnjqklkq/Build/Products/Anonymised_MultiScanTest_iphonesimulator14.2-x86_64.xctestrun' -parallel-testing-enabled NO -resultBundlePath '/Users/aistes/Anonymised-app-ios/fastlane/test_output/report.xcresult' -only-testing:UITests/TestObserver/testCaseDidFinish -only-testing:UITests/TestObserver/testBundleWillStart -only-testing:UITests/DiscoverTests/test_checkDisks -only-testing:UITests/LocalizationsHelper/testingTerms test-without-building | tee '/Users/aistes/Library/Logs/scan/Jelbi-Anonymised.log' | xcpretty --report junit --output '/Users/aistes/Anonymised-app-ios/fastlane/test_output/report.junit' --report junit --output '/var/folders/1y/vn6grmgx1dl74ly29rsgc6yh0000gn/T/junit_report20210211-75338-65eeg7'
INFO [2021-02-11 19:57:14.43]: ▸ Loading...
INFO [2021-02-11 19:57:16.46]: ▸ 2021-02-11 19:57:16.468 xcodebuild[76181:1738420] IDETestOperationsObserverDebug: Writing diagnostic log for test session to:
INFO [2021-02-11 19:57:16.46]: ▸ /Users/aistes/Anonymised-app-ios/fastlane/test_output/report.xcresult/Staging/1_Test/Diagnostics/UITests-5F74931F-F343-424B-995F-4944822796AE/UITests-0E92DBC5-1214-4A54-8EF2-A82F13A90CB9/Session-UITests-2021-02-11_195716-P4jn9Z.log
INFO [2021-02-11 19:57:16.47]: ▸ 2021-02-11 19:57:16.471 xcodebuild[76181:1738219] [MT] IDETestOperationsObserverDebug: (F92C85B4-BD73-4FF6-BC35-4C9A65ECC30A) Beginning test session UITests-F92C85B4-BD73-4FF6-BC35-4C9A65ECC30A at 2021-02-11 19:57:16.470 with Xcode 12B45b on target {
INFO [2021-02-11 19:57:16.47]: ▸ SimDevice: iPhone 11 (701116F7-41F1-4204-A59B-AB2DA73BDCEA, iOS 14.2, Booted)
INFO [2021-02-11 19:57:16.47]: ▸ } (14.2 (18B79))
INFO [2021-02-11 19:57:20.16]: ▸ 2021-02-11 19:57:20.161 xcodebuild[76181:1738219] [MT] IDETestOperationsObserverDebug: (F92C85B4-BD73-4FF6-BC35-4C9A65ECC30A) Finished requesting crash reports. Continuing with testing.
INFO [2021-02-11 19:57:22.10]: ▸ Selected tests
INFO [2021-02-11 19:57:22.10]: ▸ Test Suite UITests.xctest started
INFO [2021-02-11 19:57:22.10]: ▸ DiscoverTests
INFO [2021-02-11 19:57:29.68]: ▸ ✓ test_checkDisks (7.573 seconds)
INFO [2021-02-11 19:57:29.68]: ▸ [32;1m Executed 1 test, with 0 failures (0 unexpected) in 7.573 (7.575) seconds
INFO [2021-02-11 19:57:29.68]: ▸ [0m
INFO [2021-02-11 19:57:29.94]: ▸ 2021-02-11 19:57:29.948 xcodebuild[76181:1738219] [MT] IDETestOperationsObserverDebug: 13.587 elapsed -- Testing started completed.
INFO [2021-02-11 19:57:29.94]: ▸ 2021-02-11 19:57:29.948 xcodebuild[76181:1738219] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start
INFO [2021-02-11 19:57:29.94]: ▸ 2021-02-11 19:57:29.948 xcodebuild[76181:1738219] [MT] IDETestOperationsObserverDebug: 13.587 sec, +13.587 sec -- end
INFO [2021-02-11 19:57:29.95]: ▸ Test execute Succeeded
+--------------------+---+
| Test Results |
+--------------------+---+
| Number of tests | 1 |
| Number of failures | 0 |
+--------------------+---+

DEBUG [2021-02-11 19:57:30.02]: Batch # incrementing retry count to 1
DEBUG [2021-02-11 19:57:30.02]: Scan passed the tests
DEBUG [2021-02-11 19:57:30.02]: ReportCollator collating
DEBUG [2021-02-11 19:57:30.02]: Copying xcresult bundle from /Users/aistes/Anonymised-app-ios/Fastlane/test_output/report.xcresult to /Users/aistes/Anonymised-app-ios/fastlane/test_output/report.xcresult
WARN [2021-02-11 19:57:30.02]: Lane Context:
INFO [2021-02-11 19:57:30.02]: {:DEFAULT_PLATFORM=>:ios, :PLATFORM_NAME=>:ios, :LANE_NAME=>"ios Test"}
ERROR [2021-02-11 19:57:30.02]: Invalid argument @ rb_file_s_rename - (/Users/aistes/Anonymised-app-ios/Fastlane/test_output/report.xcresult, /Users/aistes/Anonymised-app-ios/fastlane/test_output/report.xcresult/report.xcresult)
INFO [2021-02-11 19:57:30.02]: Successfully generated documentation at path '/Users/aistes/Anonymised-app-ios/fastlane/README.md'

+------+----------------------+-------------+
| fastlane summary |
+------+----------------------+-------------+
| Step | Action | Time (in s) |
+------+----------------------+-------------+
| 1 | default_platform | 0 |
| 2 | rm -rf "test_output" | 0 |
| 💥 | multi_scan | 106 |
+------+----------------------+-------------+

DEBUG [2021-02-11 19:57:30.03]: All plugins are up to date
ERROR [2021-02-11 19:57:30.03]: fastlane finished with errors

Looking for related GitHub issues on fastlane/fastlane...
Search query: Invalid argument @ rb_file_s_rename - (/Users/aistes/Anonymised-app-ios/Fastlane/test_output/report.xcresult, /Users/aistes/Anonymised-app-ios/fastlane/test_output/report.xcresult/report.xcresult)

URL: https://api.github.com/search/issues?q=Invalid%20argument%20%40%20rb_file_s_rename%20-%20%28%2FUsers%2Faistes%2FAnonymised-app-ios%2FFastlane%2Ftest_output%2Freport.xcresult%2C%20%2FUsers%2Faistes%2FAnonymised-app-ios%2Ffastlane%2Ftest_output%2Freport.xcresult%2Freport.xcresult%29+repo:fastlane/fastlane
Found no similar issues. To create a new issue, please visit:
https://github.com/fastlane/fastlane/issues/new
Run fastlane env to append the fastlane environment to your issue
DEBUG [2021-02-11 19:57:30.29]: All plugins are up to date
bundler: failed to load command: fastlane (/Users/aistes/.rbenv/versions/2.7.2/bin/fastlane)
Errno::EINVAL: [!] Invalid argument @ rb_file_s_rename - (/Users/aistes/Anonymised-app-ios/Fastlane/test_output/report.xcresult, /Users/aistes/Anonymised-app-ios/fastlane/test_output/report.xcresult/report.xcresult)
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/2.7.0/fileutils.rb:548:in rename' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/2.7.0/fileutils.rb:548:inblock in mv'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/2.7.0/fileutils.rb:1589:in block in fu_each_src_dest' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/2.7.0/fileutils.rb:1603:infu_each_src_dest0'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/2.7.0/fileutils.rb:1587:in fu_each_src_dest' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/2.7.0/fileutils.rb:539:inmv'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/report_collator.rb:167:in collate_xcresult_bundles' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/report_collator.rb:32:incollate'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan_helper.rb:237:in collate_reports' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan_helper.rb:218:inafter_testrun'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan.rb:21:in run' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan.rb:12:inrun'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/test_batch_worker.rb:18:in run' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:249:inblock in run_test_batches'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:246:in each' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:246:ineach_with_index'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:246:in run_test_batches' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:110:inblock in run'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:137:in block in setup_run_tests_for_each_device' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:126:ineach'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:126:in each_with_index' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:126:insetup_run_tests_for_each_device'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:108:in run' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-plugin-test_center-3.15.2/lib/fastlane/plugin/test_center/actions/multi_scan.rb:38:inrun'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/runner.rb:263:in block (2 levels) in execute_action' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/actions/actions_helper.rb:69:inexecute_action'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/runner.rb:255:in block in execute_action' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/runner.rb:229:inchdir'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/runner.rb:229:in execute_action' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/runner.rb:157:intrigger_action_by_name'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/fast_file.rb:159:in method_missing' ../fastlane/Fastfile:129:inblock (3 levels) in parsing_binding'
../fastlane/Fastfile:113:in each' ../fastlane/Fastfile:113:inblock (2 levels) in parsing_binding'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/lane.rb:33:in call' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/runner.rb:49:inblock in execute'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/runner.rb:45:in chdir' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/runner.rb:45:inexecute'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/lane_manager.rb:47:in cruise_lane' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/command_line_handler.rb:36:inhandle'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/commands_generator.rb:108:in block (2 levels) in run' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:178:incall'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:153:in run' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/commander-fastlane-4.4.6/lib/commander/runner.rb:476:inrun_active_command'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane_core/lib/fastlane_core/ui/fastlane_runner.rb:76:in run!' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/commander-fastlane-4.4.6/lib/commander/delegates.rb:15:inrun!'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/commands_generator.rb:352:in run' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/commands_generator.rb:41:instart'
/Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/fastlane/lib/fastlane/cli_tools_distributor.rb:122:in take_off' /Users/aistes/.rbenv/versions/2.7.2/lib/ruby/gems/2.7.0/gems/fastlane-2.174.0/bin/fastlane:23:in /Users/aistes/.rbenv/versions/2.7.2/bin/fastlane:23:in load' /Users/aistes/.rbenv/versions/2.7.2/bin/fastlane:23:in

Environment

🚫 fastlane environment 🚫


Stack

| Key                         | Value                                       |

| --------------------------- | ------------------------------------------- |

| OS                          | 11.2                                        |

| Ruby                        | 2.7.2                                       |

| Bundler?                    | true                                        |

| Git                         | git version 2.24.3 (Apple Git-128)          |

| Installation Source         | ~/.rbenv/versions/2.7.2/bin/fastlane        |

| Host                        | macOS 11.2 (20D64)                          |

| Ruby Lib Dir                | ~/.rbenv/versions/2.7.2/lib                 |

| OpenSSL Version             | OpenSSL 1.1.1g  21 Apr 2020                 |

| Is contained                | false                                       |

| Is homebrew                 | false                                       |

| Is installed via Fabric.app | false                                       |

| Xcode Path                  | /Applications/Xcode.app/Contents/Developer/ |

| Xcode Version               | 12.2                                        |

System Locale

| Error                       |

| --------------------------- |

| No Locale with UTF8 found 🚫 |

fastlane files:

./fastlane/Fastfile


...

    ###########
    # TESTING #
    ###########

    lane :Test do |options|
        targets(options).each do |target|
            # Clean up
            sh 'rm -rf "test_output"'
            #Test
            multi_scan(
                project: "Anonymised.xcodeproj",
                scheme: target.name,
                device: "iPhone 11",
                try_count: 2,
                output_types: "junit,xcresult",
                #xcargs: "configuration='Prod UITest'",
                testplan: "MultiScanTest"
            )
            # Generate report
            #sh 'xchtmlreport -r "test_output/TestResults.xcresult"'
        end
    end

...





No Appfile found

fastlane gems

| Gem      | Version | Update-Status |

| -------- | ------- | ------------- |

| fastlane | 2.174.0 | ✅ Up-To-Date  |

Loaded fastlane plugins:

| Plugin                      | Version | Update-Status |

| --------------------------- | ------- | ------------- |

| fastlane-plugin-test_center | 3.15.2  | ✅ Up-To-Date  |

Loaded gems


| Gem                           | Version      |

| ----------------------------- | ------------ |

| did_you_mean                  | 1.4.0        |

| bundler                       | 2.1.4        |

| uri                           | 0.10.0       |

| rake                          | 13.0.3       |

| CFPropertyList                | 3.0.3        |

| public_suffix                 | 4.0.6        |

| addressable                   | 2.7.0        |

| artifactory                   | 3.0.15       |

| atomos                        | 0.1.3        |

| aws-eventstream               | 1.1.0        |

| aws-partitions                | 1.426.0      |

| aws-sigv4                     | 1.2.2        |

| jmespath                      | 1.4.0        |

| aws-sdk-core                  | 3.112.0      |

| aws-sdk-kms                   | 1.42.0       |

| aws-sdk-s3                    | 1.88.0       |

| babosa                        | 1.0.4        |

| claide                        | 1.0.3        |

| colored                       | 1.2          |

| colored2                      | 3.1.2        |

| colorize                      | 0.8.1        |

| highline                      | 1.7.10       |

| commander-fastlane            | 4.4.6        |

| declarative                   | 0.0.20       |

| declarative-option            | 0.1.0        |

| digest-crc                    | 0.6.3        |

| unf_ext                       | 0.0.7.7      |

| unf                           | 0.1.4        |

| domain_name                   | 0.5.20190701 |

| dotenv                        | 2.7.6        |

| emoji_regex                   | 3.2.1        |

| excon                         | 0.79.0       |

| faraday-net_http              | 1.0.1        |

| multipart-post                | 2.0.0        |

| ruby2_keywords                | 0.0.4        |

| faraday                       | 1.3.0        |

| http-cookie                   | 1.0.3        |

| faraday-cookie_jar            | 0.0.7        |

| faraday_middleware            | 1.0.0        |

| fastimage                     | 2.2.2        |

| gh_inspector                  | 1.1.3        |

| jwt                           | 2.2.2        |

| memoist                       | 0.16.2       |

| multi_json                    | 1.15.0       |

| os                            | 1.1.1        |

| signet                        | 0.14.1       |

| googleauth                    | 0.15.1       |

| httpclient                    | 2.8.3        |

| mini_mime                     | 1.0.2        |

| uber                          | 0.1.0        |

| representable                 | 3.0.4        |

| retriable                     | 3.1.2        |

| google-api-client             | 0.38.0       |

| rexml                         | 3.2.4        |

| webrick                       | 1.7.0        |

| google-apis-core              | 0.2.1        |

| google-apis-iamcredentials_v1 | 0.1.0        |

| google-apis-storage_v1        | 0.2.0        |

| google-cloud-env              | 1.4.0        |

| google-cloud-errors           | 1.0.1        |

| google-cloud-core             | 1.5.0        |

| google-cloud-storage          | 1.30.0       |

| json                          | 2.5.1        |

| mini_magick                   | 4.11.0       |

| plist                         | 3.6.0        |

| rubyzip                       | 2.3.0        |

| security                      | 0.1.3        |

| naturally                     | 2.2.1        |

| simctl                        | 1.6.8        |

| slack-notifier                | 2.3.2        |

| terminal-notifier             | 2.0.0        |

| unicode-display_width         | 1.7.0        |

| terminal-table                | 1.8.0        |

| tty-screen                    | 0.8.1        |

| tty-cursor                    | 0.7.1        |

| tty-spinner                   | 0.9.3        |

| word_wrap                     | 1.0.0        |

| nanaimo                       | 0.3.0        |

| xcodeproj                     | 1.19.0       |

| rouge                         | 2.0.7        |

| xcpretty                      | 0.3.0        |

| xcpretty-travis-formatter     | 1.0.1        |

| trainer                       | 0.9.1        |

| xctest_list                   | 1.2.1        |

| fastlane-plugin-test_center   | 3.15.2       |

| parallel                      | 1.19.1       |



generated on: 2021-02-11

♻️ multi_scan 🐞bug

Source

aistetests

Most helpful comment

Good news! I have been able to spend some time on this issue this morning.
More good news! I have a clue of what the problem is. Take a look at this:

Copying xcresult bundle from /Users/aistes/Anonymised-app-ios/Fastlane/test_output/report.xcresult to /Users/aistes/Anonymised-app-ios/fastlane/test_output/report.xcresult

Do you notice any difference between the source and destination file path? No? Well the check to see if the paths are the same does see the difference:

File.realdirpath(test_xcresult_bundlepaths.first) != File.realdirpath(collated_xcresult_bundlepath)

But Mac OS does not: the F in fastlane is capitalized in the source path, yet Mac treats them as the same path.

I'm out of time for today, but hopefully this week I can make an improvement to this file path check for equivalency.

lyndsey-ferguson on 2 Mar 2021

❤2

All 14 comments

bump 😭

absimas on 1 Mar 2021

I don't have a lot of time to look into issues right now. You can see the list of priorities in the project.

If you're open to investigating, I can review and test pull requests that fix issues or add features.

lyndsey-ferguson on 1 Mar 2021

Good news! I have been able to spend some time on this issue this morning.
More good news! I have a clue of what the problem is. Take a look at this:

Copying xcresult bundle from /Users/aistes/Anonymised-app-ios/Fastlane/test_output/report.xcresult to /Users/aistes/Anonymised-app-ios/fastlane/test_output/report.xcresult

Do you notice any difference between the source and destination file path? No? Well the check to see if the paths are the same does see the difference:

File.realdirpath(test_xcresult_bundlepaths.first) != File.realdirpath(collated_xcresult_bundlepath)

But Mac OS does not: the F in fastlane is capitalized in the source path, yet Mac treats them as the same path.

I'm out of time for today, but hopefully this week I can make an improvement to this file path check for equivalency.

lyndsey-ferguson on 2 Mar 2021

❤2

Can you modify your Pluginfile per my instructions below, run bundle install, and then run your fastlane again (with the --verbose flag)?

Pluginfile:

gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-328-collating-xcresults-crash"

If there are still problems, please let me know and attach the console output as a text file to this issue (makes it easier for me to review). If it works, please let me know.

lyndsey-ferguson on 4 Mar 2021

Thanks Lyndsey!

It no longer fails with this error, and if there has been no test retrying I can see both reports (junit and xcresult) nicely 👍 .

However, if there has been a retry I see nothing under test_output (neither junit nor xcresult reports). I do see them there while the run is in progress and then they disappear. Then I can only find the merged xcresult in the temporary directory - e.g. /var/folders/1y/vn6grmgx1dl74ly29rsgc6yh0000gn/T/ .

Here's the part of the console output that happens after tests are run and collating happens:
DEBUG [2021-03-05 16:38:28.93]: Batch # incrementing retry count to 2 DEBUG [2021-03-05 16:38:28.93]: Scan found failing tests DEBUG [2021-03-05 16:38:28.93]: ReportCollator collating DEBUG [2021-03-05 16:38:28.93]: Collating junit report files ["/Users/aistes/anonymised-app-ios/Fastlane/test_output/report.junit", "/Users/aistes/anonymised-app-ios/Fastlane/test_output/report-2.junit"] DEBUG [2021-03-05 16:38:28.93]: collate_junit_reports with ["/Users/aistes/anonymised-app-ios/Fastlane/test_output/report.junit", "/Users/aistes/anonymised-app-ios/Fastlane/test_output/report-2.junit"] DEBUG [2021-03-05 16:38:28.94]: > collating last report file /Users/aistes/anonymised-app-ios/Fastlane/test_output/report-2.junit DEBUG [2021-03-05 16:38:28.94]: > collating testsuite UITests.DiscoverTests DEBUG [2021-03-05 16:38:28.94]: collate_testsuite with testcase test_checkDisks DEBUG [2021-03-05 16:38:28.94]: replacing "<testcase classname='UITests.DiscoverTests' name='test_checkDisks'> <failure message='XCTAssertTrue failed'>UITests/Tests/DiscoverTests.swift:17</failure> </testcase>" with "<testcase classname='UITests.DiscoverTests' name='test_checkDisks'> <failure message='XCTAssertTrue failed'>UITests/Tests/DiscoverTests.swift:17</failure> </testcase>" DEBUG [2021-03-05 16:38:28.94]: DEBUG [2021-03-05 16:38:28.94]: target_testcase after replacement "<testsuite failures='1' name='UITests.DiscoverTests' tests='1'> <testcase classname='UITests.DiscoverTests' name='test_checkDisks' retries='1'> <failure message='XCTAssertTrue failed'>UITests/Tests/DiscoverTests.swift:17</failure> </testcase> </testsuite>" DEBUG [2021-03-05 16:38:28.94]: < collating testsuite UITests.DiscoverTests DEBUG [2021-03-05 16:38:28.94]: < collating last report file /Users/aistes/anonymised-app-ios/Fastlane/test_output/report-2.junit DEBUG [2021-03-05 16:38:28.94]: Collating xcresult bundles ["/Users/aistes/anonymised-app-ios/Fastlane/test_output/report.xcresult", "/Users/aistes/anonymised-app-ios/Fastlane/test_output/report-2.xcresult"] INFO [2021-03-05 16:38:28.94]: $ xcrun xcresulttool merge /Users/aistes/anonymised-app-ios/Fastlane/test_output/report.xcresult /Users/aistes/anonymised-app-ios/Fastlane/test_output/report-2.xcresult --output-path /var/folders/1y/vn6grmgx1dl74ly29rsgc6yh0000gn/T/collated_result_20210305-57407-16cjh4g.xcresult INFO [2021-03-05 16:38:35.09]: ▸ [v3] Merged to: /var/folders/1y/vn6grmgx1dl74ly29rsgc6yh0000gn/T/collated_result_20210305-57407-16cjh4g.xcresult INFO [2021-03-05 16:38:35.56]: Finished collating xcresults to '/Users/aistes/anonymised-app-ios/fastlane/test_output/report.xcresult' DEBUG [2021-03-05 16:38:35.80]: Results for each test run: [false]

aistetests on 5 Mar 2021

Are you saying that this print statement:

Finished collating xcresults to '/Users/aistes/anonymised-app-ios/fastlane/test_output/report.xcresult'

Is not correct and there is no such file being created? Can you include the entire log file for me to analyze?

lyndsey-ferguson on 6 Mar 2021

Yes - to be more exact, this file is being created (as well as junit report and report-2.xcresult), but after collating test_output folder becomes empty.

Here is the full log:
logs for test-center issue #328.txt

aistetests on 8 Mar 2021

I dug a bit deeper and added a verbose:true to collate_xcresults.rb, line 32:
FileUtils.cp_r(tmp_collated_xcresult_bundlepath, params[:collated_xcresult], verbose: true)

It showed the command being executed:
cp -r /var/folders/1y/vn6grmgx1dl74ly29rsgc6yh0000gn/T/collated_result_20210308-14152-100p8w4.xcresult /Users/aistes/anonymised-app-ios/fastlane/test_output/report.xcresult

I executed it alone in terminal and report.xcresult appeared in test_ouput. I tried to play with other parameters of cp_r but no luck so far. I am not really familiar with ruby to do much more effectively. Could it be something related to permissions or something?

aistetests on 8 Mar 2021

Update: I got it to work! There were simply more places in the report_collator.rb where .downcase was needed.

Attached a version that seems to work (I only did the changes for directories + xcresult and junit reports):
report_collator.rb.txt

aistetests on 8 Mar 2021

So, downcasing worked? This is soo strange. There could be something else going on with your case. I don't have time to look deeply into this right now, but thank you for your hard work and the clues!

lyndsey-ferguson on 8 Mar 2021

@aistetests I've modified the code to add more logging to find out where this difference in case is occurring. Can you re-run your fastlane on my updated branch with the --verbose flag on?

Remove your Gemfile.lock file, modify your Pluginfile per my instructions below, run bundle install, and then run your fastlane again (with the --verbose flag)?

Pluginfile:

gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-328-collating-xcresults-crash"

If there are still problems, please let me know and attach the console output as a text file to this issue (makes it easier for me to review). If it works, please let me know.

lyndsey-ferguson on 18 Mar 2021

Sure, here's the output. Thanks for looking into it!

logs for test-center issue #328 - 2.txt

aistetests on 19 Mar 2021

I noticed the issue has status "awaiting response", perhaps my previous comment got lost, so dropping this line just in case.

aistetests on 13 Apr 2021

Thanks @aistetests, unfortunately, I have other things that are demanding my time right now. I may not be able to really look at this until December. If you're willing to investigate this, I can provide some guidance.

lyndsey-ferguson on 16 Apr 2021

Was this page helpful?

0 / 5 - 0 ratings