Fastlane-plugin-test_center: passing :result_bundle: true to multi_scan generates error: and fails multi_scan

Created on 25 Jul 2018 · 9Comments · Source: lyndsey-ferguson/fastlane-plugin-test_center

New Issue Checklist

[x] Updated fastlane-plugin-test_center to the latest version
[x] I read the README.md
[x] I reviewed the example(s) for the action(s) I am using
[x] I have removed any sensitive data such as passwords, authentication tokens, or anything else I do not want to world to see

Issue Description

multi_scan fails with an error when using multi_scan with try_count > 1 and result_bundle: true

multi_scan(
try_count: 2,
fail_build: false,
scheme: options[:scheme],
testrun_completed_block: test_run_block,
output_directory: "fastlane/test_output/multi_scan",
output_files: "multi_scan_report.junit,multi_scan_report.html",
output_types: "junit,html",
result_bundle: true
)

INFO [2018-07-25 16:54:39.30]: ------------------------
INFO [2018-07-25 16:54:39.30]: --- Step: multi_scan ---
INFO [2018-07-25 16:54:39.30]: ------------------------

+----------------------+----------------------+
| Summary for multi_scan (test_center v3.5.1) |
+----------------------+----------------------+
| try_count | 2 |
| fail_build | false |
+----------------------+----------------------+

iPhone 7 (11.4)
INFO [2018-07-25 16:54:39.33]: Successfully loaded '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/Scanfile' 📄

INFO [2018-07-25 16:54:39.40]: $ xcodebuild -showBuildSettings -workspace ./MPGMoonpig.xcworkspace -scheme UAT\ Regression
WARN [2018-07-25 16:54:42.41]: Command timed out after 3 seconds on try 1 of 4, trying again with a 6 second timeout...
DEBUG [2018-07-25 16:54:45.56]: Fetching available simulator devices
DEBUG [2018-07-25 16:54:45.81]: Detected derived data path '/Users/bohdan.orlov/Library/Developer/Xcode/Derived/MPGMoonpig-gwxgyqjedayhefahmjrbldnzhgtx'
iPhone 7 (11.4)
INFO [2018-07-25 16:54:46.09]: Successfully loaded '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/Scanfile' 📄

INFO [2018-07-25 16:54:46.10]: $ xcodebuild -showBuildSettings -workspace ./MPGMoonpig.xcworkspace -scheme UAT\ Regression
WARN [2018-07-25 16:54:49.11]: Command timed out after 3 seconds on try 1 of 4, trying again with a 6 second timeout...
DEBUG [2018-07-25 16:54:53.38]: Fetching available simulator devices

INFO [2018-07-25 16:54:53.64]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -workspace ./MPGMoonpig.xcworkspace -scheme UAT\ Regression -destination 'platform=iOS Simulator,id=44DEAC14-9578-4892-BFA9-56EE826DACD6' -destination 'platform=iOS Simulator,id=44DEAC14-9578-4892-BFA9-56EE826DACD6' -derivedDataPath '/Users/bohdan.orlov/Library/Developer/Xcode/Derived/MPGMoonpig-gwxgyqjedayhefahmjrbldnzhgtx' -resultBundlePath 'fastlane/test_output/multi_scan/UAT Regression.test_result' -enableCodeCoverage YES build-for-testing | tee '/Users/bohdan.orlov/Library/Logs/scan/MPGMoonpig-UAT Regression.log' | xcpretty --report junit --output '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/test_output/multi_scan/report.junit' --report junit --output '/var/folders/sy/641lm9ks5179hj5_cd_94bn17rrh6f/T/junit_report20180725-57722-q6k8p4'
INFO [2018-07-25 16:54:53.64]: ▸ Loading...
INFO [2018-07-25 16:54:55.66]: ▸ Building Pods/AFNetworking [Debug]
INFO [2018-07-25 16:54:55.66]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.15]: ▸ Building Pods/FXKeychain [Debug]
INFO [2018-07-25 16:54:56.15]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.15]: ▸ Building Pods/AdyenCSE [Debug]
INFO [2018-07-25 16:54:56.15]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.15]: ▸ Building Pods/FormatterKit [Debug]
INFO [2018-07-25 16:54:56.15]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.15]: ▸ Building Pods/MoonpigFoundation-MoonpigFoundationResources [Debug]
INFO [2018-07-25 16:54:56.15]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.16]: ▸ Building Core/Core [Debug]
INFO [2018-07-25 16:54:56.16]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.16]: ▸ Compiling isDebug.swift
INFO [2018-07-25 16:54:56.16]: ▸ Compiling Core.swift
INFO [2018-07-25 16:54:56.16]: ▸ Building Pods/APFNetworking [Debug]
INFO [2018-07-25 16:54:56.16]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.16]: ▸ Building Pods/DarklyEventSource [Debug]
INFO [2018-07-25 16:54:56.16]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.16]: ▸ Building Pods/MoonpigFoundation [Debug]
INFO [2018-07-25 16:54:56.16]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.17]: ▸ Building UI/UI [Debug]
INFO [2018-07-25 16:54:56.17]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.17]: ▸ Compiling UIImage+isSquare.swift
INFO [2018-07-25 16:54:56.17]: ▸ Compiling ApplePayButton+State.swift
INFO [2018-07-25 16:54:56.18]: ▸ Compiling TransitionProtocol.swift
INFO [2018-07-25 16:54:56.18]: ▸ Compiling Checkbox+State.swift
INFO [2018-07-25 16:54:56.19]: ▸ Compiling UITestsSupportConstants.swift
INFO [2018-07-25 16:54:56.19]: ▸ Compiling LoginLauncherPresenting.swift
INFO [2018-07-25 16:54:56.20]: ▸ Compiling PreviewCell.swift
INFO [2018-07-25 16:54:56.20]: ▸ Compiling Transition+Style.swift
INFO [2018-07-25 16:54:56.21]: ▸ Compiling TitleDetailsView.swift
INFO [2018-07-25 16:54:56.21]: ▸ Compiling ApplePayButton.swift
INFO [2018-07-25 16:54:56.22]: ▸ Compiling LoginLauncherView+Style.swift
INFO [2018-07-25 16:54:56.22]: ▸ Compiling LoginLauncherView.swift
INFO [2018-07-25 16:54:56.23]: ▸ Compiling MultiStateTextField+Style.swift
INFO [2018-07-25 16:54:56.23]: ▸ Compiling HyperLinkLabel+Style.swift
INFO [2018-07-25 16:54:56.24]: ▸ Compiling TitleDetailsView+Style.swift
INFO [2018-07-25 16:54:56.25]: ▸ Compiling PreviewViewController+UICollectionViewDataSource.swift
INFO [2018-07-25 16:54:56.25]: ▸ Compiling Checkbox.swift
INFO [2018-07-25 16:54:56.26]: ▸ Compiling SmartButton+Data.swift
INFO [2018-07-25 16:54:56.26]: ▸ Compiling MutliStateTextField+Data.swift
INFO [2018-07-25 16:54:56.27]: ▸ Compiling Transition.swift
INFO [2018-07-25 16:54:56.27]: ▸ Compiling StatusBarStyle.swift
INFO [2018-07-25 16:54:56.28]: ▸ Compiling Colors.swift
INFO [2018-07-25 16:54:56.29]: ▸ Compiling HighlightableButton.swift
INFO [2018-07-25 16:54:56.29]: ▸ Compiling TItleDetailsView+Data.swift
INFO [2018-07-25 16:54:56.30]: ▸ Compiling TitleButtonView+Style.swift
INFO [2018-07-25 16:54:56.30]: ▸ Compiling MultiStateTextField.swift
INFO [2018-07-25 16:54:56.31]: ▸ Compiling PreviewViewController+Style.swift
INFO [2018-07-25 16:54:56.32]: ▸ Compiling PreviewViewController+Data.swift
INFO [2018-07-25 16:54:56.32]: ▸ Compiling SmartButton+Style.swift
INFO [2018-07-25 16:54:56.33]: ▸ Compiling HyperLinkLabel+Data.swift
INFO [2018-07-25 16:54:56.33]: ▸ Compiling UITextFieldWithEditingCallback.swift
INFO [2018-07-25 16:54:56.34]: ▸ Compiling TitleButtonView.swift
INFO [2018-07-25 16:54:56.34]: ▸ Compiling PreviewViewController.swift
INFO [2018-07-25 16:54:56.35]: ▸ Compiling TitleButtonView+Data.swift
INFO [2018-07-25 16:54:56.35]: ▸ Compiling String+Extensions.swift
INFO [2018-07-25 16:54:56.37]: ▸ Compiling Fonts.swift
INFO [2018-07-25 16:54:56.37]: ▸ Compiling UINavigationBar+Extensions.swift
INFO [2018-07-25 16:54:56.38]: ▸ Compiling SmartButton.swift
INFO [2018-07-25 16:54:56.38]: ▸ Compiling HyperLinkLabel.swift
INFO [2018-07-25 16:54:56.39]: ▸ Compiling UIView+Shake.swift
INFO [2018-07-25 16:54:56.40]: ▸ Compiling UIView+Shadow.swift
INFO [2018-07-25 16:54:56.41]: ▸ Compiling UIWindow+FirstResponder.swift
INFO [2018-07-25 16:54:56.41]: ▸ Compiling ApplePayButton+Style.swift
INFO [2018-07-25 16:54:56.42]: ▸ Compiling UIGestureRecognizer+Extensions.swift
INFO [2018-07-25 16:54:56.42]: ▸ Compiling LoginLauncherView+Data.swift
INFO [2018-07-25 16:54:56.43]: ▸ Building Pods/GoogleToolboxForMac [Debug]
INFO [2018-07-25 16:54:56.43]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.43]: ▸ Building Pods/LaunchDarkly [Debug]
INFO [2018-07-25 16:54:56.44]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.44]: ▸ Building Pods/MBProgressHUD [Debug]
INFO [2018-07-25 16:54:56.44]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.44]: ▸ Building Pods/MagicalRecord [Debug]
INFO [2018-07-25 16:54:56.44]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.44]: ▸ Building Pods/AppFactoryPhotoScienceKit [Debug]
INFO [2018-07-25 16:54:56.44]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.44]: ▸ Building Pods/Mantle [Debug]
INFO [2018-07-25 16:54:56.44]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.44]: ▸ Building Pods/PBXFramework [Debug]
INFO [2018-07-25 16:54:56.44]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.44]: ▸ Building Pods/Realm [Debug]
INFO [2018-07-25 16:54:56.44]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.53]: ▸ Building Pods/nanopb [Debug]
INFO [2018-07-25 16:54:56.53]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.53]: ▸ Building Domain/Domain [Debug]
INFO [2018-07-25 16:54:56.53]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.53]: ▸ Compiling FeatureFlags.swift
INFO [2018-07-25 16:54:56.53]: ▸ Compiling DebugFeatureFlagsService.swift
INFO [2018-07-25 16:54:56.53]: ▸ Compiling FeatureFlagsByKeyStorage.swift
INFO [2018-07-25 16:54:56.54]: ▸ Compiling FeatureFlagsFetching.swift
INFO [2018-07-25 16:54:56.54]: ▸ Compiling TestsSupport.swift
INFO [2018-07-25 16:54:56.54]: ▸ Compiling UserDefaultStorage.swift
INFO [2018-07-25 16:54:56.54]: ▸ Compiling Observable.swift
INFO [2018-07-25 16:54:56.55]: ▸ Compiling FeatureFlagsService.swift
INFO [2018-07-25 16:54:56.55]: ▸ Compiling FeatureFlagsByKeyProtocols.swift
INFO [2018-07-25 16:54:56.55]: ▸ Building MoonpigBasketKit/MoonpigBasketKit [Debug]
INFO [2018-07-25 16:54:56.55]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.60]: ▸ Building Pods/Pods-Moonpig-MPGMoonpig [Debug]
INFO [2018-07-25 16:54:56.60]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.60]: ▸ Building Pods/Pods-Moonpig-MPGMoonpigUITests [Debug]
INFO [2018-07-25 16:54:56.60]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.60]: ▸ Building MoonpigBasketKit/MoonpigBasketKitTestsSupport [Debug]
INFO [2018-07-25 16:54:56.61]: ▸ Check Dependencies
INFO [2018-07-25 16:54:56.62]: ▸ Building MPGMoonpig/MPGMoonpig [Debug]
INFO [2018-07-25 16:54:56.62]: ▸ Check Dependencies
INFO [2018-07-25 16:54:57.88]: ▸ Running script 'Install Git hooks'
INFO [2018-07-25 16:54:58.52]: ▸ Running script 'CI Compiled Settings Bundle For Non App Store Builds'
INFO [2018-07-25 16:54:58.57]: ▸ Running script 'Fabric'
INFO [2018-07-25 16:54:58.64]: ▸ Running script 'Upload dSym file to App Dynamics'
INFO [2018-07-25 16:54:58.68]: ▸ Running script 'Allow App Transport for all configurations other than Release'
INFO [2018-07-25 16:54:58.74]: ▸ Running script 'Include Firebase settings depending on configuration'
INFO [2018-07-25 16:54:58.79]: ▸ Running script 'Copy GTM container'
INFO [2018-07-25 16:54:58.84]: ▸ Building MPGMoonpig/MPGMoonpigUITests [Debug]
INFO [2018-07-25 16:54:58.84]: ▸ Check Dependencies
INFO [2018-07-25 16:54:58.91]: ▸ Test build Succeeded
+--------------------+---+
| Test Results |
+--------------------+---+
| Number of tests | 0 |
| Number of failures | 0 |
+--------------------+---+

iPhone 7 (11.4)
INFO [2018-07-25 16:55:03.07]: Successfully loaded '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/Scanfile' 📄

INFO [2018-07-25 16:55:03.07]: $ xcodebuild -showBuildSettings -workspace ./MPGMoonpig.xcworkspace -scheme UAT\ Regression
WARN [2018-07-25 16:55:06.08]: Command timed out after 3 seconds on try 1 of 4, trying again with a 6 second timeout...
DEBUG [2018-07-25 16:55:10.34]: Fetching available simulator devices
iPhone 7 (11.4)
INFO [2018-07-25 16:55:10.63]: Successfully loaded '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/Scanfile' 📄

INFO [2018-07-25 16:55:10.64]: $ xcodebuild -showBuildSettings -workspace ./MPGMoonpig.xcworkspace -scheme UAT\ Regression
WARN [2018-07-25 16:55:13.64]: Command timed out after 3 seconds on try 1 of 4, trying again with a 6 second timeout...
DEBUG [2018-07-25 16:55:16.79]: Fetching available simulator devices

+----------------------------+------------------------------------------------------------------------------------------+
| Summary for scan 2.99.1 |
+----------------------------+------------------------------------------------------------------------------------------+
| scheme | UAT Regression |
| result_bundle | true |
| test_without_building | true |
| derived_data_path | /Users/bohdan.orlov/Library/Developer/Xcode/Derived/MPGMoonpig-gwxgyqjedayhefahmjrbldnz |
| | hgtx |
| workspace | ./MPGMoonpig.xcworkspace |
| devices | ["iPhone 7 (11.4)"] |
| code_coverage | true |
| skip_build | false |
| buildlog_path | ~/Library/Logs/scan |
| include_simulator_logs | false |
| disable_concurrent_testing | false |
| should_zip_build_products | false |
| open_report | false |
| skip_slack | false |
| slack_only_on_failure | false |
| use_clang_report_name | false |
| clean | false |
| output_directory | fastlane/test_output/multi_scan |
| only_testing | ["MPGMoonpigUITests/ADEumANRDetection/testTriggerANR", |
| | "MPGMoonpigUITests/FIRInstanceIDTokenOperation/testBlock", |
| | "MPGMoonpigUITests/RegisterUser/test_RegisterUserFromMenuWithAddress", |
| | "MPGMoonpigUITests/RewardsTests/testAuthenticatedUserSingsUpForRewardScheme", |
| | "MPGMoonpigUITests/RewardsTests/testAuthenticatedUserSingsUpForRewardSchemeAndPressInfo |
| | Button", "MPGMoonpigUITests/BuyWithPayPal/test_SingleCardPurchaseWithPayPal", |
| | "MPGMoonpigUITests/TabBarFeature/testTapOnAccountsTabBarItemNavigatesToLoginLauncherWhe |
| | nSignedOut", |
| | "MPGMoonpigUITests/TabBarFeature/testTapOnRemindersTabBarItemNavigatesToLoginLauncherWh |
| | enSignedOut", |
| | "MPGMoonpigUITests/TabBarFeature/testWhenSigInFromAccountTabThenAccountScreenAndReminde |
| | rsScreenIsDisplayed", |
| | "MPGMoonpigUITests/TabBarFeature/testWhenSigInFromRemindersTabThenAccountScreenAndRemin |
| | dersScreenIsDisplayed", |
| | "MPGMoonpigUITests/TabBarFeature/testWhenSignInFromLoginLauncherOnAccountTabThenAccount |
| | ScreenIsDisplayed", |
| | "MPGMoonpigUITests/TabBarFeature/testWhenSignInFromLoginLauncherOnRemindersTabThenRemin |
| | derScreenIsDisplayed", |
| | "MPGMoonpigUITests/TabBarFeature/testWhenCreateUserFromLoginLauncherOnAccountTabThenAcc |
| | ountScreenIsDisplayed", |
| | "MPGMoonpigUITests/TabBarFeature/testWhenCreateUserFromLoginLauncherOnRemindersTabThenR |
| | emindersScreenIsDisplayed", |
| | "MPGMoonpigUITests/TabBarFeature/testTabBarVisibilityWhenFeatureFlagIsTurnedOn", |
| | "MPGMoonpigUITests/TabBarFeature/testWhenSignOutLoginLaunchScreenIsDisplayedInAccountAn |
| | dReminderScreen", |
| | "MPGMoonpigUITests/RemindersTests/testCreateReminderAndVerifyPopulatedReminderListIsDis |
| | played", |
| | "MPGMoonpigUITests/CardSearchTests/testSearchForBirthdayThemeCardFromHomepage", |
| | "MPGMoonpigUITests/CardSearchTests/testErrorMessageIsDisplayedWhenSearchingForNonExisti |
| | ngThemeCard", |
| | "MPGMoonpigUITests/CreditCardTests/testAuthenticatedUserOrdersCardFromFavouritesCatalog |
| | ueAndPaysWithAmericanExpressCreditCard", |
| | "MPGMoonpigUITests/CreditCardTests/testUsersSignsInDuringOrderFlowAndPaysForCardWithCre |
| | ditCard", |
| | "MPGMoonpigUITests/CreditCardTests/testUsersSignsInDuringOrderFlowAndPaysForGiftWithCre |
| | ditCard", |
| | "MPGMoonpigUITests/CreditCardTests/testUsersSignsInDuringOrderFlowAndPaysForFlowersWith |
| | CreditCard", |
| | "MPGMoonpigUITests/CreditCardTests/testAuthenticatedUserOrdersGiftFromBalloonsCatalogue |
| | AndPaysWithCreditCard", |
| | "MPGMoonpigUITests/CreditCardTests/testAuthenticatedUserOrdersFlowersFromFavouritesCata |
| | logueAndPaysWithCreditCard", |
| | "MPGMoonpigUITests/CreditCardTests/testDismissOrderConfirmationScreen", |
| | "MPGMoonpigUITests/AddCrossSellItem/test_AddGiftCrossSellThenPurchase", |
| | "MPGMoonpigUITests/BuyMultipleCards/test_MultipleCardPurchaseWithCreditCard", |
| | "MPGMoonpigUITests/EditAddressTests/testEditAddressFromBackToMeAddressBook", |
| | "MPGMoonpigUITests/EditAddressTests/testEditAddressFromSendDirectToRecipentAddressBook" |
| | , "MPGMoonpigUITests/HandwritingTests/testUserCanClearTextsWhenOnHandwritingPage", |
| | "MPGMoonpigUITests/HandwritingTests/testHandwritingPurchaseJourney", |
| | "MPGMoonpigUITests/HandwritingTests/testHandwritingTutorialFunctionality", |
| | "MPGMoonpigUITests/HandwritingTests/testTypeWithKeyboard", |
| | "MPGMoonpigUITests/PhoneNumberTests/testPhoneNumberIsRequiredToCompletePurchase", |
| | "MPGMoonpigUITests/ChangeOptionsTests/testNavigateBackDuringOrderFlowAndChangeDeliveryA |
| | ddress", |
| | "MPGMoonpigUITests/ChangeOptionsTests/testNavigateBackDuringOrderFlowAndChangeCardSize" |
| | , "MPGMoonpigUITests/CreateAccountTests/testRegisterUserFromMenuWithAddress", |
| | "MPGMoonpigUITests/CreateAccountTests/testRegisterUserDuringOrderFlowWithAddressComplet |
| | ePurchase", |
| | "MPGMoonpigUITests/CreateAccountTests/testRegisterUserFromMenuAddingAddressDuringOrderF |
| | lowCompletePurchase", |
| | "MPGMoonpigUITests/CreateAddressTests/testAddAddressFromSendBackToMeAddressBookInOrderF |
| | low", |
| | "MPGMoonpigUITests/CreateAddressTests/testAddAddressFromSendBackToMeAddressBookAsStandA |
| | loneProcess", |
| | "MPGMoonpigUITests/CreateAddressTests/testAddAddressFromSendDirectToRecipentAddressBook |
| | InOrderFlow", |
| | "MPGMoonpigUITests/CreateAddressTests/testAddAddressFromSendDirectToRecipentAddressBook |
| | AsStandAloneProcess", |
| | "MPGMoonpigUITests/DeleteAddressTests/testDeleteAddressFromSendBackToMeAddressBook", |
| | "MPGMoonpigUITests/DeleteAddressTests/testDeleteAddressFromSendDirectToRecipentAddressB |
| | ook", "MPGMoonpigUITests/DeleteProductTests/testRemoveCardFromMultiItemBasket", |
| | "MPGMoonpigUITests/DeleteProductTests/testRemoveGiftFromMultiItemBasket", |
| | "MPGMoonpigUITests/MultiPurchaseTests/testAddCardToGiftPurchaseChangingDeliveryDate", |
| | "MPGMoonpigUITests/MultiPurchaseTests/testAddGiftToCardPurchase", |
| | "MPGMoonpigUITests/MultiPurchaseTests/testAddCardToFlowersPurchaseChangingDeliveryMetho |
| | d", "MPGMoonpigUITests/MultiPurchaseTests/testAddFlowersToCardPurchase", |
| | "MPGMoonpigUITests/TabBarRewardsTests/testAuthenticatedUserSingsUpForRewardScheme", |
| | "MPGMoonpigUITests/TabBarRewardsTests/testAuthenticatedUserSingsUpForRewardSchemeAndPre |
| | ssInfoButton", |
| | "MPGMoonpigUITests/ChangePasswordTests/testUserLogsInAndChangesPasswordSuccessfully", |
| | "MPGMoonpigUITests/DeliveryOptionsTests/testChangeDespatchDateForCardAndCompletePurchas |
| | e", |
| | "MPGMoonpigUITests/DeliveryOptionsTests/testChangePostageMethodForCardAndCompletePurcha |
| | se", |
| | "MPGMoonpigUITests/DeliveryOptionsTests/testChangePostageMethodForGiftAndCompletePurcha |
| | se", |
| | "MPGMoonpigUITests/DeliveryOptionsTests/testChangePostageMethodForFlowersAndCompletePur |
| | chase", "MPGMoonpigUITests/RemoveItemFromBasket/test_RemoveItemFromBasketThenPurchase", |
| | "MPGMoonpigUITests/CardTypeJourneysTests/testCustomiseLimelightCardAndChangeCardSize", |
| | "MPGMoonpigUITests/CardTypeJourneysTests/testCustomiseSinglePictureCardAndCompletePurch |
| | ase", |
| | "MPGMoonpigUITests/CardTypeJourneysTests/testCustomiseWordReplacementCardAndChangeQuant |
| | ity", "MPGMoonpigUITests/ChangeDeliveryAddress/test_EditAddressThenPurchase", |
| | "MPGMoonpigUITests/GiftTypeJourneysTests/testUnderEighteenCannotOrderAlcohol", |
| | "MPGMoonpigUITests/GiftTypeJourneysTests/testPurchaseAlcoholAndChangeDeliveryAddress", |
| | "MPGMoonpigUITests/MultipleItemsInBasket/test_OpenMultilineBasket", |
| | "MPGMoonpigUITests/MultipleItemsInBasket/test_AddAnotherItemToBasket", |
| | "MPGMoonpigUITests/MultipleItemsInBasket/test_ContinueShoppingWithMultipleBasketItems", |
| | "MPGMoonpigUITests/MultipleItemsInBasket/test_SelectPrepayOptionWithMultipleBasketItems |
| | ", |
| | "MPGMoonpigUITests/MultipleItemsInBasket/test_SelectPaymentOptionWithMultipleBasketItem |
| | s", |
| | "MPGMoonpigUITests/MultipleItemsInBasket/test_GivenAddingItemToMultilineBasket_WhenCrea |
| | tingNewRecipient_ThenCancellingRecipientCreation", |
| | "MPGMoonpigUITests/CardCustomisationTests/testCustomiseCardWithFilteredImagesAndPreview |
| | ", |
| | "MPGMoonpigUITests/CardCustomisationTests/testCustomiseCardWithAllAvailableOptionsAndPr |
| | eviewCard", |
| | "MPGMoonpigUITests/CardCustomisationTests/testDiscardChangesAlertIsPresentedAfterEditin |
| | gCardAndGoingBack", |
| | "MPGMoonpigUITests/CardCustomisationTests/testSelectImageFromAlbumAndPreview", |
| | "MPGMoonpigUITests/CardCustomisationTests/testErrorIsDisplayedWhenCustomisableImagesAre |
| | NotDefined", |
| | "MPGMoonpigUITests/CrossSaleAndPrepayTests/testAddFromCrossSaleForCardAndPayWithCreditC |
| | ard", |
| | "MPGMoonpigUITests/CrossSaleAndPrepayTests/testDismissCrossSaleForCardAndPayWithPrepay" |
| | , |
| | "MPGMoonpigUITests/CrossSaleAndPrepayTests/testCrossSaleNotDisplayedForGiftAndPayWithPr |
| | epay", |
| | "MPGMoonpigUITests/CrossSaleAndPrepayTests/testCrossSaleNotDisplayedForFlowersAndPayWit |
| | hCreditCard", |
| | "MPGMoonpigUITests/PersonalisedMessagesTests/testUseCreditCardWhenPurchasingGiftWithGif |
| | tMessage", |
| | "MPGMoonpigUITests/PersonalisedMessagesTests/testWarningDisplayedWhenTryingToAddCardToG |
| | iftOrderWithGiftMessage", |
| | "MPGMoonpigUITests/PersonalisedMessagesTests/testUnableToUsePrepayWhenPurchasingFlowers |
| | WithGiftMessage", |
| | "MPGMoonpigUITests/MultipleItemsBasketSmokeTest/test_GivenUserLoggedInNewBasketToPurcha |
| | seTwoCards_WhenUserContinueShopping_ThenUserCanAddSecondCard_AndCompletePurchase", |
| | "MPGMoonpigUITests/MultipleItemsBasketSmokeTest/test_GivenOneCardAdded_WhenUserWantLarg |
| | eSize_ThenUserCanChangeSizeInOrderSummary", |
| | "MPGMoonpigUITests/SignInAddAddressAndBuyFlowers/test_SignInAndPurchaseFlowers", |
| | "MPGMoonpigUITests/AmericanMultiplePurchaseJourney/test_SingleCardPurchaseEditAddress_T |
| | henPurchaseUSUAT", |
| | "MPGMoonpigUITests/AustralianMultiplePurchaseJourney/test_SingleCardPurchaseEditAddress |
| | _ThenPurchaseAuUAT", |
| | "MPGMoonpigUITests/BuyCardAU/test_SingleCardPurchase_ThenPurchaseAuUAT", |
| | "MPGMoonpigUITests/BuyCardUS/test_SingleCardPurchase_ThenPurchaseUsUAT"] |
| output_types | junit,html |
| output_files | multi_scan_report.junit,multi_scan_report.html |
| fail_build | true |
| xcode_path | /Applications/Xcode.app |
+----------------------------+------------------------------------------------------------------------------------------+

MPGMoonpigUITest.RegisterUser
test_RegisterUserFromMenuWithAddress, failed -
RegisterUser.swift:14

 Executed 1 test, with 1 failure (0 unexpected) in 10.505 (10.506) seconds

Failing tests: RegisterUser.test_RegisterUserFromMenuWithAddress() ** TEST EXECUTE FAILED ** ERROR [2018-07-25 16:55:52.33]: Exit status: 65 +--------------------+---+ | Test Results | +--------------------+---+ | Number of tests | 1 | | Number of failures | 1 | +--------------------+---+ DEBUG [2018-07-25 16:55:52.68]: Scan failed with Tests have failed INFO [2018-07-25 16:55:52.71]: ------------------------------------------------------- INFO [2018-07-25 16:55:52.71]: --- :multi_scan attempt #1 of 2 failed. Retrying... --- INFO [2018-07-25 16:55:52.71]: ------------------------------------------------------- INFO [2018-07-25 16:55:52.71]: Re-running scan on only failed tests iPhone 7 (11.4) INFO [2018-07-25 16:55:53.77]: Successfully loaded '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/Scanfile' 📄 +----------------------+---------------------+ | Detected Values from './fastlane/Scanfile' | +----------------------+---------------------+ | code_coverage | true | | output_types | junit | | devices | ["iPhone 7 (11.4)"] | +----------------------+---------------------+ INFO [2018-07-25 16:55:53.78]: $ xcodebuild -showBuildSettings -workspace ./MPGMoonpig.xcworkspace -scheme UAT\ Regression WARN [2018-07-25 16:55:56.78]: Command timed out after 3 seconds on try 1 of 4, trying again with a 6 second timeout... DEBUG [2018-07-25 16:55:59.82]: Fetching available simulator devices iPhone 7 (11.4) INFO [2018-07-25 16:56:00.12]: Successfully loaded '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/Scanfile' 📄 +----------------------+---------------------+ | Detected Values from './fastlane/Scanfile' | +----------------------+---------------------+ | code_coverage | true | | output_types | junit | | devices | ["iPhone 7 (11.4)"] | +----------------------+---------------------+ INFO [2018-07-25 16:56:00.13]: $ xcodebuild -showBuildSettings -workspace ./MPGMoonpig.xcworkspace -scheme UAT\ Regression WARN [2018-07-25 16:56:03.14]: Command timed out after 3 seconds on try 1 of 4, trying again with a 6 second timeout... DEBUG [2018-07-25 16:56:06.40]: Fetching available simulator devices +----------------------------+------------------------------------------------------------------------------------------+ | Summary for scan 2.99.1 | +----------------------------+------------------------------------------------------------------------------------------+ | scheme | UAT Regression | | result_bundle | true | | test_without_building | true | | derived_data_path | /Users/bohdan.orlov/Library/Developer/Xcode/Derived/MPGMoonpig-gwxgyqjedayhefahmjrbldnz | | | hgtx | | workspace | ./MPGMoonpig.xcworkspace | | devices | ["iPhone 7 (11.4)"] | | code_coverage | true | | skip_build | false | | buildlog_path | ~/Library/Logs/scan | | include_simulator_logs | false | | disable_concurrent_testing | false | | should_zip_build_products | false | | open_report | false | | skip_slack | false | | slack_only_on_failure | false | | use_clang_report_name | false | | clean | false | | output_directory | fastlane/test_output/multi_scan | | only_testing | ["MPGMoonpigUITests/RegisterUser/test_RegisterUserFromMenuWithAddress"] | | output_types | junit,html | | output_files | multi_scan_report-2.junit,multi_scan_report-2.html | | fail_build | true | | xcode_path | /Applications/Xcode.app | +----------------------------+------------------------------------------------------------------------------------------+ INFO [2018-07-25 16:56:06.73]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -workspace ./MPGMoonpig.xcworkspace -scheme UAT\ Regression -destination 'platform=iOS Simulator,id=44DEAC14-9578-4892-BFA9-56EE826DACD6' -destination 'platform=iOS Simulator,id=44DEAC14-9578-4892-BFA9-56EE826DACD6' -derivedDataPath '/Users/bohdan.orlov/Library/Developer/Xcode/Derived/MPGMoonpig-gwxgyqjedayhefahmjrbldnzhgtx' -resultBundlePath 'fastlane/test_output/multi_scan/UAT Regression.test_result' -enableCodeCoverage YES -only-testing:MPGMoonpigUITests/RegisterUser/test_RegisterUserFromMenuWithAddress test-without-building | tee '/Users/bohdan.orlov/Library/Logs/scan/MPGMoonpig-UAT Regression.log' | xcpretty --report junit --output '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/test_output/multi_scan/multi_scan_report-2.junit' --report html --output '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/test_output/multi_scan/multi_scan_report-2.html' --report junit --output '/var/folders/sy/641lm9ks5179hj5_cd_94bn17rrh6f/T/junit_report20180725-57722-y8kcd9' INFO [2018-07-25 16:56:06.73]: ▸ Loading... INFO [2018-07-25 16:56:08.74]: ▸ 2018-07-25 16:56:08.745 xcodebuild[58295:15749288] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: INFO [2018-07-25 16:56:08.74]: ▸ /var/folders/sy/641lm9ks5179hj5_cd_94bn17rrh6f/T/com.apple.dt.XCTest/IDETestRunSession-584DB3DF-6D41-422F-AEBC-85135B9A232A/MPGMoonpigUITests-DB9BC9CD-FD20-45F1-8A33-9F21739D00F4/Session-MPGMoonpigUITests-2018-07-25_45608 pm-zwb0F6.log INFO [2018-07-25 16:56:08.74]: ▸ 2018-07-25 16:56:08.746 xcodebuild[58295:15749236] [MT] IDETestOperationsObserverDebug: (EFD06771-D23E-42F8-8E08-8DAB7C137DF7) Beginning test session MPGMoonpigUITests-EFD06771-D23E-42F8-8E08-8DAB7C137DF7 at 2018-07-25 4:56:08.745 pm with Xcode 9F2000 on target { INFO [2018-07-25 16:56:08.74]: ▸ SimDevice: iPhone 7 (44DEAC14-9578-4892-BFA9-56EE826DACD6, iOS 11.4, Booted) INFO [2018-07-25 16:56:08.74]: ▸ } (11.4 (15F79)) INFO [2018-07-25 16:56:25.44]: ▸ Selected tests INFO [2018-07-25 16:56:25.44]: ▸ Test Suite MPGMoonpigUITests.xctest started INFO [2018-07-25 16:56:25.44]: ▸ RegisterUser INFO [2018-07-25 16:56:35.45]: ▸ ✗ test_RegisterUserFromMenuWithAddress, failed - INFO [2018-07-25 16:56:35.68]: ▸ MPGMoonpigUITest.RegisterUser INFO [2018-07-25 16:56:35.68]: ▸ test_RegisterUserFromMenuWithAddress, failed - INFO [2018-07-25 16:56:35.68]: ▸ RegisterUser.swift:14 INFO [2018-07-25 16:56:35.68]: ▸ Executed 1 test, with 1 failure (0 unexpected) in 10.226 (10.228) seconds INFO [2018-07-25 16:56:35.68]: ▸ INFO [2018-07-25 16:56:37.01]: ▸ Failing tests: INFO [2018-07-25 16:56:37.01]: ▸ RegisterUser.test_RegisterUserFromMenuWithAddress() INFO [2018-07-25 16:56:37.01]: ▸ ** TEST EXECUTE FAILED ** 2018-07-25 16:56:08.745 xcodebuild[58295:15749288] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: /var/folders/sy/641lm9ks5179hj5_cd_94bn17rrh6f/T/com.apple.dt.XCTest/IDETestRunSession-584DB3DF-6D41-422F-AEBC-85135B9A232A/MPGMoonpigUITests-DB9BC9CD-FD20-45F1-8A33-9F21739D00F4/Session-MPGMoonpigUITests-2018-07-25_45608 pm-zwb0F6.log 2018-07-25 16:56:08.746 xcodebuild[58295:15749236] [MT] IDETestOperationsObserverDebug: (EFD06771-D23E-42F8-8E08-8DAB7C137DF7) Beginning test session MPGMoonpigUITests-EFD06771-D23E-42F8-8E08-8DAB7C137DF7 at 2018-07-25 4:56:08.745 pm with Xcode 9F2000 on target { SimDevice: iPhone 7 (44DEAC14-9578-4892-BFA9-56EE826DACD6, iOS 11.4, Booted) } (11.4 (15F79)) Selected tests Test Suite MPGMoonpigUITests.xctest started RegisterUser ✗ test_RegisterUserFromMenuWithAddress, failed - MPGMoonpigUITest.RegisterUser test_RegisterUserFromMenuWithAddress, failed - RegisterUser.swift:14

 Executed 1 test, with 1 failure (0 unexpected) in 10.226 (10.228) seconds

Failing tests: RegisterUser.test_RegisterUserFromMenuWithAddress() ** TEST EXECUTE FAILED ** ERROR [2018-07-25 16:56:41.23]: Exit status: 65 +--------------------+---+ | Test Results | +--------------------+---+ | Number of tests | 1 | | Number of failures | 1 | +--------------------+---+ DEBUG [2018-07-25 16:56:41.59]: Scan failed with Tests have failed WARN [2018-07-25 16:56:41.74]: Lane Context: INFO [2018-07-25 16:56:41.74]: {:DEFAULT_PLATFORM=>:ios, :PLATFORM_NAME=>nil, :LANE_NAME=>"regression", :SCAN_DERIVED_DATA_PATH=>"/Users/bohdan.orlov/Library/Developer/Xcode/Derived/MPGMoonpig-gwxgyqjedayhefahmjrbldnzhgtx", :SCAN_GENERATED_PLIST_FILES=>[], :SCAN_GENERATED_PLIST_FILE=>nil} ERROR [2018-07-25 16:56:41.74]: Shell command exited with exit status 1 instead of 0. INFO [2018-07-25 16:56:41.75]: Successfully generated documentation at path '/Users/bohdan.orlov/Projects/PhotoboxGroup/archon-appfactory-moonpig-ios/fastlane/README.md' +------+-------------------------------+-------------+ | fastlane summary | +------+-------------------------------+-------------+ | Step | Action | Time (in s) | +------+-------------------------------+-------------+ | 1 | opt_out_usage | 0 | | 2 | default_platform | 0 | | 3 | Verifying fastlane version | 0 | | 4 | Switch to scan_and_retry lane | 0 | | 💥 | multi_scan | 122 | +------+-------------------------------+-------------+ DEBUG [2018-07-25 16:56:41.75]: All plugins are up to date ERROR [2018-07-25 16:56:41.75]: fastlane finished with errors

Environment

md5-6f908dddfc15a18b6fd6d7beed4e40ba

✅ fastlane environment ✅

Stack

| Key                         | Value                                                          |
| --------------------------- | -------------------------------------------------------------- |
| OS                          | 10.13.5                                                        |
| Ruby                        | 2.3.3                                                          |
| Bundler?                    | true                                                           |
| Git                         | git version 2.15.2 (Apple Git-101.1)                           |
| Installation Source         | /usr/local/bin/fastlane                                        |
| Host                        | Mac OS X 10.13.5 (17F77)                                       |
| Ruby Lib Dir                | /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib |
| OpenSSL Version             | LibreSSL 2.2.7                                                 |
| Is contained                | false                                                          |
| Is homebrew                 | false                                                          |
| Is installed via Fabric.app | false                                                          |
| Xcode Path                  | /Applications/Xcode.app/Contents/Developer/                    |
| Xcode Version               | 9.4.1                                                          |


System Locale

| Variable | Value       |   |
| -------- | ----------- | - |
| LANG     | en_GB.UTF-8 | ✅ |
| LC_ALL   |             |   |
| LANGUAGE |             |   |

fastlane gems

| Gem      | Version | Update-Status |
| -------- | ------- | ------------- |
| fastlane | 2.100.1 | ✅ Up-To-Date  |


Loaded fastlane plugins:

| Plugin                      | Version | Update-Status |
| --------------------------- | ------- | ------------- |
| fastlane-plugin-test_center | 3.5.1   | ✅ Up-To-Date  |


Loaded gems

| Gem                         | Version      |
| --------------------------- | ------------ |
| did_you_mean                | 1.0.0        |
| bundler                     | 1.16.1       |
| io-console                  | 0.4.5        |
| CFPropertyList              | 3.0.0        |
| concurrent-ruby             | 1.0.5        |
| i18n                        | 0.9.5        |
| minitest                    | 5.11.3       |
| thread_safe                 | 0.3.6        |
| tzinfo                      | 1.2.5        |
| activesupport               | 4.2.10       |
| public_suffix               | 2.0.5        |
| addressable                 | 2.5.2        |
| atomos                      | 0.1.2        |
| babosa                      | 1.0.2        |
| claide                      | 1.0.2        |
| fuzzy_match                 | 2.0.4        |
| nap                         | 1.1.0        |
| cocoapods-core              | 1.4.0        |
| cocoapods-deintegrate       | 1.0.2        |
| cocoapods-downloader        | 1.2.1        |
| cocoapods-plugins           | 1.0.0        |
| cocoapods-search            | 1.0.0        |
| cocoapods-stats             | 1.0.0        |
| netrc                       | 0.11.0       |
| cocoapods-trunk             | 1.3.0        |
| cocoapods-try               | 1.1.0        |
| colored2                    | 3.1.2        |
| escape                      | 0.0.4        |
| fourflusher                 | 2.0.1        |
| gh_inspector                | 1.1.3        |
| molinillo                   | 0.6.5        |
| ruby-macho                  | 1.2.0        |
| nanaimo                     | 0.2.6        |
| xcodeproj                   | 1.5.9        |
| cocoapods                   | 1.4.0        |
| colored                     | 1.2          |
| highline                    | 1.7.10       |
| commander-fastlane          | 4.4.6        |
| declarative                 | 0.0.10       |
| declarative-option          | 0.1.0        |
| unf_ext                     | 0.0.7.5      |
| unf                         | 0.1.4        |
| domain_name                 | 0.5.20180417 |
| dotenv                      | 2.5.0        |
| emoji_regex                 | 0.1.1        |
| excon                       | 0.62.0       |
| multipart-post              | 2.0.0        |
| faraday                     | 0.15.2       |
| http-cookie                 | 1.0.3        |
| faraday-cookie_jar          | 0.0.6        |
| faraday_middleware          | 0.12.2       |
| fastimage                   | 2.1.3        |
| jwt                         | 2.1.0        |
| little-plugger              | 1.1.4        |
| multi_json                  | 1.13.1       |
| logging                     | 2.2.2        |
| memoist                     | 0.16.0       |
| os                          | 0.9.6        |
| signet                      | 0.8.1        |
| googleauth                  | 0.6.2        |
| httpclient                  | 2.8.3        |
| mime-types-data             | 3.2016.0521  |
| mime-types                  | 3.1          |
| uber                        | 0.1.0        |
| representable               | 3.0.4        |
| retriable                   | 3.1.2        |
| google-api-client           | 0.21.2       |
| json                        | 2.1.0        |
| mini_magick                 | 4.5.1        |
| multi_xml                   | 0.6.0        |
| plist                       | 3.4.0        |
| rubyzip                     | 1.2.1        |
| security                    | 0.1.3        |
| naturally                   | 2.2.0        |
| simctl                      | 1.6.5        |
| slack-notifier              | 2.3.2        |
| terminal-notifier           | 1.8.0        |
| unicode-display_width       | 1.4.0        |
| terminal-table              | 1.8.0        |
| tty-screen                  | 0.6.5        |
| tty-cursor                  | 0.6.0        |
| tty-spinner                 | 0.8.0        |
| word_wrap                   | 1.0.0        |
| rouge                       | 2.0.7        |
| xcpretty                    | 0.2.8        |
| xcpretty-travis-formatter   | 1.0.0        |
| xctest_list                 | 1.1.3        |
| fastlane-plugin-test_center | 3.5.1        |
| xcov                        | 1.4.0        |



*generated on:* **2018-07-25**

♻️ multi_scan 🐞bug 🔸 collate_test_result_bundles

Source

BohdanOrlov

All 9 comments

Hello @BohdanOrlov, thank you for submitting this bug. I don't see the failure. I only see that there is a failing test that continually fails, RegisterUser.test_RegisterUserFromMenuWithAddress(). Can you elaborate one what the problem is?

lyndsey-ferguson on 25 Jul 2018

Hey @lyndsey-ferguson!
Thank you for the fast reply!

multi_scan fails and throws exception and doesn't return a result.
Please compare images below to see the difference between failure and success (the test fails in both cases):

Failed multi_scan try_count: 2 and result_bundle: true

Succeeded multi_scan try_count: 2 and result_bundle: false

BohdanOrlov on 26 Jul 2018

You gave 2 examples: one with try_count: 2 and result_bundle: true, and the other with try_count: 2 and result_bundle: false. Both output Scan failed with Tests have failed. Both output Lane Context: with the ruby Hash for the value.

In the first example, Scan failed with Tests have failed is immediately followed by Lane Context:. In the second example, Scan failed with Tests have failed is immediately followed by the multi_scan results.

It is not clear to me, but do both examples "retry" appropriately?

The first example does seem to indicate that an exception is happening, can you zip up and attach the fastlane/test_output/multi_scan/UAT Regression.test_result bundles?

lyndsey-ferguson on 26 Jul 2018

@lyndsey-ferguson

It did retry correctly in both cases, it didn't finish the action correctly in the first case.

So to sum up some evidence of that please note these:

Here are both test bundles:
multi_scan.zip

Is there anything else I could provide to help to understand the issue?

BohdanOrlov on 26 Jul 2018

👍1

I think that the code that deals with test_result bundles is causing the exception. I will run that code and try and "collate" those bundles and see what happens: hopefully I get the same crash.

lyndsey-ferguson on 26 Jul 2018

👍1

@BohdanOrlov did you get an exception stack trace for this issue?

lyndsey-ferguson on 27 Jul 2018

It is the spaces in the filepath

lyndsey-ferguson on 27 Jul 2018

Fixed in v3.5.2

lyndsey-ferguson on 27 Jul 2018

@lyndsey-ferguson many thanks for the fix!

BohdanOrlov on 30 Jul 2018

👍1

Was this page helpful?