Fastlane-plugin-test_center: collating test_result bundles in Xcode 11 crashes
New Issue Checklist
- [x] Updated
fastlane-plugin-test_centerto the latest version - [X] I read the README.md
- [X] I reviewed the example(s) for the action(s) I am using
- [X] I have removed any sensitive data such as passwords, authentication tokens, or anything else I do not want to world to see
Issue Description
I am trying to run tests using multi_scan, at the end of parallel test run collate actions fail. Please see the output for more details.
Complete output when running fastlane, including the stack trace and command used
You can ⌘ + double-click on links to open them directly in your browser.
/Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/actions/collate_test_result_bundles.rb:97:in collate_infoplist': [!] undefined methodzip' for nil:NilClass (NoMethodError)
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/actions/collate_test_result_bundles.rb:25:in block in collate_bundles'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/actions/collate_test_result_bundles.rb:23:inforeach'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/actions/collate_test_result_bundles.rb:23:in collate_bundles'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/actions/collate_test_result_bundles.rb:14:inblock in run'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/actions/collate_test_result_bundles.rb:13:in each'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/actions/collate_test_result_bundles.rb:13:inrun'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/helper/multi_scan_manager/report_collator.rb:127:in collate_test_result_bundles'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/helper/multi_scan_manager/report_collator.rb:24:incollate'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:204:in collate_batched_reports_for_testable'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:165:inblock in collate_batched_reports'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:164:in each'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:164:incollate_batched_reports'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:146:in run_test_batches'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:53:inrun'
from /Users/jdoshi/.gems/gems/fastlane-plugin-test_center-3.8.4/lib/fastlane/plugin/test_center/actions/multi_scan.rb:23:in run'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/runner.rb:256:inblock (2 levels) in execute_action'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/actions/actions_helper.rb:50:in execute_action'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/runner.rb:235:inblock in execute_action'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/runner.rb:227:in chdir'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/runner.rb:227:inexecute_action'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/runner.rb:157:in trigger_action_by_name'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/fast_file.rb:154:inmethod_missing'
from Fastfile:597:in block (2 levels) in parsing_binding'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/lane.rb:33:incall'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/runner.rb:49:in block in execute'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/runner.rb:45:inchdir'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/runner.rb:45:in execute'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/lane_manager.rb:56:incruise_lane'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/command_line_handler.rb:36:in handle'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/commands_generator.rb:108:inblock (2 levels) in run'
from /Library/Ruby/Gems/2.3.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:178:in call'
from /Library/Ruby/Gems/2.3.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:153:inrun'
from /Library/Ruby/Gems/2.3.0/gems/commander-fastlane-4.4.6/lib/commander/runner.rb:476:in run_active_command'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane_core/lib/fastlane_core/ui/fastlane_runner.rb:76:inrun!'
from /Library/Ruby/Gems/2.3.0/gems/commander-fastlane-4.4.6/lib/commander/delegates.rb:15:in run!'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/commands_generator.rb:349:inrun'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/commands_generator.rb:41:in start'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/fastlane/lib/fastlane/cli_tools_distributor.rb:119:intake_off'
from /Users/jdoshi/.gems/gems/fastlane-2.131.0/bin/fastlane:23:in <top (required)>'
from /Users/jdoshi/.gems/bin/fastlane:22:inload'
from /Users/jdoshi/.gems/bin/fastlane:22:in `
Environment
✅ fastlane environment ✅ ### Stack | Key | Value | | --------------------------- | -------------------------------------------------------------- | | OS | 10.14.5 | | Ruby | 2.3.7 | | Bundler? | false | | Git | git version 2.19.0 | | Installation Source | ~/.gems/bin/fastlane | | Host | Mac OS X 10.14.5 (18F132) | | Ruby Lib Dir | /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib | | OpenSSL Version | LibreSSL 2.6.5 | | Is contained | false | | Is homebrew | false | | Is installed via Fabric.app | false | | Xcode Path | /Applications/Xcode11.app/Contents/Developer/ | | Xcode Version | 11.0 | ### System Locale | Variable | Value | | | -------- | ----------- | - | | LANG | en_US.UTF-8 | ✅ | | LC_ALL | | | | LANGUAGE | | | ### fastlane gems | Gem | Version | Update-Status | | -------- | ------- | ------------- | | fastlane | 2.131.0 | ✅ Up-To-Date | ### Loaded fastlane plugins: | Plugin | Version | Update-Status | | --------------------------- | ------- | ------------- | | fastlane-plugin-test_center | 3.8.4 | ✅ Up-To-Date |*generated on:* **2019-09-25**Loaded gems
| Gem | Version | | --------------------------- | ------------ | | did_you_mean | 1.0.0 | | slack-notifier | 2.3.2 | | rouge | 2.0.7 | | xcpretty | 0.3.0 | | terminal-notifier | 2.0.0 | | terminal-table | 1.8.0 | | multipart-post | 2.0.0 | | word_wrap | 1.0.0 | | public_suffix | 2.0.5 | | babosa | 1.0.2 | | colored | 1.2 | | highline | 1.7.10 | | commander-fastlane | 4.4.6 | | http-cookie | 1.0.3 | | faraday-cookie_jar | 0.0.6 | | gh_inspector | 1.1.3 | | mini_magick | 4.9.5 | | multi_xml | 0.6.0 | | security | 0.1.3 | | xcpretty-travis-formatter | 1.0.0 | | naturally | 2.2.0 | | simctl | 1.6.5 | | jwt | 2.1.0 | | uber | 0.1.0 | | declarative | 0.0.10 | | declarative-option | 0.1.0 | | representable | 3.0.4 | | retriable | 3.1.2 | | mime-types | 3.2.2 | | httpclient | 2.8.3 | | google-api-client | 0.23.9 | | tty-cursor | 0.7.0 | | tty-spinner | 0.9.1 | | tty-screen | 0.7.0 | | faraday | 0.15.4 | | json | 2.2.0 | | io-console | 0.4.5 | | excon | 0.66.0 | | rubyzip | 1.2.3 | | CFPropertyList | 3.0.1 | | libxml-ruby | 2.9.0 | | plist | 3.5.0 | | atomos | 0.1.3 | | colored2 | 3.1.2 | | nanaimo | 0.2.6 | | xcodeproj | 1.12.0 | | claide | 1.0.3 | | google-cloud-env | 1.2.1 | | google-cloud-core | 1.3.1 | | digest-crc | 0.4.1 | | google-cloud-storage | 1.16.0 | | memoist | 0.16.0 | | multi_json | 1.13.1 | | googleauth | 0.6.7 | | unf | 0.1.4 | | domain_name | 0.5.20190701 | | faraday_middleware | 0.13.1 | | signet | 0.11.0 | | fastimage | 2.1.5 | | bundler | 2.0.2 | | unicode-display_width | 1.6.0 | | addressable | 2.6.0 | | os | 1.0.1 | | psych | 2.1.0.1 | | mime-types-data | 3.2019.0331 | | xctest_list | 1.1.8 | | colorize | 0.8.1 | | fastlane-plugin-test_center | 3.8.4 |
jineshqa
All 75 comments
This works fine for Xcode 10?
lyndsey-ferguson
on 25 Sep 2019
Yes it does. Also, take a look at this as well.
jineshqa
on 25 Sep 2019
@jineshqa do you have a theory that they are somehow related? This issue that you created seems to indicate that there is a problem collating test result bundles. The issue that you reference fastlane/fastlane#15138 indicates that there is a crash after uploading to testflight.
lyndsey-ferguson
on 25 Sep 2019
I saw that you commented in the issue. According to the stack trace of the crash, these are not related issues.
lyndsey-ferguson
on 25 Sep 2019
As this fails in both Xcode 10 and Xcode 11, this is probably not related to the versions. I haven't changed anything in the collation of test result bundles of v3.8.4 vs. v.3.8.x.
You must have something in your project that is catching an edge case that I have not encountered before. I need either the test result bundles to see why the collation fails, or a sample project that you can submit freely that exhibits the problem.
🙏
lyndsey-ferguson
on 25 Sep 2019
Hey Lyndsey,
This does not fail on xcode 10.
Thanks,
Jinesh
jineshqa
on 26 Sep 2019
Okay. Can you provide the test result bundles?
lyndsey-ferguson
on 26 Sep 2019
Oh, and another question, if you remove the request to create test_result bundles, does it still crash?
lyndsey-ferguson
on 26 Sep 2019
I am not sure I can try.
jineshqa
on 26 Sep 2019
Also, will get you sample project.
jineshqa
on 26 Sep 2019
I am not sure I can try.
This is didn't help.
jineshqa
on 27 Sep 2019
Also, will get you sample project.
Sample project is located here
Test output is attached.
test_outout.zip
jineshqa
on 27 Sep 2019
@lyndsey-ferguson is above info good enough.
jineshqa
on 1 Oct 2019
@jineshqa yes, I was able to fix the crash. I have a PR open.
Can you modify your Pluginfile per my instructions below, run bundle install, and then run your fastlane again (with the --verbose flag)?
Pluginfile:
gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-145-crash-when-collating-test-bundles"
If there are still problems, please let me know and attach the console output as a text file to this issue (makes it easier for me to review). If it works, please let me know.
lyndsey-ferguson
on 1 Oct 2019
However, I do not believe that collation now works. The test summaries no longer exist and the tests failures and passes are no longer listed.
lyndsey-ferguson
on 1 Oct 2019
It looks like there is a new format:
https://github.com/fastlane-community/trainer/issues/32
lyndsey-ferguson
on 1 Oct 2019
Ok, this looks like a lot of work.
lyndsey-ferguson
on 1 Oct 2019
I'm going to change this issue to a Feature Request to support Xcode 11 format.
lyndsey-ferguson
on 1 Oct 2019
Actually, I can issue a fix for now until test_result bundles can be collated with the new format.
lyndsey-ferguson
on 1 Oct 2019
@jineshqa try running the branch I suggested above with multi_scan. It will use version 2 of the test result bundle path
lyndsey-ferguson
on 1 Oct 2019
This should have everything you need.
jineshqa
on 2 Oct 2019
Please try again.
Delete your Gemfile.lock file, make sure that you have modified your Pluginfile per my instructions below, run bundle install, and then run your fastlane again (with the --verbose flag).
Pluginfile:
gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-145-crash-when-collating-test-bundles"
If there are still problems, please let me know and attach the complete console output as a text file to this issue (makes it easier for me to review). If it works, please let me know.
lyndsey-ferguson
on 3 Oct 2019
Monday Oct 7th EOD, promise.
jineshqa
on 6 Oct 2019
@jineshqa I got your console.log from the closed issue. To answer the question, no, there is an edge-case that I overlooked. Thanks for providing the log, super helpful.
lyndsey-ferguson
on 8 Oct 2019
@jineshqa @szymon-kazmierczak I _believe_ (:pray:) that I have fixed the issue.
Can you modify your Pluginfile per my instructions below, (if you already have, please delete your Gemfile.lock file), run bundle install, and then run your fastlane again (with the --verbose flag)?
Pluginfile:
gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-145-crash-when-collating-test-bundles"
If there are still problems, please let me know and attach the console output as a text file to this issue (makes it easier for me to review). If it works, please let me know.
lyndsey-ferguson
on 10 Oct 2019
@jineshqa @szymon-kazmierczak any update?
lyndsey-ferguson
on 12 Oct 2019
I still see the error. I followed your instructions to the dot. Below is my fastlane env output if it helps.
🚫 fastlane environment 🚫
Stack
| Key | Value |
| --------------------------- | -------------------------------------------------------------- |
| OS | 10.14.6 |
| Ruby | 2.3.7 |
| Bundler? | false |
| Git | git version 2.19.0 |
| Installation Source | ~/.gems/bin/fastlane |
| Host | Mac OS X 10.14.6 (18G95) |
| Ruby Lib Dir | /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib |
| OpenSSL Version | LibreSSL 2.6.5 |
| Is contained | false |
| Is homebrew | false |
| Is installed via Fabric.app | false |
| Xcode Path | /Applications/Xcode11.app/Contents/Developer/ |
| Xcode Version | 11.1 |
System Locale
| Variable | Value | |
| -------- | ----------- | - |
| LANG | en_US.UTF-8 | ✅ |
| LC_ALL | | |
| LANGUAGE | | |
fastlane files:
./fastlane/Fastfile
# This file contains the fastlane.tools configuration
# You can find the documentation at https://docs.fastlane.tools
#
# For a list of all available actions, check out
#
# https://docs.fastlane.tools/actions
#
# For a list of all available plugins, check out
#
# https://docs.fastlane.tools/plugins/available-plugins
#
# Uncomment the line if you want fastlane to automatically update itself
# update_fastlane
default_platform(:ios)
platform :ios do
lane :sweep do
begin
sh 'rm -rf ./test_output'
rescue
end
test_run_block = lambda do |testrun_info|
failed_test_count = testrun_info[:failed].size
if failed_test_count > 0
UI.important('The run of tests would finish with failures due to fragile tests here.')
try_attempt = testrun_info[:try_count]
if try_attempt < 3
UI.header('Since we are using :multi_scan, we can re-run just those failing tests!')
end
end
end
result = multi_scan(
try_count: 3,
fail_build: false,
scheme: 'collate errors',
result_bundle: true,
device: "iPhone 11 (13.1)",
testrun_completed_block: test_run_block,
output_directory: './fastlane/test_output',
output_types: 'junit,html',
buildlog_path: './fastlane/test_output/',
code_coverage: true,
invocation_based_tests: false,
parallel_testrun_count: 2
)
unless result[:failed_testcount].zero?
UI.message("There are #{result[:failed_testcount]} legitimate failing tests")
end
end
end
./fastlane/Appfile
# app_identifier("[[APP_IDENTIFIER]]") # The bundle identifier of your app
# apple_id("[[APPLE_ID]]") # Your Apple email address
# For more information about the Appfile, see:
# https://docs.fastlane.tools/advanced/#appfile
fastlane gems
| Gem | Version | Update-Status |
| -------- | ------- | ------------- |
| fastlane | 2.133.0 | ✅ Up-To-Date |
Loaded fastlane plugins:
| Plugin | Version | Update-Status |
| --------------------------- | ------- | ------------------ |
| fastlane-plugin-test_center | 3.8.5 | 🚫 Update available |
Loaded gems
| Gem | Version |
| --------------------------- | ------------ |
| did_you_mean | 1.0.0 |
| slack-notifier | 2.3.2 |
| rouge | 2.0.7 |
| xcpretty | 0.3.0 |
| terminal-notifier | 2.0.0 |
| terminal-table | 1.8.0 |
| multipart-post | 2.0.0 |
| word_wrap | 1.0.0 |
| public_suffix | 2.0.5 |
| colored | 1.2 |
| highline | 1.7.10 |
| commander-fastlane | 4.4.6 |
| http-cookie | 1.0.3 |
| faraday-cookie_jar | 0.0.6 |
| gh_inspector | 1.1.3 |
| mini_magick | 4.9.5 |
| multi_xml | 0.6.0 |
| rubyzip | 1.3.0 |
| security | 0.1.3 |
| xcpretty-travis-formatter | 1.0.0 |
| jwt | 2.1.0 |
| uber | 0.1.0 |
| declarative | 0.0.10 |
| declarative-option | 0.1.0 |
| representable | 3.0.4 |
| retriable | 3.1.2 |
| httpclient | 2.8.3 |
| google-api-client | 0.23.9 |
| tty-cursor | 0.7.0 |
| tty-spinner | 0.9.1 |
| tty-screen | 0.7.0 |
| faraday | 0.15.4 |
| json | 2.2.0 |
| io-console | 0.4.5 |
| excon | 0.67.0 |
| CFPropertyList | 3.0.1 |
| libxml-ruby | 2.9.0 |
| plist | 3.5.0 |
| atomos | 0.1.3 |
| colored2 | 3.1.2 |
| nanaimo | 0.2.6 |
| xcodeproj | 1.12.0 |
| claide | 1.0.3 |
| google-cloud-env | 1.2.1 |
| google-cloud-core | 1.3.1 |
| digest-crc | 0.4.1 |
| google-cloud-storage | 1.16.0 |
| memoist | 0.16.0 |
| multi_json | 1.13.1 |
| googleauth | 0.6.7 |
| unf | 0.1.4 |
| domain_name | 0.5.20190701 |
| faraday_middleware | 0.13.1 |
| signet | 0.11.0 |
| babosa | 1.0.3 |
| fastimage | 2.1.7 |
| bundler | 2.0.2 |
| unicode-display_width | 1.6.0 |
| addressable | 2.7.0 |
| os | 1.0.1 |
| psych | 2.1.0.1 |
| mime-types | 3.3 |
| mime-types-data | 3.2019.1009 |
| xctest_list | 1.1.8 |
| colorize | 0.8.1 |
| fastlane-plugin-test_center | 3.8.5 |
generated on: 2019-10-12
jineshqa
on 12 Oct 2019
My plugin file looks like this,
# Autogenerated by fastlane
#
# Ensure this file is checked in to source control!
gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-145-crash-when-collating-test-bundles"
For some reason, it is failing to pre-delete xcresult files. When xcodebuild tries to create a new one, it fails because it already exists.
lyndsey-ferguson
on 13 Oct 2019
Can you remove your Gemfile.lock file, bundle install, and then re-run your lane with the --verbose flag?
lyndsey-ferguson
on 13 Oct 2019
I've added more logging
lyndsey-ferguson
on 13 Oct 2019
There you go captain. @lyndsey-ferguson
jineshqa
on 13 Oct 2019
@lyndsey-ferguson seems to be working for me! Btw, with multiscan parallel support my test run went down from 1 hour 20 minutes to 26 minutes with only 3 simulators 😂 Amazing work on the plugin 🤘
szymon-kazmierczak
on 14 Oct 2019
@szymon-kazmierczak thank you for testing and confirming the fix. I truly appreciate that you shared the good news and the joy 😄.
Now I just have to figure out what is going on with @jineshqa 's system.
lyndsey-ferguson
on 14 Oct 2019
@jineshqa can you please remove your Gemfile.lock, modify your Pluginfile per my instructions below, run bundle install, and confirm that the revision SHA for the fastlane-plugin-test_center is add995823a105d1b4b257a33fc7efaf92fa79f78?
The section in the Gemfile.lock file for the plugin should look like this:
GIT
remote: https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git
revision: add995823a105d1b4b257a33fc7efaf92fa79f78
branch: issue-145-crash-when-collating-test-bundles
specs:
fastlane-plugin-test_center (3.8.5)
colorize
json
plist
xcodeproj
xctest_list (>= 1.1.8)
Once you've confirmed that the Gemfile.lock is pointing to the correct source, run your fastlane again (with the --verbose flag).
Pluginfile:
gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-145-crash-when-collating-test-bundles"
If there are still problems, please let me know and attach the console output as a text file to this issue (makes it easier for me to review). If it works, please let me know.
lyndsey-ferguson
on 14 Oct 2019
Gemlock file screenshot
Pluginfile
gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-145-crash-when-collating-test-bundles"
Bundle list output
Console log
console_verbose.txt
jineshqa
on 14 Oct 2019
@jineshqa, the logs indicate that it was not run with the latest changes. For example, in the logs I see this:
[0;32;49m[worker 2] [0mDEBUG [2019-10-14 10:17:32.10]: Deleting xcresults:
[0;32;49m[worker 2] [0mDEBUG [2019-10-14 10:17:32.10]: Restarting Simulator D7EF0888
Where on my local, I see this:
[worker 1] DEBUG [2019-10-14 14:01:37.48]: About to check if we are using Xcdoe 11
[worker 1] DEBUG [2019-10-14 14:01:37.48]: Also looking in '/Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/fastlane/test_output/AtomicBoyTests-batch-1' for xcresult bundles
[worker 1] DEBUG [2019-10-14 14:01:37.48]: Deleting xcresults:
[worker 1] DEBUG [2019-10-14 14:01:37.48]: /Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/fastlane/test_output/AtomicBoyTests-batch-1/AtomicBoy.test_result.xcresult
[worker 1] DEBUG [2019-10-14 14:01:37.49]: Restarting Simulator EF4C5F39
The difference above tells me that what you are running is _not_ using the latest code.
lyndsey-ferguson
on 14 Oct 2019
Is this running on CI and your bundle install was performed locally? CI must have the same Gemfile.lock and Pluginfile in order to get those changes.
lyndsey-ferguson
on 14 Oct 2019
@lyndsey-ferguson
I am running it on local and I do bundle install manually. What you are suggesting is that somehow I am not running the latest code from the branch that you told me to add in plugin file? If yes, kindly tell me how to make sure that I am running the latest. I checked the SHA and it's same as you mentioned. Also, I uninstalled the fastlane-plugin-test_center gem before I ran bundle install just to be sure. What else should I be doing?
jineshqa
on 14 Oct 2019
Let's put a breakpoint in to see if it is the same code. I will assume that you have not done debugging of Ruby code before, so please be patient and follow these instructions (and thank you for your participation!!):
- Add
gem 'pry-byebug'to yourGemfile - Run
bundle install - In your
Fastfileadd this to the top:require 'pry-byebug' - In your
Fastfile, above the line where you callmulti_scanaddbyebug. - Remove the option to run
parallel_testrun_count(otherwise your code will lock up waiting for you to respond to the debug console in another process that you do not have access to). - Run your fastlane with the
--verboseflag - The code should stop and put you into a
byebugdebug session. - Add a breakpoint in the method that deletes the
xcresultsby typing:
b ::TestCenter::Helper::MultiScanManager::RetryingScanHelper#delete_xcresults
- Type
cto continue
- When the code stops at the breakpoint, copy the code and paste it here.
For example, it will look like this:
[35, 44] in /Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan_helper.rb
35: `xcrun simctl boot #{udid} 2>/dev/null`
36: end
37: end
38: end
39:
=> 40: def delete_xcresults
41: derived_data_path = File.expand_path(@options[:derived_data_path] || Scan.config[:derived_data_path])
42: xcresults = Dir.glob("#{derived_data_path}/Logs/Test/*.xcresult")
43: FastlaneCore::UI.verbose("About to check if we are using Xcdoe 11")
44: if FastlaneCore::Helper.xcode_at_least?('11.0.0')
- Type
cto continue if your code looks like the above. Once a test-run completes, it will stop here again. Pressnto follow the code to see what is going on here. If it _does_ not stop here, we'll figure out what to do next.
lyndsey-ferguson
on 14 Oct 2019
Please be sure to include the file path as I did. I want to make sure it is using the correct gem.
lyndsey-ferguson
on 14 Oct 2019
One other thing, you do not have to uninstall the gem. But you _do_ need to remove the Gemfile.lock file. Also, and this is important, are you running fastlane with the bundle exec command? It makes sure that the gems that are being used are the ones you specified in your Gemfile.
Very important
i.e.:
bundle exec fastlane <your_lane_name_here> --verbose
@lyndsey-ferguson Apologies for the delay. I am dealing with a stupid setup issue.
INFO [2019-10-15 16:26:51.12]: ▸ Loading...
INFO [2019-10-15 16:26:51.38]: ▸ Ignoring byebug-11.0.1 because its extensions are not built. Try: gem pristine byebug --version 11.0.1
INFO [2019-10-15 16:26:51.64]: ▸ Could not find byebug-11.0.1 in any of the sources
INFO [2019-10-15 16:26:51.64]: ▸ Run `bundle install` to install missing gems.
Even though byebug is installed.
~ bundle list | grep 'byebug'
* byebug (11.0.1)
* pry-byebug (3.7.0)
Any idea?
jineshqa
on 16 Oct 2019
How are you calling it? This is what I would do if I were you:
- Add the
pry-byebuggem to your Gemfile. - Run bundle install
- Run
bundle exec fastlane your_lane_name --verbose
This is when you've put the require 'pry-byebug' in your Fastfile right?
If you ran gem install pry-byebug that may not install it in the right place for when you run bundle exec fastlane ....
lyndsey-ferguson
on 16 Oct 2019
That is exactly what I am trying to do but when I execute bundle exec fastlane sweep --verbose command fails with the below error.
INFO [2019-10-15 16:26:51.12]: ▸ Loading...
INFO [2019-10-15 16:26:51.38]: ▸ Ignoring byebug-11.0.1 because its extensions are not built. Try: gem pristine byebug --version 11.0.1
INFO [2019-10-15 16:26:51.64]: ▸ Could not find byebug-11.0.1 in any of the sources
INFO [2019-10-15 16:26:51.64]: ▸ Run `bundle install` to install missing gems.
jineshqa
on 16 Oct 2019
Ah, did you already gem pristine byebug --version 11.0.1?
Otherwise I would gem cleanup byebug; gem cleanup pry-byebug
lyndsey-ferguson
on 16 Oct 2019
Now my entire ruby installation is messed up. The default one on the OS.
jineshqa
on 16 Oct 2019
What did you do? I cannot imagine that running those commands would cause the problem.
Unless, you ran other commands with sudo. That would be very dangerous.
lyndsey-ferguson
on 16 Oct 2019
I highly recommend using a virtual version manager such as rbenv. That way you will not break your system Ruby and you can install any version of Ruby that you want.
lyndsey-ferguson
on 16 Oct 2019
Will do that..for now the ruby is restored but now I am getting a new error.
No tests found in '/Users/jdoshi/Documents/Jinesh/workspace/xx/DerivedData/xx/Build/Products/Debug-iphonesimulator/xx-Runner.app/PlugIns/xx.xctest'!
Is the Build Setting,ENABLE_TESTABILITYenabled for the test target JobsUITests?
I am using Xcode Version 11.1 (11A1027)
jineshqa
on 16 Oct 2019
😱
lyndsey-ferguson
on 16 Oct 2019
Unending challenges!
lyndsey-ferguson
on 16 Oct 2019
Is the ENABLE_TESTABILITY on for that test target?
lyndsey-ferguson
on 16 Oct 2019
Does that xctest file exist?
lyndsey-ferguson
on 16 Oct 2019
Enable_testability is on and xctest file does exist. However I get this message at the beginning of the run. Do you think this has anything to do with missing tests?
Ignoring byebug-11.0.1 because its extensions are not built. Try: gem pristine byebug --version 11.0.1
jineshqa
on 17 Oct 2019
Any idea what would cause this?
[15:40:09]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -scheme collate\ errors -project ./collate_errors.xcodeproj -destination 'platform=iOS Simulator,id=D67DE434-EABF-46AA-84BB-522E7061C854' -derivedDataPath '/Users/jdoshi/Documents/Jinesh/ios/code/collate_errors/DerivedData/collate_errors' -resultBundlePath './fastlane/test_output/collate errors.test_result' -enableCodeCoverage YES build-for-testing | tee '/Users/jdoshi/Documents/Jinesh/ios/code/collate_errors/fastlane/test_output/collate_errors-collate errors.log' | xcpretty --report junit --output '/Users/jdoshi/Documents/Jinesh/ios/code/collate_errors/fastlane/test_output/report.junit' --report html --output '/Users/jdoshi/Documents/Jinesh/ios/code/collate_errors/fastlane/test_output/report.html' --report junit --output '/var/folders/_v/385bsl711hj8mg07gcv518y80000gn/T/junit_report20191016-58813-r4hkz5'
[15:40:09]: ▸ Loading...
[15:40:11]: ▸ Test build Succeeded
+--------------------+---+
| Test Results |
+--------------------+---+
| Number of tests | 0 |
| Number of failures | 0 |
+--------------------+---+
nm: invalid option -- U
Usage: nm [option(s)] [file(s)]
List symbols in [file(s)] (a.out by default).
The options are:
-a, --debug-syms Display debugger-only symbols
-A, --print-file-name Print name of the input file before every symbol
-B Same as --format=bsd
-C, --demangle[=STYLE] Decode low-level symbol names into user-level names
The STYLE, if specified, can be `auto' (the default),
`gnu', `lucid', `arm', `hp', `edg', `gnu-v3', `java'
or `gnat'
--no-demangle Do not demangle low-level symbol names
--recurse-limit Enable a demangling recursion limit. This is the default.
--no-recurse-limit Disable a demangling recursion limit.
-D, --dynamic Display dynamic symbols instead of normal symbols
--defined-only Display only defined symbols
-e (ignored)
-f, --format=FORMAT Use the output format FORMAT. FORMAT can be `bsd',
`sysv' or `posix'. The default is `bsd'
-g, --extern-only Display only external symbols
-l, --line-numbers Use debugging information to find a filename and
line number for each symbol
-n, --numeric-sort Sort symbols numerically by address
-o Same as -A
-p, --no-sort Do not sort the symbols
-P, --portability Same as --format=posix
-r, --reverse-sort Reverse the sense of the sort
--plugin NAME Load the specified plugin
-S, --print-size Print size of defined symbols
-s, --print-armap Include index for symbols from archive members
--size-sort Sort symbols by size
--special-syms Include special symbols in the output
--synthetic Display synthetic symbols as well
-t, --radix=RADIX Use RADIX for printing symbol values
--target=BFDNAME Specify the target object format as BFDNAME
-u, --undefined-only Display only undefined symbols
--with-symbol-versions Display version strings after symbol names
-X 32_64 (ignored)
@FILE Read options from FILE
-h, --help Display this information
-V, --version Display this program's version number
nm: supported targets: mach-o-x86-64 elf32-bigaarch64 elf32-littleaarch64 elf64-bigaarch64 elf64-bigaarch64-cloudabi elf64-littleaarch64 elf64-littleaarch64-cloudabi mach-o-arm64 ecoff-littlealpha elf64-alpha elf64-alpha-freebsd vms-alpha vms-libtxt elf32-am33lin elf32-bigarc elf32-littlearc elf32-bigarm elf32-littlearm elf32-bigarm-fdpic elf32-littlearm-fdpic elf32-bigarm-symbian elf32-littlearm-symbian elf32-bigarm-vxworks elf32-littlearm-vxworks mach-o-arm pe-arm-big pe-arm-little pe-arm-wince-big pe-arm-wince-little pei-arm-big pei-arm-little pei-arm-wince-big pei-arm-wince-little elf32-avr elf32-bfin elf32-bfinfdpic elf32-cr16 elf32-cr16c a.out-cris elf32-cris elf32-us-cris elf32-crx elf32-csky-big elf32-csky-little elf32-d10v elf32-d30v elf32-dlx elf32-big elf32-little elf64-big elf64-little elf32-epiphany elf32-fr30 elf32-frv elf32-frvfdpic elf32-h8300 elf32-h8300-linux elf32-hppa elf32-hppa-linux elf32-hppa-netbsd elf64-hppa elf64-hppa-linux som a.out-i386 a.out-i386-bsd a.out-i386-lynx coff-i386 coff-go32 coff-go32-exe coff-i386-lynx elf32-i386 elf32-i386-freebsd elf32-i386-nacl elf32-i386-sol2 elf32-i386-vxworks mach-o-i386 msdos pe-i386 pei-i386 elf32-iamcu elf32-ia64-hpux-big elf64-ia64-big elf64-ia64-little elf64-ia64-hpux-big elf64-ia64-vms pei-ia64 elf32-ip2k elf32-iq2000 elf64-k1om elf64-k1om-freebsd elf64-l1om elf64-l1om-freebsd elf32-lm32 elf32-m32c elf32-m32r elf32-m32rle elf32-m32r-linux elf32-m32rle-linux elf32-m68hc11 elf32-m68hc12 elf32-m68k elf32-s12z mach-o-be mach-o-le mach-o-fat elf32-mcore-big elf32-mcore-little pe-mcore-big pe-mcore-little pei-mcore-big pei-mcore-little elf32-mep elf32-metag elf32-microblaze ecoff-bigmips ecoff-littlemips ecoff-biglittlemips elf32-bigmips elf32-littlemips elf32-nbigmips elf32-nlittlemips elf32-ntradbigmips elf32-ntradlittlemips elf32-ntradbigmips-freebsd elf32-ntradlittlemips-freebsd elf32-tradbigmips elf32-tradlittlemips elf32-tradbigmips-freebsd elf32-tradlittlemips-freebsd elf32-bigmips-vxworks elf32-littlemips-vxworks elf64-bigmips elf64-littlemips elf64-tradbigmips elf64-tradlittlemips elf64-tradbigmips-freebsd elf64-tradlittlemips-freebsd elf64-mmix mmo elf32-mn10200 elf32-mn10300 elf32-bigmoxie elf32-littlemoxie elf32-msp430 elf32-msp430 elf32-mt elf32-nds32be elf32-nds32le elf32-nds32be-linux elf32-nds32le-linux elf64-nfp elf32-bignios2 elf32-littlenios2 a.out-pc532-mach a.out-ns32k-netbsd elf32-or1k a.out-pdp11 pef pef-xlib elf32-pj elf32-pjl plugin ppcboot elf32-powerpc elf32-powerpcle elf32-powerpc-freebsd elf32-powerpc-vxworks elf64-powerpc elf64-powerpcle elf64-powerpc-freebsd pe-powerpc pe-powerpcle pei-powerpc pei-powerpcle elf32-pru elf32-littleriscv elf64-littleriscv elf32-rl78 aixcoff64-rs6000 aix5coff64-rs6000 aixcoff-rs6000 elf32-rx-be elf32-rx-be-ns elf32-rx-le elf32-s390 elf64-s390 elf32-bigscore elf32-littlescore coff-sh coff-shl coff-sh-small coff-shl-small elf32-sh elf32-shl elf32-shbig-fdpic elf32-sh-fdpic elf32-sh-linux elf32-shbig-linux elf32-sh-nbsd elf32-shl-nbsd elf32-sh-vxworks elf32-shl-vxworks pe-shl pei-shl elf32-sparc elf32-sparc-sol2 elf32-sparc-vxworks elf64-sparc elf64-sparc-freebsd elf64-sparc-sol2 elf32-spu sym a.out-tic30 coff-tic30 coff0-beh-c54x coff0-c54x coff1-beh-c54x coff1-c54x coff2-beh-c54x coff2-c54x elf32-tic6x-be elf32-tic6x-le coff-tic80 elf32-tilegx-be elf32-tilegx-le elf64-tilegx-be elf64-tilegx-le elf32-tilepro elf32-ft32 elf32-v850-rh850 elf32-v850 a.out-vax1k-netbsd a.out-vax-netbsd elf32-vax elf32-visium wasm elf32-wasm32 coff-x86-64 elf32-x86-64 elf32-x86-64-nacl elf64-x86-64 elf64-x86-64-cloudabi elf64-x86-64-freebsd elf64-x86-64-nacl elf64-x86-64-sol2 pe-x86-64 pe-bigobj-x86-64 pei-x86-64 elf32-xc16x elf32-xgate elf32-xstormy16 elf32-xtensa-be elf32-xtensa-le coff-z80 coff-z8k srec symbolsrec verilog tekhex binary ihex
nm: invalid option -- i
Usage: nm [option(s)] [file(s)]
List symbols in [file(s)] (a.out by default).
The options are:
-a, --debug-syms Display debugger-only symbols
-A, --print-file-name Print name of the input file before every symbol
-B Same as --format=bsd
-C, --demangle[=STYLE] Decode low-level symbol names into user-level names
The STYLE, if specified, can be `auto' (the default),
`gnu', `lucid', `arm', `hp', `edg', `gnu-v3', `java'
or `gnat'
--no-demangle Do not demangle low-level symbol names
--recurse-limit Enable a demangling recursion limit. This is the default.
--no-recurse-limit Disable a demangling recursion limit.
-D, --dynamic Display dynamic symbols instead of normal symbols
--defined-only Display only defined symbols
-e (ignored)
-f, --format=FORMAT Use the output format FORMAT. FORMAT can be `bsd',
`sysv' or `posix'. The default is `bsd'
-g, --extern-only Display only external symbols
-l, --line-numbers Use debugging information to find a filename and
line number for each symbol
-n, --numeric-sort Sort symbols numerically by address
-o Same as -A
-p, --no-sort Do not sort the symbols
-P, --portability Same as --format=posix
-r, --reverse-sort Reverse the sense of the sort
--plugin NAME Load the specified plugin
-S, --print-size Print size of defined symbols
-s, --print-armap Include index for symbols from archive members
--size-sort Sort symbols by size
--special-syms Include special symbols in the output
--synthetic Display synthetic symbols as well
-t, --radix=RADIX Use RADIX for printing symbol values
--target=BFDNAME Specify the target object format as BFDNAME
-u, --undefined-only Display only undefined symbols
--with-symbol-versions Display version strings after symbol names
-X 32_64 (ignored)
@FILE Read options from FILE
-h, --help Display this information
-V, --version Display this program's version number
nm: supported targets: mach-o-x86-64 elf32-bigaarch64 elf32-littleaarch64 elf64-bigaarch64 elf64-bigaarch64-cloudabi elf64-littleaarch64 elf64-littleaarch64-cloudabi mach-o-arm64 ecoff-littlealpha elf64-alpha elf64-alpha-freebsd vms-alpha vms-libtxt elf32-am33lin elf32-bigarc elf32-littlearc elf32-bigarm elf32-littlearm elf32-bigarm-fdpic elf32-littlearm-fdpic elf32-bigarm-symbian elf32-littlearm-symbian elf32-bigarm-vxworks elf32-littlearm-vxworks mach-o-arm pe-arm-big pe-arm-little pe-arm-wince-big pe-arm-wince-little pei-arm-big pei-arm-little pei-arm-wince-big pei-arm-wince-little elf32-avr elf32-bfin elf32-bfinfdpic elf32-cr16 elf32-cr16c a.out-cris elf32-cris elf32-us-cris elf32-crx elf32-csky-big elf32-csky-little elf32-d10v elf32-d30v elf32-dlx elf32-big elf32-little elf64-big elf64-little elf32-epiphany elf32-fr30 elf32-frv elf32-frvfdpic elf32-h8300 elf32-h8300-linux elf32-hppa elf32-hppa-linux elf32-hppa-netbsd elf64-hppa elf64-hppa-linux som a.out-i386 a.out-i386-bsd a.out-i386-lynx coff-i386 coff-go32 coff-go32-exe coff-i386-lynx elf32-i386 elf32-i386-freebsd elf32-i386-nacl elf32-i386-sol2 elf32-i386-vxworks mach-o-i386 msdos pe-i386 pei-i386 elf32-iamcu elf32-ia64-hpux-big elf64-ia64-big elf64-ia64-little elf64-ia64-hpux-big elf64-ia64-vms pei-ia64 elf32-ip2k elf32-iq2000 elf64-k1om elf64-k1om-freebsd elf64-l1om elf64-l1om-freebsd elf32-lm32 elf32-m32c elf32-m32r elf32-m32rle elf32-m32r-linux elf32-m32rle-linux elf32-m68hc11 elf32-m68hc12 elf32-m68k elf32-s12z mach-o-be mach-o-le mach-o-fat elf32-mcore-big elf32-mcore-little pe-mcore-big pe-mcore-little pei-mcore-big pei-mcore-little elf32-mep elf32-metag elf32-microblaze ecoff-bigmips ecoff-littlemips ecoff-biglittlemips elf32-bigmips elf32-littlemips elf32-nbigmips elf32-nlittlemips elf32-ntradbigmips elf32-ntradlittlemips elf32-ntradbigmips-freebsd elf32-ntradlittlemips-freebsd elf32-tradbigmips elf32-tradlittlemips elf32-tradbigmips-freebsd elf32-tradlittlemips-freebsd elf32-bigmips-vxworks elf32-littlemips-vxworks elf64-bigmips elf64-littlemips elf64-tradbigmips elf64-tradlittlemips elf64-tradbigmips-freebsd elf64-tradlittlemips-freebsd elf64-mmix mmo elf32-mn10200 elf32-mn10300 elf32-bigmoxie elf32-littlemoxie elf32-msp430 elf32-msp430 elf32-mt elf32-nds32be elf32-nds32le elf32-nds32be-linux elf32-nds32le-linux elf64-nfp elf32-bignios2 elf32-littlenios2 a.out-pc532-mach a.out-ns32k-netbsd elf32-or1k a.out-pdp11 pef pef-xlib elf32-pj elf32-pjl plugin ppcboot elf32-powerpc elf32-powerpcle elf32-powerpc-freebsd elf32-powerpc-vxworks elf64-powerpc elf64-powerpcle elf64-powerpc-freebsd pe-powerpc pe-powerpcle pei-powerpc pei-powerpcle elf32-pru elf32-littleriscv elf64-littleriscv elf32-rl78 aixcoff64-rs6000 aix5coff64-rs6000 aixcoff-rs6000 elf32-rx-be elf32-rx-be-ns elf32-rx-le elf32-s390 elf64-s390 elf32-bigscore elf32-littlescore coff-sh coff-shl coff-sh-small coff-shl-small elf32-sh elf32-shl elf32-shbig-fdpic elf32-sh-fdpic elf32-sh-linux elf32-shbig-linux elf32-sh-nbsd elf32-shl-nbsd elf32-sh-vxworks elf32-shl-vxworks pe-shl pei-shl elf32-sparc elf32-sparc-sol2 elf32-sparc-vxworks elf64-sparc elf64-sparc-freebsd elf64-sparc-sol2 elf32-spu sym a.out-tic30 coff-tic30 coff0-beh-c54x coff0-c54x coff1-beh-c54x coff1-c54x coff2-beh-c54x coff2-c54x elf32-tic6x-be elf32-tic6x-le coff-tic80 elf32-tilegx-be elf32-tilegx-le elf64-tilegx-be elf64-tilegx-le elf32-tilepro elf32-ft32 elf32-v850-rh850 elf32-v850 a.out-vax1k-netbsd a.out-vax-netbsd elf32-vax elf32-visium wasm elf32-wasm32 coff-x86-64 elf32-x86-64 elf32-x86-64-nacl elf64-x86-64 elf64-x86-64-cloudabi elf64-x86-64-freebsd elf64-x86-64-nacl elf64-x86-64-sol2 pe-x86-64 pe-bigobj-x86-64 pei-x86-64 elf32-xc16x elf32-xgate elf32-xstormy16 elf32-xtensa-be elf32-xtensa-le coff-z80 coff-z8k srec symbolsrec verilog tekhex binary ihex
nm: invalid option -- U
Usage: nm [option(s)] [file(s)]
List symbols in [file(s)] (a.out by default).
The options are:
-a, --debug-syms Display debugger-only symbols
-A, --print-file-name Print name of the input file before every symbol
-B Same as --format=bsd
-C, --demangle[=STYLE] Decode low-level symbol names into user-level names
The STYLE, if specified, can be `auto' (the default),
`gnu', `lucid', `arm', `hp', `edg', `gnu-v3', `java'
or `gnat'
--no-demangle Do not demangle low-level symbol names
--recurse-limit Enable a demangling recursion limit. This is the default.
--no-recurse-limit Disable a demangling recursion limit.
-D, --dynamic Display dynamic symbols instead of normal symbols
--defined-only Display only defined symbols
-e (ignored)
-f, --format=FORMAT Use the output format FORMAT. FORMAT can be `bsd',
`sysv' or `posix'. The default is `bsd'
-g, --extern-only Display only external symbols
-l, --line-numbers Use debugging information to find a filename and
line number for each symbol
-n, --numeric-sort Sort symbols numerically by address
-o Same as -A
-p, --no-sort Do not sort the symbols
-P, --portability Same as --format=posix
-r, --reverse-sort Reverse the sense of the sort
--plugin NAME Load the specified plugin
-S, --print-size Print size of defined symbols
-s, --print-armap Include index for symbols from archive members
--size-sort Sort symbols by size
--special-syms Include special symbols in the output
--synthetic Display synthetic symbols as well
-t, --radix=RADIX Use RADIX for printing symbol values
--target=BFDNAME Specify the target object format as BFDNAME
-u, --undefined-only Display only undefined symbols
--with-symbol-versions Display version strings after symbol names
-X 32_64 (ignored)
@FILE Read options from FILE
-h, --help Display this information
-V, --version Display this program's version number
nm: supported targets: mach-o-x86-64 elf32-bigaarch64 elf32-littleaarch64 elf64-bigaarch64 elf64-bigaarch64-cloudabi elf64-littleaarch64 elf64-littleaarch64-cloudabi mach-o-arm64 ecoff-littlealpha elf64-alpha elf64-alpha-freebsd vms-alpha vms-libtxt elf32-am33lin elf32-bigarc elf32-littlearc elf32-bigarm elf32-littlearm elf32-bigarm-fdpic elf32-littlearm-fdpic elf32-bigarm-symbian elf32-littlearm-symbian elf32-bigarm-vxworks elf32-littlearm-vxworks mach-o-arm pe-arm-big pe-arm-little pe-arm-wince-big pe-arm-wince-little pei-arm-big pei-arm-little pei-arm-wince-big pei-arm-wince-little elf32-avr elf32-bfin elf32-bfinfdpic elf32-cr16 elf32-cr16c a.out-cris elf32-cris elf32-us-cris elf32-crx elf32-csky-big elf32-csky-little elf32-d10v elf32-d30v elf32-dlx elf32-big elf32-little elf64-big elf64-little elf32-epiphany elf32-fr30 elf32-frv elf32-frvfdpic elf32-h8300 elf32-h8300-linux elf32-hppa elf32-hppa-linux elf32-hppa-netbsd elf64-hppa elf64-hppa-linux som a.out-i386 a.out-i386-bsd a.out-i386-lynx coff-i386 coff-go32 coff-go32-exe coff-i386-lynx elf32-i386 elf32-i386-freebsd elf32-i386-nacl elf32-i386-sol2 elf32-i386-vxworks mach-o-i386 msdos pe-i386 pei-i386 elf32-iamcu elf32-ia64-hpux-big elf64-ia64-big elf64-ia64-little elf64-ia64-hpux-big elf64-ia64-vms pei-ia64 elf32-ip2k elf32-iq2000 elf64-k1om elf64-k1om-freebsd elf64-l1om elf64-l1om-freebsd elf32-lm32 elf32-m32c elf32-m32r elf32-m32rle elf32-m32r-linux elf32-m32rle-linux elf32-m68hc11 elf32-m68hc12 elf32-m68k elf32-s12z mach-o-be mach-o-le mach-o-fat elf32-mcore-big elf32-mcore-little pe-mcore-big pe-mcore-little pei-mcore-big pei-mcore-little elf32-mep elf32-metag elf32-microblaze ecoff-bigmips ecoff-littlemips ecoff-biglittlemips elf32-bigmips elf32-littlemips elf32-nbigmips elf32-nlittlemips elf32-ntradbigmips elf32-ntradlittlemips elf32-ntradbigmips-freebsd elf32-ntradlittlemips-freebsd elf32-tradbigmips elf32-tradlittlemips elf32-tradbigmips-freebsd elf32-tradlittlemips-freebsd elf32-bigmips-vxworks elf32-littlemips-vxworks elf64-bigmips elf64-littlemips elf64-tradbigmips elf64-tradlittlemips elf64-tradbigmips-freebsd elf64-tradlittlemips-freebsd elf64-mmix mmo elf32-mn10200 elf32-mn10300 elf32-bigmoxie elf32-littlemoxie elf32-msp430 elf32-msp430 elf32-mt elf32-nds32be elf32-nds32le elf32-nds32be-linux elf32-nds32le-linux elf64-nfp elf32-bignios2 elf32-littlenios2 a.out-pc532-mach a.out-ns32k-netbsd elf32-or1k a.out-pdp11 pef pef-xlib elf32-pj elf32-pjl plugin ppcboot elf32-powerpc elf32-powerpcle elf32-powerpc-freebsd elf32-powerpc-vxworks elf64-powerpc elf64-powerpcle elf64-powerpc-freebsd pe-powerpc pe-powerpcle pei-powerpc pei-powerpcle elf32-pru elf32-littleriscv elf64-littleriscv elf32-rl78 aixcoff64-rs6000 aix5coff64-rs6000 aixcoff-rs6000 elf32-rx-be elf32-rx-be-ns elf32-rx-le elf32-s390 elf64-s390 elf32-bigscore elf32-littlescore coff-sh coff-shl coff-sh-small coff-shl-small elf32-sh elf32-shl elf32-shbig-fdpic elf32-sh-fdpic elf32-sh-linux elf32-shbig-linux elf32-sh-nbsd elf32-shl-nbsd elf32-sh-vxworks elf32-shl-vxworks pe-shl pei-shl elf32-sparc elf32-sparc-sol2 elf32-sparc-vxworks elf64-sparc elf64-sparc-freebsd elf64-sparc-sol2 elf32-spu sym a.out-tic30 coff-tic30 coff0-beh-c54x coff0-c54x coff1-beh-c54x coff1-c54x coff2-beh-c54x coff2-c54x elf32-tic6x-be elf32-tic6x-le coff-tic80 elf32-tilegx-be elf32-tilegx-le elf64-tilegx-be elf64-tilegx-le elf32-tilepro elf32-ft32 elf32-v850-rh850 elf32-v850 a.out-vax1k-netbsd a.out-vax-netbsd elf32-vax elf32-visium wasm elf32-wasm32 coff-x86-64 elf32-x86-64 elf32-x86-64-nacl elf64-x86-64 elf64-x86-64-cloudabi elf64-x86-64-freebsd elf64-x86-64-nacl elf64-x86-64-sol2 pe-x86-64 pe-bigobj-x86-64 pei-x86-64 elf32-xc16x elf32-xgate elf32-xstormy16 elf32-xtensa-be elf32-xtensa-le coff-z80 coff-z8k srec symbolsrec verilog tekhex binary ihex
[15:40:11]: No tests found in '/Users/jdoshi/Documents/Jinesh/ios/code/collate_errors/DerivedData/collate_errors/Build/Products/Debug-iphonesimulator/collate_errorsUITests-Runner.app/PlugIns/collate_errorsUITests.xctest'!
[15:40:11]: Is the Build Setting, `ENABLE_TESTABILITY` enabled for the test target collate_errorsUITests?
+-------------------+------+
| multi_scan results |
+-------------------+------+
| result | true |
| total_tests | 0 |
| passing_testcount | 0 |
| failed_testcount | 0 |
| failed_tests | [] |
| total_retry_count | 0 |
| report_files | [] |
+-------------------+------+
+------+----------------------+-------------+
| fastlane summary |
+------+----------------------+-------------+
| Step | Action | Time (in s) |
+------+----------------------+-------------+
| 1 | default_platform | 0 |
| 2 | rm -rf ./test_output | 0 |
| 3 | multi_scan | 16 |
+------+----------------------+-------------+
[15:40:23]: fastlane.tools finished successfully 🎉
[15:40:23]: Deleting iPhone 11 Clone 1 TestCenter::Helper::MultiScanManager::SimulatorHelper<70164688052480>
[15:40:30]: Deleting iPhone 11 Clone 2 TestCenter::Helper::MultiScanManager::SimulatorHelper<70164688052480>
Any idea what would cause this?
[15:40:09]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -scheme collate\ errors -project ./collate_errors.xcodeproj -destination 'platform=iOS Simulator,id=D67DE434-EABF-46AA-84BB-522E7061C854' -derivedDataPath '/Users/jdoshi/Documents/Jinesh/ios/code/collate_errors/DerivedData/collate_errors' -resultBundlePath './fastlane/test_output/collate errors.test_result' -enableCodeCoverage YES build-for-testing | tee '/Users/jdoshi/Documents/Jinesh/ios/code/collate_errors/fastlane/test_output/collate_errors-collate errors.log' | xcpretty --report junit --output '/Users/jdoshi/Documents/Jinesh/ios/code/collate_errors/fastlane/test_output/report.junit' --report html --output '/Users/jdoshi/Documents/Jinesh/ios/code/collate_errors/fastlane/test_output/report.html' --report junit --output '/var/folders/_v/385bsl711hj8mg07gcv518y80000gn/T/junit_report20191016-58813-r4hkz5' [15:40:09]: ▸ Loading... [15:40:11]: ▸ Test build Succeeded +--------------------+---+ | Test Results | +--------------------+---+ | Number of tests | 0 | | Number of failures | 0 | +--------------------+---+ nm: invalid option -- U
Not offhand. It is stating that the -U option for nm is not valid. Which is _very_ strange. Is this running on a Mac? Have the Command Line Tools been installed? Have they been corrupted?
lyndsey-ferguson
on 17 Oct 2019
With regards to this:
Enable_testability is on and xctest file does exist. However I get this message at the beginning of the run. Do you think this has anything to do with missing tests?
Ignoring byebug-11.0.1 because its extensions are not built. Try: gem pristine byebug --version 11.0.1
This is just stating that the run cannot use the byebug gem. I don't think it would cause the code to determine that there are no tests. I think that the problem is that the nm -U command is failing to pull the tests out of the xctest binary file.
You could try adding _another_ breakpoint once you get byebug installed properly. When your Fastfile breaks at the byebug breakpoint, create a new breakpoint b XCTestList.objc_tests and walk through the code to see why the nm -U ... system command fails.
lyndsey-ferguson
on 17 Oct 2019
I tried to run tests with xcodebuild and it ran just fine. So I'm not sure what is causing this. Command line tools are solid.
jineshqa
on 17 Oct 2019
@lyndsey-ferguson I feel terrible for wasting your time. I think you should just go ahead and merge this PR. Someone already confirmed that it is working for them.
jineshqa
on 17 Oct 2019
Ok...I have to clean it up a bit, I'll do that and you'll see it merged soon.
lyndsey-ferguson
on 17 Oct 2019
Fixed in v3.8.7
lyndsey-ferguson
on 17 Oct 2019
@lyndsey-ferguson didn't want to spam by creating a new issue but I am seeing this after upgrading to latest version of the plugin. Kindly let me know if I should create a new issue or it is just me.
jineshqa
on 18 Oct 2019
Ug.
lyndsey-ferguson
on 18 Oct 2019
I don't have time to test, but it looks like it is using the new apis. Sorry for this.
lyndsey-ferguson
on 18 Oct 2019
Please do not apologize...you are doing awesome work for the community.
jineshqa
on 18 Oct 2019
This is not professional to drop a broken gem out there.
lyndsey-ferguson
on 18 Oct 2019
Well, @szymon-kazmierczak tested and it was working for him. It could be just me.
jineshqa
on 18 Oct 2019
No, I refactored the code and didn't adequately test it.
lyndsey-ferguson
on 18 Oct 2019
@jineshqa, can you modify your Pluginfile per my instructions below, run bundle install, and then run your fastlane again (with the --verbose flag)?
Pluginfile:
gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-145-fix-broken-gem-release"
If there are still problems, please let me know and attach the console output as a text file to this issue (makes it easier for me to review). If it works, please let me know.
lyndsey-ferguson
on 18 Oct 2019
@jineshqa are you doing it now? Have you tested it yet?
Just kidding 😄. Let me know when you've had a chance to look at it.
lyndsey-ferguson
on 18 Oct 2019
Hi @lyndsey-ferguson, it is working fine now. That was a nice quick turn around.
jineshqa
on 18 Oct 2019
truly fixed in v3.8.8
lyndsey-ferguson
on 18 Oct 2019
Fix verified on fastlane-plugin-test_center (3.8.10).
jineshqa
on 19 Oct 2019
Related issues
jineshqa
·
9Comments
zacoid55
·
4Comments
lyndsey-ferguson
·
6Comments
ssharma0312
·
4Comments
jordan-romeroporter-earnin
·
8Comments