NoMethodError: [!] undefined method `-' for nil:NilClass when using invocation_based_tests
Closed this issue · 25 comments
kcatigbe commented
New Issue Checklist
- Updated
fastlane-plugin-test_centerto the latest version - I read the README.md
- I reviewed the example(s) for the action(s) I am using
- I have removed any sensitive data such as passwords, authentication tokens, or anything else I do not want to world to see
Issue Description
When running multi_scan against our project with invocation_based_tests set to true, and having a failing test, we get the following crash:
NoMethodError: [!] undefined method `-' for nil:NilClass
/Users/<private>/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan_helper.rb:248:in `update_only_testing'
We're using a mix of XCTest/XCUITest, and Quick/Nimble tests (hence the need for invocation_based_tests)
If I set invocation_based_tests to false, multi_scan will complete however we're obviously missing a bunch of tests.
Our current env is ruby 2.4.1, however I've run it in ruby 2.6.0 with the same results.
running scan normally is fine.
This is a first-time integration for this tool, so if it's a configuration issue I need to correct I'm all ears!
Complete output when running fastlane, including the stack trace and command used
lane call:
multi_scan(
try_count: 3,
fail_build: false,
parallel_testrun_count: 4,
invocation_based_tests: true
)
trainer(
output_directory: "./output",
path: "./output",
fail_build: false
)
ScanFile:
skip_build(false)
workspace("CNBC5.xcworkspace")
clean("true")
output_style("rspec")
output_types("junit")
max_concurrent_simulators(4)
disable_concurrent_testing(false)
scheme("Debug")
device("iPhone 8")
slack_only_on_failure("true")
code_coverage(true)
output_directory("output")
xcargs('-IDEBuildOperationMaxNumberOfConcurrentCompileTasks=`sysctl -n hw.ncpu`')
fail_build(false)
Stack Trace:
NoMethodError: [!] undefined method `-' for nil:NilClass /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan_helper.rb:248:in `update_only_testing' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan_helper.rb:230:in `update_scan_options' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan_helper.rb:166:in `handle_test_failure' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan_helper.rb:123:in `after_testrun' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan.rb:72:in `rescue in run' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan.rb:60:in `run' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/retrying_scan.rb:54:in `run' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:124:in `run_tests_through_single_try' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:65:in `run' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-plugin-test_center-3.10.2/lib/fastlane/plugin/test_center/actions/multi_scan.rb:34:in `run' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:261:in `block (2 levels) in execute_action' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/actions/actions_helper.rb:50:in `execute_action' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:253:in `block in execute_action' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:227:in `chdir' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:227:in `execute_action' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:157:in `trigger_action_by_name' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/fast_file.rb:159:in `method_missing' Fastfile:64:in `block (2 levels) in parsing_binding' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/lane.rb:33:in `call' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:49:in `block in execute' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:45:in `chdir' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:45:in `execute' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/lane_manager.rb:56:in `cruise_lane' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/command_line_handler.rb:36:in `handle' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/commands_generator.rb:108:in `block (2 levels) in run' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:178:in `call' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:153:in `run' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/commander-fastlane-4.4.6/lib/commander/runner.rb:476:in `run_active_command' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane_core/lib/fastlane_core/ui/fastlane_runner.rb:76:in `run!' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/commander-fastlane-4.4.6/lib/commander/delegates.rb:15:in `run!' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/commands_generator.rb:349:in `run' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/commands_generator.rb:41:in `start' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/cli_tools_distributor.rb:119:in `take_off' /Users//.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/bin/fastlane:23:in `' /Users//.rbenv/versions/2.4.1/bin/fastlane:22:in `load' /Users//.rbenv/versions/2.4.1/bin/fastlane:22:in `'
lyndsey-ferguson commented
Here is the problem. This should have been:
@options.fetch(:only_testing, []) -
Sorry. It may take me a few days to update this. If you really need this right away, you can make a fork with this fix and point your Pluginfile there.
Pluginfile:
gem 'fastlane-plugin-test_center', :git => "https://github.com/YOUR_FORK/fastlane-plugin-test_center.git", :branch => "BRANCHNAME"
You could consider opening up a PR to make this an official release too.
kcatigbe commented
Thanks for the fast response.
I'll give the change a test locally
kcatigbe commented
@lyndsey-ferguson Ok, so after a bit of testing, the above solution doesn't seem to work for this particular use-case.
it appears that the :only_testing key is being explicitly set to nil somewhere, and for @options.fetch(...) that's a valid value, so it never returns the empty array.
I've adjusted the code in question to:
only_testing = @options.fetch(:only_testing, []).nil? ? [] : @options.fetch(:only_testing, [])
@options[:only_testing] = only_testing - Fastlane::Actions::TestsFromJunitAction.run(config).fetch(:passing, Hash.new).map(&:shellsafe_testidentifier)And that seems to work.
I've also added a test that covers this scenario - but from observation the update_only_testing method is susceptible to this regardless of whether it's called with invocation_based_tests or not; it's just that particular codepath that exposed it.
I'm a bit limited in opening a PR since my company policy disallows it (👎 , trying to get clarity on that, since this is a tool and not going into production code).
In the meantime, I'll try to dig deeper to find the codepath where it's being explicitly set to nil.
lyndsey-ferguson commented
lyndsey-ferguson commented
@kcatigbe I believe I fixed it.
Can you modify your Pluginfile per my instructions below, run bundle install, and then run your fastlane again (with the --verbose flag)?
Pluginfile:
gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-219-invocation-tests-break"
If there are still problems, please let me know and attach the console output as a text file to this issue (makes it easier for me to review). If it works, please let me know.
kcatigbe commented
Ok that fixed the NoMethodError, but now seeing a different crash from move_single_testable_reports_to_final_location:
expand
ESTCNBY41D9JGML:Mobile.iOS.***** karlcatigbe$ bundle exec fastlane test --verbose [✔] 🚀 INFO [2020-05-02 12:54:36.65]: Successfully loaded custom action '/Users/karlcatigbe/Development/Mobile.iOS.*****/fastlane/actions/create_sonar_coverage.rb'. INFO [2020-05-02 12:54:36.70]: Successfully loaded custom action '/Users/karlcatigbe/Development/Mobile.iOS.*****/fastlane/actions/validate_config.rb'. INFO [2020-05-02 12:54:36.70]: Successfully loaded custom action '/Users/karlcatigbe/Development/Mobile.iOS.*****/fastlane/actions/enable_bitcode.rb'. INFO [2020-05-02 12:54:36.70]: Successfully loaded custom action '/Users/karlcatigbe/Development/Mobile.iOS.*****/fastlane/actions/embed_framework.rb'. DEBUG [2020-05-02 12:54:36.70]: Checking if there are any plugins that should be loaded... DEBUG [2020-05-02 12:54:36.71]: Loading 'fastlane-plugin-appcenter' plugin INFO [2020-05-02 12:54:36.71]: gem 'fastlane-plugin-appcenter' is already installed DEBUG [2020-05-02 12:54:36.72]: Loading 'fastlane-plugin-trainer' plugin INFO [2020-05-02 12:54:36.72]: gem 'fastlane-plugin-trainer' is already installed DEBUG [2020-05-02 12:54:36.73]: Loading 'fastlane-plugin-test_center' plugin INFO [2020-05-02 12:54:36.73]: gem 'fastlane-plugin-test_center' is already installed +-----------------------------+---------+------------------------------------------------------------------+ | Used plugins | +-----------------------------+---------+------------------------------------------------------------------+ | Plugin | Version | Action | +-----------------------------+---------+------------------------------------------------------------------+ | fastlane-plugin-appcenter | 1.8.0 | appcenter_fetch_version_number appcenter_fetch_devices | | | | appcenter_upload | | fastlane-plugin-trainer | 0.4.1 | trainer | | fastlane-plugin-test_center | 3.10.2 | suppressed_tests suppress_tests suppress_tests_from_junit | | | | tests_from_xctestrun quit_core_simulator_service | | | | collate_test_result_bundles tests_from_junit multi_scan | | | | collate_html_reports collate_junit_reports collate_json_reports | | | | collate_xcresults | +-----------------------------+---------+------------------------------------------------------------------+
INFO [2020-05-02 12:54:39.02]: ---------------------------------------- INFO [2020-05-02 12:54:39.02]: --- Step: Verifying fastlane version --- INFO [2020-05-02 12:54:39.02]: ---------------------------------------- INFO [2020-05-02 12:54:39.02]: Your fastlane version 2.146.1 matches the minimum requirement of 2.137.0 ✅ INFO [2020-05-02 12:54:39.02]: ------------------------------ INFO [2020-05-02 12:54:39.02]: --- Step: default_platform --- INFO [2020-05-02 12:54:39.02]: ------------------------------ INFO [2020-05-02 12:54:39.03]: Driving the lane 'ios test' 🚀 INFO [2020-05-02 12:54:39.03]: ------------------- INFO [2020-05-02 12:54:39.03]: --- Step: is_ci --- INFO [2020-05-02 12:54:39.03]: ------------------- INFO [2020-05-02 12:54:39.03]: --------------------------- INFO [2020-05-02 12:54:39.03]: --- Step: setup_jenkins --- INFO [2020-05-02 12:54:39.03]: ---------------------------
+-----------------------------+-------------+ | Summary for Setup Jenkins Action | +-----------------------------+-------------+ | force | true | | output_directory | output | | derived_data_path | derivedData | | unlock_keychain | false | | add_keychain_to_search_list | replace | | set_default_keychain | true | | set_code_signing_identity | true | | result_bundle | true | +-----------------------------+-------------+
INFO [2020-05-02 12:54:39.03]: Set output directory path to: "/Users/karlcatigbe/Development/Mobile.iOS.*****/output". INFO [2020-05-02 12:54:39.03]: Set derived data path to: "/Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData". INFO [2020-05-02 12:54:39.03]: Set result bundle. INFO [2020-05-02 12:54:39.03]: ------------------- INFO [2020-05-02 12:54:39.03]: --- Step: is_ci --- INFO [2020-05-02 12:54:39.03]: ------------------- INFO [2020-05-02 12:54:39.04]: ----------------------- INFO [2020-05-02 12:54:39.04]: --- Step: cocoapods --- INFO [2020-05-02 12:54:39.04]: ----------------------- INFO [2020-05-02 12:54:39.04]: gem 'cocoapods' is already installed INFO [2020-05-02 12:54:39.04]: $ bundle exec pod install --silent INFO [2020-05-02 12:54:46.96]: ------------------------------------ INFO [2020-05-02 12:54:46.96]: --- Step: increment_build_number --- INFO [2020-05-02 12:54:46.96]: ------------------------------------ Current version of project ***** is: 1
/Users/karlcatigbe/Development/Mobile.iOS.***** INFO [2020-05-02 12:54:47.51]: $ cd /Users/karlcatigbe/Development/Mobile.iOS.***** && agvtool new-version -all 1 && cd - INFO [2020-05-02 12:54:47.90]: ▸ Setting version of project ***** to: INFO [2020-05-02 12:54:47.90]: ▸ 1. INFO [2020-05-02 12:54:47.99]: ▸ Also setting CFBundleVersion key (assuming it exists) INFO [2020-05-02 12:54:48.05]: ▸ Updating CFBundleVersion in Info.plist(s)... INFO [2020-05-02 12:54:48.09]: ▸ Updated CFBundleVersion in "*****.xcodeproj/../Application Frameworks/NetworkRequestManager/NetworkRequestManagerTests/Info.plist" to 1 INFO [2020-05-02 12:54:48.12]: ▸ Updated CFBundleVersion in "*****.xcodeproj/../Application Frameworks/NetworkRequestManager/Sources/Info.plist" to 1 INFO [2020-05-02 12:54:48.15]: ▸ Updated CFBundleVersion in "*****.xcodeproj/../Application Frameworks/SpeechManager/Sources/Info.plist" to 1 INFO [2020-05-02 12:54:48.18]: ▸ Updated CFBundleVersion in "*****.xcodeproj/../Application Frameworks/SpeechManager/SpeechManagerTests/Info.plist" to 1 INFO [2020-05-02 12:54:48.21]: ▸ Updated CFBundleVersion in "*****.xcodeproj/../*****/Info.plist" to 1 INFO [2020-05-02 12:54:48.24]: ▸ Updated CFBundleVersion in "*****.xcodeproj/../*****Tests/Info.plist" to 1 INFO [2020-05-02 12:54:48.27]: ▸ Updated CFBundleVersion in "*****.xcodeproj/../*****UITests/Info.plist" to 1 INFO [2020-05-02 12:54:48.30]: ▸ Updated CFBundleVersion in "*****.xcodeproj/../NotificationService/Info.plist" to 1 INFO [2020-05-02 12:54:48.33]: ▸ Updated CFBundleVersion in "*****.xcodeproj/../Today Widget/res/Info.plist" to 1 INFO [2020-05-02 12:54:48.33]: ▸ /Users/karlcatigbe/Development/Mobile.iOS.***** INFO [2020-05-02 12:54:48.35]: ------------------------ INFO [2020-05-02 12:54:48.35]: --- Step: multi_scan --- INFO [2020-05-02 12:54:48.35]: ------------------------ WARN [2020-05-02 12:54:48.35]: As of Xcode 11, test_result bundles created in the output directory are actually symbolic links to an xcresult bundle
+------------------------+---------------------+ | Summary for multi_scan (test_center v3.10.2) | +------------------------+---------------------+ | try_count | 3 | | parallel_testrun_count | 4 | | invocation_based_tests | true | +------------------------+---------------------+
ERROR [2020-05-02 12:54:48.39]: Using deprecated option: '--custom_report_file_name' (Use '--output_files' instead) WARN [2020-05-02 12:54:48.39]: Scanfile found: overriding multi_scan options with it's values. DEBUG [2020-05-02 12:54:48.39]: Preparing Scan config options for multi_scan testing ERROR [2020-05-02 12:54:48.40]: Using deprecated option: '--custom_report_file_name' (Use '--output_files' instead) INFO [2020-05-02 12:54:48.40]: Successfully loaded '/Users/karlcatigbe/Development/Mobile.iOS.*****/fastlane/Scanfile' 📄
+----------------------------+-------------------------------------------------------------------------+ | Detected Values from './fastlane/Scanfile' | +----------------------------+-------------------------------------------------------------------------+ | workspace | *****.xcworkspace | | clean | true | | output_style | rspec | | output_types | junit | | max_concurrent_simulators | 4 | | disable_concurrent_testing | false | | scheme | Debug | | device | iPhone 8 | | slack_only_on_failure | true | | code_coverage | true | | output_directory | output | | xcargs | -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' | | fail_build | false | +----------------------------+-------------------------------------------------------------------------+
WARN [2020-05-02 12:54:48.49]: Resolving Swift Package Manager dependencies... INFO [2020-05-02 12:54:48.49]: $ xcodebuild -resolvePackageDependencies -workspace *****.xcworkspace -scheme Debug INFO [2020-05-02 12:54:50.10]: ▸ Command line invocation: INFO [2020-05-02 12:54:50.10]: ▸ /Applications/Xcode.app/Contents/Developer/usr/bin/xcodebuild -resolvePackageDependencies -workspace *****.xcworkspace -scheme Debug INFO [2020-05-02 12:54:50.38]: ▸ 2020-05-02 12:54:50.383 xcodebuild[53989:7482816] +dataWithFirstBytes:1024 ofFile:"/Users/karlcatigbe/Development/Mobile.iOS.*****/Pods/ComScore/.pod" failed, errno = 2 INFO [2020-05-02 12:54:51.99]: ▸ resolved source packages: INFO [2020-05-02 12:54:52.00]: $ xcodebuild -showBuildSettings -workspace *****.xcworkspace -scheme Debug 2020-05-02 12:54:53.623 xcodebuild[53992:7483063] +dataWithFirstBytes:1024 ofFile:"/Users/karlcatigbe/Development/Mobile.iOS.*****/Pods/ComScore/.pod" failed, errno = 2 WARN [2020-05-02 12:54:55.00]: Command timed out after 3 seconds on try 1 of 4, trying again with a 6 second timeout... 2020-05-02 12:54:57.592 xcodebuild[53996:7483306] +dataWithFirstBytes:1024 ofFile:"/Users/karlcatigbe/Development/Mobile.iOS.*****/Pods/ComScore/.pod" failed, errno = 2 WARN [2020-05-02 12:55:01.01]: Command timed out after 6 seconds on try 2 of 4, trying again with a 12 second timeout... 2020-05-02 12:55:02.996 xcodebuild[54025:7483593] +dataWithFirstBytes:1024 ofFile:"/Users/karlcatigbe/Development/Mobile.iOS.*****/Pods/ComScore/.pod" failed, errno = 2 DEBUG [2020-05-02 12:55:07.14]: Fetching available simulator devices DEBUG [2020-05-02 12:55:07.41]: Running invocation tests DEBUG [2020-05-02 12:55:07.41]: Restarting Simulator 1AE40764 INFO [2020-05-02 12:55:07.68]: Starting scan #1. DEBUG [2020-05-02 12:55:07.69]: retrying_scan #update_scan_options DEBUG [2020-05-02 12:55:07.69]: Setting fail_build to false DEBUG [2020-05-02 12:55:07.69]: Setting skip_build to true DEBUG [2020-05-02 12:55:07.69]: Setting output_types to junit DEBUG [2020-05-02 12:55:07.69]: Setting workspace to *****.xcworkspace DEBUG [2020-05-02 12:55:07.69]: Setting scheme to Debug DEBUG [2020-05-02 12:55:07.69]: Setting skip_detect_devices to false DEBUG [2020-05-02 12:55:07.69]: Setting reset_simulator to false DEBUG [2020-05-02 12:55:07.69]: Setting disable_slide_to_type to true DEBUG [2020-05-02 12:55:07.69]: Setting reinstall_app to false DEBUG [2020-05-02 12:55:07.69]: Setting clean to false DEBUG [2020-05-02 12:55:07.69]: Setting code_coverage to true DEBUG [2020-05-02 12:55:07.69]: Setting open_report to false DEBUG [2020-05-02 12:55:07.69]: Setting output_directory to /Users/karlcatigbe/Development/Mobile.iOS.*****/output DEBUG [2020-05-02 12:55:07.69]: Setting output_style to rspec DEBUG [2020-05-02 12:55:07.69]: Setting output_files to report.junit DEBUG [2020-05-02 12:55:07.69]: Setting buildlog_path to ~/Library/Logs/scan DEBUG [2020-05-02 12:55:07.69]: Setting include_simulator_logs to false DEBUG [2020-05-02 12:55:07.69]: Setting derived_data_path to /Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData DEBUG [2020-05-02 12:55:07.69]: Setting should_zip_build_products to false DEBUG [2020-05-02 12:55:07.69]: Setting use_clang_report_name to false DEBUG [2020-05-02 12:55:07.69]: Setting max_concurrent_simulators to 4 DEBUG [2020-05-02 12:55:07.69]: Setting disable_concurrent_testing to true DEBUG [2020-05-02 12:55:07.69]: Setting build_for_testing to false DEBUG [2020-05-02 12:55:07.69]: Setting xcargs to -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled NO -resultBundlePath '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/report.xcresult' DEBUG [2020-05-02 12:55:07.69]: Setting slack_use_webhook_configured_username_and_icon to false DEBUG [2020-05-02 12:55:07.69]: Setting slack_username to fastlane DEBUG [2020-05-02 12:55:07.69]: Setting slack_icon_url to https://s3-eu-west-1.amazonaws.com/fastlane.tools/fastlane.png DEBUG [2020-05-02 12:55:07.69]: Setting skip_slack to false DEBUG [2020-05-02 12:55:07.69]: Setting slack_only_on_failure to true DEBUG [2020-05-02 12:55:07.69]: Setting destination to ["platform=iOS Simulator,id=1AE40764-CD73-4268-A715-F5B6F20CA059"] DEBUG [2020-05-02 12:55:07.69]: Setting xcodebuild_command to env NSUnbufferedIO=YES xcodebuild
+------------------------------------------------+----------------------------------------------------------------------------------------------------+ | Summary for scan 2.146.1 | +------------------------------------------------+----------------------------------------------------------------------------------------------------+ | fail_build | false | | skip_build | true | | output_types | junit | | workspace | *****.xcworkspace | | scheme | Debug | | skip_detect_devices | false | | force_quit_simulator | false | | reset_simulator | false | | disable_slide_to_type | true | | reinstall_app | false | | clean | false | | code_coverage | true | | open_report | false | | output_directory | /Users/karlcatigbe/Development/Mobile.iOS.*****/output | | output_style | rspec | | output_files | report.junit | | buildlog_path | ~/Library/Logs/scan | | include_simulator_logs | false | | derived_data_path | /Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData | | should_zip_build_products | false | | use_clang_report_name | false | | max_concurrent_simulators | 4 | | disable_concurrent_testing | true | | build_for_testing | false | | xcargs | -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled | | | NO -resultBundlePath '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/report.xcresult' | | slack_use_webhook_configured_username_and_icon | false | | slack_username | fastlane | | slack_icon_url | https://s3-eu-west-1.amazonaws.com/fastlane.tools/fastlane.png | | skip_slack | false | | slack_only_on_failure | true | | xcodebuild_command | env NSUnbufferedIO=YES xcodebuild | | device | iPhone 8 | | result_bundle | false | | xcode_path | /Applications/Xcode.app | +------------------------------------------------+----------------------------------------------------------------------------------------------------+
DEBUG [2020-05-02 12:55:07.71]: Fetching available simulator devices INFO [2020-05-02 12:55:07.97]: Disabling 'Slide to Type' iPhone 8 INFO [2020-05-02 12:55:07.97]: $ /usr/libexec/PlistBuddy -c "Add :KeyboardContinuousPathEnabled bool false" /Users/karlcatigbe/Library/Developer/CoreSimulator/Devices/1AE40764-CD73-4268-A715-F5B6F20CA059/data/Library/Preferences/com.apple.keyboard.ContinuousPath.plist >/dev/null 2>&1 INFO [2020-05-02 12:55:07.98]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -workspace *****.xcworkspace -scheme Debug -destination 'platform=iOS Simulator,id=1AE40764-CD73-4268-A715-F5B6F20CA059' -derivedDataPath '/Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData' -maximum-concurrent-test-simulator-destinations 4 -disable-concurrent-testing -enableCodeCoverage YES -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled NO -resultBundlePath '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/report.xcresult' test | tee '/Users/karlcatigbe/Library/Logs/scan/CNBC-Debug.log' | xcpretty --test --report junit --output '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/report.junit' --report junit --output '/var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/junit_report20200502-53847-ul2ebq' INFO [2020-05-02 12:55:07.98]: ▸ Loading... INFO [2020-05-02 12:55:09.65]: ▸ 2020-05-02 12:55:09.656 xcodebuild[54070:7484053] +dataWithFirstBytes:1024 ofFile:"/Users/karlcatigbe/Development/Mobile.iOS.*****/Pods/ComScore/.pod" failed, errno = 2 INFO [2020-05-02 12:55:32.61]: ▸ MobileCoreServices has been renamed. Use CoreServices instead. (in target 'AFNetworking' from project 'Pods')MobileCoreServices has been renamed. Use CoreServices instead. (in target 'apptentive-ios' from project 'Pods')MobileCoreServices has been renamed. Use CoreServices instead. (in target 'UrbanAirship-iOS-SDK' from project 'Pods')2020-05-02 12:55:32.619 xcodebuild[54070:7484124] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: INFO [2020-05-02 12:55:32.62]: ▸ /Users/karlcatigbe/Development/Mobile.iOS.*****/output/report.xcresult/Staging/1_Test/Diagnostics/*****UITests-FE7F5F44-04FD-41D9-AADD-C0FDF4E69BA0/*****UITests-69AE4B0D-B789-4ADA-9121-16C4AF61880B/Session-*****UITests-2020-05-02_125532-I1mm5L.log INFO [2020-05-02 12:55:32.62]: ▸ 2020-05-02 12:55:32.620 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: (C0116B6F-E0CD-4CCB-A467-DC6BD39C0E25) Beginning test session *****UITests-C0116B6F-E0CD-4CCB-A467-DC6BD39C0E25 at 2020-05-02 12:55:32.620 with Xcode 11E503a on target <DVTiPhoneSimulator: 0x7fc02af1bc10> { INFO [2020-05-02 12:55:32.62]: ▸ SimDevice: iPhone 8 (1AE40764-CD73-4268-A715-F5B6F20CA059, iOS 13.4, Shutdown) INFO [2020-05-02 12:55:32.62]: ▸ } (13.4.1 (17E8260)) INFO [2020-05-02 12:55:36.97]: ▸ 2020-05-02 12:55:36.978 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: (C0116B6F-E0CD-4CCB-A467-DC6BD39C0E25) Finished requesting crash reports. Continuing with testing. INFO [2020-05-02 13:00:15.21]: ▸ .....F........ INFO [2020-05-02 13:00:15.21]: ▸ *****UITests.GeneralSeeAllUITests INFO [2020-05-02 13:00:15.22]: ▸ testTappingTrendingSearchOpensSearch, XCTAssertTrue failed - Timeout waiting for 'testCommonSeeAllCollectionView' INFO [2020-05-02 13:00:15.22]: ▸ GeneralSeeAllUITests.swift:67 INFO [2020-05-02 13:00:15.22]: ▸ [31m Executed 14 tests, with 1 failure (0 unexpected) in 275.748 (275.758) seconds INFO [2020-05-02 13:00:15.53]: ▸ [0m2020-05-02 13:00:15.539 xcodebuild[54070:7491967] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: INFO [2020-05-02 13:00:15.53]: ▸ /Users/karlcatigbe/Development/Mobile.iOS.*****/output/report.xcresult/Staging/1_Test/Diagnostics/NetworkRequestManagerTests-DE369B32-060D-411D-A0C0-42C27323D2F0/NetworkRequestManagerTests-D689DC79-E54B-44D7-9C27-97516A94AE0F/Session-NetworkRequestManagerTests-2020-05-02_130015-Vqkjh4.log INFO [2020-05-02 13:00:15.54]: ▸ 2020-05-02 13:00:15.539 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: (4E6FE32D-F895-47ED-A693-300C178A5F12) Beginning test session NetworkRequestManagerTests-4E6FE32D-F895-47ED-A693-300C178A5F12 at 2020-05-02 13:00:15.539 with Xcode 11E503a on target <DVTiPhoneSimulator: 0x7fc02af1bc10> { INFO [2020-05-02 13:00:15.54]: ▸ SimDevice: iPhone 8 (1AE40764-CD73-4268-A715-F5B6F20CA059, iOS 13.4, Booted) INFO [2020-05-02 13:00:15.54]: ▸ } (13.4.1 (17E8260)) INFO [2020-05-02 13:00:15.54]: ▸ 2020-05-02 13:00:15.543 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: (4E6FE32D-F895-47ED-A693-300C178A5F12) Finished requesting crash reports. Continuing with testing. INFO [2020-05-02 13:00:15.93]: ▸ F.... INFO [2020-05-02 13:00:15.93]: ▸ NetworkRequestManagerTests.NetworkRequestManagerStubTest INFO [2020-05-02 13:00:15.93]: ▸ testExample, XCTAssertTrue failed INFO [2020-05-02 13:00:15.93]: ▸ /Users/karlcatigbe/Development/Mobile.iOS.*****/Application Frameworks/NetworkRequestManager/NetworkRequestManagerTests/NetworkRequestManagerTests.swift:36 INFO [2020-05-02 13:00:15.94]: ▸ ''' INFO [2020-05-02 13:00:15.94]: ▸ [38;5;230m [39m[38;5;221;01mlet[39;00m[38;5;230m [39m[38;5;153;01minteger[39;00m[38;5;230m [39m[38;5;87m=[39m[38;5;230m [39m[38;5;155;01mInt[39;00m[38;5;87m.[39m[38;5;153mrandom[39m[38;5;87m([39m[38;5;153;01min[39;00m[38;5;87m:[39m[38;5;230m [39m[38;5;212;01m0[39;00m[38;5;87m..<[39m[38;5;212;01m10[39;00m[38;5;87m)[39m[38;5;230m INFO [2020-05-02 13:00:15.94]: ▸ [38;5;230m [39m[38;5;155;01mXCTAssertTrue[39;00m[38;5;87m([39m[38;5;230minteger[39m[38;5;230m [39m[38;5;87m%[39m[38;5;230m [39m[38;5;212;01m2[39;00m[38;5;230m [39m[38;5;87m==[39m[38;5;230m [39m[38;5;212;01m0[39;00m[38;5;87m)[39m[38;5;230m INFO [2020-05-02 13:00:15.94]: ▸ [38;5;230m [39m[38;5;87m}[39m[38;5;230m INFO [2020-05-02 13:00:15.94]: ▸ [38;5;230m[39m ''' INFO [2020-05-02 13:00:15.94]: ▸ [31m Executed 5 tests, with 1 failure (0 unexpected) in 0.013 (0.016) seconds INFO [2020-05-02 13:00:28.00]: ▸ [0m2020-05-02 13:00:28.006 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: 295.394 elapsed -- Testing started completed. INFO [2020-05-02 13:00:28.00]: ▸ 2020-05-02 13:00:28.006 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start INFO [2020-05-02 13:00:28.00]: ▸ 2020-05-02 13:00:28.006 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: 295.394 sec, +295.394 sec -- end INFO [2020-05-02 13:00:30.60]: ▸ Failing tests: INFO [2020-05-02 13:00:30.60]: ▸ *****UITests: INFO [2020-05-02 13:00:30.60]: ▸ GeneralSeeAllUITests.testTappingTrendingSearchOpensSearch() INFO [2020-05-02 13:00:30.60]: ▸ NetworkRequestManagerTests: INFO [2020-05-02 13:00:30.60]: ▸ NetworkRequestManagerStubTest.testExample() INFO [2020-05-02 13:00:30.60]: ▸ ** TEST FAILED ** 2020-05-02 12:55:09.656 xcodebuild[54070:7484053] +dataWithFirstBytes:1024 ofFile:"/Users/karlcatigbe/Development/Mobile.iOS.*****/Pods/ComScore/.pod" failed, errno = 2 MobileCoreServices has been renamed. Use CoreServices instead. (in target 'AFNetworking' from project 'Pods')MobileCoreServices has been renamed. Use CoreServices instead. (in target 'apptentive-ios' from project 'Pods')MobileCoreServices has been renamed. Use CoreServices instead. (in target 'UrbanAirship-iOS-SDK' from project 'Pods')2020-05-02 12:55:32.619 xcodebuild[54070:7484124] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: /Users/karlcatigbe/Development/Mobile.iOS.*****/output/report.xcresult/Staging/1_Test/Diagnostics/*****UITests-FE7F5F44-04FD-41D9-AADD-C0FDF4E69BA0/*****UITests-69AE4B0D-B789-4ADA-9121-16C4AF61880B/Session-*****UITests-2020-05-02_125532-I1mm5L.log 2020-05-02 12:55:32.620 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: (C0116B6F-E0CD-4CCB-A467-DC6BD39C0E25) Beginning test session *****UITests-C0116B6F-E0CD-4CCB-A467-DC6BD39C0E25 at 2020-05-02 12:55:32.620 with Xcode 11E503a on target <DVTiPhoneSimulator: 0x7fc02af1bc10> { SimDevice: iPhone 8 (1AE40764-CD73-4268-A715-F5B6F20CA059, iOS 13.4, Shutdown) } (13.4.1 (17E8260)) 2020-05-02 12:55:36.978 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: (C0116B6F-E0CD-4CCB-A467-DC6BD39C0E25) Finished requesting crash reports. Continuing with testing. .....F........
*****UITests.GeneralSeeAllUITests testTappingTrendingSearchOpensSearch, XCTAssertTrue failed - Timeout waiting for 'testCommonSeeAllCollectionView' GeneralSeeAllUITests.swift:67
Executed 14 tests, with 1 failure (0 unexpected) in 275.748 (275.758) seconds 2020-05-02 13:00:15.539 xcodebuild[54070:7491967] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: /Users/karlcatigbe/Development/Mobile.iOS.*****/output/report.xcresult/Staging/1_Test/Diagnostics/NetworkRequestManagerTests-DE369B32-060D-411D-A0C0-42C27323D2F0/NetworkRequestManagerTests-D689DC79-E54B-44D7-9C27-97516A94AE0F/Session-NetworkRequestManagerTests-2020-05-02_130015-Vqkjh4.log 2020-05-02 13:00:15.539 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: (4E6FE32D-F895-47ED-A693-300C178A5F12) Beginning test session NetworkRequestManagerTests-4E6FE32D-F895-47ED-A693-300C178A5F12 at 2020-05-02 13:00:15.539 with Xcode 11E503a on target <DVTiPhoneSimulator: 0x7fc02af1bc10> { SimDevice: iPhone 8 (1AE40764-CD73-4268-A715-F5B6F20CA059, iOS 13.4, Booted) } (13.4.1 (17E8260)) 2020-05-02 13:00:15.543 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: (4E6FE32D-F895-47ED-A693-300C178A5F12) Finished requesting crash reports. Continuing with testing. F....
NetworkRequestManagerTests.NetworkRequestManagerStubTest testExample, XCTAssertTrue failed /Users/karlcatigbe/Development/Mobile.iOS.*****/Application Frameworks/NetworkRequestManager/NetworkRequestManagerTests/NetworkRequestManagerTests.swift:36 ''' let integer = Int.random(in: 0..<10) XCTAssertTrue(integer % 2 == 0) } '''
Executed 5 tests, with 1 failure (0 unexpected) in 0.013 (0.016) seconds 2020-05-02 13:00:28.006 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: 295.394 elapsed -- Testing started completed. 2020-05-02 13:00:28.006 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start 2020-05-02 13:00:28.006 xcodebuild[54070:7484053] [MT] IDETestOperationsObserverDebug: 295.394 sec, +295.394 sec -- end Failing tests: *****UITests: GeneralSeeAllUITests.testTappingTrendingSearchOpensSearch() NetworkRequestManagerTests: NetworkRequestManagerStubTest.testExample()
** TEST FAILED ** ERROR [2020-05-02 13:00:35.71]: Exit status: 65 +--------------------+----+ | Test Results | +--------------------+----+ | Number of tests | 19 | | Number of failures | 2 | +--------------------+----+
DEBUG [2020-05-02 13:00:35.72]: Batch # incrementing retry count to 1 DEBUG [2020-05-02 13:00:35.72]: Scan found failing tests DEBUG [2020-05-02 13:00:35.73]: ReportCollator collating DEBUG [2020-05-02 13:00:35.74]: Fetching available simulator devices DEBUG [2020-05-02 13:00:36.13]: Fetching available simulator devices DEBUG [2020-05-02 13:00:36.42]: Cloning simulator DEBUG [2020-05-02 13:00:40.71]: Cloning simulator DEBUG [2020-05-02 13:00:44.24]: Cloning simulator DEBUG [2020-05-02 13:00:47.77]: Cloning simulator INFO [2020-05-02 13:00:55.88]: Starting test run 1 INFO [2020-05-02 13:00:55.88]: Starting test run 2 [worker 1] DEBUG [2020-05-02 13:00:55.89]: Restarting Simulator EBF98E18 [worker 1] INFO [2020-05-02 13:00:57.60]: Starting scan #1 with 1 tests for batch #1. [worker 1] DEBUG [2020-05-02 13:00:57.62]: retrying_scan #update_scan_options [worker 1] DEBUG [2020-05-02 13:00:57.62]: Setting fail_build to false [worker 1] DEBUG [2020-05-02 13:00:57.62]: Setting skip_build to true [worker 1] DEBUG [2020-05-02 13:00:57.62]: Setting output_types to junit [worker 1] DEBUG [2020-05-02 13:00:57.62]: Setting workspace to *****.xcworkspace [worker 1] DEBUG [2020-05-02 13:00:57.62]: Setting scheme to Debug [worker 1] DEBUG [2020-05-02 13:00:57.62]: Setting skip_detect_devices to false [worker 1] DEBUG [2020-05-02 13:00:57.62]: Setting reset_simulator to false [worker 1] DEBUG [2020-05-02 13:00:57.63]: Setting disable_slide_to_type to true [worker 1] DEBUG [2020-05-02 13:00:57.63]: Setting reinstall_app to false [worker 1] DEBUG [2020-05-02 13:00:57.63]: Setting only_testing to ["NetworkRequestManagerTests/GeneralSeeAllUITests"] [worker 1] DEBUG [2020-05-02 13:00:57.63]: Setting xctestrun to /Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData/Build/Products/Debug_iphonesimulator13.4-x86_64.xctestrun [worker 1] DEBUG [2020-05-02 13:00:57.63]: Setting clean to false [worker 1] DEBUG [2020-05-02 13:00:57.63]: Setting code_coverage to true [worker 1] DEBUG [2020-05-02 13:00:57.63]: Setting open_report to false [worker 1] DEBUG [2020-05-02 13:00:57.63]: Setting output_directory to /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1 [worker 1] DEBUG [2020-05-02 13:00:57.63]: Setting output_style to rspec [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting output_files to report.junit [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting buildlog_path to ~/Library/Logs/scan/worker-1-logs [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting include_simulator_logs to false [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting derived_data_path to /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/derived_data_path20200502-53847-1ucpb6h-worker-1 [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting should_zip_build_products to false [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting use_clang_report_name to false [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting max_concurrent_simulators to 4 [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting disable_concurrent_testing to true [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting build_for_testing to false [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting xcargs to -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled NO -resultBundlePath '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1/report.xcresult' [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting slack_use_webhook_configured_username_and_icon to false [worker 1] DEBUG [2020-05-02 13:00:57.64]: Setting slack_username to fastlane [worker 1] DEBUG [2020-05-02 13:00:57.65]: Setting slack_icon_url to https://s3-eu-west-1.amazonaws.com/fastlane.tools/fastlane.png [worker 1] DEBUG [2020-05-02 13:00:57.65]: Setting skip_slack to false [worker 1] DEBUG [2020-05-02 13:00:57.65]: Setting slack_only_on_failure to true [worker 1] DEBUG [2020-05-02 13:00:57.65]: Setting destination to ["platform=iOS Simulator,id=EBF98E18-1290-487D-B5A6-33C3A877BA10"] [worker 1] DEBUG [2020-05-02 13:00:57.65]: Setting xcodebuild_command to env NSUnbufferedIO=YES xcodebuild [worker 1] [worker 1] +------------------------------------------------+----------------------------------------------------------------------------------------------------+ [worker 1] | Summary for scan 2.146.1 | [worker 1] +------------------------------------------------+----------------------------------------------------------------------------------------------------+ [worker 1] | fail_build | false | [worker 1] | skip_build | true | [worker 1] | output_types | junit | [worker 1] | workspace | *****.xcworkspace | [worker 1] | scheme | Debug | [worker 1] | skip_detect_devices | false | [worker 1] | force_quit_simulator | false | [worker 1] | reset_simulator | false | [worker 1] | disable_slide_to_type | true | [worker 1] | reinstall_app | false | [worker 1] | only_testing | ["NetworkRequestManagerTests/GeneralSeeAllUITests"] | [worker 1] | xctestrun | /Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData/Build/Products/Debug_iphonesimulator1 | [worker 1] | | 3.4-x86_64.xctestrun | [worker 1] | clean | false | [worker 1] | code_coverage | true | [worker 1] | open_report | false | [worker 1] | output_directory | /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1 | [worker 1] | output_style | rspec | [worker 1] | output_files | report.junit | [worker 1] | buildlog_path | ~/Library/Logs/scan/worker-1-logs | [worker 1] | include_simulator_logs | false | [worker 1] | derived_data_path | /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/derived_data_path20200502-53847-1ucpb6h-worker-1 | [worker 1] | should_zip_build_products | false | [worker 1] | use_clang_report_name | false | [worker 1] | max_concurrent_simulators | 4 | [worker 1] | disable_concurrent_testing | true | [worker 1] | build_for_testing | false | [worker 1] | xcargs | -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled | [worker 1] | | NO -resultBundlePath | [worker 1] | | '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1/report | [worker 1] | | .xcresult' | [worker 1] | slack_use_webhook_configured_username_and_icon | false | [worker 1] | slack_username | fastlane | [worker 1] | slack_icon_url | https://s3-eu-west-1.amazonaws.com/fastlane.tools/fastlane.png | [worker 1] | skip_slack | false | [worker 1] | slack_only_on_failure | true | [worker 1] | xcodebuild_command | env NSUnbufferedIO=YES xcodebuild | [worker 1] | xcode_path | /Applications/Xcode.app | [worker 1] | device | iPhone 8 | [worker 1] | result_bundle | false | [worker 1] +------------------------------------------------+----------------------------------------------------------------------------------------------------+ [worker 1] [worker 1] DEBUG [2020-05-02 13:00:58.10]: Fetching available simulator devices [worker 1] INFO [2020-05-02 13:00:59.49]: Disabling 'Slide to Type' iPhone 8 [worker 1] INFO [2020-05-02 13:00:59.49]: $ /usr/libexec/PlistBuddy -c "Add :KeyboardContinuousPathEnabled bool false" /Users/karlcatigbe/Library/Developer/CoreSimulator/Devices/1AE40764-CD73-4268-A715-F5B6F20CA059/data/Library/Preferences/com.apple.keyboard.ContinuousPath.plist >/dev/null 2>&1 [worker 1] INFO [2020-05-02 13:00:59.53]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -destination 'platform=iOS Simulator,id=EBF98E18-1290-487D-B5A6-33C3A877BA10' -derivedDataPath '/var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/derived_data_path20200502-53847-1ucpb6h-worker-1' -maximum-concurrent-test-simulator-destinations 4 -disable-concurrent-testing -enableCodeCoverage YES -xctestrun '/Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData/Build/Products/Debug_iphonesimulator13.4-x86_64.xctestrun' -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled NO -resultBundlePath '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1/report.xcresult' -only-testing:NetworkRequestManagerTests/GeneralSeeAllUITests test-without-building | tee '/Users/karlcatigbe/Library/Logs/scan/worker-1-logs/CNBC-Debug.log' | xcpretty --test --report junit --output '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1/report.junit' --report junit --output '/var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/junit_report20200502-54797-bejqui' [worker 1] INFO [2020-05-02 13:00:59.53]: ▸ Loading... [worker 1] INFO [2020-05-02 13:01:06.41]: ▸ 2020-05-02 13:01:06.411 xcodebuild[54947:7530246] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: [worker 1] INFO [2020-05-02 13:01:06.41]: ▸ /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1/report.xcresult/Staging/1_Test/Diagnostics/NetworkRequestManagerTests-F1A1F476-A02A-42F4-81F3-D63B12743B83/NetworkRequestManagerTests-1007D9F0-67BB-4D74-ABA6-7D389A78AB33/Session-NetworkRequestManagerTests-2020-05-02_130106-wrF5rP.log [worker 1] INFO [2020-05-02 13:01:06.41]: ▸ 2020-05-02 13:01:06.412 xcodebuild[54947:7527498] [MT] IDETestOperationsObserverDebug: (77C7A466-7622-4B9B-971E-A5FA5E70E803) Beginning test session NetworkRequestManagerTests-77C7A466-7622-4B9B-971E-A5FA5E70E803 at 2020-05-02 13:01:06.412 with Xcode 11E503a on target <DVTiPhoneSimulator: 0x7ffa4c1c8040> { [worker 1] INFO [2020-05-02 13:01:06.41]: ▸ SimDevice: iPhone 8 Clone 1 TestCenter::Helper::MultiScanManager::SimulatorHelper<70247245053760> (EBF98E18-1290-487D-B5A6-33C3A877BA10, iOS 13.4, Booted) [worker 1] INFO [2020-05-02 13:01:06.41]: ▸ } (13.4.1 (17E8260)) [worker 1] INFO [2020-05-02 13:01:15.33]: ▸ 2020-05-02 13:01:15.330 xcodebuild[54947:7527498] [MT] IDETestOperationsObserverDebug: (77C7A466-7622-4B9B-971E-A5FA5E70E803) Finished requesting crash reports. Continuing with testing. [worker 1] INFO [2020-05-02 13:01:15.79]: ▸ [32;1m Executed 0 tests, with 0 failures (0 unexpected) in 0.000 (0.000) seconds [worker 1] INFO [2020-05-02 13:01:16.05]: ▸ [0m2020-05-02 13:01:16.055 xcodebuild[54947:7527498] [MT] IDETestOperationsObserverDebug: 9.652 elapsed -- Testing started completed. [worker 1] INFO [2020-05-02 13:01:16.05]: ▸ 2020-05-02 13:01:16.055 xcodebuild[54947:7527498] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start [worker 1] INFO [2020-05-02 13:01:16.05]: ▸ 2020-05-02 13:01:16.055 xcodebuild[54947:7527498] [MT] IDETestOperationsObserverDebug: 9.652 sec, +9.652 sec -- end [worker 1] +--------------------+---+ [worker 1] | Test Results | [worker 1] +--------------------+---+ [worker 1] | Number of tests | 0 | [worker 1] | Number of failures | 0 | [worker 1] +--------------------+---+ [worker 1] [worker 1] DEBUG [2020-05-02 13:01:18.50]: Batch #1 incrementing retry count to 1 [worker 1] DEBUG [2020-05-02 13:01:18.50]: Scan passed the tests for batch #1 [worker 1] DEBUG [2020-05-02 13:01:18.50]: ReportCollator collating [worker 1] DEBUG [2020-05-02 13:01:18.50]: All tests passed for batch 1? true [worker 2] DEBUG [2020-05-02 13:00:55.89]: Restarting Simulator D81A13B9 [worker 2] INFO [2020-05-02 13:00:57.76]: Starting scan #1 with 1 tests for batch #2. [worker 2] DEBUG [2020-05-02 13:00:57.79]: retrying_scan #update_scan_options [worker 2] DEBUG [2020-05-02 13:00:57.79]: Setting fail_build to false [worker 2] DEBUG [2020-05-02 13:00:57.79]: Setting skip_build to true [worker 2] DEBUG [2020-05-02 13:00:57.79]: Setting output_types to junit [worker 2] DEBUG [2020-05-02 13:00:57.80]: Setting workspace to *****.xcworkspace [worker 2] DEBUG [2020-05-02 13:00:57.80]: Setting scheme to Debug [worker 2] DEBUG [2020-05-02 13:00:57.81]: Setting skip_detect_devices to false [worker 2] DEBUG [2020-05-02 13:00:57.81]: Setting reset_simulator to false [worker 2] DEBUG [2020-05-02 13:00:57.81]: Setting disable_slide_to_type to true [worker 2] DEBUG [2020-05-02 13:00:57.82]: Setting reinstall_app to false [worker 2] DEBUG [2020-05-02 13:00:57.82]: Setting only_testing to ["NetworkRequestManagerTests/NetworkRequestManagerStubTest"] [worker 2] DEBUG [2020-05-02 13:00:57.82]: Setting xctestrun to /Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData/Build/Products/Debug_iphonesimulator13.4-x86_64.xctestrun [worker 2] DEBUG [2020-05-02 13:00:57.82]: Setting clean to false [worker 2] DEBUG [2020-05-02 13:00:57.83]: Setting code_coverage to true [worker 2] DEBUG [2020-05-02 13:00:57.83]: Setting open_report to false [worker 2] DEBUG [2020-05-02 13:00:57.83]: Setting output_directory to /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2 [worker 2] DEBUG [2020-05-02 13:00:57.83]: Setting output_style to rspec [worker 2] DEBUG [2020-05-02 13:00:57.83]: Setting output_files to report.junit [worker 2] DEBUG [2020-05-02 13:00:57.83]: Setting buildlog_path to ~/Library/Logs/scan/worker-2-logs [worker 2] DEBUG [2020-05-02 13:00:57.83]: Setting include_simulator_logs to false [worker 2] DEBUG [2020-05-02 13:00:57.83]: Setting derived_data_path to /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/derived_data_path20200502-53847-1gvmb1r-worker-2 [worker 2] DEBUG [2020-05-02 13:00:57.84]: Setting should_zip_build_products to false [worker 2] DEBUG [2020-05-02 13:00:57.85]: Setting use_clang_report_name to false [worker 2] DEBUG [2020-05-02 13:00:57.85]: Setting max_concurrent_simulators to 4 [worker 2] DEBUG [2020-05-02 13:00:57.85]: Setting disable_concurrent_testing to true [worker 2] DEBUG [2020-05-02 13:00:57.85]: Setting build_for_testing to false [worker 2] DEBUG [2020-05-02 13:00:58.01]: Setting xcargs to -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled NO -resultBundlePath '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.xcresult' [worker 2] DEBUG [2020-05-02 13:00:58.02]: Setting slack_use_webhook_configured_username_and_icon to false [worker 2] DEBUG [2020-05-02 13:00:58.02]: Setting slack_username to fastlane [worker 2] DEBUG [2020-05-02 13:00:58.02]: Setting slack_icon_url to https://s3-eu-west-1.amazonaws.com/fastlane.tools/fastlane.png [worker 2] DEBUG [2020-05-02 13:00:58.02]: Setting skip_slack to false [worker 2] DEBUG [2020-05-02 13:00:58.03]: Setting slack_only_on_failure to true [worker 2] DEBUG [2020-05-02 13:00:58.03]: Setting destination to ["platform=iOS Simulator,id=D81A13B9-4FBB-4E2B-BB4E-FC2DC450F9A0"] [worker 2] DEBUG [2020-05-02 13:00:58.04]: Setting xcodebuild_command to env NSUnbufferedIO=YES xcodebuild [worker 2] [worker 2] +------------------------------------------------+----------------------------------------------------------------------------------------------------+ [worker 2] | Summary for scan 2.146.1 | [worker 2] +------------------------------------------------+----------------------------------------------------------------------------------------------------+ [worker 2] | fail_build | false | [worker 2] | skip_build | true | [worker 2] | output_types | junit | [worker 2] | workspace | *****.xcworkspace | [worker 2] | scheme | Debug | [worker 2] | skip_detect_devices | false | [worker 2] | force_quit_simulator | false | [worker 2] | reset_simulator | false | [worker 2] | disable_slide_to_type | true | [worker 2] | reinstall_app | false | [worker 2] | only_testing | ["NetworkRequestManagerTests/NetworkRequestManagerStubTest"] | [worker 2] | xctestrun | /Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData/Build/Products/Debug_iphonesimulator1 | [worker 2] | | 3.4-x86_64.xctestrun | [worker 2] | clean | false | [worker 2] | code_coverage | true | [worker 2] | open_report | false | [worker 2] | output_directory | /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2 | [worker 2] | output_style | rspec | [worker 2] | output_files | report.junit | [worker 2] | buildlog_path | ~/Library/Logs/scan/worker-2-logs | [worker 2] | include_simulator_logs | false | [worker 2] | derived_data_path | /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/derived_data_path20200502-53847-1gvmb1r-worker-2 | [worker 2] | should_zip_build_products | false | [worker 2] | use_clang_report_name | false | [worker 2] | max_concurrent_simulators | 4 | [worker 2] | disable_concurrent_testing | true | [worker 2] | build_for_testing | false | [worker 2] | xcargs | -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled | [worker 2] | | NO -resultBundlePath | [worker 2] | | '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report | [worker 2] | | .xcresult' | [worker 2] | slack_use_webhook_configured_username_and_icon | false | [worker 2] | slack_username | fastlane | [worker 2] | slack_icon_url | https://s3-eu-west-1.amazonaws.com/fastlane.tools/fastlane.png | [worker 2] | skip_slack | false | [worker 2] | slack_only_on_failure | true | [worker 2] | xcodebuild_command | env NSUnbufferedIO=YES xcodebuild | [worker 2] | xcode_path | /Applications/Xcode.app | [worker 2] | device | iPhone 8 | [worker 2] | result_bundle | false | [worker 2] +------------------------------------------------+----------------------------------------------------------------------------------------------------+ [worker 2] [worker 2] DEBUG [2020-05-02 13:00:58.20]: Fetching available simulator devices [worker 2] INFO [2020-05-02 13:00:59.54]: Disabling 'Slide to Type' iPhone 8 [worker 2] INFO [2020-05-02 13:00:59.54]: $ /usr/libexec/PlistBuddy -c "Add :KeyboardContinuousPathEnabled bool false" /Users/karlcatigbe/Library/Developer/CoreSimulator/Devices/1AE40764-CD73-4268-A715-F5B6F20CA059/data/Library/Preferences/com.apple.keyboard.ContinuousPath.plist >/dev/null 2>&1 [worker 2] INFO [2020-05-02 13:00:59.57]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -destination 'platform=iOS Simulator,id=D81A13B9-4FBB-4E2B-BB4E-FC2DC450F9A0' -derivedDataPath '/var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/derived_data_path20200502-53847-1gvmb1r-worker-2' -maximum-concurrent-test-simulator-destinations 4 -disable-concurrent-testing -enableCodeCoverage YES -xctestrun '/Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData/Build/Products/Debug_iphonesimulator13.4-x86_64.xctestrun' -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled NO -resultBundlePath '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.xcresult' -only-testing:NetworkRequestManagerTests/NetworkRequestManagerStubTest test-without-building | tee '/Users/karlcatigbe/Library/Logs/scan/worker-2-logs/CNBC-Debug.log' | xcpretty --test --report junit --output '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.junit' --report junit --output '/var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/junit_report20200502-54800-wja6iu' [worker 2] INFO [2020-05-02 13:00:59.57]: ▸ Loading... [worker 2] INFO [2020-05-02 13:01:06.41]: ▸ 2020-05-02 13:01:06.411 xcodebuild[54954:7530258] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: [worker 2] INFO [2020-05-02 13:01:06.41]: ▸ /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.xcresult/Staging/1_Test/Diagnostics/NetworkRequestManagerTests-08C31C39-44EE-4CDC-B2FB-54360A6861C3/NetworkRequestManagerTests-C646BACC-8B39-4EBD-A2E1-793FC6C4F024/Session-NetworkRequestManagerTests-2020-05-02_130106-1eYKmA.log [worker 2] INFO [2020-05-02 13:01:06.41]: ▸ 2020-05-02 13:01:06.413 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: (C30F96AC-BC7D-49DC-8BDE-EB63B56B67F5) Beginning test session NetworkRequestManagerTests-C30F96AC-BC7D-49DC-8BDE-EB63B56B67F5 at 2020-05-02 13:01:06.413 with Xcode 11E503a on target <DVTiPhoneSimulator: 0x7ff013096ce0> { [worker 2] INFO [2020-05-02 13:01:06.41]: ▸ SimDevice: iPhone 8 Clone 2 TestCenter::Helper::MultiScanManager::SimulatorHelper<70247245053760> (D81A13B9-4FBB-4E2B-BB4E-FC2DC450F9A0, iOS 13.4, Booted) [worker 2] INFO [2020-05-02 13:01:06.41]: ▸ } (13.4.1 (17E8260)) [worker 2] INFO [2020-05-02 13:01:15.53]: ▸ 2020-05-02 13:01:15.539 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: (C30F96AC-BC7D-49DC-8BDE-EB63B56B67F5) Finished requesting crash reports. Continuing with testing. [worker 2] INFO [2020-05-02 13:01:15.80]: ▸ F [worker 2] INFO [2020-05-02 13:01:15.80]: ▸ NetworkRequestManagerTests.NetworkRequestManagerStubTest [worker 2] INFO [2020-05-02 13:01:15.80]: ▸ testExample, XCTAssertTrue failed [worker 2] INFO [2020-05-02 13:01:15.80]: ▸ /Users/karlcatigbe/Development/Mobile.iOS.*****/Application Frameworks/NetworkRequestManager/NetworkRequestManagerTests/NetworkRequestManagerTests.swift:36 [worker 2] INFO [2020-05-02 13:01:15.80]: ▸ ''' [worker 2] INFO [2020-05-02 13:01:15.81]: ▸ [38;5;230m [39m[38;5;221;01mlet[39;00m[38;5;230m [39m[38;5;153;01minteger[39;00m[38;5;230m [39m[38;5;87m=[39m[38;5;230m [39m[38;5;155;01mInt[39;00m[38;5;87m.[39m[38;5;153mrandom[39m[38;5;87m([39m[38;5;153;01min[39;00m[38;5;87m:[39m[38;5;230m [39m[38;5;212;01m0[39;00m[38;5;87m..<[39m[38;5;212;01m10[39;00m[38;5;87m)[39m[38;5;230m [worker 2] INFO [2020-05-02 13:01:15.81]: ▸ [38;5;230m [39m[38;5;155;01mXCTAssertTrue[39;00m[38;5;87m([39m[38;5;230minteger[39m[38;5;230m [39m[38;5;87m%[39m[38;5;230m [39m[38;5;212;01m2[39;00m[38;5;230m [39m[38;5;87m==[39m[38;5;230m [39m[38;5;212;01m0[39;00m[38;5;87m)[39m[38;5;230m [worker 2] INFO [2020-05-02 13:01:15.81]: ▸ [38;5;230m [39m[38;5;87m}[39m[38;5;230m [worker 2] INFO [2020-05-02 13:01:15.81]: ▸ [38;5;230m[39m ''' [worker 2] INFO [2020-05-02 13:01:15.81]: ▸ [31m Executed 1 test, with 1 failure (0 unexpected) in 0.003 (0.005) seconds [worker 2] INFO [2020-05-02 13:01:51.01]: ▸ [0m2020-05-02 13:01:51.015 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: 44.612 elapsed -- Testing started completed. [worker 2] INFO [2020-05-02 13:01:51.01]: ▸ 2020-05-02 13:01:51.015 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start [worker 2] INFO [2020-05-02 13:01:51.01]: ▸ 2020-05-02 13:01:51.016 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: 44.612 sec, +44.612 sec -- end [worker 2] INFO [2020-05-02 13:01:53.07]: ▸ Failing tests: [worker 2] INFO [2020-05-02 13:01:53.07]: ▸ NetworkRequestManagerTests: [worker 2] INFO [2020-05-02 13:01:53.07]: ▸ NetworkRequestManagerStubTest.testExample() [worker 2] INFO [2020-05-02 13:01:53.07]: ▸ ** TEST EXECUTE FAILED ** [worker 2] 2020-05-02 13:01:06.411 xcodebuild[54954:7530258] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: [worker 2] /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.xcresult/Staging/1_Test/Diagnostics/NetworkRequestManagerTests-08C31C39-44EE-4CDC-B2FB-54360A6861C3/NetworkRequestManagerTests-C646BACC-8B39-4EBD-A2E1-793FC6C4F024/Session-NetworkRequestManagerTests-2020-05-02_130106-1eYKmA.log [worker 2] 2020-05-02 13:01:06.413 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: (C30F96AC-BC7D-49DC-8BDE-EB63B56B67F5) Beginning test session NetworkRequestManagerTests-C30F96AC-BC7D-49DC-8BDE-EB63B56B67F5 at 2020-05-02 13:01:06.413 with Xcode 11E503a on target <DVTiPhoneSimulator: 0x7ff013096ce0> { [worker 2] SimDevice: iPhone 8 Clone 2 TestCenter::Helper::MultiScanManager::SimulatorHelper<70247245053760> (D81A13B9-4FBB-4E2B-BB4E-FC2DC450F9A0, iOS 13.4, Booted) [worker 2] } (13.4.1 (17E8260)) [worker 2] 2020-05-02 13:01:15.539 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: (C30F96AC-BC7D-49DC-8BDE-EB63B56B67F5) Finished requesting crash reports. Continuing with testing. [worker 2] F [worker 2] [worker 2] NetworkRequestManagerTests.NetworkRequestManagerStubTest [worker 2] testExample, XCTAssertTrue failed [worker 2] /Users/karlcatigbe/Development/Mobile.iOS.*****/Application Frameworks/NetworkRequestManager/NetworkRequestManagerTests/NetworkRequestManagerTests.swift:36 [worker 2] ''' [worker 2] let integer = Int.random(in: 0..<10) [worker 2] XCTAssertTrue(integer % 2 == 0) [worker 2] } [worker 2] ''' [worker 2] [worker 2] [worker 2] Executed 1 test, with 1 failure (0 unexpected) in 0.003 (0.005) seconds [worker 2] 2020-05-02 13:01:51.015 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: 44.612 elapsed -- Testing started completed. [worker 2] 2020-05-02 13:01:51.015 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start [worker 2] 2020-05-02 13:01:51.016 xcodebuild[54954:7527538] [MT] IDETestOperationsObserverDebug: 44.612 sec, +44.612 sec -- end [worker 2] Failing tests: [worker 2] NetworkRequestManagerTests: [worker 2] NetworkRequestManagerStubTest.testExample() [worker 2] [worker 2] ** TEST EXECUTE FAILED ** [worker 2] ERROR [2020-05-02 13:01:57.39]: Exit status: 65 [worker 2] +--------------------+---+ [worker 2] | Test Results | [worker 2] +--------------------+---+ [worker 2] | Number of tests | 1 | [worker 2] | Number of failures | 1 | [worker 2] +--------------------+---+ [worker 2] [worker 2] DEBUG [2020-05-02 13:01:57.40]: Batch #2 incrementing retry count to 1 [worker 2] DEBUG [2020-05-02 13:01:57.40]: Scan found failing tests for batch #2 [worker 2] DEBUG [2020-05-02 13:01:57.41]: ReportCollator collating [worker 2] DEBUG [2020-05-02 13:01:57.41]: Restarting Simulator D81A13B9 [worker 2] INFO [2020-05-02 13:01:57.96]: Starting scan #2 with 1 tests for batch #2. [worker 2] DEBUG [2020-05-02 13:01:57.97]: retrying_scan #update_scan_options [worker 2] DEBUG [2020-05-02 13:01:57.97]: Setting fail_build to false [worker 2] DEBUG [2020-05-02 13:01:57.97]: Setting skip_build to true [worker 2] DEBUG [2020-05-02 13:01:57.97]: Setting output_types to junit [worker 2] DEBUG [2020-05-02 13:01:57.97]: Setting workspace to *****.xcworkspace [worker 2] DEBUG [2020-05-02 13:01:57.97]: Setting scheme to Debug [worker 2] DEBUG [2020-05-02 13:01:57.97]: Setting skip_detect_devices to false [worker 2] DEBUG [2020-05-02 13:01:57.97]: Setting reset_simulator to false [worker 2] DEBUG [2020-05-02 13:01:57.97]: Setting disable_slide_to_type to true [worker 2] DEBUG [2020-05-02 13:01:57.97]: Setting reinstall_app to false [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting only_testing to ["NetworkRequestManagerTests/NetworkRequestManagerStubTest"] [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting xctestrun to /Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData/Build/Products/Debug_iphonesimulator13.4-x86_64.xctestrun [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting clean to false [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting open_report to false [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting output_directory to /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2 [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting output_style to rspec [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting output_files to report-2.junit [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting buildlog_path to ~/Library/Logs/scan/worker-2-logs [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting include_simulator_logs to false [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting derived_data_path to /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/derived_data_path20200502-53847-1gvmb1r-worker-2 [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting should_zip_build_products to false [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting use_clang_report_name to false [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting max_concurrent_simulators to 4 [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting disable_concurrent_testing to true [worker 2] DEBUG [2020-05-02 13:01:57.98]: Setting build_for_testing to false [worker 2] DEBUG [2020-05-02 13:01:57.99]: Setting xcargs to -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled NO -resultBundlePath '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.xcresult' [worker 2] DEBUG [2020-05-02 13:01:57.99]: Setting slack_use_webhook_configured_username_and_icon to false [worker 2] DEBUG [2020-05-02 13:01:57.99]: Setting slack_username to fastlane [worker 2] DEBUG [2020-05-02 13:01:57.99]: Setting slack_icon_url to https://s3-eu-west-1.amazonaws.com/fastlane.tools/fastlane.png [worker 2] DEBUG [2020-05-02 13:01:57.99]: Setting skip_slack to false [worker 2] DEBUG [2020-05-02 13:01:57.99]: Setting slack_only_on_failure to true [worker 2] DEBUG [2020-05-02 13:01:57.99]: Setting destination to ["platform=iOS Simulator,id=D81A13B9-4FBB-4E2B-BB4E-FC2DC450F9A0"] [worker 2] DEBUG [2020-05-02 13:01:57.99]: Setting xcodebuild_command to env NSUnbufferedIO=YES xcodebuild [worker 2] [worker 2] +------------------------------------------------+----------------------------------------------------------------------------------------------------+ [worker 2] | Summary for scan 2.146.1 | [worker 2] +------------------------------------------------+----------------------------------------------------------------------------------------------------+ [worker 2] | fail_build | false | [worker 2] | skip_build | true | [worker 2] | output_types | junit | [worker 2] | workspace | *****.xcworkspace | [worker 2] | scheme | Debug | [worker 2] | skip_detect_devices | false | [worker 2] | force_quit_simulator | false | [worker 2] | reset_simulator | false | [worker 2] | disable_slide_to_type | true | [worker 2] | reinstall_app | false | [worker 2] | only_testing | ["NetworkRequestManagerTests/NetworkRequestManagerStubTest"] | [worker 2] | xctestrun | /Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData/Build/Products/Debug_iphonesimulator1 | [worker 2] | | 3.4-x86_64.xctestrun | [worker 2] | clean | false | [worker 2] | code_coverage | true | [worker 2] | open_report | false | [worker 2] | output_directory | /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2 | [worker 2] | output_style | rspec | [worker 2] | output_files | report-2.junit | [worker 2] | buildlog_path | ~/Library/Logs/scan/worker-2-logs | [worker 2] | include_simulator_logs | false | [worker 2] | derived_data_path | /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/derived_data_path20200502-53847-1gvmb1r-worker-2 | [worker 2] | should_zip_build_products | false | [worker 2] | use_clang_report_name | false | [worker 2] | max_concurrent_simulators | 4 | [worker 2] | disable_concurrent_testing | true | [worker 2] | build_for_testing | false | [worker 2] | xcargs | -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled | [worker 2] | | NO -resultBundlePath | [worker 2] | | '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report | [worker 2] | | -2.xcresult' | [worker 2] | slack_use_webhook_configured_username_and_icon | false | [worker 2] | slack_username | fastlane | [worker 2] | slack_icon_url | https://s3-eu-west-1.amazonaws.com/fastlane.tools/fastlane.png | [worker 2] | skip_slack | false | [worker 2] | slack_only_on_failure | true | [worker 2] | xcodebuild_command | env NSUnbufferedIO=YES xcodebuild | [worker 2] | xcode_path | /Applications/Xcode.app | [worker 2] | device | iPhone 8 | [worker 2] | result_bundle | false | [worker 2] +------------------------------------------------+----------------------------------------------------------------------------------------------------+ [worker 2] [worker 2] DEBUG [2020-05-02 13:01:58.09]: Fetching available simulator devices [worker 2] INFO [2020-05-02 13:01:58.52]: Disabling 'Slide to Type' iPhone 8 [worker 2] INFO [2020-05-02 13:01:58.52]: $ /usr/libexec/PlistBuddy -c "Add :KeyboardContinuousPathEnabled bool false" /Users/karlcatigbe/Library/Developer/CoreSimulator/Devices/1AE40764-CD73-4268-A715-F5B6F20CA059/data/Library/Preferences/com.apple.keyboard.ContinuousPath.plist >/dev/null 2>&1 [worker 2] INFO [2020-05-02 13:01:58.55]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -destination 'platform=iOS Simulator,id=D81A13B9-4FBB-4E2B-BB4E-FC2DC450F9A0' -derivedDataPath '/var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/derived_data_path20200502-53847-1gvmb1r-worker-2' -maximum-concurrent-test-simulator-destinations 4 -disable-concurrent-testing -enableCodeCoverage YES -xctestrun '/Users/karlcatigbe/Development/Mobile.iOS.*****/derivedData/Build/Products/Debug_iphonesimulator13.4-x86_64.xctestrun' -IDEBuildOperationMaxNumberOfConcurrentCompileTasks='sysctl -n hw.ncpu' -parallel-testing-enabled NO -resultBundlePath '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.xcresult' -only-testing:NetworkRequestManagerTests/NetworkRequestManagerStubTest test-without-building | tee '/Users/karlcatigbe/Library/Logs/scan/worker-2-logs/CNBC-Debug.log' | xcpretty --test --report junit --output '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.junit' --report junit --output '/var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/junit_report20200502-54800-kyel9' [worker 2] INFO [2020-05-02 13:01:58.55]: ▸ Loading... [worker 2] INFO [2020-05-02 13:02:01.31]: ▸ 2020-05-02 13:02:01.312 xcodebuild[55166:7547921] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: [worker 2] INFO [2020-05-02 13:02:01.31]: ▸ /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.xcresult/Staging/1_Test/Diagnostics/NetworkRequestManagerTests-12ABAC81-957F-4FE3-93A5-4FBAD112E24B/NetworkRequestManagerTests-BC525C69-A695-4EE5-862E-6AB55507009C/Session-NetworkRequestManagerTests-2020-05-02_130201-hflCcl.log [worker 2] INFO [2020-05-02 13:02:01.31]: ▸ 2020-05-02 13:02:01.314 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: (0ACFF52E-8FF0-443D-9FCE-DD1F7408AC64) Beginning test session NetworkRequestManagerTests-0ACFF52E-8FF0-443D-9FCE-DD1F7408AC64 at 2020-05-02 13:02:01.314 with Xcode 11E503a on target <DVTiPhoneSimulator: 0x7fe0fae5bab0> { [worker 2] INFO [2020-05-02 13:02:01.31]: ▸ SimDevice: iPhone 8 Clone 2 TestCenter::Helper::MultiScanManager::SimulatorHelper<70247245053760> (D81A13B9-4FBB-4E2B-BB4E-FC2DC450F9A0, iOS 13.4, Booted) [worker 2] INFO [2020-05-02 13:02:01.31]: ▸ } (13.4.1 (17E8260)) [worker 2] INFO [2020-05-02 13:02:01.54]: ▸ 2020-05-02 13:02:01.541 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: (0ACFF52E-8FF0-443D-9FCE-DD1F7408AC64) Finished requesting crash reports. Continuing with testing. [worker 2] INFO [2020-05-02 13:02:01.75]: ▸ F [worker 2] INFO [2020-05-02 13:02:01.75]: ▸ NetworkRequestManagerTests.NetworkRequestManagerStubTest [worker 2] INFO [2020-05-02 13:02:01.75]: ▸ testExample, XCTAssertTrue failed [worker 2] INFO [2020-05-02 13:02:01.76]: ▸ /Users/karlcatigbe/Development/Mobile.iOS.*****/Application Frameworks/NetworkRequestManager/NetworkRequestManagerTests/NetworkRequestManagerTests.swift:36 [worker 2] INFO [2020-05-02 13:02:01.76]: ▸ ''' [worker 2] INFO [2020-05-02 13:02:01.76]: ▸ [38;5;230m [39m[38;5;221;01mlet[39;00m[38;5;230m [39m[38;5;153;01minteger[39;00m[38;5;230m [39m[38;5;87m=[39m[38;5;230m [39m[38;5;155;01mInt[39;00m[38;5;87m.[39m[38;5;153mrandom[39m[38;5;87m([39m[38;5;153;01min[39;00m[38;5;87m:[39m[38;5;230m [39m[38;5;212;01m0[39;00m[38;5;87m..<[39m[38;5;212;01m10[39;00m[38;5;87m)[39m[38;5;230m [worker 2] INFO [2020-05-02 13:02:01.76]: ▸ [38;5;230m [39m[38;5;155;01mXCTAssertTrue[39;00m[38;5;87m([39m[38;5;230minteger[39m[38;5;230m [39m[38;5;87m%[39m[38;5;230m [39m[38;5;212;01m2[39;00m[38;5;230m [39m[38;5;87m==[39m[38;5;230m [39m[38;5;212;01m0[39;00m[38;5;87m)[39m[38;5;230m [worker 2] INFO [2020-05-02 13:02:01.76]: ▸ [38;5;230m [39m[38;5;87m}[39m[38;5;230m [worker 2] INFO [2020-05-02 13:02:01.76]: ▸ [38;5;230m[39m ''' [worker 2] INFO [2020-05-02 13:02:01.76]: ▸ [31m Executed 1 test, with 1 failure (0 unexpected) in 0.002 (0.004) seconds [worker 2] INFO [2020-05-02 13:02:39.78]: ▸ [0m2020-05-02 13:02:39.783 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: 38.480 elapsed -- Testing started completed. [worker 2] INFO [2020-05-02 13:02:39.78]: ▸ 2020-05-02 13:02:39.783 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start [worker 2] INFO [2020-05-02 13:02:39.78]: ▸ 2020-05-02 13:02:39.783 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: 38.480 sec, +38.480 sec -- end [worker 2] INFO [2020-05-02 13:02:41.51]: ▸ Failing tests: [worker 2] INFO [2020-05-02 13:02:41.51]: ▸ NetworkRequestManagerTests: [worker 2] INFO [2020-05-02 13:02:41.51]: ▸ NetworkRequestManagerStubTest.testExample() [worker 2] INFO [2020-05-02 13:02:41.52]: ▸ ** TEST EXECUTE FAILED ** [worker 2] 2020-05-02 13:02:01.312 xcodebuild[55166:7547921] IDETestOperationsObserverDebug: Writing diagnostic log for test session to: [worker 2] /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.xcresult/Staging/1_Test/Diagnostics/NetworkRequestManagerTests-12ABAC81-957F-4FE3-93A5-4FBAD112E24B/NetworkRequestManagerTests-BC525C69-A695-4EE5-862E-6AB55507009C/Session-NetworkRequestManagerTests-2020-05-02_130201-hflCcl.log [worker 2] 2020-05-02 13:02:01.314 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: (0ACFF52E-8FF0-443D-9FCE-DD1F7408AC64) Beginning test session NetworkRequestManagerTests-0ACFF52E-8FF0-443D-9FCE-DD1F7408AC64 at 2020-05-02 13:02:01.314 with Xcode 11E503a on target <DVTiPhoneSimulator: 0x7fe0fae5bab0> { [worker 2] SimDevice: iPhone 8 Clone 2 TestCenter::Helper::MultiScanManager::SimulatorHelper<70247245053760> (D81A13B9-4FBB-4E2B-BB4E-FC2DC450F9A0, iOS 13.4, Booted) [worker 2] } (13.4.1 (17E8260)) [worker 2] 2020-05-02 13:02:01.541 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: (0ACFF52E-8FF0-443D-9FCE-DD1F7408AC64) Finished requesting crash reports. Continuing with testing. [worker 2] F [worker 2] [worker 2] NetworkRequestManagerTests.NetworkRequestManagerStubTest [worker 2] testExample, XCTAssertTrue failed [worker 2] /Users/karlcatigbe/Development/Mobile.iOS.*****/Application Frameworks/NetworkRequestManager/NetworkRequestManagerTests/NetworkRequestManagerTests.swift:36 [worker 2] ''' [worker 2] let integer = Int.random(in: 0..<10) [worker 2] XCTAssertTrue(integer % 2 == 0) [worker 2] } [worker 2] ''' [worker 2] [worker 2] [worker 2] Executed 1 test, with 1 failure (0 unexpected) in 0.002 (0.004) seconds [worker 2] 2020-05-02 13:02:39.783 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: 38.480 elapsed -- Testing started completed. [worker 2] 2020-05-02 13:02:39.783 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start [worker 2] 2020-05-02 13:02:39.783 xcodebuild[55166:7547602] [MT] IDETestOperationsObserverDebug: 38.480 sec, +38.480 sec -- end [worker 2] Failing tests: [worker 2] NetworkRequestManagerTests: [worker 2] NetworkRequestManagerStubTest.testExample() [worker 2] [worker 2] ** TEST EXECUTE FAILED ** [worker 2] ERROR [2020-05-02 13:02:45.41]: Exit status: 65 [worker 2] +--------------------+---+ [worker 2] | Test Results | [worker 2] +--------------------+---+ [worker 2] | Number of tests | 1 | [worker 2] | Number of failures | 1 | [worker 2] +--------------------+---+ [worker 2] [worker 2] DEBUG [2020-05-02 13:02:45.43]: Batch #2 incrementing retry count to 2 [worker 2] DEBUG [2020-05-02 13:02:45.43]: Scan found failing tests for batch #2 [worker 2] DEBUG [2020-05-02 13:02:45.43]: ReportCollator collating [worker 2] DEBUG [2020-05-02 13:02:45.43]: Collating junit report files ["/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.junit", "/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.junit"] [worker 2] DEBUG [2020-05-02 13:02:45.43]: collate_junit_reports with ["/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.junit", "/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.junit"] [worker 2] DEBUG [2020-05-02 13:02:45.44]: > collating last report file /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.junit [worker 2] DEBUG [2020-05-02 13:02:45.45]: > collating testsuite NetworkRequestManagerTests.NetworkRequestManagerStubTest [worker 2] DEBUG [2020-05-02 13:02:45.45]: collate_testsuite with testcase testExample [worker 2] DEBUG [2020-05-02 13:02:45.45]: replacing "<testcase classname='NetworkRequestManagerTests.NetworkRequestManagerStubTest' name='testExample'> [worker 2] <failure message='XCTAssertTrue failed'> [worker 2] Application [worker 2] Frameworks/NetworkRequestManager/NetworkRequestManagerTests/NetworkRequestManagerTests.swift:36 [worker 2] </failure> [worker 2] </testcase>" with "<testcase classname='NetworkRequestManagerTests.NetworkRequestManagerStubTest' name='testExample'> [worker 2] <failure message='XCTAssertTrue failed'> [worker 2] Application [worker 2] Frameworks/NetworkRequestManager/NetworkRequestManagerTests/NetworkRequestManagerTests.swift:36 [worker 2] </failure> [worker 2] </testcase>" [worker 2] DEBUG [2020-05-02 13:02:45.45]: [worker 2] DEBUG [2020-05-02 13:02:45.45]: target_testcase after replacement "<testsuite failures='1' name='NetworkRequestManagerTests.NetworkRequestManagerStubTest' tests='1'> [worker 2] <testcase classname='NetworkRequestManagerTests.NetworkRequestManagerStubTest' name='testExample' retries='1'> [worker 2] <failure message='XCTAssertTrue failed'> [worker 2] Application [worker 2] Frameworks/NetworkRequestManager/NetworkRequestManagerTests/NetworkRequestManagerTests.swift:36 [worker 2] </failure> [worker 2] </testcase> [worker 2] </testsuite>" [worker 2] DEBUG [2020-05-02 13:02:45.45]: < collating testsuite NetworkRequestManagerTests.NetworkRequestManagerStubTest [worker 2] DEBUG [2020-05-02 13:02:45.45]: < collating last report file /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.junit [worker 2] DEBUG [2020-05-02 13:02:45.47]: Collating xcresult bundles ["/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.xcresult", "/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.xcresult"] [worker 2] INFO [2020-05-02 13:02:45.47]: $ xcrun xcresulttool merge /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.xcresult /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report-2.xcresult --output-path /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/collated_result_20200502-54800-spxzbp.xcresult [worker 2] INFO [2020-05-02 13:02:58.26]: ▸ [v3] Merged to: /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/collated_result_20200502-54800-spxzbp.xcresult [worker 2] INFO [2020-05-02 13:02:59.23]: Finished collating xcresults to '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.xcresult' [worker 2] DEBUG [2020-05-02 13:02:59.52]: All tests passed for batch 2? false DEBUG [2020-05-02 13:02:59.59]: Collating results for all batches DEBUG [2020-05-02 13:02:59.59]: ReportCollator collating DEBUG [2020-05-02 13:02:59.59]: Collating junit report files ["/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1/report.junit", "/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.junit"] DEBUG [2020-05-02 13:02:59.59]: collate_junit_reports with ["/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1/report.junit", "/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.junit"] DEBUG [2020-05-02 13:02:59.59]: > collating last report file /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.junit DEBUG [2020-05-02 13:02:59.59]: < collating last report file /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.junit DEBUG [2020-05-02 13:02:59.59]: Collating xcresult bundles ["/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1/report.xcresult", "/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.xcresult"] INFO [2020-05-02 13:02:59.62]: $ xcrun xcresulttool merge /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-1/report.xcresult /Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests-batch-2/report.xcresult --output-path /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/collated_result_20200502-53847-1l2w6lq.xcresult INFO [2020-05-02 13:03:12.18]: ▸ [v3] Merged to: /var/folders/v9/gplf5gyn5nx1sd3l8423jl4c0000gp/T/collated_result_20200502-53847-1l2w6lq.xcresult INFO [2020-05-02 13:03:12.95]: Finished collating xcresults to '/Users/karlcatigbe/Development/Mobile.iOS.*****/output/NetworkRequestManagerTests/report.xcresult' INFO [2020-05-02 13:03:14.14]: ------------------- INFO [2020-05-02 13:03:14.14]: --- Step: is_ci --- INFO [2020-05-02 13:03:14.14]: ------------------- WARN [2020-05-02 13:03:14.14]: Lane Context: INFO [2020-05-02 13:03:14.14]: {:DEFAULT_PLATFORM=>:ios, :PLATFORM_NAME=>:ios, :LANE_NAME=>"ios test", :BUILD_NUMBER=>"1"} ERROR [2020-05-02 13:03:14.14]: File exists @ syserr_fail2_in - /Users/karlcatigbe/Development/Mobile.iOS.*****/output/./report.test_result INFO [2020-05-02 13:03:14.15]: Successfully generated documentation at path '/Users/karlcatigbe/Development/Mobile.iOS.*****/fastlane/README.md'
+------+----------------------------+-------------+ | fastlane summary | +------+----------------------------+-------------+ | Step | Action | Time (in s) | +------+----------------------------+-------------+ | 1 | Verifying fastlane version | 0 | | 2 | default_platform | 0 | | 3 | is_ci | 0 | | 4 | setup_jenkins | 0 | | 5 | is_ci | 0 | | 6 | cocoapods | 7 | | 7 | increment_build_number | 1 | | 💥 | multi_scan | 505 | | 9 | is_ci | 0 | +------+----------------------------+-------------+
DEBUG [2020-05-02 13:03:14.17]: All plugins are up to date ERROR [2020-05-02 13:03:14.17]: fastlane finished with errors
Looking for related GitHub issues on fastlane/fastlane... Search query: File exists @ syserr_fail2_in - /Users/karlcatigbe/Development/Mobile.iOS.*****/output/./report.test_result
URL: https://api.github.com/search/issues?q=File%20exists%20%40%20syserr_fail2_in%20-%20%2FUsers%2Fkarlcatigbe%2FDevelopment%2FMobile.iOS.*****%2Foutput%2F.%2Freport.test_result+repo:fastlane/fastlane Found no similar issues. To create a new issue, please visit: https://github.com/fastlane/fastlane/issues/new Run 'fastlane env' to append the fastlane environment to your issue DEBUG [2020-05-02 13:03:14.39]: All plugins are up to date bundler: failed to load command: fastlane (/Users/karlcatigbe/.rbenv/versions/2.4.1/bin/fastlane) Errno::EEXIST: [!] File exists @ syserr_fail2_in - /Users/karlcatigbe/Development/Mobile.iOS.*****/output/./report.test_result /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:1267:in 'symlink' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:1267:in 'copy' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:415:in 'block in copy_entry' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:1387:in 'wrap_traverse' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:1390:in 'block in wrap_traverse' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:1389:in 'each' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:1389:in 'wrap_traverse' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:412:in 'copy_entry' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:390:in 'block in cp_r' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:1460:in 'block in fu_each_src_dest' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:1474:in 'fu_each_src_dest0' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:1458:in 'fu_each_src_dest' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/2.4.0/fileutils.rb:389:in 'cp_r' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/bundler/gems/fastlane-plugin-test_center-2e5ba2aa054a/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:210:in 'move_single_testable_reports_to_final_location' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/bundler/gems/fastlane-plugin-test_center-2e5ba2aa054a/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:200:in 'collate_batched_reports' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/bundler/gems/fastlane-plugin-test_center-2e5ba2aa054a/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:179:in 'run_test_batches' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/bundler/gems/fastlane-plugin-test_center-2e5ba2aa054a/lib/fastlane/plugin/test_center/helper/multi_scan_manager/runner.rb:70:in 'run' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/bundler/gems/fastlane-plugin-test_center-2e5ba2aa054a/lib/fastlane/plugin/test_center/actions/multi_scan.rb:34:in 'run' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:261:in 'block (2 levels) in execute_action' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/actions/actions_helper.rb:50:in 'execute_action' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:253:in 'block in execute_action' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:227:in 'chdir' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:227:in 'execute_action' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:157:in 'trigger_action_by_name' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/fast_file.rb:159:in 'method_missing' Fastfile:53:in 'block (2 levels) in parsing_binding' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/lane.rb:33:in 'call' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:49:in 'block in execute' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:45:in 'chdir' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/runner.rb:45:in 'execute' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/lane_manager.rb:56:in 'cruise_lane' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/command_line_handler.rb:36:in 'handle' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/commands_generator.rb:108:in 'block (2 levels) in run' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:178:in 'call' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:153:in 'run' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/commander-fastlane-4.4.6/lib/commander/runner.rb:476:in 'run_active_command' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane_core/lib/fastlane_core/ui/fastlane_runner.rb:76:in 'run!' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/commander-fastlane-4.4.6/lib/commander/delegates.rb:15:in 'run!' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/commands_generator.rb:349:in 'run' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/commands_generator.rb:41:in 'start' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/fastlane/lib/fastlane/cli_tools_distributor.rb:119:in 'take_off' /Users/karlcatigbe/.rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/fastlane-2.146.1/bin/fastlane:23:in '<top (required)>' /Users/karlcatigbe/.rbenv/versions/2.4.1/bin/fastlane:22:in 'load' /Users/karlcatigbe/.rbenv/versions/2.4.1/bin/fastlane:22:in '<top (required)>' INFO [2020-05-02 13:03:14.39]: Deleting iPhone 8 Clone 1 TestCenter::Helper::MultiScanManager::SimulatorHelper<70247245053760> INFO [2020-05-02 13:03:20.62]: Deleting iPhone 8 Clone 2 TestCenter::Helper::MultiScanManager::SimulatorHelper<70247245053760> INFO [2020-05-02 13:03:26.92]: Deleting iPhone 8 Clone 3 TestCenter::Helper::MultiScanManager::SimulatorHelper<70247245053760> INFO [2020-05-02 13:03:33.13]: Deleting iPhone 8 Clone 4 TestCenter::Helper::MultiScanManager::SimulatorHelper<70247245053760> ESTCNBY41D9JGML:Mobile.iOS.***** karlcatigbe$
kcatigbe commented
Some details about the project itself, if it helps:
There's a single Scheme that has 4 test targets -
- Unit Test target
- Main App UI Test Targets
- Seperate framework for Network Requests
- Additional framework for a propiertary API
Right now I am just testing with one UI Test suite, and the network framework tests.
The network framework exclusively had tests from Quick/Nimble, but I added a second suite with normal XCTests to troubleshoot (and added a random failure, since that seems to trigger the crash)
I will try to throw together a simple sample project to demonstrate
lyndsey-ferguson commented
A sample project would be very helpful, thanks!
kcatigbe commented
@lyndsey-ferguson sorry for the delay - here's a sample app that I can replicate the issue with:
https://github.com/kcatigbe/sample_app
This more-or-less replicates the build structure of my production app.
Let me know if you need more info, in the meantime I will keep digging as well.
lyndsey-ferguson commented
Hello @kcatigbe I ran the sample project and did not have any problems (other than having to remove the override keyword).
output.txt
kcatigbe commented
@lyndsey-ferguson - It looks like you're running Xcode 11.3 - I'll try that version
lyndsey-ferguson commented
What version of Xcode are you using? I'd like for test_center to work for as many versions of our tools as possible (within my limits 😄)
kcatigbe commented
I was using 11.4.1 on Catalina.
This is a tricky one, honestly... sometimes it succeeds just fine, and other times it fails with the cp_r exception.
Something I noticed, is that when it fails, the output directory has a "different" structure:
Debug.junit
Debug.test_result@
Debug.xcresult/
TestCenterTestingUITests/
TestCenterTestingUITests/Debug.junit
TestCenterTestingUITests/Debug.test_result@
TestCenterTestingUITests/Debug.xcresult/
when it passes, the structure is "similar" except that the folder is named after the batch run, i.e.
TestCenterTestingUITests-batch-1
The jUnit/xcresult output is also different. The root Debug.junit has the failing test, but the files in the test batch folder have 0 tests.
Still digging - but this is what I'm seeing so far
lyndsey-ferguson commented
Thanks for the information and for your own investigation. I have already added code in the past to handle how different versions of Xcode behave. Hopefully, I can get this fixed over the weekend.
lyndsey-ferguson commented
I downloaded Xcode11.4.1 and have reproduced the same error with your sample project. Next step, understand what is going on.
lyndsey-ferguson commented
Ok, here is what I think it is happening.
- For the invocation tests, the first
xcresultfile is placed in the output folder. - For the subsequent tests, the
xcresulttests are placed in "batch" subfolders in the output folder. - When a "batch" wraps up, the tool tries to merge all the
xcresultfiles in the subfolders into a finalxcresultfile in the output folder.
Result: as the xcresult file already exists, the xcrun xcresulttool merge crashes. The solution seems to be rather than "move", this should be a merge if the bundle already exists.
(for tomorrow)
lyndsey-ferguson commented
@kcatigbe I believe that I have fixed it. Can you remove your Gemfile.lock file and test it with the above instructions?
kcatigbe commented
Thanks @lyndsey-ferguson - I'm not seeing the failure on my sample app anymore either.
I've pointed my actual app at the new branch and will be running it through it's paces on our CI system continuously and will let you know if anything crops up, but so far so good
kcatigbe commented
Ok so good news and bad news - Good news is, I get through the complete multi-scan without any more ruby exceptions.
The bad news (and this isn't related to the original issue) -
The tests that are being re-executed are incorrect -
For example, when I have this set of failed tests:
TestCenterTestingTests:
RandomInvocationTests.Invocation_Test__Random_Test_Failure__Should_Fail_Randomly()
TestCenterTestingUITests:
TestCenterTestingUITests.testExample()
DummyTests:
DummyInvocationTests.Invocation_Test__Random_Test_Failure__Should_Fail_Randomly()
The worker threads get the following suites to retest:
[worker 1] DEBUG [2020-05-13 10:14:15.37]: Setting only_testing to ["DummyTests/DummyInvocationTests"]
[worker 2] DEBUG [2020-05-13 10:14:15.68]: Setting only_testing to ["DummyTests/RandomInvocationTests"]
[worker 3] DEBUG [2020-05-13 10:14:15.34]: Setting only_testing to ["DummyTests/TestCenterTestingUITests"]
As you can see, they are incorrectly named; These will be passed directly to xcodebuild's `-only-testing' list, which won't find the tests.
I believe it's inside /lib/fastlane/plugin/test_center/helper/junit_helper.rb
It's using the outermost <testsuites> element name as the identifier, however in this project setup, xcpretty combines all of the tests under one root that seems arbitrarily named (sometimes I get "DummyTests.xctest" other times I get the name of another suite).
I'm not sure this has anything to do with invocation based tests, or just single scheme / multiple test target setup that I'm using in the app.
lyndsey-ferguson commented
So, you're saying that junit_helper sees all those tests under the DummyTests test suite. I may be able to debug this if the sample you provided has different test suites.
lyndsey-ferguson commented
I'm not familiar with invocation tests, so forgive me if this is a stupid question. What would be the correct only testing parameter be?
-TestCenterTestingTests/RandomInvocationTests.Invocation_Test__Random_Test_Failure__Should_Fail_Randomly
-DummyTests/TestCenterTestingTests/RandomInvocationTests.Invocation_Test__Random_Test_Failure__Should_Fail_Randomly
-DummyTests/RandomInvocationTests.Invocation_Test__Random_Test_Failure__Should_Fail_Randomly
?
lyndsey-ferguson commented
I think the failure to re-run invocation tests would be a separate issue than this and prefer to finish this one up and then work on that one.
kcatigbe commented
Thanks @lyndsey-ferguson. I agree that this is a new issue.
If you'd like I can open another issue regarding the test suites to keep this topic uncluttered
lyndsey-ferguson commented
Yes, I would appreciate it if you could open up another issue for the failure to re-run the failed invocation tests.
Also provide more info on my above question (to the new Issue).
lyndsey-ferguson commented
Fixed in v3.10.3