flaky 
Run Appium iOS/Android tests on OS X to measure flakiness.
gem uninstall -aIx flaky; gem install --no-rdoc --no-ri flakyflake 3 ios[nop]- Run the iOS test named nop 3 times.flake 3 ios- Run all the iOS tests up to 3 times. If a test passes then it moves onto the next test. If a test fails 3 times then it moves onto the next test.
The flake command must be run in the directory that contains the Rakefile.
Results are stored in /tmp/flaky
Must set ENV['APPIUM_HOME'] to point to the appium folder containing server.js.
This only works with:
- Ruby / appium_lib
- iOS iPhone Simulator 6.1 +
- Unique test file names per platform
--
For each test:
- iOS Simulator is closed
- All
/Users/#{user}/Library/Application Support/iPhone Simulator/**/Applications/*are removed - Appium server is restarted
- spec test logs are saved and colored
- Appium logs are saved and colored
--
logs & video
# Sample setup/teardown that saves logs and records videos.
# Appium::Driver.new(app_path: env_app_path, debug: true,
# device: device, device_cap: device_cap,
# export_session: true).start_driver
#
# The following code goes after Driver.new.start_driver
puts "Recording #{device} to /tmp/video.mov"
flaky_screen_recording_pid = Flaky.screen_recording_start os: device, path: '/tmp/video.mov'
Minitest.after_run do
if $driver
puts "Ending pid: #{flaky_screen_recording_pid}"
Flaky.screen_recording_stop flaky_screen_recording_pid # save video
Flaky.capture_ios_app_log 'MyApp.app' # save app logs
ignore { wait(10) { $driver.x } }
end
end