WebdriverIO is a progressive automation framework built to automate modern web and mobile applications. It simplifies the interaction with your app and provides a set of plugins that help you create a scalable, robust and flakiness test suite.
This BrowserStack Example repository demonstrates a WebdriverIO tests framework written in Mocha and nodeJS with parallel testing capabilities. The WebdriverIO test scripts are written for the open source Browserstack Demo App.This BrowserStack Demo Mobile App is an e-commerce mobile application which showcases multiple real-world user scenarios. The app is bundled with offers data, orders data and products data that contains everything you need to start using the app and run tests out-of-the-box.
The WebDriverIO tests are run on different platforms like on-prem and BrowserStack using various run configurations and test capabilities.
-
Clone the repository
-
Ensure you have the following dependencies installed on the machine
- NodeJS >= 16.11.1 (includes npm 8.0.0)
-
Run below command to configure dependencies
npm install
This repository contains the following WebdriverIO tests:
Module | Test name | Description |
---|---|---|
E2E | e2e.spec.js | This test scenario verifies successful product purchase lifecycle end-to-end. It demonstrates the Page Object Model design pattern and is also the default test executed in all the single test run profiles. |
Login | login.spec.js | This test verifies the login workflow with different types of valid login users. |
Login | login_data_driven.spec.js | This test verifies the login for all error cases in a datadriven way |
Login | login_requested.spec.js | This test verifies that the login page is shown when you access the favourites page with being logged in |
Offers | offers.spec.js | This test mocks the GPS location for Singapore and verifies that the product offers applicable for the Singapore location are shown. |
User | user.spec.js | The first test verifies that existing orders are shown for user: "existing_orders_user". The second test verifies if a user can add product to the favourites. |
For all the parallel run configuration profiles, you can configure the maximum parallel test threads by changing the settings below.
-
BrowserStack
resources/conf/wdio-bstack-parallel.conf.js
capabilities: [{ maxInstances: 5, ...
This infrastructure points to running the tests on your own machine using simulator or connected devices.
- For this infrastructure configuration (i.e on-premise), ensure that the app is downloaded and placed in the
/bin
folder.
-
How to run the test?
To run the default test scenario (e.g. End to End Scenario) on your own machine, use the following command:
npm run onprem
To run a specific test scenario, use the following command with the additional 'spec' argument:
npm run onprem-suite -- -- spec orders
-
How to run the test?
To run the entire test suite on your own machine, use the following command:
npm run onprem-suite
BrowserStack provides instant access to 2,000+ real mobile devices and browsers on a highly reliable cloud infrastructure that effortlessly scales as testing needs grow.
-
Create a new BrowserStack account or use an existing one.
-
Identify your BrowserStack username and access key from the BrowserStack App Automate Dashboard and export them as environment variables using the below commands.
-
For *nix based and Mac machines:
export BROWSERSTACK_USERNAME=<browserstack-username> && export BROWSERSTACK_ACCESS_KEY=<browserstack-access-key>
-
For Windows:
set BROWSERSTACK_USERNAME=<browserstack-username> set BROWSERSTACK_ACCESS_KEY=<browserstack-access-key>
-
Alternatively, you can also hardcode username and access_key objects in the wdio*.conf.js files.
Note:
- We have configured the capabilities in wdio*.conf.js files. You can certainly update them based on your device test requirements.
- The exact test capability values can be easily identified using the Browserstack Capability Generator
You need to upload the APK
or IPA
to BrowserStack, before you can run the test on BrowserStack. BrowserStack will provide you with an app_url
which you need to use.
You can upload the APK
or IPA
using a file on your filesystem or using a public url.
cURL command:
curl -u "browserstack_username:browserstack_access_key" \
-X POST "https://api-cloud.browserstack.com/app-automate/upload" \
-F "file=@/path/to/ipa/or/apk" \
-F "custom_id=BrowserStackDemoApp"
More information on Upload apps from filesystem, Upload apps using public URL or Define custom ID for app.
In this section, we will run a single test on an Android device on Browserstack. To change test capabilities for this configuration, please refer to the capabilities
object in resources/conf/wdio-bstack-single.conf.js
file.
-
How to run the test?
- To run the default test scenario (e.g. End to End Scenario) on a BrowserStack device, use the following command:
npm run bstack-single
- To run a specific test scenario, use the following command with the additional 'spec' argument:
npm run bstack-suite -- -- spec orders
- To run the default test scenario (e.g. End to End Scenario) on a BrowserStack device, use the following command:
In this section, we will run the tests in parallel on a single device on Browserstack. Refer to capabilities
object in resources/conf/wdio-bstack-parallel.conf.js
file to change test capabilities for this configuration.
-
How to run the test?
- To run the entire test suite in parallel on a single BrowserStack device type, use the following command:
npm run bstack-parallel
- To run the entire test suite in parallel on a single BrowserStack device type, use the following command:
Note: By default, this execution would run maximum 2 test threads in parallel on BrowserStack. The parallels can eb modified by updated the
maxInstances
insidecapabilities
object inresources/conf/wdio-bstack-parallel.conf.js
.
In this section, we will run the tests in parallel on multiple devices on Browserstack. Refer to the capabilities
object in resources/conf/wdio-bstack-parallel-devices.conf.js
file to change test capabilities for this configuration.
-
How to run the test?
- To run the entire test suite in parallel on multiple BrowserStack devices, use the following command:
npm run bstack-parallel-devices
- To run the entire test suite in parallel on multiple BrowserStack devices, use the following command:
Mobile application using local or internal environment - Running your tests on BrowserStack using BrowserStackLocal
-
Clone the BrowserStack demo application repository.
git clone https://github.com/browserstack/browserstack-demo-app
-
Please follow the README.md on the BrowserStack demo application repository to install and start the dev server on localhost.
-
We will change the response of the
signin
(for thelocked_user
) API endpoint. (File to change:pages/api/signin.js
line43
)- The API endpoint respond with a specific error,
Your account has been locked.
. - We will change that to something generic, like:
Something went wrong.
- The API endpoint respond with a specific error,
-
In this section, we will run a single test case that changes the API used in BrowserStack Demo app, in a wat that it interact with you local machine. Refer to the
capabilities
object inresources/conf/wdio-bstack-local.conf.js
file to change test capabilities for this configuration. -
Note: You may need to provide additional BrowserStackLocal arguments to successfully connect your localhost environment with BrowserStack infrastructure. (e.g if you are behind firewalls, proxy or VPN).
-
Further details for successfully creating a BrowserStackLocal connection can be found here:
Mobile application using local or internal environment - Run a specific test on BrowserStack using BrowserStackLocal
-
How to run the test?
- To run the default test scenario (e.g. End to End Scenario) on a single BrowserStack device using BrowserStackLocal, use the following command:
npm run bstack-local
- To run the default test scenario (e.g. End to End Scenario) on a single BrowserStack device using BrowserStackLocal, use the following command:
Mobile application using local or internal environment - Run the entire test suite in parallel on multiple BrowserStack devices using BrowserStackLocal
In this section, we will run the test cases on a mobile application using a local or internal environment in parallel on multiple devices on Browserstack. Refer to the capabilities
object in resources/conf/wdio-bstack-local-parallel-devices.conf.js
file to change test capabilities for this configuration.
-
How to run the test?
- To run the entire test suite in parallel on multiple BrowserStack devices using BrowserStackLocal, use the following command:
npm run bstack-local-parallel-devices
- To run the entire test suite in parallel on multiple BrowserStack devices using BrowserStackLocal, use the following command:
- Generate Report using the following command:
npm run generate-report
- View your test results on the BrowserStack App Automate Dashboard
- Documentation for writing App Automate test scripts in JS
- Customizing your tests capabilities on BrowserStack using our test capability generator
- List of Browsers & mobile devices for automation testing on BrowserStack
- Using Automate REST API to access information about your tests via the command-line interface
- Understand how many parallel sessions you need by using our Parallel Test Calculator
- For testing public web applications behind IP restriction, Inbound IP Whitelisting can be enabled with the BrowserStack Enterprise offering