brave/qa-resources

Test Jitsi `8.6.3` SDK beta

Closed this issue · 8 comments

mrose17 commented

The version of the iOS browser using the Jitsi SDK (in beta) is the following:

* Brave build: 0.0 (24.2.15.15)
* BraveCore: 1.63.141 (121.0.6167.139)

The release notes are here.

Could someone put Brave Talk "through its paces" to see if there are any regressions. The Jitsi folks do a "smoke test", but I'd be happier if we did our own sanity test.

Release Date/Target:

  • Release Date: N/A (Complete ASAP so 8.6.3 can be added into production TF and released via 1.62.x)

Summary:

We can merge the Jitsi SDK beta into our production build whenever we like, and there are no known issues in the current build, so we are not under a time constraint.

Milestone:

Current Progress: using Brave build: 0.0 (23.12.8.11) using 8.6.0 SDK

Current Progress: using Brave build: 0.0 (24.2.15.15) using 8.6.3 SDK:

hffvld commented

Verified on iPhone 14 running iOS 17 and iPad Air running iOS 16 using version(s):

Device/OS:
- iPhone 14 / iOS 17.2
- iPad Air / iPadOS 16.7.2
Brave build: 0.0 (23.12.8.11)
BraveCore: 1.61.101 (120.0.6099.71)
Jetsi SDK: 8.6.0

Filed issue #140, #141, #142, #143

Tested:

  • checked for PiP
  • idle
  • lock screen background audio
  • app background
  • handsfree for audio
  • orientation checks

NOTE: I wasn't able to check it with VPN enabled since VPN is not working on Brave Dev.

1 2 3
1 2 3
1 2 3
Uni-verse commented

Verified on iPhone XR running iOS 15.5 using version 0.0 (23.12.8.11)

SDK version: 8.6.0

Test Cases:

  • Hosting Brave Talk meeting (Start free call).
  • Joining Brave Talk meeting (brave talk link).
  • Inviting via mobile number.
  • Toolbar functionality (mic, video, chat, emotes, tile view, 3-dot menu, end call)
  • PIP
  • Low bandwidth mode
  • Car mode
  • Brave Talk in background (locked screen)
  • Orientation checks
Example Example Example Example
IMG_0356 IMG_0357 2 IMG_0358 2 IMG_0359 2
IMG_0360 2 IMG_0361 2 IMG_0362 2 IMG_0363 2
srirambv commented

Verification passed on on iPad (iOS 16.7.2) and iPhone 13 (iOS 17.2) running 0.0 (23.12.8.11) using https://talk. brave.com

  • Verified able create Web3 Talk and join the call
  • Verified NFT gating works as expected
  • Verified POAP gating works as expected
  • Verified BAT gating works as expected
  • Verified able to place both ETH/SOL Web3 calls

Talk Staging doesn't work on the build shows 8x8 webrtc error

Dev environment also doesn't work. Subscription status doesn't update so unable to create a Web3 talk call

Uni-verse commented

Verified on iPhone 12 running iOS 17 using version 0.0 (24.2.15.15)

Jitsi SDK Release: 8.6.3

Test Scenarios:

  • Lobby view
    • Landing in lobby when pasting talk link in address bar
  • Hosting a call via Start free call button on https://talk.brave.com
  • Joining ongoing brave talk call
    • Joining in low bandwidth
    • Enabling mic / cam before joining
  • Ending call
  • Toolbar / menus functionality
    • Toggling microphone / camera
    • Chat window / emotes
    • Switching views (tile view)
    • Settings menu
  • Orientation checks
  • Picture-in-picture
  • Lock screen mode
  • Car mode
  • Notifications

Notes:

Example Example Example Example Example Example
IMG_5716 IMG_5717 IMG_5704 IMG_5705 IMG_5718 IMG_5721
IMG_5734 IMG_5710 IMG_5726 IMG_5728 IMG_5724 IMG_5722
hffvld commented

Verified on iPad Air running iOS 16 using version(s):

Device/OS: iPad Air / iPadOS 16.7.2
Brave build: 0.0 (24.2.15.15)
BraveCore: 1.63.141 (121.0.6167.139)
Jetsi SDK: 8.6.3

Tested:

  • Start a free call
  • Start the call in Low Bandwith Mode
  • Cancel a call
  • Join the existing call
  • Chat / Poll
  • Raise Your Hand / Reactions
  • Enabling/disabling Mic and Camera
  • PiP mode
  • App idle while on the call
  • App in the background while on the call
  • Device orientation checks
  • Switching views
  • Menu and Settings UI
1 2 3
1 2 3
1 2 3
1 2 3
1 2 3
1 2 3
srirambv commented

Verification passed on iPad with iOS 16.7.5 running 0.0 (24.2.15.15)

  • Verified able to create a Web3 Talk call on Jitsi 8.6.3 build
  • Verified able to join a call a Web3 call initiated from other device using the SDK build
  • Verified able to sign message when creating call
  • Verified able to token gate the calls with POAP/NFT/BAT
  • Verified unable to join token gated Web3 talk calls when account doesn't have required tokens/NFTs/POAP
Uni-verse commented

Verified on iPad (9th Gen) running iOS 15.6.1 using version 0.0 (24.2.15.15)

Jitsi SDK Release: 8.6.3

Test Scenarios:

  • Lobby view
    • Landing in lobby when pasting talk link in address bar
  • Hosting a call via Start free call button on https://talk.brave.com
  • Joining ongoing brave talk call
    • Joining in low bandwidth
    • Enabling mic / cam before joining
  • Ending call
  • Toolbar / menus functionality
    • Toggling microphone / camera
    • Chat window / emotes
    • Switching views (tile view)
    • Settings menu
  • Orientation checks
  • Picture-in-picture
  • Lock screen mode
  • Car mode
  • Notifications
  • Working on dev site (Talk.brave.software)

Notes:

Example Example Example Example Example Example
IMG_0330 3 IMG_0331 3 IMG_0333 3 IMG_0334 3 IMG_0335 3 IMG_0336 3
IMG_0337 3 IMG_0338 3 IMG_0339 4 IMG_0340 3 IMG_0341 3 IMG_0342 4
kjozwiak commented

@hffvld @Uni-verse @srirambv awesome work guys. Going to close this one off as we're going to be pushing the new SDK via 1.62.1 as per brave/brave-ios#8777 (comment).