This project allows you to record and playback youtube videos for testing.
When the Youtube client loads, it calls the server to get chunks of audio and video data with a request on:
https://someserver.googlevideo.com/videoplayback?itag=XXX&range=A:B
Where itag is the quality of the video, defined by an integer see the full list at https://github.com/tarekziade/youtube-test/blob/master/yttest/util.py#L9 and range is the bytes requested for the video.
The Youtube client can change the quality on the fly during playback, and request arbitrary chunks, so a regular proxy will record one single combination of playback for the video. The sequence of chunks asked from the server may vary depending on the network and user activity, and a recorded playback may fail on a following run.
In order to provide a reliable proxy for reproducible local playbacks, and treat the YT client as a black box, the audio and video files are rebuilt locally so any chunk can be returned when requested. For a given YT video, if the video is fully played on all qualities, the proxy will have all the chunks.
It's required to update the recorded chunks on a regular basis to avoid a regression in case the youtube client or server change.
$ virtualenv . $ bin/python setup.py develop $ bin/pip install pytube
Add a .mitmproxy/config.yaml file in your home dir:
upstream_cert: False ssl_insecure: True anticache: True keepserving: True stream_large_bodies: 5m server_replay_nopop: True
Make sure you install mitmproxy 2.x or 4.x - if you are using Python 2, you need to use the binary version of mitmproxy because the Python 2 version is outdated.
You also need to make sure you have all the mozbase packages in your environment against the latest mozilla-central.
Go to youtube and select a short video, for example: https://www.youtube.com/watch?v=wvpZZqmnNhg
To start the proxy in record mode, run
$ ./mitmdump -w data/wvpZZqmnNhg.playback -s yttest/record.py
Where wvpZZqmnNhg is the id of the video.
Set firefox to use 127.0.0.1:8080 as a proxy server. Play the video fully once. Stop the proxy. The data/ directory will contain the playback file.
Now let's download all streams:
$ bin/python yttest/download.py wvpZZqmnNhg
To start the proxy in playback mode, run
$ ./mitmdump --set upstream_cert=false -v --server-replay-nopop -S data/wvpZZqmnNhg.playback -s yttest/playback.py wvpZZqmnNhg
Then visit the browser at https://www.youtube.com/watch?v=wvpZZqmnNhg
Example:
import unittest
from yttest.support import youtube_video
class YoutubeTest(unittest.TestCase):
def test_stream(self):
with youtube_video("wvpZZqmnNhg") as page:
res = page.run_test()
# checking the video playback quality
self.assertEqual(res["droppedVideoFrames"], 0)