Scrapper Graal

Python 3.9.0

Scrapping https://soundcloud.com/nocopyrightsounds

Docs:

Simple Python Version Management: pyenv

The application-specific .python-version file in the current directory

pyenv

https://github.com/pyenv/pyenv

direnv

https://direnv.net/

Selenium guidelines https://www.selenium.dev/documentation/guidelines/ Selenium - Python https://selenium-python.readthedocs.io/index.html

Requirements:

  • pyenv
  • direnv
  • beautifulsoup4
  • chromedriver-binary
  • chromedriver-binary-auto
  • selenium

https://github.com/danielkaiser/python-chromedriver-binary

TODO: Download from: ChromeDriver 93.0.4577.15 chromedriver_win32.zip https://sites.google.com/a/chromium.org/chromedriver/downloads

Linux

pip: command not found

https://stackoverflow.com/questions/9780717/bash-pip-command-not-found

check linux version

cat /etc/os-release

useful shortcut

ll = ls -la

uninstall whole packages

pip uninstall -r requirements.txt -y pip uninstall -y -r <(pip freeze)

bat

A cat(1) clone with syntax highlighting and Git integration.

https://github.com/sharkdp/bat

Pycharm settings

using wsl as a remote interpreter

https://www.jetbrains.com/help/pycharm/using-wsl-as-a-remote-interpreter.html#wsl-terminal