sibiryakov
Building search engines and large scale data processing applications.
Frontera core developer at @scrapinghub
Pinned Repositories
balancer
http balancer
community
Kubernetes community content
dmoz-revisiting
DMOZ Scraper with revisiting using Frontera and Scrapy
fastavro
Fast Avro for Python
frontera
A flexible frontier for web crawlers
frontera-google
A broad crawl example with limitation per host based on Frontera
general-spider
A general spider with links extraction for Frontera
infrared
Infrared remote control library for embedded Rust
tutorials
wow-and-flutter-analyzer
Wow and flutter analyzer, originally written by Alex Freed
sibiryakov's Repositories
sibiryakov/frontera-google
A broad crawl example with limitation per host based on Frontera
sibiryakov/dmoz-revisiting
DMOZ Scraper with revisiting using Frontera and Scrapy
sibiryakov/wow-and-flutter-analyzer
Wow and flutter analyzer, originally written by Alex Freed
sibiryakov/general-spider
A general spider with links extraction for Frontera
sibiryakov/tutorials
sibiryakov/balancer
http balancer
sibiryakov/community
Kubernetes community content
sibiryakov/fastavro
Fast Avro for Python
sibiryakov/frontera
A flexible frontier for web crawlers
sibiryakov/infrared
Infrared remote control library for embedded Rust
sibiryakov/kafka-python
Python client for Apache Kafka
sibiryakov/maria-phono-preamp
Moving magnet phono preamp Maria
sibiryakov/nsenter
Slim nsenter Docker image - enter into Docker container/host namespaces
sibiryakov/qt5reactor
Twisted and PyQt5 eventloop integration. Borrowed from https://github.com/nehbit/aether-public/blob/master/qt5reactor.py
sibiryakov/reproduce-amplifier-rtr
Reproduce amplifier for reel to reel recorders: IEC EQ, 19 cm/s, TEAC/Soviet heads
sibiryakov/rust-debounced-pin
Adds a wrapper for an InputPin that debounces it's is_high() and is_low() methods.
sibiryakov/scrapy
Scrapy, a fast high-level screen scraping and web crawling framework for Python.
sibiryakov/scrapy-jsonrpc
Scrapy extension to control spiders using JSON-RPC
sibiryakov/scrapy-po
Page Object pattern for Scrapy
sibiryakov/splash
Lightweight, scriptable browser as a service with an HTTP API
sibiryakov/stm32f7xx-hal
A Rust embedded-hal HAL for all MCUs in the STM32 F7 family
sibiryakov/stm32g0xx-hal
Peripheral access API for STM32G0 series microcontrollers
sibiryakov/synopsys-usb-otg
usb-device implementation for Synopsys USB OTG IP cores
sibiryakov/usb-device
Experimental device-side USB framework for microcontrollers in Rust.
sibiryakov/w3lib
Python library of web-related functions
sibiryakov/web-poet
Web scraping Page Objects core library