/python-advanced

Python utilities

Primary LanguagePythonMIT LicenseMIT

Asynchronous ORM

Features

  • QuerySet
  • creates tables from models

Technologies

  • asyncio
  • PostgreSQL

Asynchronous Web Crawler

Features

  • asynchronous
  • search Rest API
  • throttling (by domain)

Technologies

  • asyncio
  • aiohttp
  • ElasticSearch

Distributed Web Crawler

Features

  • asynchronous
  • search Rest API
  • throttling (by domain)
  • distributed
  • auth by token

Technologies

  • asyncio
  • aiohttp
  • ElasticSearch (pages storage)
  • RabbitMQ broker (rpc)
  • PosgreSQL (users, tokens and stats)

Matrix C module

C extension matrix implementation, 3x times faster than Python implementation.

Operations

  • sum of matrices
  • multiplication by matrix, by integer
  • division by integer
  • transpose
  • in operator

ORM

Features:

  • QuerySet
  • creates tables from models

Technologies

  • SQLite

QR Code Bot

Generates QR codes and sends them to VK user

Technologies

  • multiprocessing
  • VK API