kim-dabin

kim-dabin's Stars

• citusdata/docker

  :ship: Docker images and configuration for Citus

  Language:Dockerfile248100

• bhavul/System-Design-Cheatsheet

  System Design Studying can be daunting. This gives you a table to study different problems, understand what components they require, their pros and cons, and how to deal with mitigations.

  33663

• Sungchul-P/aws-cdk-examples

  Language:TypeScript41

• channel-io/monthly-channel

  월간채널 — Monthly Channel

  17412

• josephmachado/docker_for_data_engineers

  Code for blog at: https://www.startdataengineering.com/post/docker-for-de/

  Language:C2913

• DarkTornado/KakaoLink.js

  Language:JavaScript128

• astronomer/astro-sdk

  Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

  Language:Python34743

• wangAoqi666/bigdata-interview

  最全的大数据大厂面试宝典，大数据面试题，大数据面试，王傲旗的大数据之路，大数据成神之路，Flink/Spark/Hadoop/Hbase/Hive/Impala/Hbase/MapReduce/YARN/HDFS/Kafka/Flume/Linux/Java/Scala...面试题

  Language:Java6113

• kaushikj/video2pdf

  Language:Python20392

• EKarton/Lecture-Video-to-PDF

  Making lecture videos readable

  Language:Python6013

• microsoft/generative-ai-for-beginners

  21 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

  Language:Jupyter Notebook64.6k32.9k

• edbullen/DockerSpark245

  Spark cluster in docker containers with sample training Jupyter notebooks

  Language:Jupyter Notebook2522

• Spatacoli/e-reader

  The python source code for my Raspberry Pi 4 e-reader.

  Language:Python41

• joeycastillo/The-Open-Book

  7.5k231

• docker/awesome-compose

  Awesome Docker Compose samples

  Language:HTML34.6k6.6k

• scalingexcellence/scrapybook

  Scrapy Book Code

  Language:Python480208

• baabaaox/ScrapyDouban

  豆瓣电影/豆瓣读书 Scarpy 爬虫

  Language:Python735203

• mmas/docker-scrapy-tor

  Scrapy environment with Tor for anonymous ip routing and Privoxy for http proxy

  Language:Shell207

• 8W9aG/scrapy-tor-downloader

  Scrapy middleware with TOR support for more robust scrapers or anonymous scraping.

  Language:Python61

• heckenmann/tor-scrapy

  webcrawler using a tor-proxy, elasticsearch and scrapy

  Language:Python63

• mheinl/OnionCrawler

  Scrapy spider to recursively crawl for TOR hidden services

  Language:Python115

• eksctl-io/eksctl

  The official CLI for Amazon EKS

  Language:Go4.9k1.4k

• Swalloow/airflow-korean-timetable

  Airflow TimeTable for korean working days

  Language:Python4

• palantir/pyspark-style-guide

  This is a guide to PySpark code style presenting common situations and the associated best practices based on the most frequent recurring topics across the PySpark repos we've encountered.

  Language:Python1k132

• istresearch/scrapy-cluster

  This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

  Language:Python1.2k323

• geekan/scrapy-examples

  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.

  Language:Python3.2k1k

• scrapy/scrapy

  Scrapy, a fast high-level web crawling & scraping framework for Python.

  Language:Python52.9k10.5k

• yasserg/crawler4j

  Open Source Web Crawler for Java

  Language:Java4.5k1.9k

• danifus/pyzipper

  Python zipfile extensions

  Language:Python12614

• databricks/Spark-The-Definitive-Guide

  Spark: The Definitive Guide's Code Repository

  Language:Scala2.9k2.8k