Internet Archive

The Internet Archive is "the library of the Internet", and a big supporter of Free Software.

San Francisco

Pinned Repositories

bookreader
The Internet Archive BookReader
Language:JavaScript945 48 317409
brozzler
brozzler - distributed browser-based web crawler
Language:Python633 37 5294
cicd
build & test using github registry; deploy to nomad clusters
12 18 00
dweb-mirror
Offline Internet Archive project
Language:JavaScript255 22 33927
heritrix3
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
Language:Java2.7k 188 155756
openlibrary
One webpage for every book ever published!
Language:Python4.9k 169 4k1.2k
openlibrary-client
Python Client Library for the Archive.org OpenLibrary API
Language:Python351 23 12679
warcprox
WARC writing MITM HTTP/S proxy
Language:Python367 33 3754
wayback
IA's public Wayback Machine (moved from SourceForge)
Language:Java716 66 132130
wayback-machine-webextension
A web browser extension for Chrome, Firefox, Edge, and Safari 14.
Language:JavaScript614 32 291208

Internet Archive's Repositories

internetarchive/openlibrary
One webpage for every book ever published!
Language:Python4.9k 169 4k1.2k
internetarchive/heritrix3
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
Language:Java2.7k 188 155756
internetarchive/bookreader
The Internet Archive BookReader
Language:JavaScript945 48 317409
internetarchive/brozzler
brozzler - distributed browser-based web crawler
Language:Python633 37 5294
internetarchive/wayback-machine-webextension
A web browser extension for Chrome, Firefox, Edge, and Safari 14.
Language:JavaScript614 32 291208
internetarchive/warcprox
WARC writing MITM HTTP/S proxy
Language:Python367 33 3754
internetarchive/openlibrary-client
Python Client Library for the Archive.org OpenLibrary API
Language:Python351 23 12679
internetarchive/internetarchivebot
Language:PHP114 35 035
internetarchive/iaux
Monorepo for Archive.org UX development and prototyping.
Language:JavaScript63 23 16085
internetarchive/openlibrary-bots
A repository of cleanup bots implementing the openlibrary-client
Language:Python57 20 3647
internetarchive/hind
Hashistack-IN-Docker (single container with nomad + consul + caddy)
Language:Shell50 15 15
internetarchive/Zeno
State-of-the-art web crawler 🔱
Language:Go43 9 152
internetarchive/infogami
Language:Python41 15 2627
internetarchive/wayback-diff
React components to render differences between captures at the Wayback Machine
Language:JavaScript30 20 88
internetarchive/iiif
The official Internet Archive IIIF service
Language:JavaScript21 21 474
internetarchive/arch
Web application for distributed compute analysis of Archive-It web archive collections.
Language:Scala13 19 04
internetarchive/iari
Import workflows for the Wikipedia Citations Database
Language:Python12 16 6189
internetarchive/Sparkling
Internet Archive's Sparkling Data Processing Library
Language:Scala10 17 12
internetarchive/iaux-typescript-wc-template
IAUX Typescript WebComponent Template
Language:TypeScript6 18 34
internetarchive/iare
An interactive IARI JSON viewer
Language:JavaScript5 16 644
internetarchive/dyno
Language:JavaScript4 16 01
internetarchive/iaux-collection-browser
Language:TypeScript4 16 21
internetarchive/openlibrary-api
API documentation for https://github.com/internetarchive/openlibrary
Language:HTML4 15 12
internetarchive/ads-common
Common components and utilities for the Archiving & Data Services (ADS) team at the Internet Archive
Language:TypeScript2 15 0
internetarchive/archiveorg-e2e-playwright
Language:TypeScript2 17 02
internetarchive/rclone
[vault fork] of "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
Language:Go2 2 01
internetarchive/iaux-book-actions
IA lending bar controls for bookreader
Language:JavaScript1 16 1
internetarchive/iaux-modal-manager
A Modal Manager WebComponent
Language:TypeScript22 11
internetarchive/wbm_ai_kg
Google Summer of Code (GSoC) 2024 Wayback Machine GenAI Knowledge Graph project
internetarchive/wbm_ai_sum
Google Summer of Code (GSoC) 2024 Wayback Machine GenAI Archival Summary project