web-archiving
There are 121 repositories under web-archiving topic.
ArchiveBox/ArchiveBox
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
webrecorder/pywb
Core Python Web Archiving Toolkit for replay and recording of web archives
Rhizome-Conifer/conifer
Collect and revisit web pages.
webrecorder/archiveweb.page
A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!
gildas-lormeau/single-file-cli
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
bellingcat/auto-archiver
Automatically archive links to videos, images, and social media content from Google Sheets (and more).
webrecorder/browsertrix-crawler
Run a high-fidelity browser-based web archiving crawler in a single Docker container
Ray-D-Song/web-archive
Free web archiving and sharing service based on Cloudflare. 跑在 Cloudflare 上的免费网页归档和分享工具。
webrecorder/replayweb.page
Serverless replay of web archives directly in the browser
oduwsdl/ipwb
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
akamhy/waybackpy
Wayback Machine API interface & a command-line tool
eclaire-labs/eclaire
Local-first, open-source AI assistant for your data. Unify tasks, notes, docs, photos, and bookmarks. Private, self-hosted, and extensible via APIs.
harvard-lil/perma
Indelible links
rahiel/archiveror
Archiveror will help you preserve the webpages you love. 💾
webrecorder/webrecorder-player
Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)
webrecorder/warcio
Streaming WARC/ARC library for fast web archive IO
oduwsdl/archivenow
A Tool To Push Web Resources Into Web Archives
Florents-Tselai/WarcDB
WarcDB: Web crawl data as SQLite databases.
machawk1/wail
:whale2: Web Archiving Integration Layer: One-Click User Instigated Preservation
ArchiveBox/archivebox-browser-extension
Official ArchiveBox browser extension: automatically/manually preserve your browsing history using ArchiveBox.
webrecorder/browsertrix
Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!
machawk1/warcreate
Chrome extension to "Create WARC files from any webpage"
cocrawler/cdx_toolkit
A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
ArchiveBox/electron-archivebox
Desktop Electron app for ArchiveBox internet archiver. (ALPHA: not ready for general use)
gwu-libraries/sfm-ui
Social Feed Manager user interface application.
helgeho/ArchiveSpark
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
programminghistorian/ph-submissions
The repository and website hosting the peer review process for new Programming Historian lessons
N0taN3rd/wail
:whale2: One-Click User Instigated Preservation
internetarchive/fatcat
Perpetual Access To The Scholarly Record
maxcountryman/warc-parquet
🗄️ A simple CLI for converting WARC to Parquet.
N0taN3rd/node-warc
Parse And Create Web ARChive (WARC) files with node.js
Own-Data-Privateer/hoardy-web
Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing, replay, mirroring, data scraping, and/or indexing. Your own personal private Wayback Machine that can also archive HTTP POST requests and responses, as well as most other HTTP-level data.
oduwsdl/warrick
Recover lost websites from the Web Infrastructure
xarantolus/Collect
A server to collect & archive websites that also supports video downloads
PKHarsimran/website-downloader
Website-downloader is a powerful and versatile Python script designed to download entire websites along with all their assets. This tool allows you to create a local copy of a website, including HTML pages, images, CSS, JavaScript files, and other resources. It is ideal for web archiving, offline browsing, and web development.
oduwsdl/MemGator
A Memento Aggregator CLI and Server in Go