Archivehost - Wayback machine downloader & server

Program to batch download and serve the wayback machine archives.

Pre-requisite

To build and run this program, you need to have the following installed:

Node.js
pnpm
Rust

Install

Currently, binary is not available. You can install by running:

$ git clone https://github.com/nazo6/archivehost
$ cd archivehost
$ pnpm i
$ pnpm inst

Usage

You can see the help message by command:

$ archivehost --help

Download

Download command just downloads the archive of the given url. It is useful when you just want to download the archive of the url.

$ archivehost download <url> [--concurrency <concurrency>] [--from <from>] [--to <to>]

File will be save to ~/.local/share/archivehost on Linux and ~/AppData/Roaming/archivehost on Windows. This can be changed by using the --root flag.

Serve

Serve command starts the server to serve the download manager and the archives (this includes sites that downloaded by download command). This can be used as self-hosted wayback machine.

$ archivehost serve [--port <port>] [--host <host>]

By default, the server will run on port 3000. You can change the port by using the --port flag.

Serve url

`/web/latest/<url>`

Show the latest archive of the url.

`/web/<timestamp>/<url>`

Show the archive of the url before the timestamp.

TODO

Download
- Download the archive
- Save downloaded info to sqlite database
- Add database cleanup feature
- Be able to export the downloaded archive
Serve
- Basic server
- Add manager web ui frontend and api
- Add banner to archive page so that user can see archive info
- On-demand download
- Return dummy response even if the archive is not found
  - Basic dummy response
  - Make dummy configurable
- Better url rewriting