web-archive

Library for archiving a web page along with its linked resources (images, css, js) for local use.

Example

web-archive = "0.3.0"

use web_archive::{archive, blocking};

// Build a collection of linked resources attached to the page

// async API
let archive = archive("http://example.com", Default::default()).await.unwrap();

// blocking API
let archive = blocking::archive("http://example.com", Default::default()).unwrap();


// Embed the resources into the HTML
let page = archive.embed_resources();

println!("{}", page);

Feature flags

blocking - enable the Blocking API
socks - enable SOCKS proxy support

Testing

The main library contains unit tests for the parsing functionality, and dynamic tests against a local webserver are in the dynamic_tests directory. The dynamic tests are built with Rocket which requires Nightly Rust, however the main library builds on Stable.

cargo test
cd dynamic_tests && cargo run

License

Licensed under either of

Apache License, Version 2.0 (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)

at your option.

Contribution