/webhdfs-rs

Hadoop WebHdfs client library for Rust

Primary LanguageRustApache License 2.0Apache-2.0

webhdfs

Hadoop webhdfs client library for Rust.

Crates.io Build Status

Documentation

  • Built on Tokio and Hyper.
  • Provides both synchronous and asynchronous APIs.

See src/bin/webhdfs.rs or tests/it.rs for usage examples.

NOTE: APIs are not yet stabilized and may change towards version 1.0.

TODO list (2nd checkbox is IT coverage)

  • Async read and write ([X])
  • Sync read and write ([X])
  • Stat and dir ([X])
  • Basic filesystem mutations (concat, mkdirs, rename, delete, symlink)
  • File-based configuration
  • Other file and directory operations (permissions, owner, ACL, times, checksum)
  • XAttr operations
  • Snapshot operations
  • Basic delegation token support
  • Full delegation token support
  • webhdfs tool
  • failover support ([X])

Building and testing

cargo test --lib -- --nocapture

Integration tests

See Integration tests

Changelog

See CHANGES.md