ymaurer

cdx-index-client

A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/

cdx-summarize

Summarize CDX(J) files for MIME analysis per 2nd-level domain

cdx-summarize-warc-indexer

Summarize Web Archive holdings using an existing SOLR index

common-crawl-dl

Download common crawl data for some top level domains

dagstuhl-vips

eluxemburgensia-opendata-ark

Get the Archival resource keys from eluxemburgensia.lu public opendata set (the text analysis pack)

fasttiffcrop

crop multiple jpegs from a single source tiff in a fast and memory-efficient way

fixit_tiff

fixes some issues in (potentially) baseline tiffs

langchain

⚡ Building applications with LLMs through composability ⚡

mets-export-illustrations

Export illustrations from METS files alongside metadata

ymaurer/cdx-summarize

Summarize CDX(J) files for MIME analysis per 2nd-level domain

ymaurer/cdx-summarize-warc-indexer

Summarize Web Archive holdings using an existing SOLR index

ymaurer/eluxemburgensia-opendata-ark

Get the Archival resource keys from eluxemburgensia.lu public opendata set (the text analysis pack)

ymaurer/fasttiffcrop

crop multiple jpegs from a single source tiff in a fast and memory-efficient way

ymaurer/cdx-index-client

A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/

ymaurer/common-crawl-dl

Download common crawl data for some top level domains

ymaurer/dagstuhl-vips

ymaurer/fixit_tiff

fixes some issues in (potentially) baseline tiffs

ymaurer/langchain

⚡ Building applications with LLMs through composability ⚡

ymaurer/mets-export-illustrations

Export illustrations from METS files alongside metadata

ymaurer/speller-ocr-eval

Evaluate OCR correctness by identifying the language and then running a spell checker

ymaurer/warcnet-cdx-summarize-analysis

Generate reports from cdx-summarize files