Pinned Repositories
cdx-index-client
A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
cdx-summarize
Summarize CDX(J) files for MIME analysis per 2nd-level domain
cdx-summarize-warc-indexer
Summarize Web Archive holdings using an existing SOLR index
common-crawl-dl
Download common crawl data for some top level domains
dagstuhl-vips
eluxemburgensia-opendata-ark
Get the Archival resource keys from eluxemburgensia.lu public opendata set (the text analysis pack)
fasttiffcrop
crop multiple jpegs from a single source tiff in a fast and memory-efficient way
fixit_tiff
fixes some issues in (potentially) baseline tiffs
langchain
⚡ Building applications with LLMs through composability ⚡
mets-export-illustrations
Export illustrations from METS files alongside metadata
ymaurer's Repositories
ymaurer/cdx-summarize
Summarize CDX(J) files for MIME analysis per 2nd-level domain
ymaurer/cdx-summarize-warc-indexer
Summarize Web Archive holdings using an existing SOLR index
ymaurer/eluxemburgensia-opendata-ark
Get the Archival resource keys from eluxemburgensia.lu public opendata set (the text analysis pack)
ymaurer/fasttiffcrop
crop multiple jpegs from a single source tiff in a fast and memory-efficient way
ymaurer/cdx-index-client
A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
ymaurer/common-crawl-dl
Download common crawl data for some top level domains
ymaurer/dagstuhl-vips
ymaurer/fixit_tiff
fixes some issues in (potentially) baseline tiffs
ymaurer/langchain
⚡ Building applications with LLMs through composability ⚡
ymaurer/mets-export-illustrations
Export illustrations from METS files alongside metadata
ymaurer/speller-ocr-eval
Evaluate OCR correctness by identifying the language and then running a spell checker
ymaurer/warcnet-cdx-summarize-analysis
Generate reports from cdx-summarize files