batch-processing

There are 1013 repositories under batch-processing topic.

pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python49.3k 93 1081.4k
NaiboWang/EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
Language:JavaScript43.3k 251 7395.3k
argoproj/argo-workflows
Workflow Engine for Kubernetes
Language:Go16.2k 199 6.4k3.4k
firecrawl/firecrawl-mcp-server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Language:JavaScript4.9k 27 58525
Netflix/maestro
Maestro: Netflix’s Workflow Orchestrator
Language:Java3.6k 169 81246
spring-projects/spring-batch
Spring Batch is a framework for writing batch applications using Java and Spring
Language:Java2.9k 230 3.7k2.5k
Ruben2776/PicView
Fast, free and customizable picture viewer
Language:C#1.8k 32 188106
faastjs/faast.js
Serverless batch computing made simple.
Language:TypeScript1.5k 15 2842
bbottema/simple-java-mail
Simple API, Complex Emails (Jakarta Mail smtp wrapper)
Language:Java1.3k 36 494275
spring-attic/spring-cloud-dataflow
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
Language:Java1.1k 92 3.6k593
hazelcast/hazelcast-jet
Distributed Stream and Batch Processing
Language:Java1.1k 75 889207
addyosmani/squish
Squish - Batch Browser-based Image Compression
Language:TypeScript1k 6 9103
alessandrofrancesconi/gimp-plugin-bimp
BIMP. Batch Image Manipulation Plugin for GIMP.
Language:C976 40 39992
iusztinpaul/energy-forecasting
🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | 𝗟𝗲𝗮𝗿𝗻 𝗠𝗟𝗘 & 𝗠𝗟𝗢𝗽𝘀 for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 2.5 𝘩𝘰𝘶𝘳𝘴 𝘰𝘧 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 & 𝘷𝘪𝘥𝘦𝘰 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
Language:Python950 13 25216
bacalhau-project/bacalhau
Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.
Language:Go835 26 2.4k103
j-easy/easy-batch
The simple, stupid batch framework for Java
Language:Java627 46 360198
guillermo-navas-palencia/optbinning
Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.
Language:Python499 17 257111
spring-cloud/spring-cloud-task
Short lived microservices with Spring Batch
Language:Java438 47 466309
GDQuest/krita-batch-exporter
A Free Krita plugin to batch export layers and groups with maximum flexibility. Scale, trim, export multiple copies of your layers...
Language:Python358 24 4828
bvn-architecture/RevitBatchProcessor
Fully automated batch processing of Revit files with your own Python or Dynamo task scripts!
Language:Python345 41 10190
lilydjwg/pssh
Parallel SSH Tools
Language:Python324 8 13966
JacobDev1/xl-converter
Easy-to-use image converter for modern formats. Supports fast parallel encoding, lossless JPEG transcoding, JPEG XL, AVIF, JPEGLI, ExifTool, and more.
Language:Python321 3 11112
nilenso/goose
A powerful background job processing library for Clojure
Language:Clojure302 11 9113
tintinweb/ida-batch_decompile
*Decompile All the Things* - IDA Batch Decompile plugin and script for Hex-Ray's IDA Pro that adds the ability to batch decompile multiple files and their imports with additional annotations (xref, stack var size) to the pseudocode .c file
Language:Python294 12 556
reidmorrison/rocketjob
Ruby's missing background and batch processing system
Language:Ruby290 10 1223
streamnative/pulsar-flink
Elastic data processing with Apache Pulsar and Apache Flink
Language:Java282 34 251121
Azure/batch-shipyard
Simplify HPC and Batch workloads on Azure
Language:Python276 45 313121
avilum/linqit
Extend python lists operations using .NET's LINQ syntax for clean and fast coding.
Language:Python248 13 813
btargac/excel-parser-processor
Automate downloads from Excel files in seconds. Simply does the tedious, repetitive operations for rows of Excel files and reports the results. It downloads files from URL(s) in column A, if a new filename is provided at column B it will rename before saving. It will even create sub folders if column C is filled with a valid folder name.
Language:JavaScript224 10 2132
apple/batch-processing-gateway
The gateway component to make Spark on K8s much easier for Spark users.
Language:Java203 14 1044
yornaath/batshit
A batch manager that will deduplicate and batch requests for a certain data type made within a window. Useful to batch requests made from multiple react components that uses react-query
Language:TypeScript199 1 186
NaiboWang/Bilibili-XMLSubtitle-to-ASS
可视化Bilibili本地视频XML弹幕转换ASS字幕转换器
Language:Python195 2 45
heathbm/BatchPool
The one-stop generic task batching and management library
Language:C#181 7 06
Ding-Kyoma/EasyTrans-mac
PDF 批量翻译，翻译后的PDF格式基本不变。导出PDF和Docx。优化并精简了来自于QPromise 的 EasyTrans。优化了通过百度翻译API稳定进行长翻译！
Language:Python143 2 1729
jberet/jsr352
Implementation of Jakarta Batch Specification and API
Language:Java136 13 7778
pszemraj/textsum
CLI & Python API to easily summarize text-based files with transformers
Language:Python130 4 78

batch-processing

pathwaycom/pathway

NaiboWang/EasySpider

argoproj/argo-workflows

firecrawl/firecrawl-mcp-server

Netflix/maestro

spring-projects/spring-batch

Ruben2776/PicView

faastjs/faast.js

bbottema/simple-java-mail

spring-attic/spring-cloud-dataflow

hazelcast/hazelcast-jet

addyosmani/squish

alessandrofrancesconi/gimp-plugin-bimp

iusztinpaul/energy-forecasting

bacalhau-project/bacalhau

j-easy/easy-batch

guillermo-navas-palencia/optbinning

spring-cloud/spring-cloud-task

GDQuest/krita-batch-exporter

bvn-architecture/RevitBatchProcessor

lilydjwg/pssh

JacobDev1/xl-converter

nilenso/goose

tintinweb/ida-batch_decompile

reidmorrison/rocketjob

streamnative/pulsar-flink

Azure/batch-shipyard

avilum/linqit

btargac/excel-parser-processor

apple/batch-processing-gateway

yornaath/batshit

NaiboWang/Bilibili-XMLSubtitle-to-ASS

heathbm/BatchPool

Ding-Kyoma/EasyTrans-mac

jberet/jsr352

pszemraj/textsum