batch-processing

There are 1006 repositories under batch-processing topic.

pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python43.5k 88 1021.3k
NaiboWang/EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
Language:JavaScript42.5k 248 7215.2k
argoproj/argo-workflows
Workflow Engine for Kubernetes
Language:Go16k 202 6.4k3.4k
firecrawl/firecrawl-mcp-server
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Language:JavaScript4.5k465
Netflix/maestro
Maestro: Netflix’s Workflow Orchestrator
Language:Java3.5k 169 64234
spring-projects/spring-batch
Spring Batch is a framework for writing batch applications using Java and Spring
Language:Java2.9k 231 3.6k2.4k
Ruben2776/PicView
Fast, free and customizable picture viewer
Language:C#1.7k 30 14079
faastjs/faast.js
Serverless batch computing made simple.
Language:TypeScript1.5k 15 2842
bbottema/simple-java-mail
Simple API, Complex Emails (Jakarta Mail smtp wrapper)
Language:Java1.3k 37 494274
spring-attic/spring-cloud-dataflow
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
Language:Java1.1k 94 3.6k593
hazelcast/hazelcast-jet
Distributed Stream and Batch Processing
Language:Java1.1k 76 889207
addyosmani/squish
Squish - Batch Browser-based Image Compression
Language:TypeScript1k 6 997
alessandrofrancesconi/gimp-plugin-bimp
BIMP. Batch Image Manipulation Plugin for GIMP.
Language:C964 42 39592
iusztinpaul/energy-forecasting
🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | 𝗟𝗲𝗮𝗿𝗻 𝗠𝗟𝗘 & 𝗠𝗟𝗢𝗽𝘀 for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 2.5 𝘩𝘰𝘶𝘳𝘴 𝘰𝘧 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 & 𝘷𝘪𝘥𝘦𝘰 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
Language:Python939 14 24215
bacalhau-project/bacalhau
Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.
Language:Go834 26 2.4k101
j-easy/easy-batch
The simple, stupid batch framework for Java
Language:Java626 46 360200
guillermo-navas-palencia/optbinning
Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.
Language:Python490 18 255110
spring-cloud/spring-cloud-task
Short lived microservices with Spring Batch
Language:Java435 48 466309
GDQuest/krita-batch-exporter
A Free Krita plugin to batch export layers and groups with maximum flexibility. Scale, trim, export multiple copies of your layers...
Language:Python349 24 4828
bvn-architecture/RevitBatchProcessor
Fully automated batch processing of Revit files with your own Python or Dynamo task scripts!
Language:Python338 40 9989
lilydjwg/pssh
Parallel SSH Tools
Language:Python322 8 3466
nilenso/goose
A powerful background job processing library for Clojure
Language:Clojure301 11 9013
tintinweb/ida-batch_decompile
*Decompile All the Things* - IDA Batch Decompile plugin and script for Hex-Ray's IDA Pro that adds the ability to batch decompile multiple files and their imports with additional annotations (xref, stack var size) to the pseudocode .c file
Language:Python295 16 556
JacobDev1/xl-converter
Easy-to-use image converter for modern formats. Supports fast parallel encoding, lossless JPEG transcoding, JPEG XL, AVIF, JPEGLI, ExifTool, and more.
Language:Python293 2 9411
reidmorrison/rocketjob
Ruby's missing background and batch processing system
Language:Ruby290 10 1223
streamnative/pulsar-flink
Elastic data processing with Apache Pulsar and Apache Flink
Language:Java282 35 251120
Azure/batch-shipyard
Simplify HPC and Batch workloads on Azure
Language:Python276 47 313121
avilum/linqit
Extend python lists operations using .NET's LINQ syntax for clean and fast coding.
Language:Python248 13 713
btargac/excel-parser-processor
Automate downloads from Excel files in seconds. Simply does the tedious, repetitive operations for rows of Excel files and reports the results. It downloads files from URL(s) in column A, if a new filename is provided at column B it will rename before saving. It will even create sub folders if column C is filled with a valid folder name.
Language:JavaScript224 10 2133
apple/batch-processing-gateway
The gateway component to make Spark on K8s much easier for Spark users.
Language:Java200 15 741
yornaath/batshit
A batch manager that will deduplicate and batch requests for a certain data type made within a window. Useful to batch requests made from multiple react components that uses react-query
Language:TypeScript192 1 154
NaiboWang/Bilibili-XMLSubtitle-to-ASS
可视化Bilibili本地视频XML弹幕转换ASS字幕转换器
Language:Python187 3 45
heathbm/BatchPool
The one-stop generic task batching and management library
Language:C#182 7 06
Ding-Kyoma/EasyTrans-mac
PDF 批量翻译，翻译后的PDF格式基本不变。导出PDF和Docx。优化并精简了来自于QPromise 的 EasyTrans。优化了通过百度翻译API稳定进行长翻译！
Language:Python143 2 1630
jberet/jsr352
Implementation of Jakarta Batch Specification and API
Language:Java135 13 7677
pszemraj/textsum
CLI & Python API to easily summarize text-based files with transformers
Language:Python130 4 78

batch-processing

pathwaycom/pathway

NaiboWang/EasySpider

argoproj/argo-workflows

firecrawl/firecrawl-mcp-server

Netflix/maestro

spring-projects/spring-batch

Ruben2776/PicView

faastjs/faast.js

bbottema/simple-java-mail

spring-attic/spring-cloud-dataflow

hazelcast/hazelcast-jet

addyosmani/squish

alessandrofrancesconi/gimp-plugin-bimp

iusztinpaul/energy-forecasting

bacalhau-project/bacalhau

j-easy/easy-batch

guillermo-navas-palencia/optbinning

spring-cloud/spring-cloud-task

GDQuest/krita-batch-exporter

bvn-architecture/RevitBatchProcessor

lilydjwg/pssh

nilenso/goose

tintinweb/ida-batch_decompile

JacobDev1/xl-converter

reidmorrison/rocketjob

streamnative/pulsar-flink

Azure/batch-shipyard

avilum/linqit

btargac/excel-parser-processor

apple/batch-processing-gateway

yornaath/batshit

NaiboWang/Bilibili-XMLSubtitle-to-ASS

heathbm/BatchPool

Ding-Kyoma/EasyTrans-mac

jberet/jsr352

pszemraj/textsum