dataplane-app/dataplane

WASM Support

John0x opened this issue ยท 1 comments

Hey, first of all, this looks extremely promising. I've been looking for a modern airflow alternative for quite some time. Keep up the great work ๐Ÿ‘

Have you thought about supporting languages apart from python? Web Assembly would be perfect for something like this. The reliance on python has been one of my biggest pain points with most data pipelines.

Hi there @John0x, glad you find it promising and thanks for the feedback. I haven't worked with WASM before but essentially any language that can run in Linux can be bundled into the workers for example Rust and called using the Bash processor - this can call any command in bash/sh. If you send me a hello world example of WASM and explain maybe how you intend to use it, I can see how it might be built into a worker docker image.