Save Dagster state to S3
Closed this issue · 1 comments
davidgasquez commented
Can save the SQLite database. Useful if we want to keep the state. Not very urgent for now as we're reconstructing everything with each run.
I'm also personally laying more into using the DuckDB database itself as the state and recover from it.
davidgasquez commented
Closing as I think I'd keep the sate at the DuckDB level when needed.