naobservatory/p2ra

Report model fit diagnostics

Closed this issue · 3 comments

Stan produces a bunch of diagnostic information about model fit and sampling. We should develop a standard workflow for using it and adjust the model accordingly.

Narrowing the scope of this: We should start by figuring out how to get the diagnostic info out of the stan model and report it in a useful way.

Part of this might also be catching the logging info that pystan sends to stderr so we can digest it systematically.

I've looked into ☝️, and it looks like with pystan 3 there's no way to redirect the logging info internally, so I think the best thing to do is redirect stderr at the command line.