ecc521 opened this issue 3 years ago · 0 comments
Linear Regression:
Quartic Regression:
This issue is caused by rounding being done mid-calculations, which has a massively bigger impact on higher order regressions. Rounding after the fact would prevent this issue, and improve performance.