cadCAD-org/cadCAD

Unexpected behaviour when simulating multiple configurations

BenSchZA opened this issue · 2 comments

When adding multiple configuration objects to the global cadCAD configs list, the results are unexpected. I'm sure it relates to this statement in the docs:

As of now it does not support multi - system model simulation because configurations are still appended globally despite append_config being a method of Experiment.

https://gist.github.com/BenSchZA/7b7052ffcd65c5645d65b3e6bb56b329

At the end of the above notebook, I calculated the expected number of rows, if A/B testing was possible. This is also related to issue #247 (comment) I believe.

The previous release was returning partial results therefore a benchmark at this time is unwarranted
A/B tested for future release

self.assertEqual(record_count_0_4_24 > record_count_0_4_23, True, "Invalid Row Count for current version")

Updated Build:
https://github.com/cadCAD-org/cadCAD/tree/staging

Resolved by version 0.4.27