Bug: Not Recording Responses on demographics_ircs_challenge survey

[sumants-dev]

The bug is fixed now. The error was that we switch from using session id to survey session id. This was updated only for survey routes but not in validation routes. Fortunately, we did a trial run of 20 people to make sure everything was working correctly before scaling, so we caught this before real run.

These are the following steps to mitigate such error in the future in order of priority.

1. Continue to use trial runs to scope out cost and potential bugs early on.
2. Currently the in-memory monogodb is extremely convenient but its settings need to be modified such that we can see what is actually written to a file (like nedb)
3. Although we have unit testing infrastructure, the code needs to be refactored to support unit testing. Currently, it is all view dependent (lower priority as we need data but needs to be done to remove surprises)

[markwhiting]

Thanks!

Agreed about 1 and 2. That was a great thing about NEDB, despite its shortcomings.

Re 3, what if we set a goal to gradually add testing, e.g., add a little more testing with every update? So as to avoid needing to do a huge push to get testing set up at a later time (or worse, never having a chance to prioritize it).