ia-toki/tcframe

Allow tcframe to skip checking unassigned subtask

jonathanirvings opened this issue · 0 comments

Currently, tcframe always checks whether a generated testcase is also valid for subtasks not assigned to the testcase. If that's the case, tcframe will trigger an error something like

"..... satisfies subtask x but not assigned to it"

A feature suggested in this issue is allowing tcframe to skip this check by specifying some "flag" in spec.cpp.

@jonathanirvings suggested that this might be a good feature to have. With this feature, any problem with any complicated subtasks can be made simply with the following test group distribution:

TestGroup 1: Subtask {1}
TestGroup 2: Subtask {2}
....
TestGroup N: Subtask {N}

while without this feature, it is impossible to use this test group distribution if one subtask is a subset of another.

There are several testcase generator framework out there that simply takes a list of testcases to be generated for each subtask. With this feature (and using the test group distribution as illustrated above), migrating a code which uses such testcase generator framework to a code which uses tcframe becomes a lot easier.