Data Testing Framework

[yujanshrestha]

Our testing framework so far has been only for one test case buckner40/004 but we need to start pushing more cases through.

• Decided to keep part 1, 2 and 3 to make debugging easier. We will integrate it into one script once we are satisfied with the numerical results.
• Defined a test case as a subdirectory inside the buckner40 directory. There are 40 test cases.
• MATLAB should write out fixtures to a directory called buckner40/<test_case_dir>/matlab_checkpoints. At the minimum, we need to write checkpoints named part 1, part 2, and part 3 cooresponding to the three fixtures used by the three samseg parts. However, more checkpoints should be written wherever we think it can aid in debugging and testing.
• Python should also write out checkpoints similar to how MATLAB does. This needs to be implemented. It should write out checkpoints to a directory called buckner40/<test_case_dir>/python_checkpoints.
• A script needs to be written that given two checkpoint directories (python_checkpoints and matlab_checkpoints), it will identify differences to aid in debugging.