oblivia-simplex / deprecated-refusr-repo Goto Github PK

The mechanism for constraint based testing needs to be implemented. This will make use of the python bindings for Z3, via PyCall, to do the heavy, constraint-based lifting. The idea will be to take the specifications of the properties discovered by our PPT module and then use these to test candidate programs that have passed the extant battery of particular test cases (input/output pairs) by searching for counter-models to those properties, given those programs. If counter-models are discovered, they are to be appended to the list of test cases.

See this paper, for example, for details.

The next step in implementing CDGP in the REFUSR/Cockatrice genetic programming system is to incorporate constraint-based testing, in addition to the existing case-based testing, and to use this to iteratively enrich the battery of test cases with property-relevant tests.

To this end we need a battery of SMT-interpretable specifications of the properties we're testing for.