Implement SQLancer (a end-to-end SQL fuzz testing library) about datafusion HOT 6 OPEN

The initial implementation is done (with ~10 bugs found 👀 )
The code is now at https://github.com/datafusion-contrib/datafusion-sqllancer, also with a more detailed description.

There is a lot of work can be done to find more bugs, any contributions are welcomed!

from datafusion.

This is the first interesting bug found: #11248:
It did not crash the DataFusion engine, instead it silently returned an incorrect result.
This logic bug is detected by NoREC oracle explained in this issue's above example

from datafusion.

Thank you @2010YOUY01 Sounds like a great idea to me -- I have created a datafusion_contrib repo for this work in case you would like to put it there: https://github.com/datafusion-contrib/datafusion-sqllancer

from datafusion.

This is really nice work @2010YOUY01 -- thank you so much.

from datafusion.

Filed #11430 to note this on the docs

Also posted on twitter: https://twitter.com/andrewlamb1111/status/1811725290801963475

Thanks again @2010YOUY01

from datafusion.

Nice!

from datafusion.