Module test_runners

Contains test runners:

• fuzzing: For crashing testing the database with generated batch, stream queries.
• differential testing: For testing the database with generated batch, stream queries and comparing their results.

Modules

diff 🔒

Provides E2E Test runner functionality.

fuzzing 🔒

Provides E2E Test runner functionality.

utils 🔒

Functions

generate

Query Generator If we encounter an expected error, just skip. If we encounter an unexpected error, Sqlsmith should stop execution, but writeout ddl and queries so far. If query takes too long -> cancel it, mark it as error. NOTE(noel): It will still fail if DDL creation fails.

run

e2e test runner for sqlsmith

run_differential_testing

Differential testing for batch and stream

run_pre_generated

e2e test runner for pre-generated queries from sqlsmith