In addition set all config options in every test, as catch2 can run tests out of order and as demonstrated in e1ad60af4f this can be an issue
e1ad60af4f
Closes: #3511