The test failures are caused by https://jira.mariadb.org/browse/CONJ-724 . Upgrading to the latest version of Connector/J doesn't fix the problem.
I submitted a fix to the Conector/J project, in the meantime I will disable the tests for MariaDB.