I expect also that the connection is destroyed and droped from pool if the validation-check fail.
Put it is possible that thea new connection can be opened but not established (you set the new-connection-sql also),
this looks like your behaviour.
Maybe it helps to TRACE 'org.jboss.jca'.
or wiki: http://community.jboss.org/wiki/configdatasources