Hi Simon,
basically yes. If the check-result fails, the connection is closed and a new one is created. As developer/user you will not see any changes, because it happens all before you get the connection from the pool. See also http://community.jboss.org/wiki/ConfigDataSources
Best regards,
Mark