False alert: my log4j configuration was invalid. It seems Apache Commons Logging logs do take our log4j configuration into account, though I don't know how (maybe there's built-in Commons Logging support in log4j).