[infinispan-dev] More verbose logging

[Radim Vansa]

It's not a potential, I can confirm that you cannot run anything with TRACE logging, with log4j logging to NFS the traces can block the whole node and break things.
Even ISPN works, listing through StateResponseCommand in the logs can sometimes block "less" viewer. Nevertheless, the TRACE info (that verbose) was really required for identifying some of the bugs.
But now, I am more and more forced to run only on DEBUG level and cherrypick the desired info using Byteman.
Regarding the -Dstuff, I'd prefer more fine-grained access than just set everything to verbose.

Radim

----- Original Message -----
| From: "Manik Surtani" <msurtani at redhat.com>
| To: "infinispan -Dev List" <infinispan-dev at lists.jboss.org>
| Sent: Tuesday, February 19, 2013 5:29:40 PM
| Subject: [infinispan-dev] More verbose logging
| 
| Guys,
| 
| I see this emitted by the CommandAwareRpcDispatcher:
....
| 
| Again, just 3 nodes, default segment size, but with TRACE level
| logging.
| 
| a) This would explode to something huge if we have, say, a cluster of
| 100+ nodes with, say, 5000 segments.
| b) Each StateChunk is listing all of its entries!  Again, here this
| is fine since the cache is empty; but a running system with a few
| hundred GB of data would make enabling TRACE logging akin to a DoS
| attack.
| 
| I agree that TRACE level logging on a running system is not
| recommended, and generally will slow things down a lot, but this has
| potential to bring a cluster down.  I imagine such information is
| only really useful in a lab or test environment when tracing
| edge-case consistency issues - so maybe we need a separate flag?
|  Perhaps a -Dinfinispan.logging.verbose=true, which would alter the
| output of StateResponseCommand.toString() accordingly?
| 
| - M
| 
| --
| Manik Surtani
| manik at jboss.org
| twitter.com/maniksurtani
| 
| Platform Architect, JBoss Data Grid
| http://red.ht/data-grid
| 
| 
| _______________________________________________
| infinispan-dev mailing list
| infinispan-dev at lists.jboss.org
| https://lists.jboss.org/mailman/listinfo/infinispan-dev
|