I quick edit to my original post,
In web.xml (of my Jboss AS 5.1.0 GA), I have configured session-timeout to be 3 minutes. When I hit my JSF servlet, and dont do any thing for 3 mins, then my customised session listener gets invoked and sessionDestroyed(HttpSessionEvent httpSessionEvent) is called.