Thanks Yong for your response. The issue got resolved after trying a fresh installation. After little more analysis, I found that we don't actually need the new JMSProvider and default JMSProvider is more than sufficient for me.
Issue is resolved now.