[JBoss JIRA] (JGRP-2483) org.jgroups.blocks.NotificationBus sendNotification error sending notification java.lang.OutOfMemoryError: Java heap space
by 欧阳 檐林 (Jira)
[ https://issues.redhat.com/browse/JGRP-2483?page=com.atlassian.jira.plugin... ]
欧阳 檐林 updated JGRP-2483:
------------------------
Description: (was: OOM error,step one
!image-2020-06-09-20-13-28-655.png!!image-2020-06-09-20-13-52-815.png!!image-2020-06-09-20-14-03-732.png!!image-2020-06-09-20-14-11-611.png!
step two
Line 93518: [20-5-19 10:35:04:845 CST] 000c0c06 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (7) for mcasted view [11.14.22.72:7805|161] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7803, 11.14.19.88:7802, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7807, 11.14.19.88:7804] after 2000ms, missing ACKs from [11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7807, 11.14.19.88:7804] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.89:7800, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.88:7803, 11.14.19.89:7807]), local_addr=11.14.22.72:7805Line 93518: [20-5-19 10:35:04:845 CST] 000c0c06 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (7) for mcasted view [11.14.22.72:7805|161] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7803, 11.14.19.88:7802, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7807, 11.14.19.88:7804] after 2000ms, missing ACKs from [11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7807, 11.14.19.88:7804] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.89:7800, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.88:7803, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 93622: [20-5-19 10:35:19:243 CST] 000c0c1e GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (3) for mcasted view [11.14.22.72:7805|162] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7803, 11.14.19.88:7802, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7804] after 2000ms, missing ACKs from [11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7804] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.89:7800, 11.14.19.88:7801, 11.14.19.89:7801, 11.14.19.88:7802, 11.14.19.88:7803, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 93681: [20-5-19 10:35:29:404 CST] 000c0c21 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (3) for mcasted view [11.14.22.72:7805|163] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7803, 11.14.19.88:7802, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7804] after 2000ms, missing ACKs from [11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7804] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7806, 11.14.19.89:7800, 11.14.19.88:7801, 11.14.19.89:7801, 11.14.19.88:7802, 11.14.19.88:7803, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 93752: [20-5-19 10:35:31:455 CST] 000c0c21 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (2) for mcasted view [11.14.22.72:7805|164] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7803, 11.14.19.88:7802, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800] after 2000ms, missing ACKs from [11.14.19.89:7804, 11.14.19.89:7805] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7804, 11.14.19.88:7806, 11.14.19.89:7806, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.88:7802, 11.14.19.89:7802, 11.14.19.88:7803, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 93780: [20-5-19 10:35:40:483 CST] 000c0c2e GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (3) for mcasted view [11.14.22.72:7805|165] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7803, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800] after 2000ms, missing ACKs from [11.14.19.88:7803, 11.14.19.88:7802, 11.14.19.89:7805] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7804, 11.14.19.88:7806, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 93973: [20-5-19 10:35:56:373 CST] 000c0c32 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|166] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800] after 2000ms, missing ACKs from [11.14.19.88:7802] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 93992: [20-5-19 10:36:02:341 CST] 000c0c32 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|167] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800, 11.14.19.88:7805] after 2000ms, missing ACKs from [11.14.19.88:7802] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 94006: [20-5-19 10:36:04:395 CST] 000c0c32 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (2) for mcasted view [11.14.22.72:7805|168] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800, 11.14.19.88:7805, 11.14.19.88:7807] after 2000ms, missing ACKs from [11.14.19.88:7802, 11.14.19.88:7805] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 94013: [20-5-19 10:36:06:448 CST] 000c0c32 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (2) for mcasted view [11.14.22.72:7805|169] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800, 11.14.19.88:7805, 11.14.19.88:7807, 11.14.19.89:7804] after 2000ms, missing ACKs from [11.14.19.88:7802, 11.14.19.88:7807] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 94420: [20-5-19 10:36:51:296 CST] 000c0c71 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (3) for mcasted view [11.14.22.72:7805|173] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800, 11.14.19.88:7805, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.88:7803] after 2000ms, missing ACKs from [11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.89:7804, 11.14.19.88:7805, 11.14.19.89:7805, 11.14.19.88:7806, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.88:7802, 11.14.19.88:7803, 11.14.19.89:7802]), local_addr=11.14.22.72:7805 Line 95494: [20-5-19 10:38:59:360 CST] 000c0cae GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (3) for mcasted view [11.14.22.72:7805|175] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800, 11.14.19.88:7805, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.88:7803, 11.14.19.89:7800] after 2000ms, missing ACKs from [11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.89:7807] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7804, 11.14.19.88:7805, 11.14.19.89:7805, 11.14.19.88:7806, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.89:7800, 11.14.19.88:7801, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.88:7803]), local_addr=11.14.22.72:7805 Line 95661: [20-5-19 10:39:14:383 CST] 000c0cb1 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|176] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7803, 11.14.19.88:7806, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800, 11.14.19.88:7805, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.88:7803, 11.14.19.89:7800] after 2000ms, missing ACKs from [11.14.19.89:7803] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.88:7803, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 102711: [20-5-19 10:49:07:060 CST] 000c0e60 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (4) for mcasted view [11.14.22.72:7805|181] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7803, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.88:7803, 11.14.19.89:7800, 11.14.19.89:7806, 11.14.19.89:7802, 11.14.19.88:7805] after 2000ms, missing ACKs from [11.14.19.88:7802, 11.14.19.88:7801, 11.14.19.88:7800, 11.14.19.88:7803] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.88:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 102717: [20-5-19 10:49:09:114 CST] 000c0e60 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (4) for mcasted view [11.14.22.72:7805|182] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7803, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.88:7803, 11.14.19.89:7800, 11.14.19.89:7806, 11.14.19.89:7802, 11.14.19.88:7805, 11.14.19.88:7806] after 2000ms, missing ACKs from [11.14.19.88:7802, 11.14.19.88:7801, 11.14.19.88:7800, 11.14.19.88:7803] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.88:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 102728: [20-5-19 10:49:13:690 CST] 000c0e60 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|183] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7802, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7803, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7800, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7800, 11.14.19.89:7806, 11.14.19.89:7802, 11.14.19.88:7805, 11.14.19.88:7806] after 2000ms, missing ACKs from [11.14.19.88:7802] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7804, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 102949: [20-5-19 10:49:37:601 CST] 000c0e88 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (2) for mcasted view [11.14.22.72:7805|186] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7805, 11.14.19.89:7803, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7800, 11.14.19.89:7806, 11.14.19.89:7802, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802] after 2000ms, missing ACKs from [11.14.19.89:7805, 11.14.19.89:7804] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7804, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.89:7806, 11.14.19.88:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 103010: [20-5-19 10:49:48:636 CST] 000c0e98 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (4) for mcasted view [11.14.22.72:7805|187] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7805, 11.14.19.89:7803, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7800, 11.14.19.89:7806, 11.14.19.89:7802, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800] after 2000ms, missing ACKs from [11.14.19.89:7805, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.89:7806, 11.14.19.89:7800, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 103158: [20-5-19 10:49:56:428 CST] 000c0ea9 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (3) for mcasted view [11.14.22.72:7805|188] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7800, 11.14.19.89:7806, 11.14.19.89:7802, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800] after 2000ms, missing ACKs from [11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.89:7800, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 103176: [20-5-19 10:50:05:402 CST] 000c0eaf GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|189] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7800, 11.14.19.89:7806, 11.14.19.89:7802, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800] after 2000ms, missing ACKs from [11.14.19.88:7807] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.89:7804, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.88:7802, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 104295: [20-5-19 10:52:16:432 CST] 000c0f02 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|192] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7800, 11.14.19.89:7806, 11.14.19.89:7802, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800, 11.14.19.89:7805, 11.14.19.88:7804] after 2000ms, missing ACKs from [11.14.19.89:7801] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7804, 11.14.19.88:7805, 11.14.19.89:7805, 11.14.19.88:7806, 11.14.19.88:7807, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.89:7800, 11.14.19.88:7802, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 104302: [20-5-19 10:52:18:483 CST] 000c0f02 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|193] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7806, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800, 11.14.19.89:7805, 11.14.19.88:7804] after 2000ms, missing ACKs from [11.14.19.89:7801] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7806, 11.14.19.88:7807, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.88:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 104427: [20-5-19 10:52:29:035 CST] 000c0f13 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (2) for mcasted view [11.14.22.72:7805|194] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7806, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800, 11.14.19.89:7805, 11.14.19.88:7804, 11.14.19.88:7801] after 2000ms, missing ACKs from [11.14.19.89:7807, 11.14.19.89:7806] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7806, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.88:7802, 11.14.19.89:7801]), local_addr=11.14.22.72:7805 Line 104467: [20-5-19 10:52:31:089 CST] 000c0f13 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (2) for mcasted view [11.14.22.72:7805|195] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7801, 11.14.19.89:7807, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7806, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800, 11.14.19.89:7805, 11.14.19.88:7804, 11.14.19.88:7801, 11.14.19.88:7803] after 2000ms, missing ACKs from [11.14.19.89:7807, 11.14.19.89:7806] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.88:7802, 11.14.19.89:7801]), local_addr=11.14.22.72:7805 Line 104495: [20-5-19 10:52:37:806 CST] 000c0f13 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|196] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7801, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7806, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800, 11.14.19.89:7805, 11.14.19.88:7804, 11.14.19.88:7801, 11.14.19.88:7803] after 2000ms, missing ACKs from [11.14.19.89:7806] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.88:7803]), local_addr=11.14.22.72:7805 Line 109406: [20-5-19 11:00:38:437 CST] 000c10b0 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|201] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7801, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800, 11.14.19.89:7805, 11.14.19.88:7804, 11.14.19.88:7801, 11.14.19.88:7803, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.89:7806, 11.14.19.89:7807] after 2000ms, missing ACKs from [11.14.19.89:7801] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7804, 11.14.19.89:7804, 11.14.19.88:7805, 11.14.19.89:7805, 11.14.19.88:7806, 11.14.19.88:7807, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.88:7802, 11.14.19.89:7802, 11.14.19.88:7803, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 112705: [20-5-19 11:07:17:784 CST] 000c11ad GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|204] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.88:7803, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.89:7800, 11.14.19.89:7801] after 2000ms, missing ACKs from [11.14.19.88:7807] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.88:7803, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 116141: [20-5-19 11:13:51:492 CST] 000c12b1 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|211] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.88:7803, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7805] after 2000ms, missing ACKs from [11.14.19.88:7806] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7804, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.89:7806, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.89:7800, 11.14.19.88:7801, 11.14.19.89:7801, 11.14.19.88:7802, 11.14.19.89:7802, 11.14.19.88:7803, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 116392: [20-5-19 11:14:27:049 CST] 000c12c9 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|212] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7806, 11.14.19.88:7802, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.88:7803, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7805] after 2000ms, missing ACKs from [11.14.19.88:7802] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.88:7807, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.89:7800, 11.14.19.88:7801, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.88:7803, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 116657: [20-5-19 11:14:51:939 CST] 000c12ec GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (2) for mcasted view [11.14.22.72:7805|215] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7806, 11.14.19.88:7800, 11.14.19.88:7803, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7805, 11.14.19.88:7802, 11.14.19.88:7801] after 2000ms, missing ACKs from [11.14.19.88:7800, 11.14.19.88:7803] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.89:7804, 11.14.19.88:7805, 11.14.19.89:7805, 11.14.19.88:7806, 11.14.19.89:7806, 11.14.19.88:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 116806: [20-5-19 11:15:10:192 CST] 000c12f6 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|216] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7806, 11.14.19.88:7803, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7805, 11.14.19.88:7802, 11.14.19.88:7801] after 2000ms, missing ACKs from [11.14.19.88:7803] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.88:7807, 11.14.19.89:7806, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.89:7802, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 118509: [20-5-19 11:18:26:738 CST] 000c137e GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|218] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7806, 11.14.19.88:7803, 11.14.19.89:7803, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7805, 11.14.19.88:7802, 11.14.19.88:7801, 11.14.19.88:7800] after 2000ms, missing ACKs from [11.14.19.89:7803] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.88:7807, 11.14.19.89:7806, 11.14.19.88:7800, 11.14.19.89:7800, 11.14.19.88:7801, 11.14.19.89:7801, 11.14.19.88:7802, 11.14.19.88:7803, 11.14.19.89:7807]), local_addr=11.14.22.72:7805 Line 118665: [20-5-19 11:18:55:819 CST] 000c139f GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (2) for mcasted view [11.14.22.72:7805|219] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7806, 11.14.19.88:7803, 11.14.19.89:7803, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7805, 11.14.19.88:7802, 11.14.19.88:7801, 11.14.19.88:7800, 11.14.19.89:7802] after 2000ms, missing ACKs from [11.14.19.89:7806, 11.14.19.89:7807] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7804, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.89:7804, 11.14.19.88:7806, 11.14.19.89:7805, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.88:7801, 11.14.19.89:7800, 11.14.19.88:7802, 11.14.19.89:7801, 11.14.19.88:7803]), local_addr=11.14.22.72:7805 Line 118885: [20-5-19 11:19:19:207 CST] 000c13b3 GMS W org.jgroups.protocols.pbcast.GMS castViewChangeWithDest 11.14.22.72:7805 failed to collect all ACKs (1) for mcasted view [11.14.22.72:7805|220] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7806, 11.14.19.88:7803, 11.14.19.89:7803, 11.14.19.89:7807, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.88:7804, 11.14.19.88:7807, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7805, 11.14.19.88:7802, 11.14.19.88:7801, 11.14.19.88:7800, 11.14.19.89:7802] after 2000ms, missing ACKs from [11.14.19.89:7807] (received=[11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.89:7803, 11.14.19.88:7804, 11.14.19.89:7804, 11.14.19.88:7805, 11.14.19.89:7805, 11.14.19.88:7806, 11.14.19.88:7807, 11.14.19.88:7800, 11.14.19.89:7800, 11.14.19.88:7801, 11.14.19.89:7801, 11.14.19.88:7802, 11.14.19.89:7802, 11.14.19.88:7803]), local_addr=11.14.22.72:7805
step three
NAKACK W org.jgroups.protocols.pbcast.NAKACK handleMessage 11.14.22.72:7805] discarded message from non-member 11.14.19.88:7800, my view is [11.14.22.72:7805|161] [11.14.22.72:7805, 11.14.22.73:7805, 11.14.19.88:7803, 11.14.19.88:7802, 11.14.19.89:7804, 11.14.19.89:7805, 11.14.19.88:7801, 11.14.19.89:7802, 11.14.19.89:7803, 11.14.19.88:7805, 11.14.19.88:7806, 11.14.19.89:7800, 11.14.19.89:7801, 11.14.19.89:7806, 11.14.19.89:7807, 11.14.19.88:7807, 11.14.19.88:7804]
step four
ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.89:7802: java.net.SocketException: Socket closed
[20-5-19 11:28:27:534 CST] 000c11e0 ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.89:7805: java.net.SocketException: Socket closed
[20-5-19 11:28:27:523 CST] 000c11b6 ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.88:7807: java.net.SocketException: Socket closed
[20-5-19 11:28:27:527 CST] 000c0e62 ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.88:7806: java.net.SocketException: Broken pipe (Write failed)
[20-5-19 11:28:27:536 CST] 000c11b3 ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.88:7804: java.net.SocketException: Socket closed
[20-5-19 11:28:27:525 CST] 000c11dd ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.89:7804: java.net.SocketException: Socket closed
[20-5-19 11:28:27:538 CST] 000c12ea ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.88:7802: java.net.SocketException: Broken pipe (Write failed)
[20-5-19 11:28:27:533 CST] 000c12c7 ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.88:7805: java.net.SocketException: Socket closed
[20-5-19 11:28:27:541 CST] 000c13c7 ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.89:7806: java.net.SocketException: Socket closed
[20-5-19 11:28:27:541 CST] 000c0f63 ConnectionTab E org.jgroups.blocks.BasicConnectionTable$Connection _send failed sending data to 11.14.19.89:7807: java.net.SocketException: Socket closed
step five
NotificationB E org.jgroups.blocks.NotificationBus receive exception=java.lang.OutOfMemoryError: Java heap space
NotificationB E org.jgroups.blocks.NotificationBus sendNotification error sending notification NotificationB E org.jgroups.blocks.NotificationBus sendNotification error sending notification java.lang.OutOfMemoryError: Java heap space at java.lang.Class.getDeclaredFieldsImpl(Native Method) at java.lang.Class.getDeclaredFields(Class.java:868) at java.io.ObjectStreamClass.getDefaultSerialFields(ObjectStreamClass.java:1951) at java.io.ObjectStreamClass.getSerialFields(ObjectStreamClass.java:1873) at java.io.ObjectStreamClass.access$800(ObjectStreamClass.java:91) at java.io.ObjectStreamClass$3.run(ObjectStreamClass.java:580) at java.io.ObjectStreamClass$3.run(ObjectStreamClass.java:566) at java.security.AccessController.doPrivileged(AccessController.java:678) at java.io.ObjectStreamClass.<init>(ObjectStreamClass.java:566) at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:410) at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:753) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2035) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1900) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2194) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1722) at java.io.ObjectInputStream.readObjectImpl(ObjectInputStream.java:540) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:475) at org.jgroups.util.Util.objectFromByteBuffer(Util.java:200) at org.jgroups.Message.getObject(Message.java:302) at org.jgroups.blocks.NotificationBus.receive(NotificationBus.java:262) at org.jgroups.JChannel.up(JChannel.java:1286) at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:462) at org.jgroups.protocols.pbcast.GMS.up(GMS.java:791) at org.jgroups.protocols.FD.up(FD.java:284) at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:233) at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:873) at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:705) at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:167) at org.jgroups.protocols.Discovery.up(Discovery.java:263) at org.jgroups.protocols.TP.passMessageUp(TP.java:1285) at org.jgroups.protocols.TP.access$100(TP.java:49) at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1838) at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1817) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:818)
)
Steps to Reproduce: (was: NAKACK reissue *155 OOM error, please ask for help based on the above problem, can you help me? , Related to the JGRP-1016 problem?Looking forward to your response!)
Affects Version/s: (was: 2.6.8)
> org.jgroups.blocks.NotificationBus sendNotification error sending notification java.lang.OutOfMemoryError: Java heap space
> -----------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: JGRP-2483
> URL: https://issues.redhat.com/browse/JGRP-2483
> Project: JGroups
> Issue Type: Bug
> Reporter: 欧阳 檐林
> Assignee: Bela Ban
> Priority: Major
> Attachments: image-2020-06-09-20-13-28-655.png, image-2020-06-09-20-13-52-815.png, image-2020-06-09-20-14-03-732.png, image-2020-06-09-20-14-11-611.png
>
>
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 1 month
[JBoss JIRA] (WFLY-10173) EjbInvocationStatisticsTestCase fails intermittently: wait-time=0
by Brian Stansberry (Jira)
[ https://issues.redhat.com/browse/WFLY-10173?page=com.atlassian.jira.plugi... ]
Brian Stansberry updated WFLY-10173:
------------------------------------
Fix Version/s: 20.0.1.Final
> EjbInvocationStatisticsTestCase fails intermittently: wait-time=0
> -----------------------------------------------------------------
>
> Key: WFLY-10173
> URL: https://issues.redhat.com/browse/WFLY-10173
> Project: WildFly
> Issue Type: Bug
> Components: Test Suite
> Affects Versions: 12.0.0.Final
> Reporter: Jan Kalina
> Assignee: Cheng Fang
> Priority: Major
> Fix For: 21.0.0.Beta1, 20.0.1.Final
>
>
> Sometime, when running EjbInvocationStatisticsTestCase on Windows, assertion fails, as wait-time is 0 (verified it is 0 by adding debug message).
> For me it fails allTests in most of cases, but when running test standalone, it fails only in 1 of 4 cases.
> I suppose it is because of too short sleep in AbstractManagedBean. (in test is called 4 times, each invocation include 50ms sleep, so I consider probable the wait-time is 0 - need to use longer sleeps to fulfill the test)
> {code}
> [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 3.078 s <<< FAILURE! - in org.jboss.as.test.integration.ejb.management.deployments.EjbInvocationStatisticsTestCase
> [ERROR] testSingletonWaitTime(org.jboss.as.test.integration.ejb.management.deployments.EjbInvocationStatisticsTestCase) Time elapsed: 0.438 s <<< FAILURE!
> java.lang.AssertionError
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at org.jboss.as.test.integration.ejb.management.deployments.EjbInvocationStatisticsTestCase.validateWaitTimeStatistic(EjbInvocationStatisticsTestCase.java:179)
> at org.jboss.as.test.integration.ejb.management.deployments.EjbInvocationStatisticsTestCase.testSingletonWaitTime(EjbInvocationStatisticsTestCase.java:148)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564)
> at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at org.jboss.arquillian.junit.Arquillian$8$1.invoke(Arquillian.java:379)
> ...
> {code}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 1 month
[JBoss JIRA] (DROOLS-5423) Fix java 11 usage with kie-pmml-new
by Gabriele Cardosi (Jira)
Gabriele Cardosi created DROOLS-5423:
----------------------------------------
Summary: Fix java 11 usage with kie-pmml-new
Key: DROOLS-5423
URL: https://issues.redhat.com/browse/DROOLS-5423
Project: Drools
Issue Type: Bug
Reporter: Gabriele Cardosi
Assignee: Gabriele Cardosi
Kie-pmml-new is broken when running under Java 11.
This is due to the missing jaxb api/implementations.
Solution should be to add a java-11 profile inside kie-pmml-compiler-commons/pom.xml
{code:java}
// <profiles>
<profile>
<id>java11-pmml</id>
<activation>
<jdk>[11,)</jdk>
</activation>
<properties>
<jaxb.api.version>2.3.2</jaxb.api.version>
</properties>
<dependencies>
<dependency>
<groupId>org.jboss.spec.javax.xml.bind</groupId>
<artifactId>jboss-jaxb-api_2.3_spec</artifactId>
</dependency>
<dependency>
<groupId>org.glassfish.jaxb</groupId>
<artifactId>jaxb-runtime</artifactId>
</dependency>
</dependencies>
</profile>
</profiles>
{code}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 1 month
[JBoss JIRA] (WFLY-12887) Clustering: com.ibm.db2.jcc.am.SqlSyntaxErrorException when DB2 is used as invalidation-cache
by Ranabir Chakraborty (Jira)
[ https://issues.redhat.com/browse/WFLY-12887?page=com.atlassian.jira.plugi... ]
Ranabir Chakraborty commented on WFLY-12887:
--------------------------------------------
[~tommaso-borgato] Can you please provide the steps to reproduce this issue?
> Clustering: com.ibm.db2.jcc.am.SqlSyntaxErrorException when DB2 is used as invalidation-cache
> ---------------------------------------------------------------------------------------------
>
> Key: WFLY-12887
> URL: https://issues.redhat.com/browse/WFLY-12887
> Project: WildFly
> Issue Type: Bug
> Components: Clustering
> Affects Versions: 19.0.0.Beta1
> Reporter: Tommaso Borgato
> Assignee: Paul Ferraro
> Priority: Critical
>
> The error happens in clustering tests where the cache is backed by a DB2 relational database;
> The cache is configured as follows:
> {noformat}
> embed-server --server-config=standalone-ha.xml
> /subsystem=jgroups/channel=ee:write-attribute(name=stack,value=tcp)
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload:add()
> /subsystem=infinispan/cache-container=web/invalidation-cache==offload/component=transaction:write-attribute(name=mode, value=BATCH)
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload/component=locking:write-attribute(name=isolation, value=REPEATABLE_READ)
> data-source add --name=testDS --jndi-name=java:jboss/datasources/testDS --driver-name=db2-connector.jar --connection-url=jdbc:db2://db2-111.hosts.mwqe.eng.bos.redhat.com:50000/dballo --enabled=true --jta=true --use-java-context=true --transaction-isolation=TRANSACTION_READ_COMMITTED --min-pool-size=1 --max-pool-size=5 --pool-prefill=true --user-name=dballo00 --password=dballo00 --prepared-statements-cache-size=32 --share-prepared-statements=true
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc:add(data-source=testDS,fetch-state=false,passivation=false,purge=false,shared=true,dialect=DB2){allow-resource-service-restart=true}
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=prefix,value=s)
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=id-column.name,value=id)
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=id-column.type,value=VARCHAR(255))
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=data-column.name,value=datum)
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=data-column.type,value=BLOB)
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=timestamp-column.name,value=version)
> /subsystem=infinispan/cache-container=web/invalidation-cache=offload/store=jdbc/table=string:write-attribute(name=timestamp-column.type,value=BIGINT)
> /subsystem=infinispan/cache-container=web:write-attribute(name=default-cache, value=offload)
> /subsystem=transactions:write-attribute(name=node-identifier,value=wildfly1)
> /subsystem=datasources/data-source=testDS:write-attribute(name=spy,value=true)
> /subsystem=logging/logger=jboss.jdbc.spy:add(level=TRACE)
> {noformat}
> The error is the following:
> {noformat}
> 2019-12-16 16:49:31,961 DEBUG [jboss.jdbc.spy] (expiration-thread--p24-t1) java:jboss/datasources/testDS [DataSource] getConnection()
> 2019-12-16 16:49:31,961 DEBUG [jboss.jdbc.spy] (expiration-thread--p24-t1) java:jboss/datasources/testDS [Connection] setAutoCommit(false)
> 2019-12-16 16:49:31,962 DEBUG [jboss.jdbc.spy] (expiration-thread--p24-t1) java:jboss/datasources/testDS [Connection] prepareStatement(SELECT datum, id FROM "s_cbnc_ear_a_war" WHERE version < ? AND version > 0 FOR UPDATE)
> 2019-12-16 16:49:31,971 DEBUG [jboss.jdbc.spy] (expiration-thread--p24-t1) java:jboss/datasources/testDS [PreparedStatement] setLong(1, 1576514971971)
> 2019-12-16 16:49:31,971 DEBUG [jboss.jdbc.spy] (expiration-thread--p24-t1) java:jboss/datasources/testDS [PreparedStatement] executeQuery()
> 2019-12-16 16:49:31,987 DEBUG [jboss.jdbc.spy] (persistence-thread--p25-t4) java:jboss/datasources/testDS [Connection] close()
> 2019-12-16 16:49:31,991 DEBUG [jboss.jdbc.spy] (persistence-thread--p25-t2) java:jboss/datasources/testDS [DataSource] getConnection()
> 2019-12-16 16:49:31,992 DEBUG [jboss.jdbc.spy] (persistence-thread--p25-t2) java:jboss/datasources/testDS [Connection] isValid(10)
> 2019-12-16 16:49:31,998 ERROR [org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore] (expiration-thread--p24-t1) ISPN008001: Failed clearing cache store: com.ibm.db2.jcc.am.SqlSyntaxErrorException: DB2 SQL Error: SQLCODE=-204, SQLSTATE=42704, SQLERRMC=DBALLO00.s_cbnc_ear_a_war, DRIVER=4.25.1301
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.b6.a(b6.java:810)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.b6.a(b6.java:66)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.b6.a(b6.java:140)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k3.c(k3.java:2824)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k3.d(k3.java:2808)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k3.a(k3.java:2234)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k4.a(k4.java:8242)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.t4.ab.i(ab.java:206)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.t4.ab.b(ab.java:96)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.t4.p.a(p.java:32)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.t4.av.i(av.java:150)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k3.al(k3.java:2203)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k4.bq(k4.java:3730)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k4.a(k4.java:4609)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k4.b(k4.java:4182)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k4.bd(k4.java:780)
> at deployment.db2-connector.jar//com.ibm.db2.jcc.am.k4.executeQuery(k4.java:745)
> at org.jboss.ironjacamar.jdbcadapters@1.4.19.Final//org.jboss.jca.adapters.jdbc.CachedPreparedStatement.executeQuery(CachedPreparedStatement.java:113)
> at org.jboss.ironjacamar.jdbcadapters@1.4.19.Final//org.jboss.jca.adapters.jdbc.WrappedPreparedStatement.executeQuery(WrappedPreparedStatement.java:504)
> at org.infinispan.persistence.jdbc@9.4.16.Final//org.infinispan.persistence.jdbc.stringbased.JdbcStringBasedStore.purge(JdbcStringBasedStore.java:456)
> at org.infinispan@9.4.16.Final//org.infinispan.persistence.manager.PersistenceManagerImpl.lambda$purgeExpired$6(PersistenceManagerImpl.java:470)
> at java.base/java.util.ArrayList.forEach(ArrayList.java:1540)
> at org.infinispan@9.4.16.Final//org.infinispan.persistence.manager.PersistenceManagerImpl.purgeExpired(PersistenceManagerImpl.java:473)
> at org.infinispan@9.4.16.Final//org.infinispan.expiration.impl.ExpirationManagerImpl.processExpiration(ExpirationManagerImpl.java:111)
> at org.infinispan@9.4.16.Final//org.infinispan.expiration.impl.ExpirationManagerImpl$ScheduledTask.run(ExpirationManagerImpl.java:245)
> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
> at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at org.jboss.as.clustering.common@19.0.0.Beta1-SNAPSHOT//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
> at org.jboss.as.clustering.common@19.0.0.Beta1-SNAPSHOT//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
> at java.base/java.lang.Thread.run(Thread.java:834)
> {noformat}
> The issue is set as "Blocker" because DB2 is one of the supported databases and we don't have a workaround at present
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 1 month