[teiid-issues] [JBoss JIRA] (TEIID-5801) Communications link failure during commit() error message when copying a MySQL table to a DB
Dmitrii Pogorelov (Jira)
issues at jboss.org
Fri Aug 2 12:14:00 EDT 2019
[ https://issues.jboss.org/browse/TEIID-5801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13766602#comment-13766602 ]
Dmitrii Pogorelov edited comment on TEIID-5801 at 8/2/19 12:13 PM:
-------------------------------------------------------------------
[~shawkins] I investigated the remote MySQL DB, checked all timeouts, they had the following:
{code}
[connect_timeout, 10]
[delayed_insert_timeout, 300]
[innodb_flush_log_at_timeout, 1]
[innodb_lock_wait_timeout, 50]
[innodb_rollback_on_timeout, OFF]
[interactive_timeout, 28800]
[lock_wait_timeout, 31536000]
[net_read_timeout, 30]
[net_write_timeout, 60]
[rpl_stop_slave_timeout, 31536000]
[slave_net_timeout, 3600]
[wait_timeout, 28800]
{code}
I tried to change many timeouts via "set SESSION" command but nothing helped me. The remote MySQL data source just fails after starting a transaction and committing it after some time. But I discovered the following behavior, if I run these commands (lingoda_read_replica is the remote MySQL data source):
{code:sql}
start transaction ;;
SELECT * FROM lingoda_read_replica.transaction limit 100 ;;
--wait for several minutes
commit ;;
{code}
it will fail with the stacktrace:
{code}
2019-08-02 17:39:08,852 WARN [org.jboss.jca.core.connectionmanager.listener.TxConnectionListener] (Worker9_QueryProcessorQueue2086) zQviPsbtOB3h IJ000305: Connection error occured: org.jboss.jca.core.connectionmanager.listener.TxConnectionListener at 5aa0db62[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 7e3275d0 connection handles=0 lastReturned=1564760159114 lastValidated=1564760159114 lastCheckedOut=1564760159114 trackByTx=true pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool at 4bced85c mcp=SemaphoreConcurrentLinkedQueueManagedConnectionPool at 160eaa84[pool=lingoda_read_replica] xaResource=LocalXAResourceImpl at 3cb2efe4[connectionListener=5aa0db62 connectionManager=222e8322 warned=false currentXid=null productName=MySQL productVersion=5.6.34-log jndiName=java:/lingoda_read_replica] txSync=TransactionSynchronization at 1540878037{tx=Local transaction (delegate=TransactionImple < ac, BasicAction: 0:ffffc0a8008c:-3ccc1e9e:5d4451f8:bd status: ActionStatus.COMMITTING >, owner=Local transaction context for provider JBoss JTA transaction provider) wasTrackByTx=true enlisted=true cancel=false}]: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: Communications link failure during commit(). Transaction resolution unknown.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1014)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:988)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:974)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:919)
at com.mysql.jdbc.ConnectionImpl.commit(ConnectionImpl.java:1700)
at org.jboss.jca.adapters.jdbc.local.LocalManagedConnection.commit(LocalManagedConnection.java:96)
at org.jboss.jca.core.tx.jbossts.LocalXAResourceImpl.commit(LocalXAResourceImpl.java:172)
at com.arjuna.ats.internal.jta.resources.arjunacore.XAOnePhaseResource.commit(XAOnePhaseResource.java:120)
at com.arjuna.ats.internal.arjuna.abstractrecords.LastResourceRecord.topLevelOnePhaseCommit(LastResourceRecord.java:172)
at com.arjuna.ats.arjuna.coordinator.BasicAction.onePhaseCommit(BasicAction.java:2386)
at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1497)
at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:96)
at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162)
at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1288)
at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:126)
at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:89)
at org.wildfly.transaction.client.LocalTransaction.commitAndDissociate(LocalTransaction.java:77)
at org.wildfly.transaction.client.ContextTransactionManager.commit(ContextTransactionManager.java:71)
at org.teiid.dqp.internal.process.TransactionServerImpl.commitDirect(TransactionServerImpl.java:386)
at org.teiid.dqp.internal.process.TransactionServerImpl.commit(TransactionServerImpl.java:459)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.teiid.logging.LogManager$LoggingProxy.invoke(LogManager.java:117)
at com.sun.proxy.$Proxy27.commit(Unknown Source)
at org.teiid.dqp.internal.process.DQPCore$4.call(DQPCore.java:780)
at org.teiid.dqp.internal.process.DQPCore$4.call(DQPCore.java:777)
at org.teiid.dqp.internal.process.DQPCore$8.run(DQPCore.java:845)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.teiid.dqp.internal.process.FutureWork.run(FutureWork.java:59)
at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:281)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:113)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:199)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2019-08-02 17:39:08,854 WARN [com.arjuna.ats.jta] (Worker9_QueryProcessorQueue2086) zQviPsbtOB3h ARJUNA016039: onePhaseCommit on < formatId=131077, gtrid_length=29, bqual_length=36, tx_uid=0:ffffc0a8008c:-3ccc1e9e:5d4451f8:bd, node_name=1, branch_uid=0:ffffc0a8008c:-3ccc1e9e:5d4451f8:c1, subordinatenodename=null, eis_name=java:/lingoda_read_replica > (LocalXAResourceImpl at 3cb2efe4[connectionListener=5aa0db62 connectionManager=222e8322 warned=false currentXid=null productName=MySQL productVersion=5.6.34-log jndiName=java:/lingoda_read_replica]) failed with exception XAException.XAER_RMFAIL: org.jboss.jca.core.spi.transaction.local.LocalXAException: IJ001156: Could not commit local transaction
at org.jboss.jca.core.tx.jbossts.LocalXAResourceImpl.commit(LocalXAResourceImpl.java:177)
at com.arjuna.ats.internal.jta.resources.arjunacore.XAOnePhaseResource.commit(XAOnePhaseResource.java:120)
at com.arjuna.ats.internal.arjuna.abstractrecords.LastResourceRecord.topLevelOnePhaseCommit(LastResourceRecord.java:172)
at com.arjuna.ats.arjuna.coordinator.BasicAction.onePhaseCommit(BasicAction.java:2386)
at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1497)
at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:96)
at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162)
at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1288)
at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:126)
at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:89)
at org.wildfly.transaction.client.LocalTransaction.commitAndDissociate(LocalTransaction.java:77)
at org.wildfly.transaction.client.ContextTransactionManager.commit(ContextTransactionManager.java:71)
at org.teiid.dqp.internal.process.TransactionServerImpl.commitDirect(TransactionServerImpl.java:386)
at org.teiid.dqp.internal.process.TransactionServerImpl.commit(TransactionServerImpl.java:459)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.teiid.logging.LogManager$LoggingProxy.invoke(LogManager.java:117)
at com.sun.proxy.$Proxy27.commit(Unknown Source)
at org.teiid.dqp.internal.process.DQPCore$4.call(DQPCore.java:780)
at org.teiid.dqp.internal.process.DQPCore$4.call(DQPCore.java:777)
at org.teiid.dqp.internal.process.DQPCore$8.run(DQPCore.java:845)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.teiid.dqp.internal.process.FutureWork.run(FutureWork.java:59)
at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:281)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:113)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:199)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.jboss.jca.core.spi.transaction.local.LocalResourceException: Communications link failure during commit(). Transaction resolution unknown.
at org.jboss.jca.adapters.jdbc.local.LocalManagedConnection.commit(LocalManagedConnection.java:103)
at org.jboss.jca.core.tx.jbossts.LocalXAResourceImpl.commit(LocalXAResourceImpl.java:172)
... 31 more
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: Communications link failure during commit(). Transaction resolution unknown.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1014)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:988)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:974)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:919)
at com.mysql.jdbc.ConnectionImpl.commit(ConnectionImpl.java:1700)
at org.jboss.jca.adapters.jdbc.local.LocalManagedConnection.commit(LocalManagedConnection.java:96)
... 32 more
{code}
At the same time working with transactions via native calls doesn't cause fatal errors. The queries:
{code:sql}
call lingoda_read_replica.native('start transaction') ;;
select s.tuple[1], s.tuple[2], s.tuple[3], s.tuple[4], s.tuple[5], s.tuple[6], s.tuple[7], s.tuple[8], s.tuple[9], s.tuple[10], s.tuple[11],
s.tuple[12], s.tuple[13], s.tuple[14], s.tuple[15], s.tuple[16], s.tuple[17], s.tuple[18], s.tuple[19], s.tuple[20], s.tuple[21]
from (call lingoda_read_replica.native('SELECT * FROM linguando.transaction limit 100')) as s ;;
--wait for several minutes
call lingoda_read_replica.native('commit') ;;
{code}
will produce the following logs:
{code}
2019-08-02 18:04:37,258 DEBUG [org.teiid.CONNECTOR] (Worker14_QueryProcessorQueue2186) zQviPsbtOB3h zQviPsbtOB3h.51.1.1049 Processing Close : EXEC lingoda_read_replica.native('start transaction')
2019-08-02 18:04:37,258 DEBUG [org.teiid.CONNECTOR] (Worker14_QueryProcessorQueue2186) zQviPsbtOB3h zQviPsbtOB3h.51.1.1049 Closed execution
2019-08-02 18:04:37,259 DEBUG [org.teiid.CONNECTOR] (Worker14_QueryProcessorQueue2186) zQviPsbtOB3h zQviPsbtOB3h.51.1.1049 Closed connection
2019-08-02 18:04:38,521 DEBUG [org.teiid.CONNECTOR] (Worker14_QueryProcessorQueue2188) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Create State
2019-08-02 18:04:38,521 DEBUG [org.teiid.CONNECTOR] (Worker15_QueryProcessorQueue2189) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Processing NEW request: EXEC lingoda_read_replica.native('SELECT * FROM linguando.transaction limit 100')
2019-08-02 18:04:38,568 DEBUG [org.teiid.CONNECTOR] (Worker15_QueryProcessorQueue2189) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Obtained execution
2019-08-02 18:04:38,568 DEBUG [org.teiid.CONNECTOR] (Worker15_QueryProcessorQueue2189) zQviPsbtOB3h Source-specific command: SELECT * FROM linguando.transaction limit 100
2019-08-02 18:04:38,685 DEBUG [org.teiid.CONNECTOR] (Worker15_QueryProcessorQueue2189) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Executed command
2019-08-02 18:04:38,685 DEBUG [org.teiid.CONNECTOR] (Worker15_QueryProcessorQueue2189) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Processing MORE request
2019-08-02 18:04:38,685 DEBUG [org.teiid.CONNECTOR] (Worker15_QueryProcessorQueue2189) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Getting results from connector
2019-08-02 18:04:38,686 DEBUG [org.teiid.CONNECTOR] (Worker15_QueryProcessorQueue2189) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Obtained last batch, total row count: 100
2019-08-02 18:04:38,686 DEBUG [org.teiid.CONNECTOR] (Worker14_QueryProcessorQueue2190) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Remove State
2019-08-02 18:04:38,686 DEBUG [org.teiid.CONNECTOR] (Worker14_QueryProcessorQueue2190) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Processing Close : EXEC lingoda_read_replica.native('SELECT * FROM linguando.transaction limit 100')
2019-08-02 18:04:38,686 DEBUG [org.teiid.CONNECTOR] (Worker14_QueryProcessorQueue2190) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Closed execution
2019-08-02 18:04:38,686 DEBUG [org.teiid.CONNECTOR] (Worker14_QueryProcessorQueue2190) zQviPsbtOB3h zQviPsbtOB3h.52.3.1050 Closed connection
2019-08-02 18:08:01,925 DEBUG [org.teiid.CONNECTOR] (Worker16_QueryProcessorQueue2192) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Create State
2019-08-02 18:08:01,927 DEBUG [org.teiid.CONNECTOR] (Worker17_QueryProcessorQueue2193) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Processing NEW request: EXEC lingoda_read_replica.native('commit')
2019-08-02 18:08:01,929 WARN [org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory] (Worker17_QueryProcessorQueue2193) zQviPsbtOB3h IJ030027: Destroying connection that is not valid, due to the following exception: com.mysql.jdbc.JDBC4Connection at 54bd1b7d: java.sql.SQLException: Ping failed: java.lang.reflect.InvocationTargetException
at org.jboss.jca.adapters.jdbc.extensions.mysql.MySQLValidConnectionChecker.isValidConnection(MySQLValidConnectionChecker.java:93)
at org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnectionFactory.isValidConnection(BaseWrapperManagedConnectionFactory.java:1273)
at org.jboss.jca.adapters.jdbc.BaseWrapperManagedConnectionFactory.getInvalidConnections(BaseWrapperManagedConnectionFactory.java:1086)
at org.jboss.jca.core.connectionmanager.pool.mcp.SemaphoreConcurrentLinkedDequeManagedConnectionPool.getConnection(SemaphoreConcurrentLinkedDequeManagedConnectionPool.java:379)
at org.jboss.jca.core.connectionmanager.pool.AbstractPool.getSimpleConnection(AbstractPool.java:632)
at org.jboss.jca.core.connectionmanager.pool.AbstractPool.getConnection(AbstractPool.java:604)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.getManagedConnection(AbstractConnectionManager.java:624)
at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:440)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:789)
at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:138)
at org.jboss.as.connector.subsystems.datasources.WildFlyDataSource.getConnection(WildFlyDataSource.java:64)
at org.teiid.translator.jdbc.JDBCExecutionFactory.getConnection(JDBCExecutionFactory.java:281)
at org.teiid.translator.jdbc.JDBCExecutionFactory.getConnection(JDBCExecutionFactory.java:71)
at org.teiid.translator.ExecutionFactory.getConnection(ExecutionFactory.java:199)
at org.teiid.dqp.internal.datamgr.ConnectorWorkItem.execute(ConnectorWorkItem.java:353)
at sun.reflect.GeneratedMethodAccessor105.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.teiid.dqp.internal.datamgr.ConnectorManager$1.invoke(ConnectorManager.java:228)
at com.sun.proxy.$Proxy41.execute(Unknown Source)
at org.teiid.dqp.internal.process.DataTierTupleSource.getResults(DataTierTupleSource.java:302)
at org.teiid.dqp.internal.process.DataTierTupleSource$1.call(DataTierTupleSource.java:108)
at org.teiid.dqp.internal.process.DataTierTupleSource$1.call(DataTierTupleSource.java:104)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.teiid.dqp.internal.process.FutureWork.run(FutureWork.java:59)
at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:281)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:113)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:199)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedMethodAccessor120.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jboss.jca.adapters.jdbc.extensions.mysql.MySQLValidConnectionChecker.isValidConnection(MySQLValidConnectionChecker.java:83)
... 30 more
Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
The last packet successfully received from the server was 203 243 milliseconds ago. The last packet sent successfully to the server was 203 309 milliseconds ago.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1117)
at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3851)
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2468)
at com.mysql.jdbc.ConnectionImpl.pingInternal(ConnectionImpl.java:4107)
at com.mysql.jdbc.ConnectionImpl.ping(ConnectionImpl.java:4084)
... 34 more
Caused by: java.net.SocketException: Software caused connection abort: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3832)
... 37 more
2019-08-02 18:08:01,931 WARN [org.jboss.jca.core.connectionmanager.pool.strategy.OnePool] (Worker17_QueryProcessorQueue2193) zQviPsbtOB3h IJ000621: Destroying connection that could not be validated: org.jboss.jca.core.connectionmanager.listener.TxConnectionListener at 675f61d2[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 245f63c4 connection handles=0 lastReturned=1564761878686 lastValidated=1564761877158 lastCheckedOut=1564761878568 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool at 4bced85c mcp=SemaphoreConcurrentLinkedQueueManagedConnectionPool at 160eaa84[pool=lingoda_read_replica] xaResource=LocalXAResourceImpl at 6030d968[connectionListener=675f61d2 connectionManager=222e8322 warned=false currentXid=null productName=MySQL productVersion=5.6.34-log jndiName=java:/lingoda_read_replica] txSync=null]
2019-08-02 18:08:02,633 DEBUG [org.teiid.CONNECTOR] (Worker17_QueryProcessorQueue2193) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Obtained execution
2019-08-02 18:08:02,633 DEBUG [org.teiid.CONNECTOR] (Worker17_QueryProcessorQueue2193) zQviPsbtOB3h Source-specific command: commit
2019-08-02 18:08:02,740 DEBUG [org.teiid.CONNECTOR] (Worker17_QueryProcessorQueue2193) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Executed command
2019-08-02 18:08:02,740 DEBUG [org.teiid.CONNECTOR] (Worker17_QueryProcessorQueue2193) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Processing MORE request
2019-08-02 18:08:02,740 DEBUG [org.teiid.CONNECTOR] (Worker17_QueryProcessorQueue2193) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Getting results from connector
2019-08-02 18:08:02,740 DEBUG [org.teiid.CONNECTOR] (Worker17_QueryProcessorQueue2193) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Obtained last batch, total row count: 1
2019-08-02 18:08:02,741 DEBUG [org.teiid.CONNECTOR] (Worker16_QueryProcessorQueue2194) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Remove State
2019-08-02 18:08:02,741 DEBUG [org.teiid.CONNECTOR] (Worker16_QueryProcessorQueue2194) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Processing Close : EXEC lingoda_read_replica.native('commit')
2019-08-02 18:08:02,741 DEBUG [org.teiid.CONNECTOR] (Worker16_QueryProcessorQueue2194) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Closed execution
2019-08-02 18:08:02,742 DEBUG [org.teiid.CONNECTOR] (Worker16_QueryProcessorQueue2194) zQviPsbtOB3h zQviPsbtOB3h.53.1.1051 Closed connection
{code}
that is eventually the commit command was executed (if I'm not mistaken).
I started to investigate the bug further and found another interesting behavior. The "insert into .... select *" command will be divided on two commands: select and insert. For every of these commands Teiid calls DataTierManagerImpl.registerRequest method. At the moment for remote MySQL and PostgreSQL data sources Teiid calls aqr.setSerial(true); for both commands (select and insert) and then the "insert into .... select *" fails (I attached server_1_fail.log, there I added also output of messages related to starting and finishing transaction). But if I call aqr.setSerial(false); for select command and aqr.setSerial(true); for insert command then the "insert into .... select *" doesn't fail, transaction is being committed without errors (I attached server_2_works.log). Could you tell me, please, why does aqr.setSerial method allow to avoid transaction errors?
was (Author: dalex005):
[~shawkins] I investigated the remote MySQL DB, checked all timeouts, they had the following:
{code}
[connect_timeout, 10]
[delayed_insert_timeout, 300]
[innodb_flush_log_at_timeout, 1]
[innodb_lock_wait_timeout, 50]
[innodb_rollback_on_timeout, OFF]
[interactive_timeout, 28800]
[lock_wait_timeout, 31536000]
[net_read_timeout, 30]
[net_write_timeout, 60]
[rpl_stop_slave_timeout, 31536000]
[slave_net_timeout, 3600]
[wait_timeout, 28800]
{code}
I tried to change many timeouts via "set SESSION" command but nothing helped me. The remote MySQL data source just fails after starting a transaction and committing it after some time. But I discovered the following behavior, if I run these commands (lingoda_read_replica is the remote MySQL data source):
{code:sql}
start transaction ;;
SELECT * FROM lingoda_read_replica.transaction limit 100 ;;
--wait for several minutes
commit ;;
{code}
it will fail with the stacktrace:
{code}
2019-08-02 17:39:08,852 WARN [org.jboss.jca.core.connectionmanager.listener.TxConnectionListener] (Worker9_QueryProcessorQueue2086) zQviPsbtOB3h IJ000305: Connection error occured: org.jboss.jca.core.connectionmanager.listener.TxConnectionListener at 5aa0db62[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 7e3275d0 connection handles=0 lastReturned=1564760159114 lastValidated=1564760159114 lastCheckedOut=1564760159114 trackByTx=true pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool at 4bced85c mcp=SemaphoreConcurrentLinkedQueueManagedConnectionPool at 160eaa84[pool=lingoda_read_replica] xaResource=LocalXAResourceImpl at 3cb2efe4[connectionListener=5aa0db62 connectionManager=222e8322 warned=false currentXid=null productName=MySQL productVersion=5.6.34-log jndiName=java:/lingoda_read_replica] txSync=TransactionSynchronization at 1540878037{tx=Local transaction (delegate=TransactionImple < ac, BasicAction: 0:ffffc0a8008c:-3ccc1e9e:5d4451f8:bd status: ActionStatus.COMMITTING >, owner=Local transaction context for provider JBoss JTA transaction provider) wasTrackByTx=true enlisted=true cancel=false}]: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: Communications link failure during commit(). Transaction resolution unknown.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1014)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:988)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:974)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:919)
at com.mysql.jdbc.ConnectionImpl.commit(ConnectionImpl.java:1700)
at org.jboss.jca.adapters.jdbc.local.LocalManagedConnection.commit(LocalManagedConnection.java:96)
at org.jboss.jca.core.tx.jbossts.LocalXAResourceImpl.commit(LocalXAResourceImpl.java:172)
at com.arjuna.ats.internal.jta.resources.arjunacore.XAOnePhaseResource.commit(XAOnePhaseResource.java:120)
at com.arjuna.ats.internal.arjuna.abstractrecords.LastResourceRecord.topLevelOnePhaseCommit(LastResourceRecord.java:172)
at com.arjuna.ats.arjuna.coordinator.BasicAction.onePhaseCommit(BasicAction.java:2386)
at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1497)
at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:96)
at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162)
at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1288)
at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:126)
at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:89)
at org.wildfly.transaction.client.LocalTransaction.commitAndDissociate(LocalTransaction.java:77)
at org.wildfly.transaction.client.ContextTransactionManager.commit(ContextTransactionManager.java:71)
at org.teiid.dqp.internal.process.TransactionServerImpl.commitDirect(TransactionServerImpl.java:386)
at org.teiid.dqp.internal.process.TransactionServerImpl.commit(TransactionServerImpl.java:459)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.teiid.logging.LogManager$LoggingProxy.invoke(LogManager.java:117)
at com.sun.proxy.$Proxy27.commit(Unknown Source)
at org.teiid.dqp.internal.process.DQPCore$4.call(DQPCore.java:780)
at org.teiid.dqp.internal.process.DQPCore$4.call(DQPCore.java:777)
at org.teiid.dqp.internal.process.DQPCore$8.run(DQPCore.java:845)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.teiid.dqp.internal.process.FutureWork.run(FutureWork.java:59)
at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:281)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:113)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:199)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2019-08-02 17:39:08,854 WARN [com.arjuna.ats.jta] (Worker9_QueryProcessorQueue2086) zQviPsbtOB3h ARJUNA016039: onePhaseCommit on < formatId=131077, gtrid_length=29, bqual_length=36, tx_uid=0:ffffc0a8008c:-3ccc1e9e:5d4451f8:bd, node_name=1, branch_uid=0:ffffc0a8008c:-3ccc1e9e:5d4451f8:c1, subordinatenodename=null, eis_name=java:/lingoda_read_replica > (LocalXAResourceImpl at 3cb2efe4[connectionListener=5aa0db62 connectionManager=222e8322 warned=false currentXid=null productName=MySQL productVersion=5.6.34-log jndiName=java:/lingoda_read_replica]) failed with exception XAException.XAER_RMFAIL: org.jboss.jca.core.spi.transaction.local.LocalXAException: IJ001156: Could not commit local transaction
at org.jboss.jca.core.tx.jbossts.LocalXAResourceImpl.commit(LocalXAResourceImpl.java:177)
at com.arjuna.ats.internal.jta.resources.arjunacore.XAOnePhaseResource.commit(XAOnePhaseResource.java:120)
at com.arjuna.ats.internal.arjuna.abstractrecords.LastResourceRecord.topLevelOnePhaseCommit(LastResourceRecord.java:172)
at com.arjuna.ats.arjuna.coordinator.BasicAction.onePhaseCommit(BasicAction.java:2386)
at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1497)
at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:96)
at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162)
at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1288)
at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:126)
at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:89)
at org.wildfly.transaction.client.LocalTransaction.commitAndDissociate(LocalTransaction.java:77)
at org.wildfly.transaction.client.ContextTransactionManager.commit(ContextTransactionManager.java:71)
at org.teiid.dqp.internal.process.TransactionServerImpl.commitDirect(TransactionServerImpl.java:386)
at org.teiid.dqp.internal.process.TransactionServerImpl.commit(TransactionServerImpl.java:459)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.teiid.logging.LogManager$LoggingProxy.invoke(LogManager.java:117)
at com.sun.proxy.$Proxy27.commit(Unknown Source)
at org.teiid.dqp.internal.process.DQPCore$4.call(DQPCore.java:780)
at org.teiid.dqp.internal.process.DQPCore$4.call(DQPCore.java:777)
at org.teiid.dqp.internal.process.DQPCore$8.run(DQPCore.java:845)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.teiid.dqp.internal.process.FutureWork.run(FutureWork.java:59)
at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:281)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:113)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:199)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.jboss.jca.core.spi.transaction.local.LocalResourceException: Communications link failure during commit(). Transaction resolution unknown.
at org.jboss.jca.adapters.jdbc.local.LocalManagedConnection.commit(LocalManagedConnection.java:103)
at org.jboss.jca.core.tx.jbossts.LocalXAResourceImpl.commit(LocalXAResourceImpl.java:172)
... 31 more
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: Communications link failure during commit(). Transaction resolution unknown.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1014)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:988)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:974)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:919)
at com.mysql.jdbc.ConnectionImpl.commit(ConnectionImpl.java:1700)
at org.jboss.jca.adapters.jdbc.local.LocalManagedConnection.commit(LocalManagedConnection.java:96)
... 32 more
{code}
I started to investigate the bug further and found another interesting behavior. The "insert into .... select *" command will be divided on two commands: select and insert. For every of these commands Teiid calls DataTierManagerImpl.registerRequest method. At the moment for remote MySQL and PostgreSQL data sources Teiid calls aqr.setSerial(true); for both commands (select and insert) and then the "insert into .... select *" fails (I attached server_1_fail.log, there I added also output of messages related to starting and finishing transaction). But if I call aqr.setSerial(false); for select command and aqr.setSerial(true); for insert command then the "insert into .... select *" doesn't fail, transaction is being committed without errors (I attached server_2_works.log). Could you tell me, please, why does aqr.setSerial method allow to avoid transaction errors?
> Communications link failure during commit() error message when copying a MySQL table to a DB
> --------------------------------------------------------------------------------------------
>
> Key: TEIID-5801
> URL: https://issues.jboss.org/browse/TEIID-5801
> Project: Teiid
> Issue Type: Quality Risk
> Components: Query Engine
> Affects Versions: 12.0
> Environment: teiid-12.0.0 on WildFly Full 14.0.1.Final (WildFly Core 6.0.2.Final)
> Reporter: Dmitrii Pogorelov
> Assignee: Steven Hawkins
> Priority: Major
> Attachments: server_1_fail.log, server_2_works.log, server_teiid.log
>
>
> When copying a MySQL table, for example, to PostgreSQL:
> {code:sql}
> insert into dwh_pg.test_target SELECT * FROM my.test_source ;;
> {code}
> in the end of the process Teiid throws out the following stacktrace (though rows are inserted in PostgreSQL successfully, seems that Teiid can't close read transaction for MySQL):
> {code}
> 2019-08-01 16:48:23,119 WARN [org.jboss.jca.core.connectionmanager.listener.TxConnectionListener] (Worker3_QueryProcessorQueue34) TidBkmeGWJN8 IJ000305: Connection error occured: org.jboss.jca.core.connectionmanager.listener.TxConnectionListener at 75284e6d[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.local.LocalManagedConnection at 5b8d92c7 connection handles=0 lastReturned=1564670796599 lastValidated=1564670796598 lastCheckedOut=1564670796678 trackByTx=true pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool at ae21718 mcp=SemaphoreConcurrentLinkedQueueManagedConnectionPool at 338041b4[pool=lingoda_read_replica] xaResource=LocalXAResourceImpl at 1fcd6b81[connectionListener=75284e6d connectionManager=20f22ec1 warned=false currentXid=null productName=MySQL productVersion=5.6.34-log jndiName=java:/lingoda_read_replica] txSync=TransactionSynchronization at 1367866468{tx=Local transaction (delegate=TransactionImple < ac, BasicAction: 0:ffffc0a8008c:33252ff9:5d42fad3:11 status: ActionStatus.PREPARING >, owner=Local transaction context for provider JBoss JTA transaction provider) wasTrackByTx=true enlisted=true cancel=false}]: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: Communications link failure during commit(). Transaction resolution unknown. at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) at com.mysql.jdbc.Util.getInstance(Util.java:386) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1014) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:988) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:974) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:919) at com.mysql.jdbc.ConnectionImpl.commit(ConnectionImpl.java:1700) at org.jboss.jca.adapters.jdbc.local.LocalManagedConnection.commit(LocalManagedConnection.java:96) at org.jboss.jca.core.tx.jbossts.LocalXAResourceImpl.commit(LocalXAResourceImpl.java:172) at com.arjuna.ats.internal.jta.resources.arjunacore.XAOnePhaseResource.commit(XAOnePhaseResource.java:120) at com.arjuna.ats.internal.arjuna.abstractrecords.LastResourceRecord.topLevelPrepare(LastResourceRecord.java:152) at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2664) at com.arjuna.ats.arjuna.coordinator.BasicAction.doPrepare(BasicAction.java:2614) at com.arjuna.ats.arjuna.coordinator.BasicAction.prepare(BasicAction.java:2157) at com.arjuna.ats.arjuna.coordinator.BasicAction.End(BasicAction.java:1503) at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:96) at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:162) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1288) at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:126) at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:89) at org.wildfly.transaction.client.LocalTransaction.commitAndDissociate(LocalTransaction.java:77) at org.wildfly.transaction.client.ContextTransactionManager.commit(ContextTransactionManager.java:71) at org.teiid.dqp.internal.process.TransactionServerImpl.commitDirect(TransactionServerImpl.java:384) at org.teiid.dqp.internal.process.TransactionServerImpl.commit(TransactionServerImpl.java:515) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.teiid.logging.LogManager$LoggingProxy.invoke(LogManager.java:117) at com.sun.proxy.$Proxy25.commit(Unknown Source) at org.teiid.dqp.internal.process.RequestWorkItem.processMore(RequestWorkItem.java:514) at org.teiid.dqp.internal.process.RequestWorkItem.process(RequestWorkItem.java:362) at org.teiid.dqp.internal.process.AbstractWorkItem.run(AbstractWorkItem.java:43) at org.teiid.dqp.internal.process.RequestWorkItem.run(RequestWorkItem.java:285) at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:281) at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:113)
> at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:199) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
> {code}
> I tried to reproduce the problem with local MySQL and PostgreSQL but couldn't. The problem can be reproduced only when using remote MySQL and PostgreSQL. On my local machine the error appears with limit more than 200000 rows, on another machines the exception appeared when setting limit 400000 and more. It seems it's related maybe somehow with MySQL timeouts or network delays. If I copy the table from remote MySQL to local PostgeSQL the error doesn't appear, and vice versa, if I copy the table from local MySQL to remote PostgreSQL the error doesn't appear again. I don't have an access to the remote MySQL to have a look at its internal options. I also tried to set net_write_timeout=1800 jdbc property for data source of the remote MySQL, tcpKeepAlive=true, tried to set ThreadBound MySQL translator property to true value - it didn't help at all. What do you think, is it possible to avoid the error on Teiid level?
> I also attached a server log with org.teiid.CONNECTOR and org.teiid.PROCESSOR log outputs.
--
This message was sent by Atlassian Jira
(v7.12.1#712002)
More information about the teiid-issues
mailing list