[JBoss JIRA] (TEIID-5205) Infinispan hotrod translator timeout on UPDATE
by Van Halbert (JIRA)
[ https://issues.jboss.org/browse/TEIID-5205?page=com.atlassian.jira.plugin... ]
Work on TEIID-5205 stopped by Van Halbert.
------------------------------------------
> Infinispan hotrod translator timeout on UPDATE
> ----------------------------------------------
>
> Key: TEIID-5205
> URL: https://issues.jboss.org/browse/TEIID-5205
> Project: Teiid
> Issue Type: Bug
> Components: JDG Connector, Misc. Connectors
> Affects Versions: 8.12.x-6.4
> Reporter: Jan Stastny
> Assignee: Van Halbert
> Priority: Blocker
>
> I encounter timeout issue when performing UPDATE operation using Infinispan Hotrod translator.
> For query
> {code:sql}
> UPDATE SmallA SET IntKey = 100 WHERE StringKey = '1'
> {code}
> with cache filled with:
> {code:sql}
> INSERT INTO SmallA (IntKey, StringKey, IntNum, StringNum, FloatNum, LongNum, DoubleNum, ByteNum, DateValue, TimeValue, TimestampValue, BooleanValue, CharValue, ShortValue, BigIntegerValue, BigDecimalValue, ObjectValue) VALUES
> (1, '1', 1, '1', convert(1.01, float), 1, convert(-1.001, double), convert(1, byte), {d '1111-11-11'}, {t '01:01:01'}, {ts '1111-11-11 01:01:01'}, true, convert('1', char), convert(1, short), 1, 1.01, '1'),
> (2, '2', 2, '2', convert(2.02, float), 2, convert(-2.002, double), convert(2, byte), {d '2222-12-22'}, {t '02:02:02'}, {ts '2222-12-22 02:02:02'}, false, convert('2', char), convert(2, short), 2, 2.02, '2')
> {code}
> results in ARJUNA timeout after 5 minutes:
> {code}
> 14:44:45,068 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a2804a2:45f23ecc:5a54c5e8:f in state RUN
> 14:44:45,070 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012095: Abort of action id 0:ffff0a2804a2:45f23ecc:5a54c5e8:f invoked while multiple threads active within it.
> 14:44:45,071 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012108: CheckedAction::check - atomic action 0:ffff0a2804a2:45f23ecc:5a54c5e8:f aborting with 1 threads active!
> 14:44:45,072 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012121: TransactionReaper::doCancellations worker Thread[Transaction Reaper Worker 0,5,main] successfully canceled TX 0:ffff0a2804a2:45f23ecc:5a54c5e8:f
> {code}
> and the query hangs.
> Interestingly, the changes get promoted to the cache. Just the query doesn't return.
> Command log for the update query:
> {code}
> 14:39:45,304 DEBUG [org.teiid.COMMAND_LOG] (Worker0_QueryProcessorQueue10) yl6LbuQEyWKk START DATA SRC COMMAND: startTime=2018-01-09 14:39:45.304 requestID=yl6LbuQEyWKk.3 sourceCommandID=2 executionID=5 txID=TransactionImple < ac, BasicAction: 0:ffff0a2804a2:45f23ecc:5a54c5e8:f status: ActionStatus.RUNNING > modelName=Source translatorName=infinispan-hotrod sessionID=yl6LbuQEyWKk principal=user@teiid-security sql=UPDATE Source.SmallA SET IntKey = 100, IntNum = 1, StringNum = '1', FloatNum = 1.01, LongNum = 1, DoubleNum = -1.001, ByteNum = 1, DateValue = '1111-11-11', TimeValue = '01:01:01', TimestampValue = '1111-11-11 01:01:01.0', BooleanValue = TRUE, CharValue = '1', ShortValue = 1, BigIntegerValue = '1', BigDecimalValue = '1.01', ObjectValue = '1' WHERE StringKey = '1'
> {code}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
8 years, 2 months
[JBoss JIRA] (TEIID-5203) Google Spreadsheet translator NPE thrown on UPDATE
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-5203?page=com.atlassian.jira.plugin... ]
Steven Hawkins resolved TEIID-5203.
-----------------------------------
Fix Version/s: 10.0.3
8.12.x-6.4
10.1
9.3.6
Resolution: Done
The update logic did not account for sheets that contained extra columns, which are still reported in the metadata as having a null label.
> Google Spreadsheet translator NPE thrown on UPDATE
> --------------------------------------------------
>
> Key: TEIID-5203
> URL: https://issues.jboss.org/browse/TEIID-5203
> Project: Teiid
> Issue Type: Bug
> Components: Misc. Connectors
> Affects Versions: 8.12.x-6.4
> Reporter: Jan Stastny
> Assignee: Steven Hawkins
> Priority: Blocker
> Fix For: 10.0.3, 8.12.x-6.4, 10.1, 9.3.6
>
>
> There is a NPE thrown with UPDATE when there is a matching row (either no criteria or criteria matching at least one row).
> {code:sql}
> UPDATE SmallA SET IntNum=2
> {code}
> {code}
> 15:50:17,006 ERROR [org.teiid.CONNECTOR] (Worker8_QueryProcessorQueue71) Connector worker process failed for atomic-request=llOgHAYB6Yd3.31.2.96: java.lang.NullPointerException
> at com.google.gdata.data.spreadsheet.CustomElementCollection.getValue(CustomElementCollection.java:106) [gdata-spreadsheet-3.0.jar:]
> at org.teiid.resource.adapter.google.gdata.GDataClientLoginAPI.listFeedUpdate(GDataClientLoginAPI.java:175) [google-api-8.12.11.6_4-redhat-64-10.jar:8.12.11.6_4-redhat-64-10]
> at org.teiid.resource.adapter.google.SpreadsheetConnectionImpl.executeListFeedUpdate(SpreadsheetConnectionImpl.java:114)
> at org.teiid.translator.google.SpreadsheetUpdateExecution.executeUpdate(SpreadsheetUpdateExecution.java:76) [translator-google-8.12.11.6_4-redhat-64-10.jar:8.12.11.6_4-redhat-64-10]
> at org.teiid.translator.google.SpreadsheetUpdateExecution.execute(SpreadsheetUpdateExecution.java:67) [translator-google-8.12.11.6_4-redhat-64-10.jar:8.12.11.6_4-redhat-64-10]
> at org.teiid.dqp.internal.datamgr.ConnectorWorkItem$1.execute(ConnectorWorkItem.java:399)
> at org.teiid.dqp.internal.datamgr.ConnectorWorkItem.execute(ConnectorWorkItem.java:361)
> at sun.reflect.GeneratedMethodAccessor209.invoke(Unknown Source) [:1.8.0_151]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_151]
> at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_151]
> at org.teiid.dqp.internal.datamgr.ConnectorManager$1.invoke(ConnectorManager.java:211)
> at com.sun.proxy.$Proxy79.execute(Unknown Source)
> at org.teiid.dqp.internal.process.DataTierTupleSource.getResults(DataTierTupleSource.java:306)
> at org.teiid.dqp.internal.process.DataTierTupleSource.nextTuple(DataTierTupleSource.java:142)
> at org.teiid.query.processor.relational.AccessNode.nextBatchDirect(AccessNode.java:391)
> at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:281)
> at org.teiid.query.processor.relational.RelationalPlan.nextBatch(RelationalPlan.java:145)
> at org.teiid.query.processor.QueryProcessor.nextBatchDirect(QueryProcessor.java:151)
> at org.teiid.query.processor.QueryProcessor.nextBatch(QueryProcessor.java:114)
> at org.teiid.query.processor.BatchIterator.finalRow(BatchIterator.java:69)
> at org.teiid.common.buffer.AbstractTupleSource.getCurrentTuple(AbstractTupleSource.java:70)
> at org.teiid.query.processor.BatchIterator.getCurrentTuple(BatchIterator.java:84)
> at org.teiid.common.buffer.AbstractTupleSource.hasNext(AbstractTupleSource.java:92)
> at org.teiid.query.processor.proc.ProcedurePlan.executePlan(ProcedurePlan.java:616)
> at org.teiid.query.processor.proc.CreateCursorResultSetInstruction.process(CreateCursorResultSetInstruction.java:69)
> at org.teiid.query.processor.proc.ProcedurePlan.processProcedure(ProcedurePlan.java:389)
> at org.teiid.query.processor.proc.ProcedurePlan.nextBatchDirect(ProcedurePlan.java:298)
> at org.teiid.query.processor.proc.ProcedurePlan.nextBatch(ProcedurePlan.java:270)
> at org.teiid.query.processor.QueryProcessor.nextBatchDirect(QueryProcessor.java:151)
> at org.teiid.query.processor.QueryProcessor.nextBatch(QueryProcessor.java:114)
> at org.teiid.query.processor.proc.ForEachRowPlan.nextBatch(ForEachRowPlan.java:147)
> at org.teiid.query.processor.relational.PlanExecutionNode.nextBatchDirect(PlanExecutionNode.java:118)
> at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:281)
> at org.teiid.query.processor.relational.ProjectNode.nextBatchDirect(ProjectNode.java:150)
> at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:281)
> at org.teiid.query.processor.relational.RelationalPlan.nextBatch(RelationalPlan.java:145)
> at org.teiid.query.processor.QueryProcessor.nextBatchDirect(QueryProcessor.java:151)
> at org.teiid.query.processor.QueryProcessor.nextBatch(QueryProcessor.java:114)
> at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:164)
> at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:146)
> at org.teiid.dqp.internal.process.RequestWorkItem.processMore(RequestWorkItem.java:472)
> at org.teiid.dqp.internal.process.RequestWorkItem.process(RequestWorkItem.java:348)
> at org.teiid.dqp.internal.process.AbstractWorkItem.run(AbstractWorkItem.java:51)
> at org.teiid.dqp.internal.process.RequestWorkItem.run(RequestWorkItem.java:274)
> at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:284)
> at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:119)
> at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:210)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_151]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_151]
> at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_151]
> 15:50:17,011 WARN [org.teiid.PROCESSOR] (Worker8_QueryProcessorQueue71) TEIID30020 Processing exception for request llOgHAYB6Yd3.31 'TEIID30504 Source: null'. Originally TeiidProcessingException CustomElementCollection.java:106. Enable more detailed logging to see the entire stacktrace.
> {code}
> COMMAND LOG:
> {code}
> 15:53:50,025 INFO [org.teiid.COMMAND_LOG] (New I/O worker #1) llOgHAYB6Yd3 START USER COMMAND: startTime=2018-01-05 15:53:50.025 requestID=llOgHAYB6Yd3.33 txID=null sessionID=llOgHAYB6Yd3 applicationName=JDBC principal=user@teiid-security vdbName=googlespreadsheetcrud vdbVersion=1 sql=UPDATE SmallA SET IntNum=2
> 15:53:50,033 DEBUG [org.teiid.COMMAND_LOG] (Worker9_QueryProcessorQueue76) llOgHAYB6Yd3 START DATA SRC COMMAND: startTime=2018-01-05 15:53:50.033 requestID=llOgHAYB6Yd3.33 sourceCommandID=1 executionID=98 txID=TransactionImple < ac, BasicAction: 0:ffff7f000001:63850a7c:5a4f89f7:80 status: ActionStatus.RUNNING > modelName=Source translatorName=google-spreadsheet sessionID=llOgHAYB6Yd3 principal=user@teiid-security sql=SELECT Source.smalla.intkey, Source.smalla.stringkey, Source.smalla.intnum, Source.smalla.stringnum, Source.smalla.floatnum, Source.smalla.longnum, Source.smalla.doublenum, Source.smalla.bytenum, Source.smalla.datevalue, Source.smalla.timevalue, Source.smalla.timestampvalue, Source.smalla.booleanvalue, Source.smalla.charvalue, Source.smalla.shortvalue, Source.smalla.bigintegervalue, Source.smalla.bigdecimalvalue, Source.smalla.objectvalue FROM Source.smalla
> 15:53:51,128 DEBUG [org.teiid.COMMAND_LOG] (Worker9_QueryProcessorQueue76) llOgHAYB6Yd3 END SRC COMMAND: endTime=2018-01-05 15:53:51.128 requestID=llOgHAYB6Yd3.33 sourceCommandID=1 executionID=98 txID=TransactionImple < ac, BasicAction: 0:ffff7f000001:63850a7c:5a4f89f7:80 status: ActionStatus.RUNNING > modelName=Source translatorName=google-spreadsheet sessionID=llOgHAYB6Yd3 principal=user@teiid-security finalRowCount=30 cpuTime(ns)=37690048
> 15:53:51,129 DEBUG [org.teiid.COMMAND_LOG] (Worker9_QueryProcessorQueue76) llOgHAYB6Yd3 START DATA SRC COMMAND: startTime=2018-01-05 15:53:51.129 requestID=llOgHAYB6Yd3.33 sourceCommandID=2 executionID=99 txID=TransactionImple < ac, BasicAction: 0:ffff7f000001:63850a7c:5a4f89f7:80 status: ActionStatus.RUNNING > modelName=Source translatorName=google-spreadsheet sessionID=llOgHAYB6Yd3 principal=user@teiid-security sql=UPDATE Source.smalla SET intkey = 2, stringkey = '2', intnum = 2, stringnum = '812376', floatnum = -27810.0, longnum = 9, doublenum = -1349305.33, bytenum = -121, datevalue = {d'2012-01-26'}, timevalue = null, timestampvalue = null, booleanvalue = FALSE, charvalue = '5', shortvalue = 13825, bigintegervalue = 27147783, bigdecimalvalue = 1703662.0300000, objectvalue = '-106.0' WHERE intkey = 2
> 15:53:51,740 DEBUG [org.teiid.COMMAND_LOG] (Worker9_QueryProcessorQueue76) llOgHAYB6Yd3 ERROR SRC COMMAND: endTime=2018-01-05 15:53:51.74 requestID=llOgHAYB6Yd3.33 sourceCommandID=2 executionID=99 txID=TransactionImple < ac, BasicAction: 0:ffff7f000001:63850a7c:5a4f89f7:80 status: ActionStatus.RUNNING > modelName=Source translatorName=google-spreadsheet sessionID=llOgHAYB6Yd3 principal=user@teiid-security
> 15:53:51,746 DEBUG [org.teiid.COMMAND_LOG] (Worker9_QueryProcessorQueue76) llOgHAYB6Yd3 END SRC COMMAND: endTime=2018-01-05 15:53:51.746 requestID=llOgHAYB6Yd3.33 sourceCommandID=2 executionID=99 txID=TransactionImple < ac, BasicAction: 0:ffff7f000001:63850a7c:5a4f89f7:80 status: ActionStatus.RUNNING > modelName=Source translatorName=google-spreadsheet sessionID=llOgHAYB6Yd3 principal=user@teiid-security finalRowCount=0 cpuTime(ns)=13526883
> 15:53:51,746 INFO [org.teiid.COMMAND_LOG] (Worker9_QueryProcessorQueue76) llOgHAYB6Yd3 ERROR USER COMMAND: endTime=2018-01-05 15:53:51.746 requestID=llOgHAYB6Yd3.33 txID=TransactionImple < ac, BasicAction: 0:ffff7f000001:63850a7c:5a4f89f7:80 status: ActionStatus.RUNNING > sessionID=llOgHAYB6Yd3 principal=user@teiid-security vdbName=googlespreadsheetcrud vdbVersion=1 finalRowCount=null
> 15:53:51,747 INFO [org.teiid.COMMAND_LOG] (Worker9_QueryProcessorQueue76) llOgHAYB6Yd3 END USER COMMAND: endTime=2018-01-05 15:53:51.747 requestID=llOgHAYB6Yd3.33 txID=null sessionID=llOgHAYB6Yd3 principal=user@teiid-security vdbName=googlespreadsheetcrud vdbVersion=1 finalRowCount=0
> {code}
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
8 years, 2 months
[JBoss JIRA] (TEIID-5206) Allow exponential values in OData V4 payloads with decimals
by Ramesh Reddy (JIRA)
[ https://issues.jboss.org/browse/TEIID-5206?page=com.atlassian.jira.plugin... ]
Ramesh Reddy commented on TEIID-5206:
-------------------------------------
Test with
{code}
~~~
1. Create table in mysql
create table test_tbl( \
id INT(10) NOT NULL AUTO_INCREMENT, \
title VARCHAR(100) NOT NULL, \
author VARCHAR(40) NOT NULL, \
price DECIMAL(15,4) NOT NULL, \
submission_date DATE, \
PRIMARY KEY ( id ) \
);
2. Create datasource
<datasource jndi-name="java:/guest_mysql5_DS" pool-name="guest_mysql5_DS" enabled="true">
<connection-url>jdbc:mysql://localhost:3306/test?sessionVariables=sql_mode=ANSI</connection-url>
<driver>mysql</driver>
<security>
<user-name>guest</user-name>
<password>welcome1</password>
</security>
</datasource>
3. Create dynamic VDB, the "price" column is "Big Decimal"
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<vdb name="Test" version="2">
<description/>
<model name="test">
<property name="importer.TableTypes" value="TABLE" />
<property name="importer.UseQualifiedName" value="false" />
<source connection-jndi-name="java:/guest_mysql5_DS" name="test" translator-name="mysql5"/>
</model>
</vdb>
4. Using restful interface to add/update value, the validation error was thrown, please check the log attached.
HttpAuthenticationFeature auth = HttpAuthenticationFeature.basic("teiidUser", "Redhat!23");
Client client = ClientBuilder.newBuilder()
.register(auth)
.build();
WebTarget target = client.target(getBaseURI());
// MySQL get test
// String restGetResp =
// target.path("Test").path("test").path("test_tbl")
// .request().accept(MediaType.APPLICATION_JSON).get()
// .readEntity(String.class);
// System.out.println(restGetResp);
// MySQL post test
String entity =
"{\"id\":3,\"title\":\"title 3\",\"author\":\"author 3\",\"price\":99999999.99,\"submission_date\":\"2017-12-08\"}";
String restPostResp =
target.path("Test").path("test").path("test_tbl")
.request(MediaType.APPLICATION_JSON).post(Entity.entity(entity, MediaType.APPLICATION_JSON))
.readEntity(String.class);
System.out.println(restPostResp);
{code}
> Allow exponential values in OData V4 payloads with decimals
> -----------------------------------------------------------
>
> Key: TEIID-5206
> URL: https://issues.jboss.org/browse/TEIID-5206
> Project: Teiid
> Issue Type: Bug
> Components: OData
> Affects Versions: 8.12
> Reporter: Ramesh Reddy
> Assignee: Ramesh Reddy
> Fix For: 10.x
>
>
> This is link to the upstream Olingo issue https://issues.apache.org/jira/browse/OLINGO-1150
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
8 years, 2 months