[teiid-issues] [JBoss JIRA] (TEIID-5265) AssertionError: Batch not found in storage

Bram Gadeyne (JIRA) issues at jboss.org
Thu Apr 12 07:20:01 EDT 2018


    [ https://issues.jboss.org/browse/TEIID-5265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560084#comment-13560084 ] 

Bram Gadeyne edited comment on TEIID-5265 at 4/12/18 7:19 AM:
--------------------------------------------------------------

[~shawkins],

Should this have also been fixed in 10.1.2 because I've encountered a similar exception now.

2018-04-12 13:09:10,310 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,939,978.  It is a Batch of 247 rows of [Ljava.lang.String;@66b75174. The estimated size was 109,190, but the actual size was 7,207. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,317 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,940,013.  It is a Batch of 230 rows of [Ljava.lang.String;@66b75174. The estimated size was 99,248, but the actual size was 7,207. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,336 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,940,225.  It is a Batch of 131 rows of [Ljava.lang.String;@66b75174. The estimated size was 57,866, but the actual size was 4,120. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,346 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,940,343.  It is a Batch of 189 rows of [Ljava.lang.String;@66b75174. The estimated size was 82,600, but the actual size was 5,149. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,367 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,940,550.  It is a Batch of 221 rows of [Ljava.lang.String;@66b75174. The estimated size was 96,816, but the actual size was 6,178. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,389 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,940,797.  It is a Batch of 144 rows of [Ljava.lang.String;@66b75174. The estimated size was 63,079, but the actual size was 4,120. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,395 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,940,863.  It is a Batch of 158 rows of [Ljava.lang.String;@66b75174. The estimated size was 69,410, but the actual size was 4,120. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,396 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,940,883.  It is a Batch of 141 rows of [Ljava.lang.String;@66b75174. The estimated size was 61,476, but the actual size was 4,120. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,402 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,940,955.  It is a Batch of 167 rows of [Ljava.lang.String;@66b75174. The estimated size was 66,744, but the actual size was 5,149. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,406 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,941,002.  It is a Batch of 198 rows of [Ljava.lang.String;@66b75174. The estimated size was 82,736, but the actual size was 6,178. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,416 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,941,115.  It is a Batch of 151 rows of [Ljava.lang.String;@66b75174. The estimated size was 66,607, but the actual size was 4,120. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:10,424 ERROR [org.teiid.BUFFER_MGR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30001 Max block number exceeded by object 2,130 from group 1,941,210.  It is a Batch of 170 rows of [Ljava.lang.String;@66b75174. The estimated size was 72,781, but the actual size was 5,149. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
2018-04-12 13:09:11,899 INFO  [org.teiid.COMMAND_LOG] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE         ERROR USER COMMAND:     endTime=2018-04-12 13:09:11.899      requestID=79SKbczz2pkE.25       txID=Local transaction (delegate=TransactionImple < ac, BasicAction: 0:ffff7f000101:-4f775f74:5acdc46b:2308 status: ActionStatus.RUNNING >, owner=Local transaction context for provider JBoss JTA transaction provider)     sessionID=79SKbczz2pkE  principal=bram  vdbName=vdb  vdbVersion=1.0.3        finalRowCount=null
2018-04-12 13:09:11,899 ERROR [org.teiid.PROCESSOR] (Worker104_QueryProcessorQueue18940) 79SKbczz2pkE TEIID30019 Unexpected exception for request 79SKbczz2pkE.25: java.lang.AssertionError: Batch not found in storage 1940013
        at org.teiid.common.buffer.impl.BufferManagerImpl$BatchManagerImpl.getBatch(BufferManagerImpl.java:382)
        at org.teiid.common.buffer.SPage.getValues(SPage.java:234)
        at org.teiid.common.buffer.SPage.search(SPage.java:135)
        at org.teiid.common.buffer.STree.find(STree.java:247)
        at org.teiid.common.buffer.STree.find(STree.java:274)
        at org.teiid.query.processor.relational.GroupingNode.groupSortPhase(GroupingNode.java:504)
        at org.teiid.query.processor.relational.GroupingNode.nextBatchDirect(GroupingNode.java:379)
        at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
        at org.teiid.query.processor.relational.SelectNode.nextBatchDirect(SelectNode.java:100)
        at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
        at org.teiid.query.processor.relational.ProjectNode.nextBatchDirect(ProjectNode.java:146)
        at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
        at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:160)
        at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:142)
        at org.teiid.query.processor.relational.SourceState.getTupleBuffer(SourceState.java:244)
        at org.teiid.query.processor.relational.EnhancedSortMergeJoinStrategy.loadLeft(EnhancedSortMergeJoinStrategy.java:227)
        at org.teiid.query.processor.relational.JoinNode.nextBatchDirectInternal(JoinNode.java:228)
        at org.teiid.query.processor.relational.JoinNode.nextBatchDirect(JoinNode.java:200)
        at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
        at org.teiid.query.processor.relational.ProjectNode.nextBatchDirect(ProjectNode.java:146)
        at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
        at org.teiid.query.processor.relational.ProjectIntoNode.nextBatchDirect(ProjectIntoNode.java:140)
        at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
        at org.teiid.query.processor.relational.RelationalPlan.nextBatch(RelationalPlan.java:141)
        at org.teiid.query.processor.QueryProcessor.nextBatchDirect(QueryProcessor.java:148)
        at org.teiid.query.processor.QueryProcessor.nextBatch(QueryProcessor.java:111)
        at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:160)
        at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:142)
        at org.teiid.dqp.internal.process.RequestWorkItem.processMore(RequestWorkItem.java:480)
        at org.teiid.dqp.internal.process.RequestWorkItem.process(RequestWorkItem.java:350)
        at org.teiid.dqp.internal.process.AbstractWorkItem.run(AbstractWorkItem.java:47)
        at org.teiid.dqp.internal.process.RequestWorkItem.run(RequestWorkItem.java:276)
        at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:280)
        at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:115)
        at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:206)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)


was (Author: gadeyne.bram):
[~shawkins],

Should this have also been fixed in 10.1.2 because I've encountered a similar exception now.

> AssertionError: Batch not found in storage
> ------------------------------------------
>
>                 Key: TEIID-5265
>                 URL: https://issues.jboss.org/browse/TEIID-5265
>             Project: Teiid
>          Issue Type: Bug
>          Components: Query Engine
>    Affects Versions: 10.1
>            Reporter: Bram Gadeyne
>            Assignee: Steven Hawkins
>             Fix For: 10.2
>
>
> While executing the following query:
> {code:sql}
> insert into rep149_cci(PatientID,age,Orig,Upd,agepointsO,agepointsU,AMI,CHF,PVD,CVD,DEM,CPD,PUD,MLD,SLD,DNC,DWC,HEM,RED,MAL,MST,HIV)
> select cci.patientid as patientid,cci.age as age,cci.orig as orig,cci.upd as upd,cci.agepointso as agepointso,cci.agepointsu as agepointsu,
> 	cci.charlson_ami as ami,cci.charlson_chf as chf,cci.charlson_pvd as pvd,cci.charlson_cvd as cvd,cci.charlson_dem as dem,cci.charlson_cpd as cpd,cci.charlson_pud as pud,
> 	cci.charlson_mld as mld,cci.charlson_sld as sld,cci.charlson_dnc as dnc,cci.charlson_dwc as dwc,cci.charlson_hem as hem,cci.charlson_red as red,cci.charlson_mal as mal,
> 	cci.charlson_mst as mst,cci.charlson_hiv as hiv
> from rep149_cohort gd
> join izisviews.pr_calculate_cci cci on
>  cci.patientid_in = gd.patientid;
> {code}
> rep149_cci is defined as
> {code:sql}
> create foreign temporary table rep149_cci(
> 	PatientID	integer not null,
> 	age	bigdecimal,
> 	Orig	long,
> 	Upd	long,
> 	agepointsO	integer,
> 	agepointsU	integer,
> 	AMI	integer,
> 	CHF	integer,
> 	PVD	integer,
> 	CVD	integer,
> 	DEM	integer,
> 	CPD	integer,
> 	PUD	integer,
> 	MLD	integer,
> 	SLD	integer,
> 	DNC	integer,
> 	DWC	integer,
> 	HEM	integer,
> 	RED	integer,
> 	MAL	integer,
> 	MST	integer,
> 	HIV	integer,
> 	primary key(patientid)
> )OPTIONS (UPDATABLE true) on tmptables;
> {code}
> pr_calculate_cci  is a virtual procedure. (I can't however share this code for confidentiality reasons).
> {code:sql}
> CREATE VIRTUAL PROCEDURE pr_calculate_cci(patientid_in integer)
> RETURNS (
> 	PatientID		integer,
> 	age				bigdecimal,
> 	Orig			long,
> 	Upd				long,
> 	agepointsO		integer,
> 	agepointsU		integer,
> 	AMI				integer,
> 	CHF				integer,
> 	PherVascDis		integer,
> 	CerebVascDis	integer,
> 	Dement			integer,
> 	ChrPulmDis		integer,
> 	PeptUlcer		integer,
> 	MildLivDis		integer,
> 	SevLivDis		integer,
> 	DiabetesNoCompl	integer,
> 	DiabetesWithCompl	integer,
> 	HemiPara		integer,
> 	RenalDis		integer,
> 	Malign			integer,
> 	Metastase		integer,
> 	HIV_AIDS		integer
> )
> AS
> BEGIN
> ...
> END
> {code}
> There are a few error reports like this one:
> 2018-02-23 08:33:05,478 ERROR [org.teiid.BUFFER_MGR] (Worker291_QueryProcessorQueue571476) mh0bsTIbs7qY TEIID30001 Max block number exceeded by object 1,366,497 from group 5,068,016.  It is a Batch of 1797 rows of [Ljava.lang.String;@10953478. The estimated size was 172,528, but the actual size was 14,410. Increase the maxStorageObjectSize to support larger storage objects.  Alternatively you could make the processor batch size smaller.
> The final stack trace is:
> 2018-02-23 08:33:05,539 ERROR [org.teiid.PROCESSOR] (Worker291_QueryProcessorQueue571476) mh0bsTIbs7qY TEIID30019 Unexpected exception for request mh0bsTIbs7qY.90: java.lang.AssertionError: Batch not found in storage 5067771
>         at org.teiid.common.buffer.impl.BufferManagerImpl$BatchManagerImpl.getBatch(BufferManagerImpl.java:382)
>         at org.teiid.common.buffer.SPage.getValues(SPage.java:234)
>         at org.teiid.common.buffer.SPage.search(SPage.java:135)
>         at org.teiid.common.buffer.STree.find(STree.java:247)
>         at org.teiid.common.buffer.STree.insert(STree.java:295)
>         at org.teiid.query.processor.relational.WindowFunctionProjectNode.saveValues(WindowFunctionProjectNode.java:419)
>         at org.teiid.query.processor.relational.WindowFunctionProjectNode.buildResults(WindowFunctionProjectNode.java:380)
>         at org.teiid.query.processor.relational.WindowFunctionProjectNode.nextBatchDirect(WindowFunctionProjectNode.java:229)
>         at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
>         at org.teiid.query.processor.relational.ProjectNode.nextBatchDirect(ProjectNode.java:146)
>         at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
>         at org.teiid.query.processor.relational.UnionAllNode.nextBatchDirectInternal(UnionAllNode.java:165)
>         at org.teiid.query.processor.relational.UnionAllNode.nextBatchDirect(UnionAllNode.java:138)
>         at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
>         at org.teiid.query.processor.relational.SelectNode.nextBatchDirect(SelectNode.java:100)
>         at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
>         at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:160)
>         at org.teiid.query.processor.relational.SourceState.prefetch(SourceState.java:207)
>         at org.teiid.query.processor.relational.SourceState.rowCountLE(SourceState.java:154)



--
This message was sent by Atlassian JIRA
(v7.5.0#75005)


More information about the teiid-issues mailing list