[JBoss JIRA] (TEIID-5963) Teiid imported all schemas from PG
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5963?page=com.atlassian.jira.plugi... ]
Steven Hawkins commented on TEIID-5963:
---------------------------------------
That is coming from the pg driver call for DatabaseMetaData.getTypeInfo() - that takes no schema qualification. This is specifically the type information, not all of the metadata in the database. Is it that call specifically that is taking a long time? All of the table/procedure metadata will be schema restricted based upon what you are showing above.
> Teiid imported all schemas from PG
> ----------------------------------
>
> Key: TEIID-5963
> URL: https://issues.redhat.com/browse/TEIID-5963
> Project: Teiid
> Issue Type: Bug
> Components: JDBC Connector
> Affects Versions: 14.0
> Reporter: Renat Eskenin
> Assignee: Steven Hawkins
> Priority: Major
>
> When we started teiid spring boot app, we have long start time.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years
[JBoss JIRA] (TEIID-5965) Allow variables to be used as TextTable delimeters, row delimeters, quote, header, skip rows, and escape characters
by Dmitrii Pogorelov (Jira)
Dmitrii Pogorelov created TEIID-5965:
----------------------------------------
Summary: Allow variables to be used as TextTable delimeters, row delimeters, quote, header, skip rows, and escape characters
Key: TEIID-5965
URL: https://issues.redhat.com/browse/TEIID-5965
Project: Teiid
Issue Type: Enhancement
Components: Query Engine
Affects Versions: 13.1
Reporter: Dmitrii Pogorelov
Assignee: Steven Hawkins
In the specified example, the delimiter is TAB. Many web APIs allow customization of the delimiter character, and in order to provide a generic parser, sometimes it is way easier to define a delimiter as a variable, and not need to create a long nested structure with IF-THEN-ELSE-IF-ELSE constructs:
{code:sql}
Select * From TextTable (
'c1 c2
1 2'
Columns
c1 integer,
c2 integer
Delimiter E'\t'
Header 1
)x;
{code}
Imagine that based on setup on API side (out of our control) the content can be delivered via tab or semicolon, e.g.
{code}
c1;c2
1;2
{code}
or
{code}
c1 c2
1 2
{code}
Let's save this response into a variable and see the code, which we will need to write depending on the setup:
{code:sql}
Begin
...
If (delimiter = 'tab')
Begin
Select * From TextTable (
apiResponse
Columns
c1 integer,
c2 integer
Delimiter E'\t'
Header 1
)x;
End
Else If (delimiter = 'tab')
Begin
Select * From TextTable (
apiResponse
Columns
c1 integer,
c2 integer
Delimiter ';'
Header 1
)x;
End
End
{code}
The if-else block is constantly growing, especially if we want to customize quote, escape, delimiter, and row delimiter.
Thus it would be great if we could make these values configurable. In this case, we could end up with this expected code, which is more readable and more easily customizable:
{code:sql}
Begin
...
Declare string delimiter = E'\t';
Select * From TextTable (
apiResponse
Columns
c1 integer,
c2 integer
Delimiter delimiter
Header 1
)x;
End
{code}
With a bit of tweaking and certain assumptions, leading in the trust level, we can even read the first line and try to auto-detect the delimiter automatically (e.g. by counting tabs, commas, and semicolons in the first line).
Please, could you be so kind as to make HEADER and SKIP values customizable (rather than hardcoded numbers)?
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years
[JBoss JIRA] (TEIID-5963) Teiid imported all schemas from PG
by Renat Eskenin (Jira)
[ https://issues.redhat.com/browse/TEIID-5963?page=com.atlassian.jira.plugi... ]
Renat Eskenin edited comment on TEIID-5963 at 6/2/20 4:21 AM:
--------------------------------------------------------------
This SQL get all metadata from DB:
{code}
select
t.typname,
t.oid
from
pg_catalog.pg_type t
join pg_catalog.pg_namespace n on
(t.typnamespace = n.oid)
where
n.nspname != 'pg_toast'
and (t.typrelid = 0
or (
select
c.relkind = 'c'
from
pg_catalog.pg_class c
where
c.oid = t.typrelid))
{code}
We get all tausents of types from all schemas.
was (Author: i3draven):
This SQL get all metadata from DB:
{code}
select
t.typname,
t.oid
from
pg_catalog.pg_type t
join pg_catalog.pg_namespace n on
(t.typnamespace = n.oid)
where
n.nspname != 'pg_toast'
and (t.typrelid = 0
or (
select
c.relkind = 'c'
from
pg_catalog.pg_class c
where
c.oid = t.typrelid))
{code}
> Teiid imported all schemas from PG
> ----------------------------------
>
> Key: TEIID-5963
> URL: https://issues.redhat.com/browse/TEIID-5963
> Project: Teiid
> Issue Type: Bug
> Components: JDBC Connector
> Affects Versions: 14.0
> Reporter: Renat Eskenin
> Assignee: Steven Hawkins
> Priority: Major
>
> When we started teiid spring boot app, we have long start time.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years
[JBoss JIRA] (TEIID-5963) Teiid imported all schemas from PG
by Renat Eskenin (Jira)
[ https://issues.redhat.com/browse/TEIID-5963?page=com.atlassian.jira.plugi... ]
Renat Eskenin commented on TEIID-5963:
--------------------------------------
This SQL get all metadata from DB:
{code}
select
t.typname,
t.oid
from
pg_catalog.pg_type t
join pg_catalog.pg_namespace n on
(t.typnamespace = n.oid)
where
n.nspname != 'pg_toast'
and (t.typrelid = 0
or (
select
c.relkind = 'c'
from
pg_catalog.pg_class c
where
c.oid = t.typrelid))
{code}
> Teiid imported all schemas from PG
> ----------------------------------
>
> Key: TEIID-5963
> URL: https://issues.redhat.com/browse/TEIID-5963
> Project: Teiid
> Issue Type: Bug
> Components: JDBC Connector
> Affects Versions: 14.0
> Reporter: Renat Eskenin
> Assignee: Steven Hawkins
> Priority: Major
>
> When we started teiid spring boot app, we have long start time.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years
[JBoss JIRA] (TEIID-5963) Teiid imported all schemas from PG
by Renat Eskenin (Jira)
[ https://issues.redhat.com/browse/TEIID-5963?page=com.atlassian.jira.plugi... ]
Renat Eskenin edited comment on TEIID-5963 at 6/2/20 4:11 AM:
--------------------------------------------------------------
I get logs from start of loading metdata
{code}
CREATE SCHEMA schpostgresql ;
HikariPool-1 - Starting...
Loading driver configuration via classloader sun.misc.Launcher$AppClassLoader@764c12b6
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
FE=> SSLRequest
<=BE SSLOk
converting regular socket connection to ssl
Receive Buffer Size is 65 536
Send Buffer Size is 34 560
FE=> StartupPacket(user=esb, database=dwh, client_encoding=UTF8, DateStyle=ISO, TimeZone=Europe/Prague, extra_float_digits=2)
<=BE AuthenticationReqMD5(salt=)
FE=> Password(md5digest=)
<=BE AuthenticationOk
<=BE ParameterStatus(application_name = )
<=BE ParameterStatus(client_encoding = UTF8)
<=BE ParameterStatus(DateStyle = ISO, MDY)
<=BE ParameterStatus(integer_datetimes = on)
<=BE ParameterStatus(IntervalStyle = postgres)
<=BE ParameterStatus(is_superuser = off)
<=BE ParameterStatus(server_encoding = UTF8)
<=BE ParameterStatus(server_version = 11.1)
<=BE ParameterStatus(session_authorization = )
<=BE ParameterStatus(standard_conforming_strings = on)
<=BE ParameterStatus(TimeZone = Europe/Prague)
<=BE BackendKeyData(pid=27 472,ckey=-1 415 578 489)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@c474a29, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET extra_float_digits = 3",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@139d160c, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET application_name = 'PostgreSQL JDBC Driver'",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE ParameterStatus(application_name = PostgreSQL JDBC Driver)
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
types using binary send = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
types using binary receive = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,DATE,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
integer date/time = true
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@15cbf325, maxRows=0, fetchSize=0, flags=21
FE=> Parse(stmt=null,query="",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE NoData
<=BE EmptyQuery
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@52e605bb, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SHOW TRANSACTION ISOLATION LEVEL",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(1)
Field(transaction_isolation,TEXT,65535,T)
<=BE DataRow(len=14)
<=BE CommandStatus(SHOW)
<=BE ReadyForQuery(I)
1
HikariPool-1 - Start completed.
PostgreSQLExecutionFactory Commit=true;DatabaseProductName=PostgreSQL;DatabaseProductVersion=11.1;DriverMajorVersion=42;DriverMajorVersion=2;DriverName=PostgreSQL JDBC Driver;DriverVersion=42.2.6;IsolationLevel=2
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@1116c4d1, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SELECT t.typname,t.oid FROM pg_catalog.pg_type t JOIN pg_catalog.pg_namespace n ON (t.typnamespace = n.oid) WHERE n.nspname != 'pg_toast' AND (t.typrelid = 0 OR (SELECT c.relkind = 'c' FROM pg_catalog.pg_class c WHERE c.oid = t.typrelid))",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(2)
Field(typname,NAME,64,T)
Field(oid,OID,4,T)
<=BE DataRow(len=6)
<=BE DataRow(len=7)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=12)
<=BE DataRow(len=6)
<=BE DataRow(len=9)
<=BE DataRow(len=6)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
{code}
was (Author: i3draven):
I get logs from start of loading metdata
{code}
CREATE SCHEMA schpostgresql ;
HikariPool-1 - Starting...
Loading driver configuration via classloader sun.misc.Launcher$AppClassLoader@764c12b6
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
FE=> SSLRequest
<=BE SSLOk
converting regular socket connection to ssl
Receive Buffer Size is 65 536
Send Buffer Size is 34 560
FE=> StartupPacket(user=esb, database=dwh, client_encoding=UTF8, DateStyle=ISO, TimeZone=Europe/Prague, extra_float_digits=2)
<=BE AuthenticationReqMD5(salt=9ab5a23a)
FE=> Password(md5digest=)
<=BE AuthenticationOk
<=BE ParameterStatus(application_name = )
<=BE ParameterStatus(client_encoding = UTF8)
<=BE ParameterStatus(DateStyle = ISO, MDY)
<=BE ParameterStatus(integer_datetimes = on)
<=BE ParameterStatus(IntervalStyle = postgres)
<=BE ParameterStatus(is_superuser = off)
<=BE ParameterStatus(server_encoding = UTF8)
<=BE ParameterStatus(server_version = 11.1)
<=BE ParameterStatus(session_authorization = )
<=BE ParameterStatus(standard_conforming_strings = on)
<=BE ParameterStatus(TimeZone = Europe/Prague)
<=BE BackendKeyData(pid=27 472,ckey=-1 415 578 489)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@c474a29, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET extra_float_digits = 3",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@139d160c, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET application_name = 'PostgreSQL JDBC Driver'",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE ParameterStatus(application_name = PostgreSQL JDBC Driver)
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
types using binary send = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
types using binary receive = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,DATE,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
integer date/time = true
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@15cbf325, maxRows=0, fetchSize=0, flags=21
FE=> Parse(stmt=null,query="",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE NoData
<=BE EmptyQuery
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@52e605bb, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SHOW TRANSACTION ISOLATION LEVEL",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(1)
Field(transaction_isolation,TEXT,65535,T)
<=BE DataRow(len=14)
<=BE CommandStatus(SHOW)
<=BE ReadyForQuery(I)
1
HikariPool-1 - Start completed.
PostgreSQLExecutionFactory Commit=true;DatabaseProductName=PostgreSQL;DatabaseProductVersion=11.1;DriverMajorVersion=42;DriverMajorVersion=2;DriverName=PostgreSQL JDBC Driver;DriverVersion=42.2.6;IsolationLevel=2
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@1116c4d1, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SELECT t.typname,t.oid FROM pg_catalog.pg_type t JOIN pg_catalog.pg_namespace n ON (t.typnamespace = n.oid) WHERE n.nspname != 'pg_toast' AND (t.typrelid = 0 OR (SELECT c.relkind = 'c' FROM pg_catalog.pg_class c WHERE c.oid = t.typrelid))",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(2)
Field(typname,NAME,64,T)
Field(oid,OID,4,T)
<=BE DataRow(len=6)
<=BE DataRow(len=7)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=12)
<=BE DataRow(len=6)
<=BE DataRow(len=9)
<=BE DataRow(len=6)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
{code}
> Teiid imported all schemas from PG
> ----------------------------------
>
> Key: TEIID-5963
> URL: https://issues.redhat.com/browse/TEIID-5963
> Project: Teiid
> Issue Type: Bug
> Components: JDBC Connector
> Affects Versions: 14.0
> Reporter: Renat Eskenin
> Assignee: Steven Hawkins
> Priority: Major
>
> When we started teiid spring boot app, we have long start time.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years
[JBoss JIRA] (TEIID-5963) Teiid imported all schemas from PG
by Renat Eskenin (Jira)
[ https://issues.redhat.com/browse/TEIID-5963?page=com.atlassian.jira.plugi... ]
Renat Eskenin edited comment on TEIID-5963 at 6/2/20 4:10 AM:
--------------------------------------------------------------
I get logs from start of loading metdata
{code}
CREATE SCHEMA schpostgresql ;
HikariPool-1 - Starting...
Loading driver configuration via classloader sun.misc.Launcher$AppClassLoader@764c12b6
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
FE=> SSLRequest
<=BE SSLOk
converting regular socket connection to ssl
Receive Buffer Size is 65 536
Send Buffer Size is 34 560
FE=> StartupPacket(user=esb, database=dwh, client_encoding=UTF8, DateStyle=ISO, TimeZone=Europe/Prague, extra_float_digits=2)
<=BE AuthenticationReqMD5(salt=9ab5a23a)
FE=> Password(md5digest=)
<=BE AuthenticationOk
<=BE ParameterStatus(application_name = )
<=BE ParameterStatus(client_encoding = UTF8)
<=BE ParameterStatus(DateStyle = ISO, MDY)
<=BE ParameterStatus(integer_datetimes = on)
<=BE ParameterStatus(IntervalStyle = postgres)
<=BE ParameterStatus(is_superuser = off)
<=BE ParameterStatus(server_encoding = UTF8)
<=BE ParameterStatus(server_version = 11.1)
<=BE ParameterStatus(session_authorization = )
<=BE ParameterStatus(standard_conforming_strings = on)
<=BE ParameterStatus(TimeZone = Europe/Prague)
<=BE BackendKeyData(pid=27 472,ckey=-1 415 578 489)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@c474a29, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET extra_float_digits = 3",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@139d160c, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET application_name = 'PostgreSQL JDBC Driver'",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE ParameterStatus(application_name = PostgreSQL JDBC Driver)
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
types using binary send = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
types using binary receive = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,DATE,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
integer date/time = true
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@15cbf325, maxRows=0, fetchSize=0, flags=21
FE=> Parse(stmt=null,query="",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE NoData
<=BE EmptyQuery
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@52e605bb, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SHOW TRANSACTION ISOLATION LEVEL",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(1)
Field(transaction_isolation,TEXT,65535,T)
<=BE DataRow(len=14)
<=BE CommandStatus(SHOW)
<=BE ReadyForQuery(I)
1
HikariPool-1 - Start completed.
PostgreSQLExecutionFactory Commit=true;DatabaseProductName=PostgreSQL;DatabaseProductVersion=11.1;DriverMajorVersion=42;DriverMajorVersion=2;DriverName=PostgreSQL JDBC Driver;DriverVersion=42.2.6;IsolationLevel=2
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@1116c4d1, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SELECT t.typname,t.oid FROM pg_catalog.pg_type t JOIN pg_catalog.pg_namespace n ON (t.typnamespace = n.oid) WHERE n.nspname != 'pg_toast' AND (t.typrelid = 0 OR (SELECT c.relkind = 'c' FROM pg_catalog.pg_class c WHERE c.oid = t.typrelid))",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(2)
Field(typname,NAME,64,T)
Field(oid,OID,4,T)
<=BE DataRow(len=6)
<=BE DataRow(len=7)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=12)
<=BE DataRow(len=6)
<=BE DataRow(len=9)
<=BE DataRow(len=6)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
{code}
was (Author: i3draven):
I get logs from start of loading metdata
{code}
CREATE SCHEMA schpostgresql ;
HikariPool-1 - Starting...
Loading driver configuration via classloader sun.misc.Launcher$AppClassLoader@764c12b6
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
FE=> SSLRequest
<=BE SSLOk
converting regular socket connection to ssl
Receive Buffer Size is 65 536
Send Buffer Size is 34 560
FE=> StartupPacket(user=esb, database=dwh, client_encoding=UTF8, DateStyle=ISO, TimeZone=Europe/Prague, extra_float_digits=2)
<=BE AuthenticationReqMD5(salt=9ab5a23a)
FE=> Password(md5digest=md546c3564fd138692177070179f0dcb87b)
<=BE AuthenticationOk
<=BE ParameterStatus(application_name = )
<=BE ParameterStatus(client_encoding = UTF8)
<=BE ParameterStatus(DateStyle = ISO, MDY)
<=BE ParameterStatus(integer_datetimes = on)
<=BE ParameterStatus(IntervalStyle = postgres)
<=BE ParameterStatus(is_superuser = off)
<=BE ParameterStatus(server_encoding = UTF8)
<=BE ParameterStatus(server_version = 11.1)
<=BE ParameterStatus(session_authorization = esb)
<=BE ParameterStatus(standard_conforming_strings = on)
<=BE ParameterStatus(TimeZone = Europe/Prague)
<=BE BackendKeyData(pid=27 472,ckey=-1 415 578 489)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@c474a29, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET extra_float_digits = 3",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@139d160c, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET application_name = 'PostgreSQL JDBC Driver'",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE ParameterStatus(application_name = PostgreSQL JDBC Driver)
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
types using binary send = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
types using binary receive = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,DATE,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
integer date/time = true
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@15cbf325, maxRows=0, fetchSize=0, flags=21
FE=> Parse(stmt=null,query="",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE NoData
<=BE EmptyQuery
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@52e605bb, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SHOW TRANSACTION ISOLATION LEVEL",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(1)
Field(transaction_isolation,TEXT,65535,T)
<=BE DataRow(len=14)
<=BE CommandStatus(SHOW)
<=BE ReadyForQuery(I)
1
HikariPool-1 - Start completed.
PostgreSQLExecutionFactory Commit=true;DatabaseProductName=PostgreSQL;DatabaseProductVersion=11.1;DriverMajorVersion=42;DriverMajorVersion=2;DriverName=PostgreSQL JDBC Driver;DriverVersion=42.2.6;IsolationLevel=2
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@1116c4d1, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SELECT t.typname,t.oid FROM pg_catalog.pg_type t JOIN pg_catalog.pg_namespace n ON (t.typnamespace = n.oid) WHERE n.nspname != 'pg_toast' AND (t.typrelid = 0 OR (SELECT c.relkind = 'c' FROM pg_catalog.pg_class c WHERE c.oid = t.typrelid))",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(2)
Field(typname,NAME,64,T)
Field(oid,OID,4,T)
<=BE DataRow(len=6)
<=BE DataRow(len=7)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=12)
<=BE DataRow(len=6)
<=BE DataRow(len=9)
<=BE DataRow(len=6)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
{code}
> Teiid imported all schemas from PG
> ----------------------------------
>
> Key: TEIID-5963
> URL: https://issues.redhat.com/browse/TEIID-5963
> Project: Teiid
> Issue Type: Bug
> Components: JDBC Connector
> Affects Versions: 14.0
> Reporter: Renat Eskenin
> Assignee: Steven Hawkins
> Priority: Major
>
> When we started teiid spring boot app, we have long start time.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years
[JBoss JIRA] (TEIID-5963) Teiid imported all schemas from PG
by Renat Eskenin (Jira)
[ https://issues.redhat.com/browse/TEIID-5963?page=com.atlassian.jira.plugi... ]
Renat Eskenin commented on TEIID-5963:
--------------------------------------
I get logs from start of loading metdata
{code}
CREATE SCHEMA schpostgresql ;
HikariPool-1 - Starting...
Loading driver configuration via classloader sun.misc.Launcher$AppClassLoader@764c12b6
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
Creating new Encoding UTF-8 with fastASCIINumbers true
FE=> SSLRequest
<=BE SSLOk
converting regular socket connection to ssl
Receive Buffer Size is 65 536
Send Buffer Size is 34 560
FE=> StartupPacket(user=esb, database=dwh, client_encoding=UTF8, DateStyle=ISO, TimeZone=Europe/Prague, extra_float_digits=2)
<=BE AuthenticationReqMD5(salt=9ab5a23a)
FE=> Password(md5digest=md546c3564fd138692177070179f0dcb87b)
<=BE AuthenticationOk
<=BE ParameterStatus(application_name = )
<=BE ParameterStatus(client_encoding = UTF8)
<=BE ParameterStatus(DateStyle = ISO, MDY)
<=BE ParameterStatus(integer_datetimes = on)
<=BE ParameterStatus(IntervalStyle = postgres)
<=BE ParameterStatus(is_superuser = off)
<=BE ParameterStatus(server_encoding = UTF8)
<=BE ParameterStatus(server_version = 11.1)
<=BE ParameterStatus(session_authorization = esb)
<=BE ParameterStatus(standard_conforming_strings = on)
<=BE ParameterStatus(TimeZone = Europe/Prague)
<=BE BackendKeyData(pid=27 472,ckey=-1 415 578 489)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@c474a29, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET extra_float_digits = 3",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.core.SetupQueryRunner$SimpleResultHandler@139d160c, maxRows=0, fetchSize=0, flags=1 047
FE=> Parse(stmt=null,query="SET application_name = 'PostgreSQL JDBC Driver'",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE ParameterStatus(application_name = PostgreSQL JDBC Driver)
<=BE CommandStatus(SET)
<=BE ReadyForQuery(I)
types using binary send = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
types using binary receive = TIMESTAMPTZ,UUID,INT2_ARRAY,INT4_ARRAY,BYTEA,TEXT_ARRAY,TIMETZ,INT8,INT2,INT4,VARCHAR_ARRAY,INT8_ARRAY,POINT,DATE,TIMESTAMP,TIME,BOX,FLOAT4,FLOAT8,FLOAT4_ARRAY,FLOAT8_ARRAY
integer date/time = true
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@15cbf325, maxRows=0, fetchSize=0, flags=21
FE=> Parse(stmt=null,query="",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=1)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE NoData
<=BE EmptyQuery
<=BE ReadyForQuery(I)
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@52e605bb, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SHOW TRANSACTION ISOLATION LEVEL",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(1)
Field(transaction_isolation,TEXT,65535,T)
<=BE DataRow(len=14)
<=BE CommandStatus(SHOW)
<=BE ReadyForQuery(I)
1
HikariPool-1 - Start completed.
PostgreSQLExecutionFactory Commit=true;DatabaseProductName=PostgreSQL;DatabaseProductVersion=11.1;DriverMajorVersion=42;DriverMajorVersion=2;DriverName=PostgreSQL JDBC Driver;DriverVersion=42.2.6;IsolationLevel=2
simple execute, handler=org.postgresql.jdbc.PgStatement$StatementResultHandler@1116c4d1, maxRows=0, fetchSize=0, flags=17
FE=> Parse(stmt=null,query="SELECT t.typname,t.oid FROM pg_catalog.pg_type t JOIN pg_catalog.pg_namespace n ON (t.typnamespace = n.oid) WHERE n.nspname != 'pg_toast' AND (t.typrelid = 0 OR (SELECT c.relkind = 'c' FROM pg_catalog.pg_class c WHERE c.oid = t.typrelid))",oids={})
FE=> Bind(stmt=null,portal=null)
FE=> Describe(portal=null)
FE=> Execute(portal=null,limit=0)
FE=> Sync
5432/dwh
PostgreSQL JDBC Driver 42.2.6
setDefaultFetchSize = 0
setPrepareThreshold = 5
5432
<=BE ParseComplete [null]
<=BE BindComplete [unnamed]
<=BE RowDescription(2)
Field(typname,NAME,64,T)
Field(oid,OID,4,T)
<=BE DataRow(len=6)
<=BE DataRow(len=7)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=6)
<=BE DataRow(len=12)
<=BE DataRow(len=6)
<=BE DataRow(len=9)
<=BE DataRow(len=6)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
<=BE DataRow(len=5)
{code}
> Teiid imported all schemas from PG
> ----------------------------------
>
> Key: TEIID-5963
> URL: https://issues.redhat.com/browse/TEIID-5963
> Project: Teiid
> Issue Type: Bug
> Components: JDBC Connector
> Affects Versions: 14.0
> Reporter: Renat Eskenin
> Assignee: Steven Hawkins
> Priority: Major
>
> When we started teiid spring boot app, we have long start time.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years
[JBoss JIRA] (TEIID-5963) Teiid imported all schemas from PG
by Renat Eskenin (Jira)
[ https://issues.redhat.com/browse/TEIID-5963?page=com.atlassian.jira.plugi... ]
Renat Eskenin commented on TEIID-5963:
--------------------------------------
I used 14 Teiid with deps:
{code}
<dependency>
<groupId>org.teiid</groupId>
<artifactId>teiid-spring-boot-starter</artifactId>
<version>1.5.0</version>
</dependency>
<dependency>
<groupId>org.teiid</groupId>
<artifactId>spring-odata</artifactId>
<version>1.5.0</version>
</dependency>
{code}
With DDL:
{code}
CREATE DATABASE db;
USE DATABASE db;
--use translator
CREATE FOREIGN DATA WRAPPER mypostgresql type postgresql OPTIONS (supportsOrderBy true);
--create teiid server
CREATE SERVER pgserver FOREIGN DATA WRAPPER mypostgresql;
--create source schema
CREATE SCHEMA schpostgresql SERVER pgserver;
--schema manual_loads
IMPORT FOREIGN SCHEMA manual_loads FROM SERVER pgserver INTO schpostgresql OPTIONS("importer.useFullSchemaName" 'false',"importer.schemaName" 'manual_loads');
SET SCHEMA schpostgresql;
ALTER TABLE dm_vcom_product ADD primary key (id);
{code}
And get same results. How I can get more information to you for reproducing?
> Teiid imported all schemas from PG
> ----------------------------------
>
> Key: TEIID-5963
> URL: https://issues.redhat.com/browse/TEIID-5963
> Project: Teiid
> Issue Type: Bug
> Components: JDBC Connector
> Affects Versions: 14.0
> Reporter: Renat Eskenin
> Assignee: Steven Hawkins
> Priority: Major
>
> When we started teiid spring boot app, we have long start time.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years
[JBoss JIRA] (TEIID-5960) Setting connection url property for MYSQL XA Datasource
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5960?page=com.atlassian.jira.plugi... ]
Steven Hawkins commented on TEIID-5960:
---------------------------------------
See also TEIID-5827 - there was an issue with the admin api and xa datasource property handling. So you should attempt this with a later version where this is addressed.
> Setting connection url property for MYSQL XA Datasource
> -------------------------------------------------------
>
> Key: TEIID-5960
> URL: https://issues.redhat.com/browse/TEIID-5960
> Project: Teiid
> Issue Type: Bug
> Components: AdminApi, JDBC Connector
> Affects Versions: 11.1.2
> Reporter: Manoj Majumdar
> Assignee: Steven Hawkins
> Priority: Minor
> Labels: Mysql-connector, teiid, xa-datasource-property
>
> I am trying to create a mysql xa datasource, but am unable to mention connection url properties in it. I have used property names such as "URL" and "connection-url", but the property is not visible in datasource.
> Also when I explicitly make a property tag in datasource for the url, it is working, but not when I am creating it through Admin Api,
> I need the connection url for setting mysql connection arguments such as "rewriteBatchedStatements=true"
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years