[teiid-issues] [JBoss JIRA] (TEIID-4251) Built in support for Postgres DB as materialization target

[Steven Hawkins (Jira)]

    [ https://issues.jboss.org/browse/TEIID-4251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753555#comment-13753555 ] 

Steven Hawkins commented on TEIID-4251:
---------------------------------------

>  It does not need to do the load logic, it just needs to elect a member to delegate to.

It will need to fully babysit that load - if the delegated pod goes down, then the load needs to be restarted.

> Is that something you can make use of with "existing materialization" approach? 

Very abstractly yes.  Also consider that the existing logic is based upon:

internal - all jgroups coordination
external - jgroups coordination and atomic status table updates

Both have a very weak notion of periodic invalidation - just based upon a local timer at startup, which means that if the pods come up in a disparate fashion they are all making very different time checks or if a single pod goes down in the middle of a long cycle, it will be off for a while the next time it comes up.

So we'll obviously retain the status table update, but the jgroups coordination for detecting members that drop out or for all of the internal materialization coordination is effectively missing.

> as I gather fdw seems to be more work for not any improved functionality.

It adds guarantees to the the load and status logic, and reduces the amount of ddl we have to generate.

> Another option is since we are saying Teiid controls the PG instance, having a sidecar kind of container to do the same co-ordination work?

Keep in mind that anything that externally kicks off the load requires some sort of service account, which has some of the issues discussed on the other jira.  However if it's just calling materialization procedures, then it's a lower level service account as it doesn't need to see/read everything.

> Built in support for Postgres DB as materialization target
> ----------------------------------------------------------
>
>                 Key: TEIID-4251
>                 URL: https://issues.jboss.org/browse/TEIID-4251
>             Project: Teiid
>          Issue Type: Feature Request
>          Components: Server
>            Reporter: Ramesh Reddy
>            Assignee: Steven Hawkins
>            Priority: Major
>             Fix For: 12.3
>
>
> If Postgres database is available along with install or assumed that it is available, then some of the materialization task can be automated, like
> - Creation of a common STATUS table
> - Creation of the materilization targets (create views on dbms)
> - On load, on undeploy and load scripts for all the materialization views
> We need to device a way this to be pluggable, such that based on success of this, we can provide additional support for other sources. 



--
This message was sent by Atlassian Jira
(v7.12.1#712002)