[
https://issues.jboss.org/browse/TEIID-4251?page=com.atlassian.jira.plugin...
]
Steven Hawkins commented on TEIID-4251:
---------------------------------------
It does not need to do the load logic, it just needs to elect a
member to delegate to.
It will need to fully babysit that load - if the delegated pod goes down, then the load
needs to be restarted.
Is that something you can make use of with "existing
materialization" approach?
Very abstractly yes. Also consider that the existing logic is based upon:
internal - all jgroups coordination
external - jgroups coordination and atomic status table updates
Both have a very weak notion of periodic invalidation - just based upon a local timer at
startup, which means that if the pods come up in a disparate fashion they are all making
very different time checks or if a single pod goes down in the middle of a long cycle, it
will be off for a while the next time it comes up.
So we'll obviously retain the status table update, but the jgroups coordination for
detecting members that drop out or for all of the internal materialization coordination is
effectively missing.
as I gather fdw seems to be more work for not any improved
functionality.
It adds guarantees to the the load and status logic, and reduces the amount of ddl we have
to generate.
Another option is since we are saying Teiid controls the PG instance,
having a sidecar kind of container to do the same co-ordination work?
Keep in mind that anything that externally kicks off the load requires some sort of
service account, which has some of the issues discussed on the other jira. However if
it's just calling materialization procedures, then it's a lower level service
account as it doesn't need to see/read everything.
Built in support for Postgres DB as materialization target
----------------------------------------------------------
Key: TEIID-4251
URL:
https://issues.jboss.org/browse/TEIID-4251
Project: Teiid
Issue Type: Feature Request
Components: Server
Reporter: Ramesh Reddy
Assignee: Steven Hawkins
Priority: Major
Fix For: 12.3
If Postgres database is available along with install or assumed that it is available,
then some of the materialization task can be automated, like
- Creation of a common STATUS table
- Creation of the materilization targets (create views on dbms)
- On load, on undeploy and load scripts for all the materialization views
We need to device a way this to be pluggable, such that based on success of this, we can
provide additional support for other sources.
--
This message was sent by Atlassian Jira
(v7.12.1#712002)