[teiid-commits] [teiid/teiid] 36a3d2: TEIID-2584: TEIID-2584: Materialization Management

Branch: refs/heads/master Home: https://github.com/teiid/teiid Commit: 36a3d2f65a4ee75685ababa234200f9ec75b86b2 https://github.com/teiid/teiid/commit/36a3d2f65a4ee75685ababa234200f9ec75... Author: Ramesh Reddy <rareddy(a)jboss.org&gt; Date: 2013-08-21 (Wed, 21 Aug 2013) Changed paths: M api/src/main/java/org/teiid/metadata/MetadataFactory.java M api/src/main/java/org/teiid/metadata/MetadataStore.java M build/kits/jboss-as7/docs/teiid/teiid-releasenotes.html M engine/src/main/java/org/teiid/dqp/internal/process/DataTierManagerImpl.java M engine/src/main/java/org/teiid/query/metadata/MetadataValidator.java M engine/src/main/java/org/teiid/query/metadata/SystemMetadata.java M engine/src/main/java/org/teiid/query/optimizer/relational/RelationalPlanner.java M engine/src/main/resources/org/teiid/metadata/SYSADMIN.sql M engine/src/main/resources/org/teiid/query/i18n.properties M engine/src/test/java/org/teiid/query/processor/proc/TestProcedureProcessor.java M jboss-integration/src/main/java/org/teiid/jboss/DQPCoreService.java M jboss-integration/src/main/java/org/teiid/jboss/IntegrationPlugin.java A jboss-integration/src/main/java/org/teiid/jboss/MaterializationManagementService.java M jboss-integration/src/main/java/org/teiid/jboss/TeiidAdd.java M jboss-integration/src/main/java/org/teiid/jboss/TeiidOperationHandler.java M jboss-integration/src/main/java/org/teiid/jboss/TeiidServiceNames.java M jboss-integration/src/main/java/org/teiid/jboss/VDBService.java M jboss-integration/src/main/java/org/teiid/jboss/rest/ResteasyEnabler.java M jboss-integration/src/main/resources/org/teiid/jboss/i18n.properties M runtime/src/main/java/org/teiid/deployers/EventDistributorImpl.java M runtime/src/main/java/org/teiid/deployers/VDBLifeCycleListener.java M runtime/src/main/java/org/teiid/deployers/VDBRepository.java M runtime/src/main/java/org/teiid/runtime/EmbeddedServer.java A runtime/src/main/java/org/teiid/runtime/MaterializationManager.java M test-integration/common/src/test/java/org/teiid/systemmodel/TestMetadataUpdates.java M test-integration/common/src/test/java/org/teiid/systemmodel/TestVirtualDocWithVirtualProc.java M test-integration/common/src/test/java/org/teiid/transport/TestODBCSocketTransport.java M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProcedureColumns.expected M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProcedures.expected M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProceduresWithEscape.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_ATTRDEF.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_ATTRIBUTE.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_CLASS.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_INDEX.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_NAMESPACE.expected M test-integration/common/src/test/resources/TestODBCSocketTransport/testPgProc.expected M test-integration/common/src/test/resources/TestPartsDatabaseMetadata/testProcedureColumns.expected M test-integration/common/src/test/resources/TestPartsDatabaseMetadata/testProcedures.expected M test-integration/common/src/test/resources/TestSystemVirtualModel/testProcedureParams.expected M test-integration/common/src/test/resources/TestSystemVirtualModel/testProcedures.expected M test-integration/common/src/test/resources/TestSystemVirtualModel/testProperties.expected M test-integration/common/src/test/resources/TestVirtualDocWithVirtualProc/testDefect15241b.expected Log Message: ----------- TEIID-2584: TEIID-2584: Materialization Management 1) If an view is configured for external materilization, if it needs to be managed by the Teiid scheduler for loading the below properties need to be defined 2) The view is expected to be populated with following properties teiid_rel:ALLOW_MATVIEW_MANAGEMENT = allow the auto management teiid_rel:MATVIEW_AFTER_LOAD_SCRIPT = script for loading the mat view table teiid_rel:MATVIEW_BEFORE_LOAD_SCRIPT = script to run before load; like truncate tables teiid_rel:MATVIEW_LOAD_SCRIPT = script to run after load; like swap/rename tables teiid_rel:MATVIEW_STATUS_TABLE = name of the status table. MATERIALIZED_TABLE = materialized table 3) The above properties expects the status table to be in the format CREATE TABLE status ( vdbname varchar(50) not null, vdbversion integer not null, schemaname varchar(50) not null, name varchar(256) not null, targetschemaname varchar(50), targetname varchar(256) not null, valid boolean not null, loadstate varchar(25) not null, cardinality integer, updated timestamp not null, primary key (vdbname, vdbversion, schemaname, name) ); 4) A SYSADMIN.loadMatView and SYSADMIN.matviewStatus procedures are provided that will load the materialization results and manage the status of the load in the status table defined above. 5) During the VDB deployment a timer sevice is started to run the above load procedure at defined CacheHint intervels defined by the orginal View. Commit: d03d1371d57c45fb3e2c634a32f781fa3fb75af6 https://github.com/teiid/teiid/commit/d03d1371d57c45fb3e2c634a32f781fa3fb... Author: Ramesh Reddy <rareddy(a)jboss.org&gt; Date: 2013-08-21 (Wed, 21 Aug 2013) Changed paths: M api/src/main/java/org/teiid/metadata/MetadataFactory.java M api/src/main/java/org/teiid/metadata/MetadataStore.java M build/kits/jboss-as7/docs/teiid/teiid-releasenotes.html M engine/src/main/java/org/teiid/dqp/internal/process/DataTierManagerImpl.java M engine/src/main/java/org/teiid/query/metadata/MetadataValidator.java M engine/src/main/java/org/teiid/query/metadata/SystemMetadata.java M engine/src/main/java/org/teiid/query/optimizer/relational/RelationalPlanner.java M engine/src/main/resources/org/teiid/metadata/SYSADMIN.sql M engine/src/main/resources/org/teiid/query/i18n.properties M engine/src/test/java/org/teiid/query/processor/proc/TestProcedureProcessor.java M jboss-integration/src/main/java/org/teiid/jboss/DQPCoreService.java M jboss-integration/src/main/java/org/teiid/jboss/IntegrationPlugin.java A jboss-integration/src/main/java/org/teiid/jboss/MaterializationManagementService.java M jboss-integration/src/main/java/org/teiid/jboss/TeiidAdd.java M jboss-integration/src/main/java/org/teiid/jboss/TeiidOperationHandler.java M jboss-integration/src/main/java/org/teiid/jboss/TeiidServiceNames.java M jboss-integration/src/main/java/org/teiid/jboss/VDBService.java M jboss-integration/src/main/java/org/teiid/jboss/rest/ResteasyEnabler.java M jboss-integration/src/main/resources/org/teiid/jboss/i18n.properties M runtime/src/main/java/org/teiid/deployers/EventDistributorImpl.java M runtime/src/main/java/org/teiid/deployers/VDBLifeCycleListener.java M runtime/src/main/java/org/teiid/deployers/VDBRepository.java M runtime/src/main/java/org/teiid/runtime/EmbeddedServer.java A runtime/src/main/java/org/teiid/runtime/MaterializationManager.java M test-integration/common/src/test/java/org/teiid/systemmodel/TestMetadataUpdates.java M test-integration/common/src/test/java/org/teiid/systemmodel/TestVirtualDocWithVirtualProc.java M test-integration/common/src/test/java/org/teiid/transport/TestODBCSocketTransport.java M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProcedureColumns.expected M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProcedures.expected M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProceduresWithEscape.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_ATTRDEF.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_ATTRIBUTE.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_CLASS.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_INDEX.expected M test-integration/common/src/test/resources/TestODBCSchema/test_PG_NAMESPACE.expected M test-integration/common/src/test/resources/TestODBCSocketTransport/testPgProc.expected M test-integration/common/src/test/resources/TestPartsDatabaseMetadata/testProcedureColumns.expected M test-integration/common/src/test/resources/TestPartsDatabaseMetadata/testProcedures.expected M test-integration/common/src/test/resources/TestSystemVirtualModel/testProcedureParams.expected M test-integration/common/src/test/resources/TestSystemVirtualModel/testProcedures.expected M test-integration/common/src/test/resources/TestSystemVirtualModel/testProperties.expected M test-integration/common/src/test/resources/TestVirtualDocWithVirtualProc/testDefect15241b.expected Log Message: ----------- Merge pull request #96 from rareddy/TEIID-2584 TEIID-2584: TEIID-2584: Materialization Management Compare: https://github.com/teiid/teiid/compare/831a0ba35576...d03d1371d57c