[teiid-commits] [teiid/teiid] 36a3d2: TEIID-2584: TEIID-2584: Materialization Management

Wed Aug 21 16:25:55 EDT 2013

  Branch: refs/heads/master
  Home:   https://github.com/teiid/teiid
  Commit: 36a3d2f65a4ee75685ababa234200f9ec75b86b2
      https://github.com/teiid/teiid/commit/36a3d2f65a4ee75685ababa234200f9ec75b86b2
  Author: Ramesh Reddy <rareddy at jboss.org>
  Date:   2013-08-21 (Wed, 21 Aug 2013)

  Changed paths:
    M api/src/main/java/org/teiid/metadata/MetadataFactory.java
    M api/src/main/java/org/teiid/metadata/MetadataStore.java
    M build/kits/jboss-as7/docs/teiid/teiid-releasenotes.html
    M engine/src/main/java/org/teiid/dqp/internal/process/DataTierManagerImpl.java
    M engine/src/main/java/org/teiid/query/metadata/MetadataValidator.java
    M engine/src/main/java/org/teiid/query/metadata/SystemMetadata.java
    M engine/src/main/java/org/teiid/query/optimizer/relational/RelationalPlanner.java
    M engine/src/main/resources/org/teiid/metadata/SYSADMIN.sql
    M engine/src/main/resources/org/teiid/query/i18n.properties
    M engine/src/test/java/org/teiid/query/processor/proc/TestProcedureProcessor.java
    M jboss-integration/src/main/java/org/teiid/jboss/DQPCoreService.java
    M jboss-integration/src/main/java/org/teiid/jboss/IntegrationPlugin.java
    A jboss-integration/src/main/java/org/teiid/jboss/MaterializationManagementService.java
    M jboss-integration/src/main/java/org/teiid/jboss/TeiidAdd.java
    M jboss-integration/src/main/java/org/teiid/jboss/TeiidOperationHandler.java
    M jboss-integration/src/main/java/org/teiid/jboss/TeiidServiceNames.java
    M jboss-integration/src/main/java/org/teiid/jboss/VDBService.java
    M jboss-integration/src/main/java/org/teiid/jboss/rest/ResteasyEnabler.java
    M jboss-integration/src/main/resources/org/teiid/jboss/i18n.properties
    M runtime/src/main/java/org/teiid/deployers/EventDistributorImpl.java
    M runtime/src/main/java/org/teiid/deployers/VDBLifeCycleListener.java
    M runtime/src/main/java/org/teiid/deployers/VDBRepository.java
    M runtime/src/main/java/org/teiid/runtime/EmbeddedServer.java
    A runtime/src/main/java/org/teiid/runtime/MaterializationManager.java
    M test-integration/common/src/test/java/org/teiid/systemmodel/TestMetadataUpdates.java
    M test-integration/common/src/test/java/org/teiid/systemmodel/TestVirtualDocWithVirtualProc.java
    M test-integration/common/src/test/java/org/teiid/transport/TestODBCSocketTransport.java
    M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProcedureColumns.expected
    M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProcedures.expected
    M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProceduresWithEscape.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_ATTRDEF.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_ATTRIBUTE.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_CLASS.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_INDEX.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_NAMESPACE.expected
    M test-integration/common/src/test/resources/TestODBCSocketTransport/testPgProc.expected
    M test-integration/common/src/test/resources/TestPartsDatabaseMetadata/testProcedureColumns.expected
    M test-integration/common/src/test/resources/TestPartsDatabaseMetadata/testProcedures.expected
    M test-integration/common/src/test/resources/TestSystemVirtualModel/testProcedureParams.expected
    M test-integration/common/src/test/resources/TestSystemVirtualModel/testProcedures.expected
    M test-integration/common/src/test/resources/TestSystemVirtualModel/testProperties.expected
    M test-integration/common/src/test/resources/TestVirtualDocWithVirtualProc/testDefect15241b.expected

  Log Message:
  -----------
  TEIID-2584: TEIID-2584: Materialization Management

1) If an view is configured for external materilization, if it needs to be
managed by the Teiid scheduler for loading the below properties need to be
defined
2) The view is expected to be populated with following properties
teiid_rel:ALLOW_MATVIEW_MANAGEMENT = allow the auto management
teiid_rel:MATVIEW_AFTER_LOAD_SCRIPT = script for loading the mat view table
teiid_rel:MATVIEW_BEFORE_LOAD_SCRIPT = script to run before load; like truncate tables
teiid_rel:MATVIEW_LOAD_SCRIPT = script to run after load; like swap/rename tables
teiid_rel:MATVIEW_STATUS_TABLE = name of the status table.
    MATERIALIZED_TABLE = materialized table
3) The above properties expects the status table to be in the format
    CREATE TABLE status
    (
       vdbname varchar(50) not null,
       vdbversion integer not null,
       schemaname varchar(50) not null,
       name varchar(256) not null,
       targetschemaname varchar(50),
       targetname varchar(256) not null,
       valid boolean not null,
       loadstate varchar(25) not null,
       cardinality integer,
       updated timestamp not null,
       primary key (vdbname, vdbversion, schemaname, name)
    );
4) A SYSADMIN.loadMatView and SYSADMIN.matviewStatus procedures are provided
that will load the materialization results and manage the status of the load
in the status table defined above.
5) During the VDB deployment a timer sevice is started to run the above
load procedure at defined CacheHint intervels defined by the orginal View.


  Commit: d03d1371d57c45fb3e2c634a32f781fa3fb75af6
      https://github.com/teiid/teiid/commit/d03d1371d57c45fb3e2c634a32f781fa3fb75af6
  Author: Ramesh Reddy <rareddy at jboss.org>
  Date:   2013-08-21 (Wed, 21 Aug 2013)

  Changed paths:
    M api/src/main/java/org/teiid/metadata/MetadataFactory.java
    M api/src/main/java/org/teiid/metadata/MetadataStore.java
    M build/kits/jboss-as7/docs/teiid/teiid-releasenotes.html
    M engine/src/main/java/org/teiid/dqp/internal/process/DataTierManagerImpl.java
    M engine/src/main/java/org/teiid/query/metadata/MetadataValidator.java
    M engine/src/main/java/org/teiid/query/metadata/SystemMetadata.java
    M engine/src/main/java/org/teiid/query/optimizer/relational/RelationalPlanner.java
    M engine/src/main/resources/org/teiid/metadata/SYSADMIN.sql
    M engine/src/main/resources/org/teiid/query/i18n.properties
    M engine/src/test/java/org/teiid/query/processor/proc/TestProcedureProcessor.java
    M jboss-integration/src/main/java/org/teiid/jboss/DQPCoreService.java
    M jboss-integration/src/main/java/org/teiid/jboss/IntegrationPlugin.java
    A jboss-integration/src/main/java/org/teiid/jboss/MaterializationManagementService.java
    M jboss-integration/src/main/java/org/teiid/jboss/TeiidAdd.java
    M jboss-integration/src/main/java/org/teiid/jboss/TeiidOperationHandler.java
    M jboss-integration/src/main/java/org/teiid/jboss/TeiidServiceNames.java
    M jboss-integration/src/main/java/org/teiid/jboss/VDBService.java
    M jboss-integration/src/main/java/org/teiid/jboss/rest/ResteasyEnabler.java
    M jboss-integration/src/main/resources/org/teiid/jboss/i18n.properties
    M runtime/src/main/java/org/teiid/deployers/EventDistributorImpl.java
    M runtime/src/main/java/org/teiid/deployers/VDBLifeCycleListener.java
    M runtime/src/main/java/org/teiid/deployers/VDBRepository.java
    M runtime/src/main/java/org/teiid/runtime/EmbeddedServer.java
    A runtime/src/main/java/org/teiid/runtime/MaterializationManager.java
    M test-integration/common/src/test/java/org/teiid/systemmodel/TestMetadataUpdates.java
    M test-integration/common/src/test/java/org/teiid/systemmodel/TestVirtualDocWithVirtualProc.java
    M test-integration/common/src/test/java/org/teiid/transport/TestODBCSocketTransport.java
    M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProcedureColumns.expected
    M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProcedures.expected
    M test-integration/common/src/test/resources/TestMMDatabaseMetaData/testGetProceduresWithEscape.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_ATTRDEF.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_ATTRIBUTE.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_CLASS.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_INDEX.expected
    M test-integration/common/src/test/resources/TestODBCSchema/test_PG_NAMESPACE.expected
    M test-integration/common/src/test/resources/TestODBCSocketTransport/testPgProc.expected
    M test-integration/common/src/test/resources/TestPartsDatabaseMetadata/testProcedureColumns.expected
    M test-integration/common/src/test/resources/TestPartsDatabaseMetadata/testProcedures.expected
    M test-integration/common/src/test/resources/TestSystemVirtualModel/testProcedureParams.expected
    M test-integration/common/src/test/resources/TestSystemVirtualModel/testProcedures.expected
    M test-integration/common/src/test/resources/TestSystemVirtualModel/testProperties.expected
    M test-integration/common/src/test/resources/TestVirtualDocWithVirtualProc/testDefect15241b.expected

  Log Message:
  -----------
  Merge pull request #96 from rareddy/TEIID-2584

TEIID-2584: TEIID-2584: Materialization Management


Compare: https://github.com/teiid/teiid/compare/831a0ba35576...d03d1371d57c