[JBoss JIRA] (RTGOV-447) Change SituationStore EPN node to use SituationStore API
by Gary Brown (JIRA)
Gary Brown created RTGOV-447:
--------------------------------
Summary: Change SituationStore EPN node to use SituationStore API
Key: RTGOV-447
URL: https://issues.jboss.org/browse/RTGOV-447
Project: RTGov (Run Time Governance)
Issue Type: Task
Reporter: Gary Brown
Assignee: Gary Brown
Fix For: 2.0.0.Final
Currently situations are persisted from the Event Processor Network node 'SituationStore' using the JPAEventProcessor. This implies the store will be a relational db, making it more difficult to change to an alternative implementation (e.g. ElasticSearch).
Change this node to use Java code that will persist the Situation using the SituationStore API.
--
This message was sent by Atlassian JIRA
(v6.2.3#6260)
10 years, 7 months
[JBoss JIRA] (RTGOV-415) ElasticSearch Activity Store implementation
by ivan mckinley (JIRA)
[ https://issues.jboss.org/browse/RTGOV-415?page=com.atlassian.jira.plugin.... ]
ivan mckinley commented on RTGOV-415:
-------------------------------------
If (3) is possible - then the ESActivityStore could have a mapping file for index rtgov and type activity. The datastore EPN could then have then mapping file for index rtgov and types 'responsetime' and 'situation'.
> it does this already. for instance. If i define a store with index= rtgov , type = actvity and there a multiple type mappings in the rtgov-mapping.json file. it will only initialize the mapping for activity. this functionality is available in the current src.
Note: I'm re-evaluting and testing another approach. for instance, what happens when your activity is derived of more complex mappings, like children etc. needs to be able to initializes the child mappings.
> ElasticSearch Activity Store implementation
> -------------------------------------------
>
> Key: RTGOV-415
> URL: https://issues.jboss.org/browse/RTGOV-415
> Project: RTGov (Run Time Governance)
> Issue Type: Sub-task
> Reporter: Gary Brown
> Assignee: ivan mckinley
> Fix For: 2.0.0.Final
>
>
> Although it is not currently clear whether organisations would rely on ElasticSearch as a database for their activity information, it will be good to be able to offer it as an alternative.
> If configured, then it will store the ActivityUnit, and any subsequent EPN can be used to store the derived information (e.g. situations and response times).
> ElasticSearch has improved its support for backup/restore, so could potentially be used as a primary db for this type of information - although it is not transactional.
> The module should be defined in modules/activity-management/activity-store-es (or elasticsearch - whatever is consistent with RTGOV-342).
--
This message was sent by Atlassian JIRA
(v6.2.3#6260)
10 years, 7 months
[JBoss JIRA] (RTGOV-415) ElasticSearch Activity Store implementation
by ivan mckinley (JIRA)
[ https://issues.jboss.org/browse/RTGOV-415?page=com.atlassian.jira.plugin.... ]
ivan mckinley commented on RTGOV-415:
-------------------------------------
2) Some central location for all rtgov related mappings, and then act store and our EPNs just rely on it already being initialised. Then the local EPN mapping file mechanism would just be used by users who want to store their own info.
> this is how i imagined it. The ootb epn for activities, situations and responses would be initialize the core rtgov index. the EPNs and ACT store reference these indexes. it does not make sense to have a separate index for the act store and the activity epn. this would be duplication of data.(your 1st point)
The current central location is the EPN at the moment, so it would be initialized the first time the epn is activated. or should the act store be referenced first the actstore would then initialize it. (first come first serve). Currently it doesn't matter when it gets initialized but it would be clean if we had a central location for this.
Local epn mappings would then define their own mapping files(rtgov-mapping, <myindex>-mapping.json). the mapping file can either define own index or append the rtgov index (this is how it works at the moment).
I seriously need to document this stuff soon :)
> ElasticSearch Activity Store implementation
> -------------------------------------------
>
> Key: RTGOV-415
> URL: https://issues.jboss.org/browse/RTGOV-415
> Project: RTGov (Run Time Governance)
> Issue Type: Sub-task
> Reporter: Gary Brown
> Assignee: ivan mckinley
> Fix For: 2.0.0.Final
>
>
> Although it is not currently clear whether organisations would rely on ElasticSearch as a database for their activity information, it will be good to be able to offer it as an alternative.
> If configured, then it will store the ActivityUnit, and any subsequent EPN can be used to store the derived information (e.g. situations and response times).
> ElasticSearch has improved its support for backup/restore, so could potentially be used as a primary db for this type of information - although it is not transactional.
> The module should be defined in modules/activity-management/activity-store-es (or elasticsearch - whatever is consistent with RTGOV-342).
--
This message was sent by Atlassian JIRA
(v6.2.3#6260)
10 years, 7 months
[JBoss JIRA] (RTGOV-415) ElasticSearch Activity Store implementation
by Gary Brown (JIRA)
[ https://issues.jboss.org/browse/RTGOV-415?page=com.atlassian.jira.plugin.... ]
Gary Brown commented on RTGOV-415:
----------------------------------
3) Make the 'prepareIndex' method check for both index and type? That way, different deployment units could use the same index but define the mapping for just the type they deal with.
If (3) is possible - then the ESActivityStore could have a mapping file for index rtgov and type activity. The datastore EPN could then have then mapping file for index rtgov and types 'responsetime' and 'situation'.
> ElasticSearch Activity Store implementation
> -------------------------------------------
>
> Key: RTGOV-415
> URL: https://issues.jboss.org/browse/RTGOV-415
> Project: RTGov (Run Time Governance)
> Issue Type: Sub-task
> Reporter: Gary Brown
> Assignee: ivan mckinley
> Fix For: 2.0.0.Final
>
>
> Although it is not currently clear whether organisations would rely on ElasticSearch as a database for their activity information, it will be good to be able to offer it as an alternative.
> If configured, then it will store the ActivityUnit, and any subsequent EPN can be used to store the derived information (e.g. situations and response times).
> ElasticSearch has improved its support for backup/restore, so could potentially be used as a primary db for this type of information - although it is not transactional.
> The module should be defined in modules/activity-management/activity-store-es (or elasticsearch - whatever is consistent with RTGOV-342).
--
This message was sent by Atlassian JIRA
(v6.2.3#6260)
10 years, 7 months
[JBoss JIRA] (RTGOV-415) ElasticSearch Activity Store implementation
by Gary Brown (JIRA)
[ https://issues.jboss.org/browse/RTGOV-415?page=com.atlassian.jira.plugin.... ]
Gary Brown commented on RTGOV-415:
----------------------------------
[~imckinle] Was wondering how you planned to handle the ES mapping for activities, when the activity store is used? Will we just ship a preconfigured mapping file in the ESActivityStore jar?
If so, then the problem will be using the same index for activities and other things (e.g. response time, situations) - as from the code it looks like the index can only be initialised once.
Solutions I can see:
1) Use separate indexes for each deployable unit - i.e. the activity store, and any EPNs have their own index - so index per EPN, so one mapping file per EPN?
2) Some central location for all rtgov related mappings, and then act store and our EPNs just rely on it already being initialised. Then the local EPN mapping file mechanism would just be used by users who want to store their own info.
> ElasticSearch Activity Store implementation
> -------------------------------------------
>
> Key: RTGOV-415
> URL: https://issues.jboss.org/browse/RTGOV-415
> Project: RTGov (Run Time Governance)
> Issue Type: Sub-task
> Reporter: Gary Brown
> Assignee: ivan mckinley
> Fix For: 2.0.0.Final
>
>
> Although it is not currently clear whether organisations would rely on ElasticSearch as a database for their activity information, it will be good to be able to offer it as an alternative.
> If configured, then it will store the ActivityUnit, and any subsequent EPN can be used to store the derived information (e.g. situations and response times).
> ElasticSearch has improved its support for backup/restore, so could potentially be used as a primary db for this type of information - although it is not transactional.
> The module should be defined in modules/activity-management/activity-store-es (or elasticsearch - whatever is consistent with RTGOV-342).
--
This message was sent by Atlassian JIRA
(v6.2.3#6260)
10 years, 7 months