[Hawkular-commits] [hawkular/hawkular-metrics] 5e7820: [HWKMETRICS-613] Add an index to keep track of met...

Fri Mar 31 13:57:13 EDT 2017

  Branch: refs/heads/master
  Home:   https://github.com/hawkular/hawkular-metrics
  Commit: 5e782054b4f170dadc34a8939109a133e75c947d
      https://github.com/hawkular/hawkular-metrics/commit/5e782054b4f170dadc34a8939109a133e75c947d
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-27 (Mon, 27 Mar 2017)

  Changed paths:
    A core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java
    R core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteMetric.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
    M core/schema/src/main/java/org/hawkular/metrics/schema/SchemaService.java
    M core/schema/src/main/resources/org/hawkular/schema/cassalog.groovy
    A core/schema/src/main/resources/org/hawkular/schema/updates/schema-0.26.0.groovy

  Log Message:
  -----------
  [HWKMETRICS-613] Add an index to keep track of metrics that need to be deleted. A metric becomes eligible for deletion when all the data points for the metric expire.

  Commit: cc0268267c34740b9e6d67b02efc995a608ccb36
      https://github.com/hawkular/hawkular-metrics/commit/cc0268267c34740b9e6d67b02efc995a608ccb36
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-28 (Tue, 28 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/CompressData.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsService.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/CounterITest.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/GaugeITest.java

  Log Message:
  -----------
  [HWKMETRICS-613] Reduce the number of writes to the expiration for data points by updating the retention index only when a compressed block is persisted.

  Commit: 99054d358e629892703810453d0ad7e44351b0fb
      https://github.com/hawkular/hawkular-metrics/commit/99054d358e629892703810453d0ad7e44351b0fb
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-29 (Wed, 29 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/CompressData.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsService.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/CompressDataJobITest.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/BaseITest.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java

  Log Message:
  -----------
  [HWKMETRICS-613] Add a tests to check that expiration index entries are properly created when data points are compressed.

  Commit: 30872dcbbc9bfd33ca9a1db0ddb6fe18bb72b336
      https://github.com/hawkular/hawkular-metrics/commit/30872dcbbc9bfd33ca9a1db0ddb6fe18bb72b336
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-29 (Wed, 29 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsService.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
    A core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteTenantITest.java

  Log Message:
  -----------
  [HWKMETRICS-613] Add integration tests for the job that deletes expired metrics.

  Commit: 9d48140357e7a85ba01991f580a2c3baa517235f
      https://github.com/hawkular/hawkular-metrics/commit/9d48140357e7a85ba01991f580a2c3baa517235f
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-29 (Wed, 29 Mar 2017)

  Changed paths:
    M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/MetricsServiceLifecycle.java
    M api/metrics-api-util/src/main/java/org/hawkular/metrics/api/jaxrs/config/ConfigurationKey.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java

  Log Message:
  -----------
  [HWKMETRICS-613] Make the expiration delay and expiration job frequency configurable.

  Commit: 4136201059e674f4c184649f9e03debaaae1eb28
      https://github.com/hawkular/hawkular-metrics/commit/4136201059e674f4c184649f9e03debaaae1eb28
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-29 (Wed, 29 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImplMBean.java

  Log Message:
  -----------
  [HWKMETRICS-613] Allow starting the job that deletes expired metrics via JMX.

  Commit: ef12a5c313bb5eefc927b9243d7cbf3f6186fb09
      https://github.com/hawkular/hawkular-metrics/commit/ef12a5c313bb5eefc927b9243d7cbf3f6186fb09
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-29 (Wed, 29 Mar 2017)

  Changed paths:
    M core/configuration-service/src/main/java/org/hawkular/metrics/sysconfig/Configuration.java
    M core/configuration-service/src/main/java/org/hawkular/metrics/sysconfig/ConfigurationService.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
    M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/api/Scheduler.java
    M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/JobsService.java
    M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/SchedulerImpl.java
    M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/TestScheduler.java

  Log Message:
  -----------
  [HWKMETRICS-613] Schedule the job that deletes expired metrics to run daily at a configured interval; the default is every 7 days.

  Commit: 7587a513b66a03ef1c2bb1cb15c290ae5d549912
      https://github.com/hawkular/hawkular-metrics/commit/7587a513b66a03ef1c2bb1cb15c290ae5d549912
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-29 (Wed, 29 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java

  Log Message:
  -----------
  [HWKMETRICS-613] Increase the time window for the test to 2 hours.

  Commit: 115ce03158df8e9111a6efc6d8395d1c858518f4
      https://github.com/hawkular/hawkular-metrics/commit/115ce03158df8e9111a6efc6d8395d1c858518f4
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-30 (Thu, 30 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/CompressData.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsService.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java

  Log Message:
  -----------
  [HWKMETRICS-613] Make the MetricsService method for updating the expiration index reactive.

Also, complete the publish subject in case of a compression error.

  Commit: 962c077dc73f1a180f07fabecc615e2009295235
      https://github.com/hawkular/hawkular-metrics/commit/962c077dc73f1a180f07fabecc615e2009295235
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-30 (Thu, 30 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java

  Log Message:
  -----------
  [HWKMETRICS-613] Add a test for running the scheduled metrics expiration job via the scheduler.

  Commit: 82c5d27faee145aec7f53d11b3d75414ad96b85f
      https://github.com/hawkular/hawkular-metrics/commit/82c5d27faee145aec7f53d11b3d75414ad96b85f
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-30 (Thu, 30 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java

  Log Message:
  -----------
  [HWKMETRICS-613] Use the DateTimeService for current system time.

  Commit: da1f884e19a576cadc6821ee1ac0be8a78cb17d4
      https://github.com/hawkular/hawkular-metrics/commit/da1f884e19a576cadc6821ee1ac0be8a78cb17d4
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-30 (Thu, 30 Mar 2017)

  Changed paths:
    M api/metrics-api-util/src/main/java/org/hawkular/metrics/api/jaxrs/config/ConfigurationKey.java

  Log Message:
  -----------
  [HWKMETRICS-613] The configuration properties for the metrics expiration job are not flags.

  Commit: 6c35b62f4841dcd9115cbe76db7b0cf80e47ceba
      https://github.com/hawkular/hawkular-metrics/commit/6c35b62f4841dcd9115cbe76db7b0cf80e47ceba
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-30 (Thu, 30 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java

  Log Message:
  -----------
  [HWKMETRICS-613] If the compression job is disabled, then check to see if there is still unexpired data for a metric before purging it.

  Commit: 6f34f0f02d75cb5132a44aa47fea71e725bb4e0b
      https://github.com/hawkular/hawkular-metrics/commit/6f34f0f02d75cb5132a44aa47fea71e725bb4e0b
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-31 (Fri, 31 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java

  Log Message:
  -----------
  [HWKMETRICS-613] Update DataAccess.updateMetricExpirationIndex to return Observable. The scheduler is now started after all the recurring jobs are scheduled. And log errors when metrics cannot be deleted.

  Commit: 58d897cf5310e4fe83c8bb684e454e98757a1a40
      https://github.com/hawkular/hawkular-metrics/commit/58d897cf5310e4fe83c8bb684e454e98757a1a40
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-31 (Fri, 31 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java

  Log Message:
  -----------
  [HWKMETRICS-613] Use onErrorResumeNext to ignore deletion errors. If a delete operation fails, it will be tried again when the expiration index is reprocessed again.

  Commit: 6bf7140c47a6c59156c3be0c5b87a76424acf181
      https://github.com/hawkular/hawkular-metrics/commit/6bf7140c47a6c59156c3be0c5b87a76424acf181
  Author: Stefan Negrea <snegrea at redhat.com>
  Date:   2017-03-31 (Fri, 31 Mar 2017)

  Changed paths:
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java

  Log Message:
  -----------
  [HWKMETRICS-613] Add logging to DeleteExpiredMetrics job.

  Commit: 6d67ed2768fb3c3cccef10eef46a3f27d3c98f1b
      https://github.com/hawkular/hawkular-metrics/commit/6d67ed2768fb3c3cccef10eef46a3f27d3c98f1b
  Author: jsanda <jsanda at redhat.com>
  Date:   2017-03-31 (Fri, 31 Mar 2017)

  Changed paths:
    M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/MetricsServiceLifecycle.java
    M api/metrics-api-util/src/main/java/org/hawkular/metrics/api/jaxrs/config/ConfigurationKey.java
    M core/configuration-service/src/main/java/org/hawkular/metrics/sysconfig/Configuration.java
    M core/configuration-service/src/main/java/org/hawkular/metrics/sysconfig/ConfigurationService.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/CompressData.java
    A core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java
    R core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteMetric.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsService.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImplMBean.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsService.java
    M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/CompressDataJobITest.java
    A core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteTenantITest.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/BaseITest.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/CounterITest.java
    M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/GaugeITest.java
    M core/schema/src/main/java/org/hawkular/metrics/schema/SchemaService.java
    M core/schema/src/main/resources/org/hawkular/schema/cassalog.groovy
    A core/schema/src/main/resources/org/hawkular/schema/updates/schema-0.26.0.groovy
    M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/api/Scheduler.java
    M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/JobsService.java
    M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/SchedulerImpl.java
    M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/TestScheduler.java

  Log Message:
  -----------
  Merge pull request #785 from hawkular/HWKMETRICS-613

[HWKMETRICS-613] Add an index to keep track of metrics that need to b…

Compare: https://github.com/hawkular/hawkular-metrics/compare/0133ff83e6c7...6d67ed2768fb