[hawkular/hawkular-metrics] 9cbe49: [HWKMETRICS-766] remove DeleteExpiredMetrics job a...
by John Sanda
Branch: refs/heads/release/0.29.0
Home: https://github.com/hawkular/hawkular-metrics
Commit: 9cbe4989f46cbe18a888081ce89cae111811eda1
https://github.com/hawkular/hawkular-metrics/commit/9cbe4989f46cbe18a8880...
Author: John Sanda <jsanda(a)redhat.com>
Date: 2018-04-12 (Thu, 12 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/MetricsServiceLifecycle.java
M api/metrics-api-util/src/main/java/org/hawkular/metrics/api/jaxrs/config/ConfigurationKey.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/CompressData.java
R core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsService.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImplMBean.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsService.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/CompressDataJobITest.java
R core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DataAccessITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/MixedMetricsITest.java
M core/schema/src/main/java/org/hawkular/metrics/schema/SchemaService.java
M core/schema/src/main/resources/org/hawkular/schema/cassalog.groovy
A core/schema/src/main/resources/org/hawkular/schema/updates/schema-0.29.0.groovy
M pom.xml
Log Message:
-----------
[HWKMETRICS-766] remove DeleteExpiredMetrics job and related code ( backport of HWKMETRICS-765)
* Remove DeleteExpiredMetrics job and related code
* Remove more code related to metrics_expiration_idx
* Unscheduled delete expired metrics job and remove config.
I have also disabled a test in MixedMetricsITest and DataAccessItest::testFindAllDataFromBucket which fails
inconsistently.
Commit: 54ed9dabeb04ca44d641a3efa93eb9d7373a2cc0
https://github.com/hawkular/hawkular-metrics/commit/54ed9dabeb04ca44d641a...
Author: John Sanda <jsanda(a)redhat.com>
Date: 2018-04-12 (Thu, 12 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/MetricsServiceLifecycle.java
M api/metrics-api-util/src/main/java/org/hawkular/metrics/api/jaxrs/config/ConfigurationKey.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/CompressData.java
R core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetrics.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsService.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImplMBean.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsService.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/CompressDataJobITest.java
R core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteExpiredMetricsJobITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DataAccessITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/MixedMetricsITest.java
M core/schema/src/main/java/org/hawkular/metrics/schema/SchemaService.java
M core/schema/src/main/resources/org/hawkular/schema/cassalog.groovy
A core/schema/src/main/resources/org/hawkular/schema/updates/schema-0.29.0.groovy
M pom.xml
Log Message:
-----------
Merge pull request #940 from rubenvp8510/HWKMETRICS-766
[HWKMETRICS-766] remove DeleteExpiredMetrics job and related code
Compare: https://github.com/hawkular/hawkular-metrics/compare/c8ae2bfd2db1...54ed9...
7 years, 5 months
[hawkular/hawkular-metrics] 5fb4ea: Release 0.30.3
by John Sanda
Branch: refs/heads/release/0.30.0
Home: https://github.com/hawkular/hawkular-metrics
Commit: 5fb4ea21af0a0e37b0e2e46909f410c4c3211e6d
https://github.com/hawkular/hawkular-metrics/commit/5fb4ea21af0a0e37b0e2e...
Author: John Sanda <john.sanda(a)gmail.com>
Date: 2018-04-09 (Mon, 09 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/pom.xml
M api/metrics-api-util/pom.xml
M clients/common/pom.xml
M clients/dropwizard/hawkular-dropwizard-reporter-factory/pom.xml
M clients/dropwizard/hawkular-dropwizard-reporter/pom.xml
M clients/dropwizard/pom.xml
M clients/pom.xml
M clients/ptranslator/pom.xml
M containers/hawkular-openshift-security-filter/pom.xml
M containers/pom.xml
M core/configuration-service/pom.xml
M core/datetime-service/pom.xml
M core/metrics-core-service/pom.xml
M core/metrics-model/pom.xml
M core/rx-java-driver/pom.xml
M core/schema-installer/pom.xml
M core/schema/pom.xml
M data-generator/pom.xml
M dist/containers/hawkular-metrics-openshift/pom.xml
M dist/pom.xml
M integration-tests/jmh-benchmark/pom.xml
M integration-tests/load-tests/pom.xml
M integration-tests/metrics-api-jaxrs-test/pom.xml
M integration-tests/pom.xml
M integration-tests/rest-tests-jaxrs/pom.xml
M job-scheduler/pom.xml
M pom.xml
Log Message:
-----------
Release 0.30.3
7 years, 5 months
[hawkular/hawkular-metrics] a33e31: [HWKMETRICS-763] fix temp tables not getting dropp...
by John Sanda
Branch: refs/heads/release/0.30.0
Home: https://github.com/hawkular/hawkular-metrics
Commit: a33e3142171053d88b7590e0ef239d532c1ba8ad
https://github.com/hawkular/hawkular-metrics/commit/a33e3142171053d88b759...
Author: John Sanda <jsanda(a)redhat.com>
Date: 2018-04-09 (Mon, 09 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/MetricsServiceLifecycle.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/util/SchemaVersionChecker.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
A core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/TempTablesCleaner.java
R job-scheduler/src/main/java/org/hawkular/metrics/scheduler/api/RetryPolicy.java
M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/api/Scheduler.java
M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/SchedulerImpl.java
M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/TestScheduler.java
M job-scheduler/src/test/java/org/hawkular/metrics/scheduler/impl/JobExecutionTest.java
Log Message:
-----------
[HWKMETRICS-763] fix temp tables not getting dropped (#928)
* [HWKMETRICS-763] fix bug in scheduler error handling
I found the bug today which is in SchedulerImpl.java. At some point a while back
I added retry support for when jobs fails. You provide a RetryPolicy that
determines if and when a job should be retried. This was primarily intended for
non-repeating, single-execution jobs. For repeating jobs, i.e., the compression
job, the job is supposed to be executed according to its trigger. Suppose the
compression job is scheduled to run at 15:00 and repeats every two hours. If
the 15:00 execution fails, the scheduler is supposed to retry the job (for all
intensive purposes) immediately with the same trigger time of 15:00. When the
job completes normally, its trigger will get updated in the database to the
next execution time of 17:00. If it already later than 17:00, then the
scheduler will again execute the job right away.
There was a bug with the error handling such that the job wasn't getting
retried for the 15:00 execution. The trigger was getting advanced and set to
17:00. The temp table being compressed gets dropped at the end of the
compression job. Unless the failure was dropping the table, we end up with
orphaned temp tables any time the job fails.
This commit does away with the RetryPolicy since it is not used. This
means that when a job fails, regardless of whether or not it is
repeating, it will be retried with the same trigger until it completes
normally.
* [HWKMETRICS-763] add "local" job to check for expired temp tables
Due to the bug in SchedulerImpl.java which was fixed in my previous
commit, there are openshift clusters with literally hundreds of expired
temp tables. They are expired in the sense that they are older than the
data retention and therefore do not contain any live data.
This commit adds a "local" job that checks for and drops expired tables.
The job is local in the sense that it is local to the hawkular-metrics
server. It is not run via the job scheduler.
* [HWKMETRICS-763] use Observable.empty to get rid of filter call
Commit: 3a7b8d1d2202db1f6d8b9decd398c4905ef07e50
https://github.com/hawkular/hawkular-metrics/commit/3a7b8d1d2202db1f6d8b9...
Author: John Sanda <jsanda(a)redhat.com>
Date: 2018-04-09 (Mon, 09 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/MetricsServiceLifecycle.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/util/SchemaVersionChecker.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
A core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/TempTablesCleaner.java
R job-scheduler/src/main/java/org/hawkular/metrics/scheduler/api/RetryPolicy.java
M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/api/Scheduler.java
M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/SchedulerImpl.java
M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/TestScheduler.java
M job-scheduler/src/test/java/org/hawkular/metrics/scheduler/impl/JobExecutionTest.java
Log Message:
-----------
Merge pull request #935 from jsanda/hwkmetrics-763-release/0.30.0
[HWKMETRICS-763] back port to release/0.30.0
Compare: https://github.com/hawkular/hawkular-metrics/compare/b469c34f0fe6...3a7b8...
7 years, 5 months
[hawkular/hawkular-metrics] edc867: Remove MetricId -> Metric enrichment from places w...
by John Sanda
Branch: refs/heads/release/0.23.0
Home: https://github.com/hawkular/hawkular-metrics
Commit: edc867e5ba862d21a2a4664a272573c048dee823
https://github.com/hawkular/hawkular-metrics/commit/edc867e5ba862d21a2a46...
Author: Michael Burman <yak(a)iki.fi>
Date: 2018-04-02 (Mon, 02 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/AvailabilityHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/CounterHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/GaugeHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/MetricHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/MetricsServiceHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/StringHandler.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/CompressData.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsService.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/TagQueryParser.java
R core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/transformers/MetricFromFullDataRowTransformer.java
A core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/transformers/MetricIdentifierFromFullDataRowTransformer.java
R core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/transformers/TagsIndexRowTransformer.java
A core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/transformers/TagsIndexRowTransformerFilter.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteTenantITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DataAccessITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/CounterITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/GaugeITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/MixedMetricsITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/TagsITest.java
Log Message:
-----------
Remove MetricId -> Metric enrichment from places where it is not needed
Disable tests failing on travis
Commit: 37636d25c7d56292716834cd0bbe52834f4760d7
https://github.com/hawkular/hawkular-metrics/commit/37636d25c7d5629271683...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-04-02 (Mon, 02 Apr 2018)
Changed paths:
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/TagQueryParser.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
Log Message:
-----------
Improve simple tag query performance by enabling the A-cost query possibilities
Add better regexp detection and test for most common cases
Add ^!.* as regexp check since we allow that syntax
Optimize OR-queries also in the query optimizer
Change tagNameAndValues to use IN
Commit: b87d7b6fb4b9088e34c8e433ad3367c4c6a10c4a
https://github.com/hawkular/hawkular-metrics/commit/b87d7b6fb4b9088e34c8e...
Author: John Sanda <jsanda(a)redhat.com>
Date: 2018-04-09 (Mon, 09 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/AvailabilityHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/CounterHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/GaugeHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/MetricHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/MetricsServiceHandler.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/handler/StringHandler.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/CompressData.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsService.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/TagQueryParser.java
R core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/transformers/MetricFromFullDataRowTransformer.java
A core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/transformers/MetricIdentifierFromFullDataRowTransformer.java
R core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/transformers/TagsIndexRowTransformer.java
A core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/transformers/TagsIndexRowTransformerFilter.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/jobs/DeleteTenantITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DataAccessITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/CounterITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/GaugeITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/MixedMetricsITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/metrics/TagsITest.java
Log Message:
-----------
Merge pull request #932 from rubenvp8510/HWKMETRICS-758
[HWKMETRICS 758] Improve simple tag query performance by enabling the A-cost query pos…
Compare: https://github.com/hawkular/hawkular-metrics/compare/b8a1bab784f6...b87d7...
7 years, 5 months
[hawkular/hawkular-metrics] 8998b1: Release 0.30.2
by John Sanda
Branch: refs/heads/release/0.30.0
Home: https://github.com/hawkular/hawkular-metrics
Commit: 8998b1d110f2fbeb2014ba767469ec4c102bda91
https://github.com/hawkular/hawkular-metrics/commit/8998b1d110f2fbeb2014b...
Author: John Sanda <john.sanda(a)gmail.com>
Date: 2018-04-06 (Fri, 06 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/pom.xml
M api/metrics-api-util/pom.xml
M clients/common/pom.xml
M clients/dropwizard/hawkular-dropwizard-reporter-factory/pom.xml
M clients/dropwizard/hawkular-dropwizard-reporter/pom.xml
M clients/dropwizard/pom.xml
M clients/pom.xml
M clients/ptranslator/pom.xml
M containers/hawkular-openshift-security-filter/pom.xml
M containers/pom.xml
M core/configuration-service/pom.xml
M core/datetime-service/pom.xml
M core/metrics-core-service/pom.xml
M core/metrics-model/pom.xml
M core/rx-java-driver/pom.xml
M core/schema-installer/pom.xml
M core/schema/pom.xml
M data-generator/pom.xml
M dist/containers/hawkular-metrics-openshift/pom.xml
M dist/pom.xml
M integration-tests/jmh-benchmark/pom.xml
M integration-tests/load-tests/pom.xml
M integration-tests/metrics-api-jaxrs-test/pom.xml
M integration-tests/pom.xml
M integration-tests/rest-tests-jaxrs/pom.xml
M job-scheduler/pom.xml
M pom.xml
Log Message:
-----------
Release 0.30.2
7 years, 6 months