[hawkular/hawkular-metrics] 143cfc: compressBlock will check for all possible blocks t...
by John Sanda
Branch: refs/heads/release/0.30.0
Home: https://github.com/hawkular/hawkular-metrics
Commit: 143cfc9578d24c48b4421fcf27d946e033486371
https://github.com/hawkular/hawkular-metrics/commit/143cfc9578d24c48b4421...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-04-05 (Thu, 05 Apr 2018)
Changed paths:
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
Log Message:
-----------
compressBlock will check for all possible blocks to compress
Commit: 42e32fbd11d950bce4961544a9fc6c14ad79fa19
https://github.com/hawkular/hawkular-metrics/commit/42e32fbd11d950bce4961...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-04-05 (Thu, 05 Apr 2018)
Changed paths:
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DataAccessITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/TestDataAccessFactory.java
Log Message:
-----------
Take the input time from the job, fixes tests
Change the DataAccessITest to use a single version of time
Commit: 26eb378232bbd9c99713a07b17195d60ca1a0083
https://github.com/hawkular/hawkular-metrics/commit/26eb378232bbd9c99713a...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-04-05 (Thu, 05 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/servlet/rx/ObservableServlet.java
Log Message:
-----------
Buffer byte stream instead of dropping
Commit: 6e726cdac1767adaff40222da3bc44d1aac34109
https://github.com/hawkular/hawkular-metrics/commit/6e726cdac1767adaff402...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-04-05 (Thu, 05 Apr 2018)
Changed paths:
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/TempDataCompressor.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
Log Message:
-----------
Add requested logging
Commit: 6b35b72343c7d71ea146e251d3a1ab8bfa7f07a3
https://github.com/hawkular/hawkular-metrics/commit/6b35b72343c7d71ea146e...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-04-05 (Thu, 05 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/servlet/OpenshiftServlet.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/TempDataCompressor.java
Log Message:
-----------
Refactor slightly.. add target subject error propagation
Commit: a72a2e63cdf6e043c51f8b7fab245233f4decc1e
https://github.com/hawkular/hawkular-metrics/commit/a72a2e63cdf6e043c51f8...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-04-05 (Thu, 05 Apr 2018)
Changed paths:
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
Log Message:
-----------
flatMap -> concatMap
Commit: 5005eddc28fadf84eacad81b378c761c49064eae
https://github.com/hawkular/hawkular-metrics/commit/5005eddc28fadf84eacad...
Author: John Sanda <jsanda(a)redhat.com>
Date: 2018-04-06 (Fri, 06 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/servlet/OpenshiftServlet.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/servlet/rx/ObservableServlet.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/TempDataCompressor.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DataAccessITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/TestDataAccessFactory.java
Log Message:
-----------
Merge pull request #934 from jsanda/release/0.30.0
back port PR 927
Compare: https://github.com/hawkular/hawkular-metrics/compare/bb62d4faebd9...5005e...
7 years, 6 months
[hawkular/hawkular-metrics] 1b7a70: [HWKMETRICS-763] fix temp tables not getting dropp...
by John Sanda
Branch: refs/heads/master
Home: https://github.com/hawkular/hawkular-metrics
Commit: 1b7a70ab16a4314aa9f49fe0c22104f3d6759963
https://github.com/hawkular/hawkular-metrics/commit/1b7a70ab16a4314aa9f49...
Author: John Sanda <jsanda(a)redhat.com>
Date: 2018-04-04 (Wed, 04 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/MetricsServiceLifecycle.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/jaxrs/util/SchemaVersionChecker.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/JobsServiceImpl.java
A core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/TempTablesCleaner.java
R job-scheduler/src/main/java/org/hawkular/metrics/scheduler/api/RetryPolicy.java
M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/api/Scheduler.java
M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/SchedulerImpl.java
M job-scheduler/src/main/java/org/hawkular/metrics/scheduler/impl/TestScheduler.java
M job-scheduler/src/test/java/org/hawkular/metrics/scheduler/impl/JobExecutionTest.java
Log Message:
-----------
[HWKMETRICS-763] fix temp tables not getting dropped (#928)
* [HWKMETRICS-763] fix bug in scheduler error handling
I found the bug today which is in SchedulerImpl.java. At some point a while back
I added retry support for when jobs fails. You provide a RetryPolicy that
determines if and when a job should be retried. This was primarily intended for
non-repeating, single-execution jobs. For repeating jobs, i.e., the compression
job, the job is supposed to be executed according to its trigger. Suppose the
compression job is scheduled to run at 15:00 and repeats every two hours. If
the 15:00 execution fails, the scheduler is supposed to retry the job (for all
intensive purposes) immediately with the same trigger time of 15:00. When the
job completes normally, its trigger will get updated in the database to the
next execution time of 17:00. If it already later than 17:00, then the
scheduler will again execute the job right away.
There was a bug with the error handling such that the job wasn't getting
retried for the 15:00 execution. The trigger was getting advanced and set to
17:00. The temp table being compressed gets dropped at the end of the
compression job. Unless the failure was dropping the table, we end up with
orphaned temp tables any time the job fails.
This commit does away with the RetryPolicy since it is not used. This
means that when a job fails, regardless of whether or not it is
repeating, it will be retried with the same trigger until it completes
normally.
* [HWKMETRICS-763] add "local" job to check for expired temp tables
Due to the bug in SchedulerImpl.java which was fixed in my previous
commit, there are openshift clusters with literally hundreds of expired
temp tables. They are expired in the sense that they are older than the
data retention and therefore do not contain any live data.
This commit adds a "local" job that checks for and drops expired tables.
The job is local in the sense that it is local to the hawkular-metrics
server. It is not run via the job scheduler.
* [HWKMETRICS-763] use Observable.empty to get rid of filter call
7 years, 6 months
[hawkular/hawkular-metrics] fe3001: compressBlock will check for all possible blocks t...
by John Sanda
Branch: refs/heads/master
Home: https://github.com/hawkular/hawkular-metrics
Commit: fe3001d01287a8758f44b5bb1fc0f7a6879b173c
https://github.com/hawkular/hawkular-metrics/commit/fe3001d01287a8758f44b...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-03-28 (Wed, 28 Mar 2018)
Changed paths:
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
Log Message:
-----------
compressBlock will check for all possible blocks to compress
Commit: 871e94c2ae6a2de03980821fd1aa5f7b95ecddc5
https://github.com/hawkular/hawkular-metrics/commit/871e94c2ae6a2de039808...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-03-30 (Fri, 30 Mar 2018)
Changed paths:
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DataAccessITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/TestDataAccessFactory.java
Log Message:
-----------
Take the input time from the job, fixes tests
Change the DataAccessITest to use a single version of time
Commit: 5b385ec2f58d0ddc5908e28becffc40236e8c719
https://github.com/hawkular/hawkular-metrics/commit/5b385ec2f58d0ddc5908e...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-03-30 (Fri, 30 Mar 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/servlet/rx/ObservableServlet.java
Log Message:
-----------
Buffer byte stream instead of dropping
Commit: 1f7bd2d37b084f227501a84cae8f5cac31a67191
https://github.com/hawkular/hawkular-metrics/commit/1f7bd2d37b084f227501a...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-03-30 (Fri, 30 Mar 2018)
Changed paths:
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/TempDataCompressor.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
Log Message:
-----------
Add requested logging
Commit: 41ef4caf576fd51d371ada851f4c48b114f87566
https://github.com/hawkular/hawkular-metrics/commit/41ef4caf576fd51d371ad...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-03-30 (Fri, 30 Mar 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/servlet/OpenshiftServlet.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/TempDataCompressor.java
Log Message:
-----------
Refactor slightly.. add target subject error propagation
Commit: 58976360c23a1cf02170408839195128d2bb1e16
https://github.com/hawkular/hawkular-metrics/commit/58976360c23a1cf021704...
Author: Michael Burman <miburman(a)redhat.com>
Date: 2018-03-31 (Sat, 31 Mar 2018)
Changed paths:
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
Log Message:
-----------
flatMap -> concatMap
Commit: cdd8f10525297c353c89699b4828c75e53819eb2
https://github.com/hawkular/hawkular-metrics/commit/cdd8f10525297c353c896...
Author: John Sanda <jsanda(a)redhat.com>
Date: 2018-04-04 (Wed, 04 Apr 2018)
Changed paths:
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/servlet/OpenshiftServlet.java
M api/metrics-api-jaxrs/src/main/java/org/hawkular/metrics/api/servlet/rx/ObservableServlet.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/jobs/TempDataCompressor.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccess.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/DataAccessImpl.java
M core/metrics-core-service/src/main/java/org/hawkular/metrics/core/service/MetricsServiceImpl.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DataAccessITest.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/DelegatingDataAccess.java
M core/metrics-core-service/src/test/java/org/hawkular/metrics/core/service/TestDataAccessFactory.java
Log Message:
-----------
Merge pull request #927 from burmanm/compress_job_do_all
[HWKMETRICS-771] compressBlock will check for all possible blocks to compress
Compare: https://github.com/hawkular/hawkular-metrics/compare/80b284afa250...cdd8f...
7 years, 6 months
