<div dir="ltr"><div><br></div><div>I have a production installation of Apiman 1.3.1 running with the 1.7 version of elastic search that has been up for a few months in an openshift.  Only recently, the API metrics are no longer displaying and I am getting the error below in the elasticsearch log. The API requests still seem to be processed by Apiman, but clearly the metrics are not being collected, or if they are, the query is failing when trying to display them. <br><br>I realize that this is not an elastic search support forum, but I was hoping tat someone would know what is involved to fix the metrics for Apiman. I have tried restarting the elasticsearch service, but that has not fixed the issue.   Could this error have happen if the volume was corrupted? If I were to clear the storage volume and restart the elastic search node, what would have to happen on Apiman? Would all of the APIs have to be republished? Is this a common thing that happens with Apiman and elastic search?</div><div><br></div><div>Thanks in advance<br></div><div>Stephen Henrie<br><br><br><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>[2018-12-28 02:59:54,387][DEBUG][action.search.type       ] [Corruptor] [apiman_metrics][3], node[r24FvIHkQN69_8nmw31Yqg], [P], s[STARTED]: Failed to execute [org.elasticsearch.action.search.SearchRequest@3049c571] lastShard [true]
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>org.elasticsearch.search.SearchParseException: [apiman_metrics][3]: from[-1],size[-1]: Parse Failure [Failed to parse source [{    &quot;query&quot;: {        &quot;bool&quot;: {            &quot;filter&quot;: [{                    &quot;term&quot;: {                        &quot;apiOrgId&quot;: &quot;chassi&quot;                    }                }, {                    &quot;term&quot;: {                        &quot;apiId&quot;: &quot;tenant&quot;                    }                }, {                    &quot;term&quot;: {                        &quot;apiVersion&quot;: &quot;1&quot;                    }                },                {                    &quot;range&quot;: {                        &quot;requestStart&quot;: {                            &quot;gte&quot;: &quot;2018-12-20T07:00:00Z&quot;,                            &quot;lte&quot;: &quot;2018-12-28T02:59:54Z&quot;                        }                    }                }            ]        }    },    &quot;size&quot;: 0,    &quot;aggs&quot;: {        &quot;usage_by_plan&quot;: {            &quot;terms&quot;: {                &quot;field&quot;: &quot;planId&quot;            }        }    }}]]
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.search.SearchService.parseSource(SearchService.java:747)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.search.SearchService.createContext(SearchService.java:572)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:544)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:306)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.search.action.SearchServiceTransportAction$5.call(SearchServiceTransportAction.java:231)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.search.action.SearchServiceTransportAction$5.call(SearchServiceTransportAction.java:228)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.search.action.SearchServiceTransportAction$23.run(SearchServiceTransportAction.java:559)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at java.lang.Thread.run(Thread.java:745)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>Caused by: org.elasticsearch.index.query.QueryParsingException: [apiman_metrics] bool query does not support [filter]
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.index.query.BoolQueryParser.parse(BoolQueryParser.java:113)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.index.query.QueryParseContext.parseInnerQuery(QueryParseContext.java:307)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.index.query.IndexQueryParserService.innerParse(IndexQueryParserService.java:382)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.index.query.IndexQueryParserService.parse(IndexQueryParserService.java:281)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.index.query.IndexQueryParserService.parse(IndexQueryParserService.java:276)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.search.query.QueryParseElement.parse(QueryParseElement.java:33)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><table><tbody id="gmail-log-viewer61-logContent"><tr class="gmail-log-line"><td class="gmail-log-line-text"><span style="font-family:monospace,monospace"><font size="2"><i>        at org.elasticsearch.search.SearchService.parseSource(SearchService.java:731)
</i></font></span></td></tr><tr class="gmail-log-line"></tr></tbody></table><span style="font-family:monospace,monospace"><font size="2"><i>        ... 9 more</i></font></span><br><br></div></div>