<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0" /> <base href="https://hibernate.atlassian.net" />
<title>Message Title</title>
</head>
<body class="jira" style="color: #333; font-family: Arial, sans-serif; font-size: 14px; line-height: 1.429">
<table id="background-table" cellpadding="0" cellspacing="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt; background-color: #f5f5f5; border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<!-- header here -->
<tr>
<td id="header-pattern-container" style="padding: 0px; border-collapse: collapse; padding: 10px 20px">
<table id="header-pattern" cellspacing="0" cellpadding="0" border="0" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tr>
<td id="header-avatar-image-container" valign="top" style="padding: 0px; border-collapse: collapse; vertical-align: top; width: 32px; padding-right: 8px"> <img id="header-avatar-image" class="image_fix" src="https://secure.gravatar.com/avatar/9eecdd1e45f98488a6cbaea66a8b96ba?d=mm&s=48" height="32" width="32" border="0" style="border-radius: 3px; vertical-align: top" />
</td>
<td id="header-text-container" valign="middle" style="padding: 0px; border-collapse: collapse; vertical-align: middle; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 1px"> <a class="user-hover" rel="darioc" id="email_darioc" href="https://hibernate.atlassian.net/secure/ViewProfile.jspa?name=darioc" style="color:#6c797f;; color: #3b73af; text-decoration: none">dario</a> <strong>commented</strong> on <a href="https://hibernate.atlassian.net/browse/HSEARCH-1686" style="color: #3b73af; text-decoration: none"><img src="cid:jira-generated-image-static-improvement-ec144ea5-e106-4b10-8115-8c8361944725" height="16" width="16" border="0" align="absmiddle" alt="Improvement" /> HSEARCH-1686</a>
</td>
</tr>
</table>
</td>
</tr>
<tr>
<td id="email-content-container" style="padding: 0px; border-collapse: collapse; padding: 0 20px">
<table id="email-content-table" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt; border-spacing: 0; border-collapse: separate">
<tr>
<!-- there needs to be content in the cell for it to render in some clients -->
<td class="email-content-rounded-top mobile-expand" style="padding: 0px; border-collapse: collapse; color: #fff; padding: 0 15px 0 16px; height: 15px; background-color: #fff; border-left: 1px solid #ccc; border-top: 1px solid #ccc; border-right: 1px solid #ccc; border-bottom: 0; border-top-right-radius: 5px; border-top-left-radius: 5px; height: 10px; line-height: 10px; padding: 0 15px 0 16px; mso-line-height-rule: exactly">
</td>
</tr>
<tr>
<td class="email-content-main mobile-expand " style="padding: 0px; border-collapse: collapse; border-left: 1px solid #ccc; border-right: 1px solid #ccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #fff">
<table class="page-title-pattern" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tr>
<td style="vertical-align: top;; padding: 0px; border-collapse: collapse; padding-right: 5px; font-size: 20px; line-height: 30px; mso-line-height-rule: exactly" class="page-title-pattern-header-container"> <span class="page-title-pattern-header" style="font-family: Arial, sans-serif; padding: 0; font-size: 20px; line-height: 30px; mso-text-raise: 2px; mso-line-height-rule: exactly; vertical-align: middle"> <a href="https://hibernate.atlassian.net/browse/HSEARCH-1686" style="color: #3b73af; text-decoration: none">Re: Faceted Performance on 50M documents</a> </span>
</td>
</tr>
</table>
</td>
</tr>
<tr>
<td id="text-paragraph-pattern-top" class="email-content-main mobile-expand comment-top-pattern" style="padding: 0px; border-collapse: collapse; border-left: 1px solid #ccc; border-right: 1px solid #ccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #fff; border-bottom: none; padding-bottom: 0">
<table class="text-paragraph-pattern" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 2px">
<tr>
<td class="text-paragraph-pattern-container mobile-resize-text " style="padding: 0px; border-collapse: collapse; padding: 0 0 10px 0">
<p style="margin: 10px 0 0 0">I could have resolved for discrete faceting adding fields to the current document. Now I reindex my small dataset (1.5M docs) to check the performance. In the second step I'll must manage dynamic range faceting.</p>
<p style="margin: 10px 0 0 0">For the first step I resolved using a custom FacetsConfig in order to change the signature for the method "Build". I have create a method "CustomBuild",<br /> <code><br /> class CustomFacetsConfig extends FacetsConfig {<br /> private void checkSeen(Set<String> seenDims, String dim) {<br /> if (seenDims.contains(dim)) </p> { throw new IllegalArgumentException("dimension \"" + dim + "\" is not multiValued, but it appears more than once in this document"); }
<p style="margin: 10px 0 0 0"> seenDims.add(dim);<br /> }</p>
<p style="margin: 10px 0 0 0"> private void processSSDVFacetFields(Map<String, List<SortedSetDocValuesFacetField>> byField, Document doc) throws IOException {<br /> //System.out.println("process SSDV: " + byField);<br /> for (Map.Entry<String, List<SortedSetDocValuesFacetField>> ent : byField.entrySet()) {</p>
<p style="margin: 10px 0 0 0"> String indexFieldName = ent.getKey();<br /> //System.out.println(" field=" + indexFieldName);</p>
<p style="margin: 10px 0 0 0"> for (SortedSetDocValuesFacetField facetField : ent.getValue()) </p> { FacetLabel cp = new FacetLabel(facetField.dim, facetField.label); String fullPath = pathToString(cp.components, cp.length); //System.out.println("add " + fullPath); // For facet counts: doc.add(new SortedSetDocValuesField(indexFieldName, new BytesRef(fullPath))); // For drill-down: doc.add(new StringField(indexFieldName, fullPath, Store.NO)); doc.add(new StringField(indexFieldName, facetField.dim, Store.NO)); }
<p style="margin: 10px 0 0 0"> }<br /> }</p>
<p style="margin: 10px 0 0 0"> public Document CustomBuild(Document doc, Document destDocument) throws IOException {<br /> // Find all FacetFields, collated by the actual field:<br /> //Map<String, List<FacetField>> byField = new HashMap<>();</p>
<p style="margin: 10px 0 0 0"> // ... and also all SortedSetDocValuesFacetFields:<br /> Map<String, List<SortedSetDocValuesFacetField>> dvByField = new HashMap<>();</p>
<p style="margin: 10px 0 0 0"> // ... and also all AssociationFacetFields<br /> //Map<String, List<AssociationFacetField>> assocByField = new HashMap<>();</p>
<p style="margin: 10px 0 0 0"> Set<String> seenDims = new HashSet<>();</p>
<p style="margin: 10px 0 0 0"> for (IndexableField field : doc.getFields()) {<br /> if (field.fieldType() == SortedSetDocValuesFacetField.TYPE) {<br /> SortedSetDocValuesFacetField facetField = (SortedSetDocValuesFacetField) field;<br /> FacetsConfig.DimConfig dimConfig = getDimConfig(facetField.dim);<br /> if (dimConfig.multiValued == false) </p> { checkSeen(seenDims, facetField.dim); }
<p style="margin: 10px 0 0 0"> String indexFieldName = dimConfig.indexFieldName;<br /> List<SortedSetDocValuesFacetField> fields = dvByField.get(indexFieldName);<br /> if (fields == null) </p> { fields = new ArrayList<>(); dvByField.put(indexFieldName, fields); }
<p style="margin: 10px 0 0 0"> fields.add(facetField);<br /> }</p>
<p style="margin: 10px 0 0 0"> }</p>
<p style="margin: 10px 0 0 0"> //Document result = new Document();<br /> processSSDVFacetFields(dvByField, destDocument);<br /> //return result;<br /> return destDocument;</p>
<p style="margin: 10px 0 0 0"> }<br /> }<br /> </code></p>
<p style="margin: 10px 0 0 0">I use this class on my FieldBridge inside the method "set" : <br /> <code><br /> @Override<br /> public void set(String name, Object value, Document document, LuceneOptions luceneOptions) </p> { .... CustomFacetsConfig config = new CustomFacetsConfig(); config.setIndexFieldName(indexField, indexField + "_facet"); Document doc = new Document(); doc.add(new SortedSetDocValuesFacetField(indexField, fieldValueStr)); config.CustomBuild(doc, document); .... }
<p style="margin: 10px 0 0 0"></code></p>
</td>
</tr>
</table>
</td>
</tr>
<tr>
<td class="email-content-main mobile-expand " style="padding: 0px; border-collapse: collapse; border-left: 1px solid #ccc; border-right: 1px solid #ccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #fff">
<table id="actions-pattern" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 1px">
<tr>
<td id="actions-pattern-container" valign="middle" style="padding: 0px; border-collapse: collapse; padding: 10px 0 10px 24px; vertical-align: middle; padding-left: 0">
<table align="left" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tr>
<td class="actions-pattern-action-icon-container" style="padding: 0px; border-collapse: collapse; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 0px; vertical-align: middle"> <a href="https://hibernate.atlassian.net/browse/HSEARCH-1686#add-comment" target="_blank" title="Add Comment" style="color: #3b73af; text-decoration: none"> <img class="actions-pattern-action-icon-image" src="cid:jira-generated-image-static-comment-icon-c9982c58-447f-43ff-8d75-c4988ac43388" alt="Add Comment" title="Add Comment" height="16" width="16" border="0" style="vertical-align: middle" /> </a>
</td>
<td class="actions-pattern-action-text-container" style="padding: 0px; border-collapse: collapse; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 4px; padding-left: 5px"> <a href="https://hibernate.atlassian.net/browse/HSEARCH-1686#add-comment" target="_blank" title="Add Comment" style="color: #3b73af; text-decoration: none">Add Comment</a>
</td>
</tr>
</table>
</td>
</tr>
</table>
</td>
</tr>
<!-- there needs to be content in the cell for it to render in some clients -->
<tr>
<td class="email-content-rounded-bottom mobile-expand" style="padding: 0px; border-collapse: collapse; color: #fff; padding: 0 15px 0 16px; height: 5px; line-height: 5px; background-color: #fff; border-top: 0; border-left: 1px solid #ccc; border-bottom: 1px solid #ccc; border-right: 1px solid #ccc; border-bottom-right-radius: 5px; border-bottom-left-radius: 5px; mso-line-height-rule: exactly">
</td>
</tr>
</table>
</td>
</tr>
<tr>
<td id="footer-pattern" style="padding: 0px; border-collapse: collapse; padding: 12px 20px">
<table id="footer-pattern-container" cellspacing="0" cellpadding="0" border="0" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tr>
<td id="footer-pattern-text" class="mobile-resize-text" width="100%" style="padding: 0px; border-collapse: collapse; color: #999; font-size: 12px; line-height: 18px; font-family: Arial, sans-serif; mso-line-height-rule: exactly; mso-text-raise: 2px">
This message was sent by Atlassian JIRA <span id="footer-build-information">(v6.4-OD-05-009#64003-<span title="e99cc6b9007a6cdb8fbf4f57d1a3717d5f37f521" data-commit-id="e99cc6b9007a6cdb8fbf4f57d1a3717d5f37f521}">sha1:e99cc6b</span>)</span>
</td>
<td id="footer-pattern-logo-desktop-container" valign="top" style="padding: 0px; border-collapse: collapse; padding-left: 20px; vertical-align: top">
<table style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tr>
<td id="footer-pattern-logo-desktop-padding" style="padding: 0px; border-collapse: collapse; padding-top: 3px"> <img id="footer-pattern-logo-desktop" src="cid:jira-generated-image-static-footer-desktop-logo-dbb3f3bb-db3a-479a-8811-a0caa658bfd8" alt="Atlassian logo" title="Atlassian logo" width="169" height="36" class="image_fix" />
</td>
</tr>
</table>
</td>
</tr>
</table>
</td>
</tr>
</table>
</body>
</html>