<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0">
<base href="https://hibernate.atlassian.net">
<title>Message Title</title>
</head>
<body class="jira" style="color: #333333; font-family: Arial, sans-serif; font-size: 14px; line-height: 1.429">
<table id="background-table" cellpadding="0" cellspacing="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0; background-color: #f5f5f5; border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0" bgcolor="#f5f5f5">
<!-- header here -->
<tbody>
<tr>
<td id="header-pattern-container" style="padding: 0; border-collapse: collapse; padding: 10px 20px">
<table id="header-pattern" cellspacing="0" cellpadding="0" border="0" style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0">
<tbody>
<tr>
<td id="header-avatar-image-container" valign="top" style="padding: 0; border-collapse: collapse; vertical-align: top; width: 32px; padding-right: 8px" width="32"> <img id="header-avatar-image" class="image_fix" src="https://avatar-cdn.atlassian.com/1c92e8184311c39a60a499b028509491?s=48&d=https%3A%2F%2Fsecure.gravatar.com%2Favatar%2F1c92e8184311c39a60a499b028509491%3Fd%3Dmm%26s%3D48%26noRedirect%3Dtrue" height="32" width="32" border="0" style="border-radius: 3px; vertical-align: top"> </td>
<td id="header-text-container" valign="middle" style="padding: 0; border-collapse: collapse; vertical-align: middle; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 1px"> <a class="user-hover" rel="lhartzman" style="color:#6c797f;; color: #3b73af; text-decoration: none" id="email_lhartzman" href="https://hibernate.atlassian.net/secure/ViewProfile.jspa?accountId=557058%3A1d140a27-40e0-4ce7-bd94-c50b68c049ab"> Les Hartzman </a> <strong>created</strong> an issue </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td id="email-content-container" style="padding: 0; border-collapse: collapse; padding: 0 20px">
<table id="email-content-table" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0; border-spacing: 0; border-collapse: separate">
<tbody>
<tr>
<!-- there needs to be content in the cell for it to render in some clients -->
<td class="email-content-rounded-top mobile-expand" style="padding: 0; border-collapse: collapse; color: #ffffff; padding: 0 15px 0 16px; height: 15px; background-color: #ffffff; border-left: 1px solid #cccccc; border-top: 1px solid #cccccc; border-right: 1px solid #cccccc; border-bottom: 0; border-top-right-radius: 5px; border-top-left-radius: 5px; height: 10px; line-height: 10px; padding: 0 15px 0 16px; mso-line-height-rule: exactly" height="10" bgcolor="#ffffff"> </td>
</tr>
<tr>
<td class="email-content-main mobile-expand " style="padding: 0; border-collapse: collapse; border-left: 1px solid #cccccc; border-right: 1px solid #cccccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #ffffff" bgcolor="#ffffff">
<table class="page-title-pattern" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0">
<tbody>
<tr>
<td class="page-title-pattern-first-line " style="padding: 0; border-collapse: collapse; font-family: Arial, sans-serif; font-size: 14px; padding-top: 10px"> <a href="https://hibernate.atlassian.net/browse/HHH?atlOrigin=eyJpIjoiNzIzMTk2NjUwMjJlNDk1MmE3OTk2ZjYzMzFmNWEwZmEiLCJwIjoiaiJ9" style="color: #3b73af; text-decoration: none">Hibernate ORM</a> / <a href="https://hibernate.atlassian.net/browse/HHH-13375?atlOrigin=eyJpIjoiNzIzMTk2NjUwMjJlNDk1MmE3OTk2ZjYzMzFmNWEwZmEiLCJwIjoiaiJ9" style="color: #3b73af; text-decoration: none"><img src="cid:jira-generated-image-avatar-5c001cc5-fdd2-4866-8f8a-05b722b2bc51" height="16" width="16" border="0" align="absmiddle" alt="Bug" style="vertical-align: text-bottom"></a> <a href="https://hibernate.atlassian.net/browse/HHH-13375?atlOrigin=eyJpIjoiNzIzMTk2NjUwMjJlNDk1MmE3OTk2ZjYzMzFmNWEwZmEiLCJwIjoiaiJ9" style="color: #3b73af; text-decoration: none">HHH-13375</a> </td>
</tr>
<tr>
<td style="vertical-align: top;; padding: 0; border-collapse: collapse; padding-right: 5px; font-size: 20px; line-height: 30px; mso-line-height-rule: exactly" class="page-title-pattern-header-container"> <span class="page-title-pattern-header" style="font-family: Arial, sans-serif; padding: 0; font-size: 20px; line-height: 30px; mso-text-raise: 2px; mso-line-height-rule: exactly; vertical-align: middle"> <a href="https://hibernate.atlassian.net/browse/HHH-13375?atlOrigin=eyJpIjoiNzIzMTk2NjUwMjJlNDk1MmE3OTk2ZjYzMzFmNWEwZmEiLCJwIjoiaiJ9" style="color: #3b73af; text-decoration: none">Duplicate entry exception on batch insert with primary key auto-generated</a> </span> </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td class="email-content-main mobile-expand wrapper-special-margin" style="padding: 0; border-collapse: collapse; border-left: 1px solid #cccccc; border-right: 1px solid #cccccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #ffffff; padding-top: 10px; padding-bottom: 5px" bgcolor="#ffffff">
<table class="keyvalue-table" style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0">
<tbody>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Issue Type:</th>
<td class="has-icon" style="padding: 0; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> <img src="cid:jira-generated-image-avatar-5c001cc5-fdd2-4866-8f8a-05b722b2bc51" height="16" width="16" border="0" align="absmiddle" alt="Bug" style="vertical-align: text-bottom"> Bug </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Assignee:</th>
<td style="padding: 0; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> Unassigned </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Components:</th>
<td style="padding: 0; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> hibernate-core, hibernate-hikaricp </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Created:</th>
<td style="padding: 0; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> 18/Apr/2019 09:44 AM </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Environment:</th>
<td style="padding: 0; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> Spring Boot 2.1.4, HikariCP 3.3.1, Aurora MySQL, JDK 1.8.0_201, MySQL Connector/J 8.0.15 </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Priority:</th>
<td class="has-icon" style="padding: 0; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> <img src="cid:jira-generated-image-static-major-ee0464da-1177-4cfd-8ac5-61df30b947c6" height="16" width="16" border="0" align="absmiddle" alt="Major" style="vertical-align: text-bottom"> Major </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Reporter:</th>
<td style="padding: 0; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> <a class="user-hover" rel="lhartzman" style="color:#6c797f;; color: #3b73af; text-decoration: none" id="email_lhartzman" href="https://hibernate.atlassian.net/secure/ViewProfile.jspa?accountId=557058%3A1d140a27-40e0-4ce7-bd94-c50b68c049ab"> Les Hartzman </a> </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td class="email-content-main mobile-expand issue-description-container" style="padding: 0; border-collapse: collapse; border-left: 1px solid #cccccc; border-right: 1px solid #cccccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #ffffff; padding-top: 5px; padding-bottom: 10px" bgcolor="#ffffff">
<table class="text-paragraph-pattern" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 2px">
<tbody>
<tr>
<td class="text-paragraph-pattern-container mobile-resize-text " style="padding: 0; border-collapse: collapse; padding: 0 0 10px"> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0; margin-top: 0">I'm getting an error executing batch inserts with a constraint violation exception, which to me makes no sense.</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0">I'm getting a list of users from a table and then looking for entries of those users in an auditing table. If not there, insert them. Because I'm dealing with a lot of users, I batch up the data to be inserted, creating a list of objects and then using *<b>saveAll(list)</b>* to batch them up.</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0">I'm using Spring Boot 2.1.4 and HikariCP 3.3.1. The primary key of the table getting the inserts is the ID field that is auto-generated. So how I could be getting duplicate entry errors is unclear, unless perhaps this is a timing issue.</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0">I'm batching 1000 objects/statements at a time. It works for at least 1 set of 1000 before it barfs. I'm assuming that the "managed flush" error is a side effect of the duplicate entry error.</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0">My entity is:</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0"> @Data<br> @Entity<br> @Table(name = "event_state", schema = "subscription")<br> public class EventState </p> { @Id @GeneratedValue(generator = "generator") @GenericGenerator(name = "generator", strategy = "increment") private Long id; @Column(name = "customer_dimension_id") private Long customerDimensionId; @Column(name = "event_id") private Long eventId; @Column(name = "last_modified") @Temporal(TemporalType.TIMESTAMP) private Date lastModified; } <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0">Here is the <b>application.properties</b> file:</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0"> spring.output.ansi.enabled=ALWAYS</p>
<ol>
<li>logging<br> logging.file=/tmp/activeusers.log</li>
</ol> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0"> #HikariCP config<br> subscription.datasource.url=jdbc:mysql://mysqlhost:3306/subscription<br> subscription.datasource.username=USER<br> subscription.datasource.password=PASS<br> subscription.datasource.driverClassName=com.mysql.cj.jdbc.Driver<br> subscription.datasource.hikari.connection-timeout=60000<br> subscription.datasource.hikari.maximum-pool-size=6<br> subscription.datasource.hikari.idle-timeout=300000<br> subscription.datasource.hikari.max-lifetime=1800000<br> subscription.datasource.hikari.minimum-idle=6<br> subscription.datasource.hikari.auto-commit=false<br> subscription.datasource.hikari.validation-timeout=15000<br> subscription.datasource.cachePrepStmts=true<br> subscription.datasource.prepStmtCacheSize=250<br> subscription.datasource.prepStmtCacheSqlLimit=2048<br> subscription.datasource.useServerPrepStmts=false<br> subscription.datasource.useLocalSessionState=true<br> subscription.datasource.rewriteBatchedStatements=true<br> subscription.datasource.cacheResultSetMetadata=true<br> subscription.datasource.cacheServerConfiguration=true<br> subscription.datasource.elideSetAutoCommits=false<br> subscription.datasource.maintainTimeStats=false<br> subscription.datasource.hikari.pool-name=SubscriptionPool</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0"> #HikariCP config<br> activity.datasource.url=jdbc:mysql://mysqlhost:3306/activity<br> activity.datasource.username=USER<br> activity.datasource.password=PASS<br> activity.datasource.driverClassName=com.mysql.cj.jdbc.Driver<br> activity.datasource.hikari.connection-timeout=60000<br> activity.datasource.hikari.maximum-pool-size=6<br> activity.datasource.hikari.idle-timeout=300000<br> activity.datasource.hikari.max-lifetime=1800000<br> activity.datasource.hikari.minimum-idle=6<br> activity.datasource.hikari.auto-commit=true<br> activity.datasource.hikari.validation-timeout=15000<br> activity.datasource.cachePrepStmts=true<br> activity.datasource.prepStmtCacheSize=250<br> activity.datasource.prepStmtCacheSqlLimit=2048<br> activity.datasource.useServerPrepStmts=true<br> activity.datasource.useLocalSessionState=true<br> activity.datasource.rewriteBatchedStatements=true<br> activity.datasource.cacheResultSetMetadata=true<br> activity.datasource.cacheServerConfiguration=true<br> activity.datasource.elideSetAutoCommits=true<br> activity.datasource.maintainTimeStats=false<br> activity.datasource.hikari.pool-name=ActivityPool</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0"> spring.jpa.properties.hibernate.jdbc.batch_size=500<br> spring.jpa.properties.hibernate.order_inserts=true<br> spring.jpa.properties.hibernate.order_updates=true</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0">I had <b>batch_size</b> set at 1000 originally, then changed it to 100. </p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0">UPD 1: tried changing from using *<b>saveAll</b>* to *<b>save</b>* in a loop. Same problem.<br> UPD 2: tried switching to the MariaDB driver, but had the same problem.</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0">I don't know if there is a config issue with HikariCP or a Hibernate issue or both. The problem is on the <b>subscription</b> DB, and only one thread does the *<b>saveAll</b>*.</p> </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td class="email-content-main mobile-expand " style="padding: 0; border-collapse: collapse; border-left: 1px solid #cccccc; border-right: 1px solid #cccccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #ffffff" bgcolor="#ffffff"> <script type="application/ld+json">
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"description": "View Issue",
"potentialAction": {
"@type": "ViewAction",
"target": "https://hibernate.atlassian.net/browse/HHH-13375?inbox=true&",
"name": "View Issue"
},
"publisher": {
"@type": "Organization",
"name": "Atlassian",
"url": "https://www.atlassian.com"
}
}
</script>
<table id="actions-pattern" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 1px">
<tbody>
<tr>
<td id="actions-pattern-container" valign="middle" style="padding: 0; border-collapse: collapse; padding: 10px 0 10px 24px; vertical-align: middle; padding-left: 0">
<table align="left" style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0">
<tbody>
<tr>
<td class="actions-pattern-action-icon-container" style="padding: 0; border-collapse: collapse; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 0; vertical-align: middle"> <a href="https://hibernate.atlassian.net/browse/HHH-13375#add-comment?atlOrigin=eyJpIjoiNzIzMTk2NjUwMjJlNDk1MmE3OTk2ZjYzMzFmNWEwZmEiLCJwIjoiaiJ9" target="_blank" title="Add Comment" style="color: #3b73af; text-decoration: none"> <img class="actions-pattern-action-icon-image" src="cid:jira-generated-image-static-comment-icon-44949eba-f959-485d-ac3a-c24c49603e39" alt="Add Comment" title="Add Comment" height="16" width="16" border="0" style="vertical-align: middle"> </a> </td>
<td class="actions-pattern-action-text-container" style="padding: 0; border-collapse: collapse; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 4px; padding-left: 5px"> <a href="https://hibernate.atlassian.net/browse/HHH-13375#add-comment?atlOrigin=eyJpIjoiNzIzMTk2NjUwMjJlNDk1MmE3OTk2ZjYzMzFmNWEwZmEiLCJwIjoiaiJ9" target="_blank" title="Add Comment" style="color: #3b73af; text-decoration: none">Add Comment</a> </td>
</tr>
</tbody>
</table> </td>
</tr>
</tbody>
</table> </td>
</tr>
<!-- there needs to be content in the cell for it to render in some clients -->
<tr>
<td class="email-content-rounded-bottom mobile-expand" style="padding: 0; border-collapse: collapse; color: #ffffff; padding: 0 15px 0 16px; height: 5px; line-height: 5px; background-color: #ffffff; border-top: 0; border-left: 1px solid #cccccc; border-bottom: 1px solid #cccccc; border-right: 1px solid #cccccc; border-bottom-right-radius: 5px; border-bottom-left-radius: 5px; mso-line-height-rule: exactly" height="5" bgcolor="#ffffff"> </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td id="footer-pattern" style="padding: 0; border-collapse: collapse; padding: 12px 20px">
<table id="footer-pattern-container" cellspacing="0" cellpadding="0" border="0" style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0">
<tbody>
<tr>
<td id="footer-pattern-mobile-separated-links" class="mobile-resize-text" width="100%" colspan="2" style="padding: 0; border-collapse: collapse; color: #999999; font-size: 12px; line-height: 18px; font-family: Arial, sans-serif; mso-line-height-rule: exactly; mso-text-raise: 2px"> Get Jira notifications on your phone! Download the Jira Cloud app for <a href="https://play.google.com/store/apps/details?id=com.atlassian.android.jira.core&referrer=utm_source%3DNotificationLink%26utm_medium%3DEmail" style="color: #3b73af; text-decoration: none">Android</a> or <a href="https://itunes.apple.com/app/apple-store/id1006972087?pt=696495&ct=EmailNotificationLink&mt=8" style="color: #3b73af; text-decoration: none">iOS</a>
<hr> </td>
</tr>
<tr>
<td id="footer-pattern-text" class="mobile-resize-text" width="100%" style="padding: 0; border-collapse: collapse; color: #999999; font-size: 12px; line-height: 18px; font-family: Arial, sans-serif; mso-line-height-rule: exactly; mso-text-raise: 2px"> This message was sent by Atlassian Jira <span id="footer-build-information">(v1001.0.0-SNAPSHOT#100099-<span title="adbe2fa4c5c17f9c5e95a9541b61463e837087d9" data-commit-id="adbe2fa4c5c17f9c5e95a9541b61463e837087d9}">sha1:adbe2fa</span>)</span> </td>
<td id="footer-pattern-logo-desktop-container" valign="top" style="padding: 0; border-collapse: collapse; padding-left: 20px; vertical-align: top">
<table style="border-collapse: collapse; mso-table-lspace: 0; mso-table-rspace: 0">
<tbody>
<tr>
<td id="footer-pattern-logo-desktop-padding" style="padding: 0; border-collapse: collapse; padding-top: 3px; opacity: 0.150"> <img id="footer-pattern-logo-desktop" src="cid:jira-generated-image-static-footer-desktop-logo-b1fb3916-d9b6-477a-9710-009eee35cfa2" alt="Atlassian logo" title="Atlassian logo" width="192" height="24" class="image_fix"> </td>
</tr>
</tbody>
</table> </td>
</tr>
</tbody>
</table> </td>
</tr>
</tbody>
</table>
<img border="0" width="1" height="1" alt="" src="http://atlassian.et.e.sparkpost.com/q/99C2Q4DhNUOWXrfjNR2VMw~~/AAAAAQA~/RgRemdzfPlcLYXRsYXNzaWFudXNCCgAAX6m4XJ9v8ilSIGhpYmVybmF0ZS1pc3N1ZXNAbGlzdHMuamJvc3Mub3JnWAQAAAAE">
</body>
</html>