[hibernate-commits] [hibernate/hibernate-search] b1178c: HSEARCH-4736 Add offloading operation submitter

Branch: refs/heads/main Home: https://github.com/hibernate/hibernate-search Commit: b1178cc15913143eaf3c25717c05f026b7fc36bd https://github.com/hibernate/hibernate-search/commit/b1178cc15913143eaf3c... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/orchestration/impl/ElasticsearchBatchingWorkOrchestrator.java M backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/orchestration/impl/ElasticsearchSimpleWorkOrchestrator.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneParallelWorkOrchestratorImpl.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneSerialWorkOrchestratorImpl.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneSyncWorkOrchestratorImpl.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/AbstractWorkOrchestrator.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutor.java M engine/src/main/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitter.java M engine/src/test/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutorTest.java M engine/src/test/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitterTest.java Log Message: ----------- HSEARCH-4736 Add offloading operation submitter Commit: 97a0b8640fd72009d62e2620e979aa3a85b75f7a https://github.com/hibernate/hibernate-search/commit/97a0b8640fd72009d62e... Author: Yoann Rodière <yoann(a)hibernate.org&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M engine/src/main/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitter.java Log Message: ----------- HSEARCH-4736 Simplify OperationSubmitter Commit: 7d56edfb066f283a5c10cf499ad75515e7ebd6a1 https://github.com/hibernate/hibernate-search/commit/7d56edfb066f283a5c10... Author: Yoann Rodière <yoann(a)hibernate.org&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/orchestration/impl/ElasticsearchBatchingWorkOrchestrator.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneSerialWorkOrchestratorImpl.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutor.java M engine/src/main/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitter.java Log Message: ----------- HSEARCH-4736 Avoid unnecessary lambdas just for casting works in orchestrators Commit: 8cb5ab3bdc7581097123d46a977f0e3a23425834 https://github.com/hibernate/hibernate-search/commit/8cb5ab3bdc7581097123... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/search/query/impl/ElasticsearchSearchQueryImpl.java M backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/search/query/impl/ElasticsearchSearchScrollImpl.java M backend/elasticsearch/src/test/java/org/hibernate/search/backend/elasticsearch/work/execution/impl/ElasticsearchIndexIndexingPlanExecutionTest.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/index/impl/LuceneIndexManagerImpl.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneParallelWorkOrchestratorImpl.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneSyncWorkOrchestratorImpl.java M backend/lucene/src/test/java/org/hibernate/search/backend/lucene/work/execution/impl/LuceneIndexIndexingPlanExecutionTest.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/AbstractWorkOrchestrator.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutor.java M engine/src/main/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitter.java M engine/src/test/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutorTest.java M engine/src/test/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitterTest.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/bootstrap/ElasticsearchBootstrapIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerDropAndCreateIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerDropIfExistingIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerOperation.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerUpdateAliasesIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerUpdateAnalyzerIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerUpdateCustomMappingIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerUpdateCustomSettingsIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerUpdateMappingBaseIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerUpdateMappingFieldTemplateIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerUpdateNormalizerIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/schema/management/ElasticsearchIndexSchemaManagerValidationOperation.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/work/ElasticsearchIndexingIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/work/ElasticsearchZeroDowntimeReindexingIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/index/LuceneIndexManagerIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/lifecycle/LuceneCleanupIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/lowlevel/directory/AbstractDirectoryIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/lowlevel/directory/MultiDirectoryIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/lowlevel/reader/LuceneIndexReaderRefreshBaseIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/lowlevel/reader/LuceneIndexReaderRefreshSettingsPerShardIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/lowlevel/writer/LuceneIndexWriterCommitIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/lowlevel/writer/LuceneIndexWriterSettingsIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/schema/management/LuceneIndexSchemaManagerCreationIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/schema/management/LuceneIndexSchemaManagerCreationOrPreservationIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/schema/management/LuceneIndexSchemaManagerDropAndCreateIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/schema/management/LuceneIndexSchemaManagerDropIfExistingIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/schema/management/LuceneIndexSchemaManagerValidationIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/work/LuceneIndexingNestedIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/dynamic/FieldTemplateIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/multitenancy/MultiTenancyBaseIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/multitenancy/MultiTenancyMismatchIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/sharding/AbstractShardingRoutingKeyIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/sharding/ShardingHashDocumentIdIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexIndexerIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexIndexerLargeDocumentsIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexIndexingPlanIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexWorkspaceFlushIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexWorkspaceIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexWorkspaceMergeSegmentsIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexWorkspacePurgeIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexWorkspaceRefreshIT.java M integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexingFieldTypesIT.java M integrationtest/mapper/orm/src/test/java/org/hibernate/search/integrationtest/mapper/orm/automaticindexing/session/AutomaticIndexingSynchronizationStrategyIT.java M integrationtest/performance/backend/base/src/main/java/org/hibernate/search/integrationtest/performance/backend/base/AbstractMassIndexingBenchmarks.java M integrationtest/performance/backend/base/src/main/java/org/hibernate/search/integrationtest/performance/backend/base/AbstractOnTheFlyIndexingBenchmarks.java M integrationtest/performance/backend/base/src/main/java/org/hibernate/search/integrationtest/performance/backend/base/testsupport/index/IndexInitializer.java M mapper/orm-batch-jsr352/core/src/main/java/org/hibernate/search/batch/jsr352/core/massindexing/step/impl/EntityWriter.java M mapper/orm-coordination-outbox-polling/src/main/java/org/hibernate/search/mapper/orm/coordination/outboxpolling/event/impl/OutboxEventProcessingPlan.java M mapper/orm-coordination-outbox-polling/src/main/java/org/hibernate/search/mapper/orm/coordination/outboxpolling/event/impl/OutboxPollingOutboxEventSendingPlan.java M mapper/orm/src/main/java/org/hibernate/search/mapper/orm/automaticindexing/session/AutomaticIndexingSynchronizationConfigurationContext.java M mapper/orm/src/main/java/org/hibernate/search/mapper/orm/automaticindexing/session/impl/ConfiguredAutomaticIndexingSynchronizationStrategy.java M mapper/orm/src/main/java/org/hibernate/search/mapper/orm/schema/management/impl/SchemaManagementListener.java M mapper/orm/src/main/java/org/hibernate/search/mapper/orm/schema/management/impl/SearchSchemaManagerImpl.java M mapper/orm/src/main/java/org/hibernate/search/mapper/orm/work/impl/SearchWorkspaceImpl.java M mapper/pojo-base/src/main/java/org/hibernate/search/mapper/pojo/massindexing/impl/PojoMassIndexingBatchCoordinator.java M mapper/pojo-base/src/main/java/org/hibernate/search/mapper/pojo/massindexing/impl/PojoMassIndexingEntityLoadingRunnable.java M mapper/pojo-base/src/main/java/org/hibernate/search/mapper/pojo/schema/management/spi/PojoScopeSchemaManager.java M mapper/pojo-base/src/main/java/org/hibernate/search/mapper/pojo/work/spi/PojoIndexer.java M mapper/pojo-base/src/main/java/org/hibernate/search/mapper/pojo/work/spi/PojoIndexingPlan.java M mapper/pojo-base/src/main/java/org/hibernate/search/mapper/pojo/work/spi/PojoIndexingQueueEventProcessingPlan.java M mapper/pojo-base/src/main/java/org/hibernate/search/mapper/pojo/work/spi/PojoIndexingQueueEventSendingPlan.java M mapper/pojo-base/src/main/java/org/hibernate/search/mapper/pojo/work/spi/PojoScopeWorkspace.java M mapper/pojo-standalone/src/main/java/org/hibernate/search/mapper/pojo/standalone/schema/management/impl/SchemaManagementListener.java M mapper/pojo-standalone/src/main/java/org/hibernate/search/mapper/pojo/standalone/schema/management/impl/SearchSchemaManagerImpl.java M mapper/pojo-standalone/src/main/java/org/hibernate/search/mapper/pojo/standalone/work/impl/SearchIndexerImpl.java M mapper/pojo-standalone/src/main/java/org/hibernate/search/mapper/pojo/standalone/work/impl/SearchIndexingPlanImpl.java M mapper/pojo-standalone/src/main/java/org/hibernate/search/mapper/pojo/standalone/work/impl/SearchWorkspaceImpl.java M util/internal/integrationtest/mapper/stub/src/main/java/org/hibernate/search/util/impl/integrationtest/mapper/stub/BulkIndexer.java M util/internal/integrationtest/mapper/stub/src/main/java/org/hibernate/search/util/impl/integrationtest/mapper/stub/StubMappingImpl.java Log Message: ----------- HSEARCH-4736 Hide operation submitter constant instances Commit: 56f06536bb2abc1339124800a0673afb8a240112 https://github.com/hibernate/hibernate-search/commit/56f06536bb2abc133912... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/orchestration/impl/ElasticsearchBatchingWorkOrchestrator.java M backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/orchestration/impl/ElasticsearchSimpleWorkOrchestrator.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneParallelWorkOrchestratorImpl.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneSerialWorkOrchestratorImpl.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneSyncWorkOrchestratorImpl.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/AbstractWorkOrchestrator.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutor.java M engine/src/main/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitter.java M engine/src/test/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutorTest.java M engine/src/test/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitterTest.java Log Message: ----------- HSEARCH-4736 Use a consumer instead of a function for blockingRetryProducer Commit: 35e0095e46959a212eebd31eff69d4ad77117d20 https://github.com/hibernate/hibernate-search/commit/35e0095e46959a212eeb... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/orchestration/impl/ElasticsearchBatchingWorkOrchestrator.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneSerialWorkOrchestratorImpl.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/AbstractWorkOrchestrator.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutor.java M engine/src/test/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutorTest.java Log Message: ----------- HSEARCH-4736 Make batching executors more generic Commit: f4f0b5b5225ed7e734df7fb193781932bfa372da https://github.com/hibernate/hibernate-search/commit/f4f0b5b5225ed7e734df... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M backend/elasticsearch/src/main/java/org/hibernate/search/backend/elasticsearch/resources/impl/DefaultElasticsearchWorkExecutorProvider.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneParallelWorkOrchestratorImpl.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/resources/impl/BackendThreads.java M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/resources/impl/DefaultLuceneWorkExecutorProvider.java M engine/src/main/java/org/hibernate/search/engine/common/execution/spi/DelegatingSimpleScheduledExecutor.java M engine/src/main/java/org/hibernate/search/engine/common/execution/spi/SimpleScheduledExecutor.java M engine/src/test/java/org/hibernate/search/engine/backend/orchestration/spi/BatchingExecutorTest.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/client/ElasticsearchClientFactoryImplIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/client/ElasticsearchContentLengthIT.java M integrationtest/backend/elasticsearch/src/test/java/org/hibernate/search/integrationtest/backend/elasticsearch/work/ElasticsearchBackendWorkExecutorProviderIT.java M integrationtest/backend/lucene/src/test/java/org/hibernate/search/integrationtest/backend/lucene/work/LuceneBackendWorkExecutorProviderIT.java M util/internal/integrationtest/backend/elasticsearch/src/main/java/org/hibernate/search/util/impl/integrationtest/backend/elasticsearch/rule/TestElasticsearchClient.java Log Message: ----------- HSEARCH-4736 Move blocking executor check to SimpleScheduledExecutor Commit: 2b1032186379163158ed3c31be00fdb37dec321a https://github.com/hibernate/hibernate-search/commit/2b1032186379163158ed... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M engine/src/main/java/org/hibernate/search/engine/common/execution/spi/SimpleScheduledExecutor.java Log Message: ----------- HSEARCH-4736 Add one more way to submit tasks to executor Commit: a2cb88588c4e26437d6434dde261c95c46080275 https://github.com/hibernate/hibernate-search/commit/a2cb88588c4e26437d64... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneParallelWorkOrchestratorImpl.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/AbstractWorkOrchestrator.java M engine/src/main/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitter.java Log Message: ----------- HSEARCH-4736 Make lucene parallel orchestrator support operation submitters Commit: 2688a0de2144179b4dc97d90195ca25c1000864b https://github.com/hibernate/hibernate-search/commit/2688a0de2144179b4dc9... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M build/jqassistant/rules.xml M engine/src/main/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitter.java Log Message: ----------- HSEARCH-4736 Update jqassist rules Commit: 3346b6bbc8eac62b94741bf3472ff756e7be8d05 https://github.com/hibernate/hibernate-search/commit/3346b6bbc8eac62b9474... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M backend/lucene/src/main/java/org/hibernate/search/backend/lucene/orchestration/impl/LuceneParallelWorkOrchestratorImpl.java M engine/src/main/java/org/hibernate/search/engine/backend/orchestration/spi/AbstractWorkOrchestrator.java M engine/src/main/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitter.java A engine/src/test/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitterExecutorTest.java A engine/src/test/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitterQueueTest.java R engine/src/test/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitterTest.java Log Message: ----------- HSEARCH-4736 Use simpler interface for `submitToExecutor` blocking retry producer Commit: f2d57dff81421aca3c38a96e323ec762d8d68d55 https://github.com/hibernate/hibernate-search/commit/f2d57dff81421aca3c38... Author: marko-bekhta <marko.prykladna(a)gmail.com&gt; Date: 2023-02-08 (Wed, 08 Feb 2023) Changed paths: M engine/src/main/java/org/hibernate/search/engine/backend/work/execution/OperationSubmitter.java Log Message: ----------- HSEARCH-4736 Try to offer to SimpleScheduledExecutor before offloading the operation Compare: https://github.com/hibernate/hibernate-search/compare/044caf31a08e...f2d5...