我已经将elastic-search 1.7.1与spring应用程序集成在一起。我有一个cron作业,每次运行时更新elasticsearch的索引。我遵循github上提供的各种示例代码使其工作。首先,我有Autowired ElasticSearchOperations用于索引目的:
@Autowired
private ElasticsearchOperations elasticsearchOperations;
然后按以下方式执行循环内索引
for(int i=0;i<list.size();i++)
{
CategoryProductSearch search = new CategoryProductSearch();
// set data to fields
System.out.println("BEFORE SAVING DATA");
IndexQuery indexQuery =new
IndexQueryBuilder().withId(search.getId()).withObject(search).build();
//indexQuery.setId(search.getId());
//indexQuery.setObject(search);
//elasticsearchOperations.createIndex(CategoryProductSearch.class);
elasticsearchOperations.putMapping(CategoryProductSearch.class);
elasticsearchOperations.index(indexQuery);
elasticsearchOperations.refresh(CategoryProductSearch.class,true);
System.out.println("SAVING DATA");
}
当我第一次运行它时,它像预期的那样工作。我在elasticsearch中将集群重命名为"mycluster"。Yml在配置文件夹。第一次运行后,我可以看到创建的文件夹。索引和搜索(在另一个文件中实现)工作完美。但有时代码会卡在下面提到的行,并显示连续的警告[Chase Stein]节点null不是集群的一部分集群[elasticsearch],忽略…
elasticsearchOperations.putMapping(CategoryProductSearch.class);
一段时间后抛出NoNodeAvailableException。我读过关于这个问题的文章,它说可能没有足够的磁盘空间用于弹性搜索来索引数据。我是春天的新手,第一次尝试弹性搜索。这是一个磁盘空间问题或错误的方式,我索引数据?另外,如果我手动从/data目录中删除"mycluster"文件夹并重新启动应用程序,它会再次正常工作。
我已经在我的本地电脑上设置了所有的东西。每当我重新启动elasticsearch服务时,这个问题就会出现。
异常的堆栈跟踪为:
org.elasticsearch.action.UnavailableShardsException: [mycluster][0]
Primary shard is not active or isn't assigned to a known node. Timeout:
[1m], request: index {[mycluster][categoryproductsearch][1],
source[{// Source string }]
at
org.elasticsearch.action.support.replication
.TransportShardReplicationOperationAction$PrimaryPhase
.retryBecauseUnavailable
(TransportShardReplicationOperationAction.java:655)
at
org.elasticsearch.action.support.replication
.TransportShardReplicationOperationAction$PrimaryPhase.doRun
(TransportShardReplicationOperationAction.java:362)
at
org.elasticsearch.common.util.concurrent.AbstractRunnable.run
(AbstractRunnable.java:36)
at
org.elasticsearch.action.support.replication.
TransportShardReplicationOperationAction$PrimaryPhase$3.onTimeout
(TransportShardReplicationOperationAction.java:515)
at
org.elasticsearch.cluster.ClusterStateObserver$ObserverClusterStateListener
.onTimeout
(ClusterStateObserver.java:231)
at
org.elasticsearch.cluster.service.
InternalClusterService$NotifyTimeout.run
(InternalClusterService.java:560)
at
java.util.concurrent.ThreadPoolExecutor.runWorker
(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:615)
at
java.lang.Thread.run(Thread.java:745)
嗨,我从generator-jhipster-elasticsearch-reindexer中获取了这段代码
@Transactional(readOnly = true)
@SuppressWarnings("unchecked")
private <T> void reindexForClass(Class<T> entityClass, JpaRepository<T, Long> jpaRepository,
ElasticsearchRepository<T, Long> elasticsearchRepository) {
elasticsearchTemplate.deleteIndex(entityClass);
try {
elasticsearchTemplate.createIndex(entityClass);
} catch (IndexAlreadyExistsException e) {
// Do nothing. Index was already concurrently recreated by some other service.
}
elasticsearchTemplate.putMapping(entityClass);
if (jpaRepository.count() > 0) {
try {
Method m = jpaRepository.getClass().getMethod("findAllWithEagerRelationships");
elasticsearchRepository.save((List<T>) m.invoke(jpaRepository));
} catch (Exception e) {
elasticsearchRepository.save(jpaRepository.findAll());
}
}
log.info("Elasticsearch: Indexed all rows for " + entityClass.getSimpleName());
}
正如你所看到的,索引首先被删除,然后再次创建映射,我认为你的顺序是错误的,它会导致一些破碎的碎片。您可以访问localhost:9200上的Elastic Rest API,并尝试使用get request/_cat/indices查看您的索引。