小贝子编程

elasticsearch java响应被卡住



我使用spring数据elasticsearch来查询并将文档保存到elaticsearch(7.12(：

  • 弹簧套：2.7.1
  • 弹簧靴启动器数据弹性搜索：2.7.1
  • 弹簧数据弹性搜索：4.4.1

运行一段时间后，调用CrudRepository#save方法保存文档时，所有工作线程都卡住了。这里有一个线程转储：

status: org.apache.http.concurrent.BasicFuture@11ab10df WAITING

java.lang.Object.wait(Native Method)
java.lang.Object.wait(Object.java:502)
org.apache.http.concurrent.BasicFuture.get(BasicFuture.java:82)
org.apache.http.impl.nio.client.FutureWrapper.get(FutureWrapper.java:70)
org.elasticsearch.client.RestClient.performRequest(RestClient.java:295)
org.elasticsearch.client.RestClient.performRequest(RestClient.java:287)
org.elasticsearch.client.RestHighLevelClient.performClientRequest(RestHighLevelClient.java:2699)
org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2171)
org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:2137)
org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:2105)
org.elasticsearch.client.IndicesClient.refresh(IndicesClient.java:900)
org.springframework.data.elasticsearch.core.RestIndexTemplate.lambda$doRefresh$8(RestIndexTemplate.java:178)
org.springframework.data.elasticsearch.core.RestIndexTemplate$$Lambda$1112/1741758039.doWithClient(Unknown Source)
org.springframework.data.elasticsearch.core.ElasticsearchRestTemplate.execute(ElasticsearchRestTemplate.java:582)
org.springframework.data.elasticsearch.core.RestIndexTemplate.doRefresh(RestIndexTemplate.java:178)
org.springframework.data.elasticsearch.core.AbstractIndexTemplate.refresh(AbstractIndexTemplate.java:163)
org.springframework.data.elasticsearch.repository.support.SimpleElasticsearchRepository.doRefresh(SimpleElasticsearchRepository.java:313)
org.springframework.data.elasticsearch.repository.support.SimpleElasticsearchRepository.executeAndRefresh(SimpleElasticsearchRepository.java:361)
org.springframework.data.elasticsearch.repository.support.SimpleElasticsearchRepository.save(SimpleElasticsearchRepository.java:188)
sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.springframework.data.repository.core.support.RepositoryMethodInvoker$RepositoryFragmentMethodInvoker.lambda$new$0(RepositoryMethodInvoker.java:289)
org.springframework.data.repository.core.support.RepositoryMethodInvoker$RepositoryFragmentMethodInvoker$$Lambda$1061/168251875.invoke(Unknown Source)
org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137)
org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121)
org.springframework.data.repository.core.support.RepositoryComposition$RepositoryFragments.invoke(RepositoryComposition.java:530)
org.springframework.data.repository.core.support.RepositoryComposition.invoke(RepositoryComposition.java:286)
org.springframework.data.repository.core.support.RepositoryFactorySupport$ImplementationMethodExecutionInterceptor.invoke(RepositoryFactorySupport.java:640)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:164)
org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
com.sun.proxy.$Proxy64.save(Unknown Source)
sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
com.sun.proxy.$Proxy64.save(Unknown Source)
...

似乎它一直停留在这个代码行(RestClient.java：295(上等待es响应，但从未得到它，所以Future#get()是永远等待：

try {
httpResponse = client.execute(context.requestProducer, context.asyncResponseConsumer, context.context, null).get();
} catch (Exception e) {

我想知道的是，为什么它不抛出类似TimeoutException的东西，而不是永远等待响应

此外，超时设置为30s，默认情况下保持活动，并且所有这些信息可以在以下调试日志中找到：

2022-08-02 17:43:28.652 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.conn.ManagedNHttpClientConnectionImpl 154 - http-outgoing-0 10.234.8.18:39418<->103.74.51.222:443[ACTIVE][rw:][ACTIVE][rw][NEED_UNWRAP][0][0][311]: Set timeout 30000
2022-08-02 17:43:28.652 [I/O dispatcher 1] DEBUG org.apache.http.headers 134 - http-outgoing-0 >> GET / HTTP/1.1
2022-08-02 17:43:28.652 [I/O dispatcher 1] DEBUG org.apache.http.headers 137 - http-outgoing-0 >> X-Elastic-Client-Meta: es=7.17.4p,jv=1.8,t=7.17.4p,hc=4.1.5
2022-08-02 17:43:28.652 [I/O dispatcher 1] DEBUG org.apache.http.headers 137 - http-outgoing-0 >> Content-Length: 0
2022-08-02 17:43:28.652 [I/O dispatcher 1] DEBUG org.apache.http.headers 137 - http-outgoing-0 >> Host: elasticsearch-xxx.com:443
2022-08-02 17:43:28.652 [I/O dispatcher 1] DEBUG org.apache.http.headers 137 - http-outgoing-0 >> Connection: Keep-Alive
2022-08-02 17:43:28.652 [I/O dispatcher 1] DEBUG org.apache.http.headers 137 - http-outgoing-0 >> User-Agent: elasticsearch-java/7.17.4-SNAPSHOT (Java/1.8.0_292)
2022-08-02 17:43:28.652 [I/O dispatcher 1] DEBUG org.apache.http.headers 137 - http-outgoing-0 >> Authorization: Basic secret
2022-08-02 17:43:28.653 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.conn.ManagedNHttpClientConnectionImpl 108 - http-outgoing-0 10.234.8.18:39418<->103.74.51.222:443[ACTIVE][rw:][ACTIVE][rw][NEED_UNWRAP][0][0][311]: Event set [w]
2022-08-02 17:43:28.654 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.client.MainClientExec 273 - [exchange: 1] Request completed
2022-08-02 17:43:28.726 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.conn.ManagedNHttpClientConnectionImpl 222 - http-outgoing-0 10.234.8.18:39418<->103.74.51.222:443[ACTIVE][rw:w][ACTIVE][rw][NOT_HANDSHAKING][0][0][334]: 305 bytes written
2022-08-02 17:43:28.726 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 >> "GET / HTTP/1.1[r][n]"
2022-08-02 17:43:28.726 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 >> "X-Elastic-Client-Meta: es=7.17.4p,jv=1.8,t=7.17.4p,hc=4.1.5[r][n]"
2022-08-02 17:43:28.727 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 >> "Content-Length: 0[r][n]"
2022-08-02 17:43:28.727 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 >> "Host: elasticsearch-xxx.com:443[r][n]"
2022-08-02 17:43:28.727 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 >> "Connection: Keep-Alive[r][n]"
2022-08-02 17:43:28.727 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 >> "User-Agent: elasticsearch-java/7.17.4-SNAPSHOT (Java/1.8.0_292)[r][n]"
2022-08-02 17:43:28.727 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 >> "Authorization: Basic secret[r][n]"
2022-08-02 17:43:28.727 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 >> "[r][n]"
2022-08-02 17:43:28.727 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.client.InternalIODispatch 71 - http-outgoing-0 [ACTIVE] Request ready
2022-08-02 17:43:28.727 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.conn.ManagedNHttpClientConnectionImpl 116 - http-outgoing-0 10.234.8.18:39418<->103.74.51.222:443[ACTIVE][r:w][ACTIVE][r][NOT_HANDSHAKING][0][0][0]: Event cleared [w]
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.conn.ManagedNHttpClientConnectionImpl 206 - http-outgoing-0 10.234.8.18:39418<->103.74.51.222:443[ACTIVE][r:r][ACTIVE][r][NOT_HANDSHAKING][0][0][0]: 698 bytes read
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "HTTP/1.1 200 OK[r][n]"
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "Server: YDWS[r][n]"
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "Date: Tue, 02 Aug 2022 09:43:28 GMT[r][n]"
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "Content-Type: application/json; charset=UTF-8[r][n]"
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "Content-Length: 536[r][n]"
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "Connection: keep-alive[r][n]"
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "[r][n]"
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "{[n]"
2022-08-02 17:43:28.732 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "  "name" : "es-ad-es-node-2",[n]"
2022-08-02 17:43:28.733 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "  "cluster_name" : "es-ad",[n]"
2022-08-02 17:43:28.733 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "  "cluster_uuid" : "z6oA-NW_ShmpJJQSXeyOIQ",[n]"
2022-08-02 17:43:28.733 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "  "version" : {[n]"
2022-08-02 17:43:28.733 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "    "number" : "7.11.2",[n]"
2022-08-02 17:43:28.733 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "    "build_flavor" : "default",[n]"
2022-08-02 17:43:28.733 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "    "build_type" : "docker",[n]"
2022-08-02 17:43:28.733 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "    "build_hash" : "3e5a16cfec50876d20ea77b075070932c6464c7d",[n]"
2022-08-02 17:43:28.733 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "    "build_date" : "2021-03-06T05:54:38.141101Z",[n]"
2022-08-02 17:43:28.733 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "    "build_snapshot" : false,[n]"
2022-08-02 17:43:28.734 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "    "lucene_version" : "8.7.0",[n]"
2022-08-02 17:43:28.734 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "    "minimum_wire_compatibility_version" : "6.8.0",[n]"
2022-08-02 17:43:28.734 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "    "minimum_index_compatibility_version" : "6.0.0-beta1"[n]"
2022-08-02 17:43:28.734 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "  },[n]"
2022-08-02 17:43:28.734 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "  "tagline" : "You Know, for Search"[n]"
2022-08-02 17:43:28.734 [I/O dispatcher 1] DEBUG org.apache.http.wire 54 - http-outgoing-0 << "}[n]"
2022-08-02 17:43:28.736 [I/O dispatcher 1] DEBUG org.apache.http.headers 123 - http-outgoing-0 << HTTP/1.1 200 OK
2022-08-02 17:43:28.736 [I/O dispatcher 1] DEBUG org.apache.http.headers 126 - http-outgoing-0 << Server: YDWS
2022-08-02 17:43:28.736 [I/O dispatcher 1] DEBUG org.apache.http.headers 126 - http-outgoing-0 << Date: Tue, 02 Aug 2022 09:43:28 GMT
2022-08-02 17:43:28.736 [I/O dispatcher 1] DEBUG org.apache.http.headers 126 - http-outgoing-0 << Content-Type: application/json; charset=UTF-8
2022-08-02 17:43:28.736 [I/O dispatcher 1] DEBUG org.apache.http.headers 126 - http-outgoing-0 << Content-Length: 536
2022-08-02 17:43:28.736 [I/O dispatcher 1] DEBUG org.apache.http.headers 126 - http-outgoing-0 << Connection: keep-alive
2022-08-02 17:43:28.736 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.client.InternalIODispatch 106 - http-outgoing-0 [ACTIVE(536)] Response received
2022-08-02 17:43:28.737 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.client.MainClientExec 286 - [exchange: 1] Response received HTTP/1.1 200 OK
2022-08-02 17:43:28.739 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.client.InternalIODispatch 81 - http-outgoing-0 [ACTIVE(536)] Input ready
2022-08-02 17:43:28.740 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.client.MainClientExec 325 - [exchange: 1] Consume content
2022-08-02 17:43:28.741 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.client.InternalHttpAsyncClient 300 - [exchange: 1] Connection can be kept alive indefinitely
2022-08-02 17:43:28.741 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.client.MainClientExec 385 - [exchange: 1] Response processed
2022-08-02 17:43:28.741 [I/O dispatcher 1] DEBUG org.apache.http.impl.nio.client.InternalHttpAsyncClient 241 - [exchange: 1] releasing connection

任何建议都将不胜感激。

另外：不仅保存请求停留在这里，搜索请求(例如：春季数据中的findById(也停留在同一行。

我终于解决了这个问题。。。默认情况下，springdataelasticsearch(以及javaelasticsearchclient本身(不会在客户端和elasticsearch之间的连接上启用保活支持。

这只发生在高并发条件下！

这里有类似的链接：

  • https://github.com/elastic/elasticsearch/issues/65213
  • https://github.com/elastic/elasticsearch/issues/65909

和spring数据在属性中不支持配置保持活动，因此必须涉及代码配置：

@Bean
public RestClientBuilderCustomizer keepalive() {
return new RestClientBuilderCustomizer() {
@Override
public void customize(RestClientBuilder builder) {
}
@Override
public void customize(HttpAsyncClientBuilder builder) {
// enable keep alive
builder.setDefaultIOReactorConfig(IOReactorConfig.custom().setSoKeepAlive(true).build());
}
};
}

我确实认为springdata或elasticsearch应该默认启用keepalive！

相关内容

最新更新


热门标签：

javascript python java c# php android html jquery c++ css ios sql mysql arrays asp.net json python-3.x ruby-on-rails .net sql-server django objective-c excel regex ruby linux ajax iphone xml vba spring asp.net-mvc database wordpress string postgresql wpf windows xcode bash git oracle list vb.net multithreading eclipse algorithm macos powershell visual-studio image forms numpy scala function api selenium