Build Logs

inoio/solrs • 3.8.0-RC3:2025-12-04

Errors

212

Warnings

Total Lines

2374

1##################################

2Clonning https://github.com/inoio/solrs.git into /build/repo using revision

3##################################

4Using target Scala version for migration: 3.7.4

5Migrating project for -source:3.4 using Scala 3.7.4

6----

7Preparing build for 3.7.4

8Would try to apply common scalacOption (best-effort, sbt/mill only):

9Append: -rewrite,REQUIRE:-source:3.4-migration

10Remove: -indent,-no-indent,-new-syntax,,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

11----

12Starting build for 3.7.4

13Execute tests: false

14sbt project found:

15Sbt version 1.11.0 is not supported, minimal supported version is 1.11.5

16Enforcing usage of sbt in version 1.11.5

17No prepare script found for project inoio/solrs

18##################################

19Scala version: 3.7.4

20Targets: io.ino%solrs

21Project projectConfig: {"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"compile-only","migrationVersions":["3.4"],"sourcePatches":[]}

22##################################

23Using extra scalacOptions: -rewrite,REQUIRE:-source:3.4-migration

24Filtering out scalacOptions: -indent,-no-indent,-new-syntax,,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

25[sbt_options] declare -a sbt_options=()

26[process_args] java_version = '17'

27[copyRt] java9_rt = '/root/.sbt/1.0/java9-rt-ext-eclipse_adoptium_17_0_8/rt.jar'

28# Executing command line:

29java

30-Dfile.encoding=UTF-8

31-Dcommunitybuild.scala=3.7.4

32-Dcommunitybuild.project.dependencies.add=

33-Xmx7G

34-Xms4G

35-Xss8M

36-Dsbt.script=/root/.sdkman/candidates/sbt/current/bin/sbt

37-Dscala.ext.dirs=/root/.sbt/1.0/java9-rt-ext-eclipse_adoptium_17_0_8

38-jar

39/root/.sdkman/candidates/sbt/1.11.5/bin/sbt-launch.jar

40"setCrossScalaVersions 3.7.4"

41"++3.7.4 -v"

42"mapScalacOptions "-rewrite,REQUIRE:-source:3.4-migration,-Wconf:msg=can be rewritten automatically under:s" "-indent,-no-indent,-new-syntax,,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e""

43"set every credentials := Nil"

44"excludeLibraryDependency com.github.ghik:zerowaste_{scalaVersion} com.olegpy:better-monadic-for_3 org.polyvariant:better-tostring_{scalaVersion} org.wartremover:wartremover_{scalaVersion}"

45"removeScalacOptionsStartingWith -P:wartremover"

47moduleMappings

48"runBuild 3.7.4 """{"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"compile-only","migrationVersions":["3.4"],"sourcePatches":[]}""" io.ino%solrs"

50[info] welcome to sbt 1.11.5 (Eclipse Adoptium Java 17.0.8)

51[info] loading settings for project repo-build from akka.sbt, gpg.sbt, plugins.sbt, sonatype.sbt...

52[info] loading project definition from /build/repo/project

53[info] compiling 2 Scala sources to /build/repo/project/target/scala-2.12/sbt-1.0/classes ...

54[info] Non-compiled module 'compiler-bridge_2.12' for Scala 2.12.20. Compiling...

55[info] Compilation completed in 8.629s.

56[info] done compiling

57[info] loading settings for project repo from build.sbt, version.sbt...

58[info] set current project to solrs (in build file:/build/repo/)

59Execute setCrossScalaVersions: 3.7.4

60OpenCB::Changing crossVersion 3.7.0 -> 3.7.4 in repo/crossScalaVersions

61[info] set current project to solrs (in build file:/build/repo/)

62[info] Setting Scala version to 3.7.4 on 1 projects.

63[info] Switching Scala version on:

64[info] * repo (2.12.20, 2.13.16, 3.7.4)

65[info] Excluding projects:

66[info] Reapplying settings...

67[info] set current project to solrs (in build file:/build/repo/)

68Execute mapScalacOptions: -rewrite,REQUIRE:-source:3.4-migration,-Wconf:msg=can be rewritten automatically under:s -indent,-no-indent,-new-syntax,,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

69[info] Reapplying settings...

70[info] set current project to solrs (in build file:/build/repo/)

71[info] Defining Global / credentials, credentials

72[info] The new values will be used by Global / pgpSelectPassphrase, Global / pgpSigningKey and 5 others.

73[info] Run `last` for details.

74[info] Reapplying settings...

75[info] set current project to solrs (in build file:/build/repo/)

76Execute excludeLibraryDependency: com.github.ghik:zerowaste_{scalaVersion} com.olegpy:better-monadic-for_3 org.polyvariant:better-tostring_{scalaVersion} org.wartremover:wartremover_{scalaVersion}

77[info] Reapplying settings...

78OpenCB::Failed to reapply settings in excludeLibraryDependency: Reference to undefined setting:

80 Global / allExcludeDependencies from Global / allExcludeDependencies (CommunityBuildPlugin.scala:331)

81 Did you mean allExcludeDependencies ?

82 , retry without global scopes

83[info] Reapplying settings...

84[info] set current project to solrs (in build file:/build/repo/)

85Execute removeScalacOptionsStartingWith: -P:wartremover

86[info] Reapplying settings...

87[info] set current project to solrs (in build file:/build/repo/)

88[success] Total time: 0 s, completed Dec 4, 2025, 3:07:40 PM

89Build config: {"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"compile-only","migrationVersions":["3.4"],"sourcePatches":[]}

90Parsed config: Success(ProjectBuildConfig(ProjectsConfig(List(),Map()),CompileOnly,List()))

91Starting build...

92Projects: Set(repo)

93Starting build for ProjectRef(file:/build/repo/,repo) (solrs)... [0/1]

94OpenCB::Exclude Scala3 specific scalacOption `-rewrite` in Scala 2.12.20 module Global

95OpenCB::Exclude Scala3 specific scalacOption `REQUIRE:-source:3.4-migration` in Scala 2.12.20 module Global

96OpenCB::Filter out '-deprecation', matches setting pattern '^-?-deprecation'

97OpenCB::Filter out '-feature', matches setting pattern '^-?-feature'

98Compile scalacOptions: -unchecked, -language:existentials, -language:higherKinds, -language:implicitConversions, -language:postfixOps, -rewrite, -Wconf:msg=can be rewritten automatically under:s, -source:3.4-migration

99[info] compiling 21 Scala sources and 1 Java source to /build/repo/target/scala-3.7.4/classes ...

100[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/AsyncSolrClient.scala:159:13

101[warn] 159 | case aware: AsyncSolrClientAware[F] => aware.setAsyncSolrClient(solr)

102[warn] | ^

103[warn] |the type test for io.ino.solrs.AsyncSolrClientAware[F] cannot be checked at runtime because its type arguments can't be determined from AnyRef

104[warn] |

105[warn] | longer explanation available when compiling with `-explain`

106[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/future/JavaFutureFactory.scala:14:9

107[warn] 14 | case sf: JavaFuture[T] => sf.inner

108[warn] | ^

109[warn] |the type test for JavaFutureFactory.this.JavaFuture[T] cannot be checked at runtime because its type arguments can't be determined from io.ino.solrs.future.Future[T]

110[warn] |

111[warn] | longer explanation available when compiling with `-explain`

112[info] [patched file /build/repo/src/main/scala/io/ino/solrs/future/Future.scala]

113[info] [patched file /build/repo/src/main/scala/io/ino/solrs/SolrServers.scala]

114[info] [patched file /build/repo/src/main/scala/io/ino/solrs/SolrServer.scala]

115[info] [patched file /build/repo/src/main/scala/io/ino/solrs/LoadBalancer.scala]

116[info] [patched file /build/repo/src/main/scala/io/ino/solrs/RetryPolicy.scala]

117[info] [patched file /build/repo/src/main/scala/io/ino/solrs/RequestInterceptor.scala]

118[info] [patched file /build/repo/src/main/scala/io/ino/solrs/JavaAsyncSolrClient.scala]

119[info] [patched file /build/repo/src/main/scala/io/ino/solrs/AsyncSolrClient.scala]

120[info] [patched file /build/repo/src/main/scala/io/ino/solrs/SolrResponseFactory.scala]

121[info] [patched file /build/repo/src/main/scala/io/ino/solrs/RequestContext.scala]

122[warn] there were 6 deprecation warnings; re-run with -deprecation for details

123[warn] three warnings found

124[info] done compiling

125[info] compiling 10 Scala sources to /build/repo/target/scala-3.7.4/classes ...

126[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/AsyncSolrClient.scala:159:13

127[warn] 159 | case aware: AsyncSolrClientAware[F] => aware.setAsyncSolrClient(solr)

128[warn] | ^

129[warn] |the type test for io.ino.solrs.AsyncSolrClientAware[F] cannot be checked at runtime because its type arguments can't be determined from AnyRef

130[warn] |

131[warn] | longer explanation available when compiling with `-explain`

132[warn] there were 6 deprecation warnings; re-run with -deprecation for details

133[warn] two warnings found

134[info] done compiling

135[info] compiling 30 Scala sources and 3 Java sources to /build/repo/target/scala-3.7.4/test-classes ...

136[warn] -- [E121] Pattern Match Warning: /build/repo/src/test/scala/io/ino/solrs/SolrMatchers.scala:20:13

137[warn] 20 | case _ => false

138[warn] | ^

139[warn] |Unreachable case except for null (if this is intentional, consider writing case null => instead).

140[info] [patched file /build/repo/src/test/scala/io/ino/solrs/SolrCloudRunner.scala]

141[info] [patched file /build/repo/src/test/scala/io/ino/solrs/CloudSolrServersIntegrationSpec.scala]

142[info] [patched file /build/repo/src/test/scala/io/ino/solrs/CloudSolrServersUninitializedIntegrationSpec.scala]

143[info] [patched file /build/repo/src/test/scala/io/ino/solrs/SolrRunner.scala]

144[info] [patched file /build/repo/src/test/scala/io/ino/solrs/AsyncSolrClientCloudIntegrationSpec.scala]

145[info] [patched file /build/repo/src/test/scala/io/ino/solrs/PingStatusObserverIntegrationSpec.scala]

146[info] [patched file /build/repo/src/test/scala/io/ino/solrs/AsyncSolrClientBasicAuthIntegrationSpec.scala]

147[info] [patched file /build/repo/src/test/scala/io/ino/solrs/RunningSolr.scala]

148[info] [patched file /build/repo/src/test/scala/io/ino/solrs/AsyncSolrClientBasicAuthCloudIntegrationSpec.scala]

149[info] [patched file /build/repo/src/test/scala/io/ino/solrs/FastestServerLBSpec.scala]

150[info] [patched file /build/repo/src/test/scala/io/ino/solrs/StandardFunSpec.scala]

151[info] [patched file /build/repo/src/test/scala/io/ino/solrs/AsyncSolrClientIntegrationSpec.scala]

152[info] [patched file /build/repo/src/test/scala/io/ino/solrs/RoundRobinLBSpec.scala]

153[info] [patched file /build/repo/src/test/scala/io/ino/solrs/usage/UsageScala.scala]

154[info] [patched file /build/repo/src/test/scala/io/ino/solrs/RetryPolicySpec.scala]

155[warn] there were 5 deprecation warnings; re-run with -deprecation for details

156[warn] two warnings found

157[info] done compiling

158[info] compiling 15 Scala sources to /build/repo/target/scala-3.7.4/test-classes ...

159[warn] there were 2 deprecation warnings; re-run with -deprecation for details

160[warn] one warning found

161[info] done compiling

162

163************************

164Build summary:

165[{

166 "module": "solrs",

167 "compile": {"status": "ok", "tookMs": 12139, "warnings": 2, "errors": 0, "sourceVersion": "3.4-migration"},

168 "doc": {"status": "skipped", "tookMs": 0, "files": 0, "totalSizeKb": 0},

169 "test-compile": {"status": "ok", "tookMs": 14043, "warnings": 1, "errors": 0, "sourceVersion": "3.4-migration"},

170 "test": {"status": "skipped", "tookMs": 0, "passed": 0, "failed": 0, "ignored": 0, "skipped": 0, "total": 0, "byFramework": []},

171 "publish": {"status": "skipped", "tookMs": 0},

172 "metadata": {

173 "crossScalaVersions": ["2.12.20", "2.13.16", "3.7.0"]

174}

175}]

176************************

177[success] Total time: 94 s (0:01:34.0), completed Dec 4, 2025, 3:09:14 PM

178[0JChecking patch project/plugins.sbt...

179Checking patch project/build.properties...

180Checking patch build.sbt...

181Applied patch project/plugins.sbt cleanly.

182Applied patch project/build.properties cleanly.

183Applied patch build.sbt cleanly.

184Commit migration rewrites

185Switched to a new branch 'opencb/migrate-source-3.4'

186[opencb/migrate-source-3.4 f152ad2] Apply Scala compiler rewrites using -source:3.4-migration using Scala 3.7.4

187 25 files changed, 106 insertions(+), 106 deletions(-)

188----

189Preparing build for 3.8.0-RC3

190Scala binary version found: 3.8

191Implicitly using source version 3.8

192Scala binary version found: 3.8

193Implicitly using source version 3.8

194Would try to apply common scalacOption (best-effort, sbt/mill only):

195Append: ,REQUIRE:-source:3.8

196Remove: ,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

197----

198Starting build for 3.8.0-RC3

199Execute tests: true

200sbt project found:

201Sbt version 1.11.0 is not supported, minimal supported version is 1.11.5

202Enforcing usage of sbt in version 1.11.5

203No prepare script found for project inoio/solrs

204##################################

205Scala version: 3.8.0-RC3

206Targets: io.ino%solrs

207Project projectConfig: {"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"full","migrationVersions":["3.4"],"sourcePatches":[]}

208##################################

209Using extra scalacOptions: ,REQUIRE:-source:3.8

210Filtering out scalacOptions: ,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

211[sbt_options] declare -a sbt_options=()

212[process_args] java_version = '17'

213[copyRt] java9_rt = '/root/.sbt/1.0/java9-rt-ext-eclipse_adoptium_17_0_8/rt.jar'

214# Executing command line:

215java

216-Dfile.encoding=UTF-8

217-Dcommunitybuild.scala=3.8.0-RC3

218-Dcommunitybuild.project.dependencies.add=

219-Xmx7G

220-Xms4G

221-Xss8M

222-Dsbt.script=/root/.sdkman/candidates/sbt/current/bin/sbt

223-Dscala.ext.dirs=/root/.sbt/1.0/java9-rt-ext-eclipse_adoptium_17_0_8

224-jar

225/root/.sdkman/candidates/sbt/1.11.5/bin/sbt-launch.jar

226"setCrossScalaVersions 3.8.0-RC3"

227"++3.8.0-RC3 -v"

228"mapScalacOptions ",REQUIRE:-source:3.8,-Wconf:msg=can be rewritten automatically under:s" ",-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e""

229"set every credentials := Nil"

230"excludeLibraryDependency com.github.ghik:zerowaste_{scalaVersion} com.olegpy:better-monadic-for_3 org.polyvariant:better-tostring_{scalaVersion} org.wartremover:wartremover_{scalaVersion}"

231"removeScalacOptionsStartingWith -P:wartremover"

232

233moduleMappings

234"runBuild 3.8.0-RC3 """{"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"full","migrationVersions":["3.4"],"sourcePatches":[]}""" io.ino%solrs"

235

236[info] welcome to sbt 1.11.5 (Eclipse Adoptium Java 17.0.8)

237[info] loading settings for project repo-build from akka.sbt, gpg.sbt, plugins.sbt, sonatype.sbt...

238[info] loading project definition from /build/repo/project

239[info] loading settings for project repo from build.sbt, version.sbt...

240[info] set current project to solrs (in build file:/build/repo/)

241Execute setCrossScalaVersions: 3.8.0-RC3

242OpenCB::Changing crossVersion 3.7.0 -> 3.8.0-RC3 in repo/crossScalaVersions

243[info] set current project to solrs (in build file:/build/repo/)

244[info] Setting Scala version to 3.8.0-RC3 on 1 projects.

245[info] Switching Scala version on:

246[info] * repo (2.12.20, 2.13.16, 3.8.0-RC3)

247[info] Excluding projects:

248[info] Reapplying settings...

249[info] set current project to solrs (in build file:/build/repo/)

250Execute mapScalacOptions: ,REQUIRE:-source:3.8,-Wconf:msg=can be rewritten automatically under:s ,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

251[info] Reapplying settings...

252[info] set current project to solrs (in build file:/build/repo/)

253[info] Defining Global / credentials, credentials

254[info] The new values will be used by Global / pgpSelectPassphrase, Global / pgpSigningKey and 5 others.

255[info] Run `last` for details.

256[info] Reapplying settings...

257[info] set current project to solrs (in build file:/build/repo/)

258Execute excludeLibraryDependency: com.github.ghik:zerowaste_{scalaVersion} com.olegpy:better-monadic-for_3 org.polyvariant:better-tostring_{scalaVersion} org.wartremover:wartremover_{scalaVersion}

259[info] Reapplying settings...

260OpenCB::Failed to reapply settings in excludeLibraryDependency: Reference to undefined setting:

261

262 Global / allExcludeDependencies from Global / allExcludeDependencies (CommunityBuildPlugin.scala:331)

263 Did you mean allExcludeDependencies ?

264 , retry without global scopes

265[info] Reapplying settings...

266[info] set current project to solrs (in build file:/build/repo/)

267Execute removeScalacOptionsStartingWith: -P:wartremover

268[info] Reapplying settings...

269[info] set current project to solrs (in build file:/build/repo/)

270[success] Total time: 0 s, completed Dec 4, 2025, 3:09:23 PM

271Build config: {"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"full","migrationVersions":["3.4"],"sourcePatches":[]}

272Parsed config: Success(ProjectBuildConfig(ProjectsConfig(List(),Map()),Full,List()))

273Starting build...

274Projects: Set(repo)

275Starting build for ProjectRef(file:/build/repo/,repo) (solrs)... [0/1]

276OpenCB::Exclude Scala3 specific scalacOption `REQUIRE:-source:3.8` in Scala 2.12.20 module Global

277OpenCB::Filter out '-deprecation', matches setting pattern '^-?-deprecation'

278OpenCB::Filter out '-feature', matches setting pattern '^-?-feature'

279Compile scalacOptions: -unchecked, -language:existentials, -language:higherKinds, -language:implicitConversions, -language:postfixOps, -Wconf:msg=can be rewritten automatically under:s, -source:3.8

280[info] compiling 21 Scala sources and 1 Java source to /build/repo/target/scala-3.8.0-RC3/classes ...

281[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/AsyncSolrClient.scala:159:13

282[warn] 159 | case aware: AsyncSolrClientAware[F] => aware.setAsyncSolrClient(solr)

283[warn] | ^

284[warn] |the type test for io.ino.solrs.AsyncSolrClientAware[F] cannot be checked at runtime because its type arguments can't be determined from AnyRef

285[warn] |

286[warn] | longer explanation available when compiling with `-explain`

287[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/future/JavaFutureFactory.scala:14:9

288[warn] 14 | case sf: JavaFuture[T] => sf.inner

289[warn] | ^

290[warn] |the type test for JavaFutureFactory.this.JavaFuture[T] cannot be checked at runtime because its type arguments can't be determined from io.ino.solrs.future.Future[T]

291[warn] |

292[warn] | longer explanation available when compiling with `-explain`

293[warn] there were 6 deprecation warnings; re-run with -deprecation for details

294[warn] three warnings found

295[info] done compiling

296[info] compiling 30 Scala sources and 3 Java sources to /build/repo/target/scala-3.8.0-RC3/test-classes ...

297[warn] -- [E121] Pattern Match Warning: /build/repo/src/test/scala/io/ino/solrs/SolrMatchers.scala:20:13

298[warn] 20 | case _ => false

299[warn] | ^

300[warn] |Unreachable case except for null (if this is intentional, consider writing case null => instead).

301[warn] there were 5 deprecation warnings; re-run with -deprecation for details

302[warn] two warnings found

303[info] done compiling

304[info] JavaAPITest:

30515:09:59:545 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Solr on port 8888 with Solr home /tmp/base1764857399505/solrhome

30615:09:59:823 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Jetty...

30715:10:00:395 [pool-1-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

30815:10:00:517 [coreLoadExecutor-13-thread-2] WARN org.apache.solr.core.SolrConfig - You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.

30915:10:00:525 [coreLoadExecutor-13-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

31015:10:00:525 [coreLoadExecutor-13-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

311[info] - testRetryPolicy

312[info] - testCloudSolrServers

313found 0 docs

314[info] - testAsyncSolrClientBuilderUrl

315[info] - testRoundRobinLB

316[info] - testStaticSolrServers

317[info] - testFastestServerLB

318found 0 docs

319[info] - testAsyncSolrClientBuilderLB

320[info] JavaAPIFunTest:

321[info] - testDeleteByIds

322[info] - testGetByIds

323[info] - testAddBean

324[info] - testGetByIdAbsent

325[info] - testQuery

326[info] - testGetById

327[info] - testExecuteQuery

328[info] - testAddDocsAsCollection

329[info] - testGetByIdsAbsent

330[info] - testDeleteById

331[info] - testAddDoc

332[info] - testCommit

333[info] - testAddDocsAsIterator

334[info] - testAddBeansAsIterable

335[info] - testAddBeansAsIterator

336[info] - testDeleteByQuery

337[info] RoundRobinLBSpec:

338[info] RoundRobinLB

339[info] - should return None if no solr server matches

340[info] - should return consecutive solr servers

341[info] - should only return active solr servers

342[info] - should return the active leader for update requests if isUpdatesToLeaders=true and UpdateRequest.sendToLeaders=true

343[info] - should round robin update requests if isUpdatesToLeaders=true and UpdateRequest.sendToLeaders=false

344[info] - should round robin update requests by default

345[info] - should return replicas matching the given shard preferences / replica type

346[info] - should consider the preferred server if active

347[info] AsyncSolrClientBasicAuthCloudIntegrationSpec:

348[info] AsyncSolrClient with CloudSolrServers

34915:10:03:299 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

35015:10:03:305 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.cloud.MiniSolrCloudCluster - Unable to inject random recording flag due to outside randomized context

351java.lang.IllegalStateException: No context information for thread: Thread[id=15, name=pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec, state=RUNNABLE, group=main]. Is this thread running under a class com.carrotsearch.randomizedtesting.RandomizedRunner runner context? Add @RunWith(class com.carrotsearch.randomizedtesting.RandomizedRunner.class) to your test class. Make sure your code accesses random contexts within @BeforeClass and @AfterClass boundary (for example, static test class initializers are not permitted to access random contexts).

352 at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:249)

353 at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)

354 at org.apache.lucene.tests.util.LuceneTestCase.random(LuceneTestCase.java:796)

355 at org.apache.lucene.tests.util.LuceneTestCase.rarely(LuceneTestCase.java:894)

356 at org.apache.solr.cloud.MiniSolrCloudCluster.injectRandomRecordingFlag(MiniSolrCloudCluster.java:1377)

357 at org.apache.solr.cloud.MiniSolrCloudCluster$Builder.build(MiniSolrCloudCluster.java:1303)

358 at io.ino.solrs.SolrCloudRunner.start$$anonfun$2(SolrCloudRunner.scala:130)

359 at io.ino.solrs.SolrCloudRunner.start$$anonfun$adapted$1(SolrCloudRunner.scala:139)

360 at io.ino.solrs.SolrCloudRunner.timed(SolrCloudRunner.scala:244)

361 at io.ino.solrs.SolrCloudRunner.start(SolrCloudRunner.scala:139)

362 at io.ino.solrs.SolrCloudRunner$.start(SolrCloudRunner.scala:256)

363 at io.ino.solrs.AsyncSolrClientBasicAuthCloudIntegrationSpec.beforeEach(AsyncSolrClientBasicAuthCloudIntegrationSpec.scala:47)

364 at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:233)

365 at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:122)

366 at io.ino.solrs.StandardFunSpec.runTest(StandardFunSpec.scala:17)

367 at org.scalatest.funspec.AnyFunSpecLike.runTests$$anonfun$1(AnyFunSpecLike.scala:528)

368 at org.scalatest.SuperEngine.traverseSubNodes$1$$anonfun$1(Engine.scala:413)

369 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

370 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

371 at scala.collection.immutable.List.foreach(List.scala:327)

372 at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:429)

373 at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:390)

374 at org.scalatest.SuperEngine.traverseSubNodes$1$$anonfun$1(Engine.scala:427)

375 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

376 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

377 at scala.collection.immutable.List.foreach(List.scala:327)

378 at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:429)

379 at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396)

380 at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475)

381 at org.scalatest.funspec.AnyFunSpecLike.runTests(AnyFunSpecLike.scala:528)

382 at org.scalatest.funspec.AnyFunSpecLike.runTests$(AnyFunSpecLike.scala:49)

383 at org.scalatest.funspec.AnyFunSpec.runTests(AnyFunSpec.scala:1631)

384 at org.scalatest.Suite.run(Suite.scala:1114)

385 at org.scalatest.Suite.run$(Suite.scala:564)

386 at org.scalatest.funspec.AnyFunSpec.org$scalatest$funspec$AnyFunSpecLike$$super$run(AnyFunSpec.scala:1631)

387 at org.scalatest.funspec.AnyFunSpecLike.run$$anonfun$1(AnyFunSpecLike.scala:532)

388 at org.scalatest.SuperEngine.runImpl(Engine.scala:535)

389 at org.scalatest.funspec.AnyFunSpecLike.run(AnyFunSpecLike.scala:532)

390 at org.scalatest.funspec.AnyFunSpecLike.run$(AnyFunSpecLike.scala:49)

391 at io.ino.solrs.StandardFunSpec.org$scalatest$BeforeAndAfterAll$$super$run(StandardFunSpec.scala:17)

392 at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213)

393 at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:217)

394 at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:135)

395 at io.ino.solrs.StandardFunSpec.run(StandardFunSpec.scala:17)

396 at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321)

397 at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517)

398 at sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414)

399 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

400 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

401 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

402 at java.base/java.lang.Thread.run(Thread.java:833)

40315:10:03:424 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40415:10:03:446 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40515:10:03:456 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40615:10:03:459 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40715:10:03:459 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40815:10:03:461 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40915:10:03:575 [jetty-launcher-35-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

41015:10:03:575 [jetty-launcher-35-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

41115:10:03:578 [jetty-launcher-35-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

41215:10:03:579 [jetty-launcher-35-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

41315:10:03:581 [jetty-launcher-35-thread-2] WARN org.apache.solr.DEPRECATED.solrxml-zookeeper - Loading solr.xml from zookeeper is deprecated. See reference guide for details.

41415:10:03:779 [jetty-launcher-35-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

41515:10:03:779 [jetty-launcher-35-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

41615:10:03:846 [jetty-launcher-35-thread-2] WARN org.apache.solr.core.CoreContainer - Solr authentication is enabled, but SSL is off. Consider enabling SSL to protect user credentials and data with encryption.

41715:10:03:848 [jetty-launcher-35-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

41815:10:03:898 [jetty-launcher-35-thread-1] WARN org.apache.solr.core.CoreContainer - Solr authentication is enabled, but SSL is off. Consider enabling SSL to protect user credentials and data with encryption.

41915:10:03:900 [jetty-launcher-35-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

42015:10:04:243 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42115:10:04:246 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42215:10:04:251 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 950 ms

42315:10:04:252 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857403288/solrhome/collection1/conf

42415:10:04:253 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42515:10:04:256 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42615:10:04:407 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857403288/solrhome/collection1/conf took 154 ms

42715:10:04:409 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

42815:10:04:414 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42915:10:04:417 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

43015:10:04:723 [qtp2021942418-120] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

43115:10:04:726 [qtp803966243-123] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

43215:10:06:167 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1758 ms

43315:10:06:168 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:39427_solr={responseHeader={status=0, QTime=482}, core=collection1_shard1_replica_n1}, 127.0.0.1:36941_solr={responseHeader={status=0, QTime=1360}, core=collection1_shard1_replica_n2}}

43415:10:06:169 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:36941/solr/collection1_shard1_replica_n2

43515:10:06:169 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:39427/solr/collection1_shard1_replica_n1

43615:10:06:314 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

43715:10:06:316 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

43815:10:06:317 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:41785/solr

43915:10:06:320 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:41785/solr

44015:10:06:327 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:39427/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:36941/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

44115:10:06:333 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientBasicAuthCloudIntegrationSpec - Awaiting all servers status is Enabled

442[info] - should support basic auth with a configured http client

44315:10:06:563 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:36941_solr, 127.0.0.1:39427_solr]

444collections:{collection1=LazyCollectionRef(collection1)}

445org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

446 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

447 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

448 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

449 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

450 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

451 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

452 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

453 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

454 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

455 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

456 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

457 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

458 at java.base/java.lang.Thread.run(Thread.java:833)

459Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

460 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

461 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

462 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

463 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

464 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

465 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

466 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

467 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

468 ... 12 more

469java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@73949265[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@15d60f04[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@72f455da]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@7b75d968[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 1]

470 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

471 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

472 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

473 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

474 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

475 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

476 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

477 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

478 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

479 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

480 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

481 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

482 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

48315:10:06:566 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

484 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

485 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

486 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

487 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

488 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

489 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

490 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

491 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

492 at java.base/java.lang.Thread.run(Thread.java:833)

49315:10:07:007 [ZkTestServer Run Thread] WARN org.apache.solr.cloud.ZkTestServer - Watch limit violations:

494Maximum concurrent create/delete watches above limit:

495

496 8 /solr/collections/collection1/terms/shard1

497 5 /solr/aliases.json

498 5 /solr/clusterprops.json

499 2 /solr/configs/collection1

500 2 /solr/packages.json

501 2 /solr/security.json

502 2 /solr/collections/collection1/collectionprops.json

503 2 /solr/configs/collection1/managed-schema.xml

504

505Maximum concurrent data watches above limit:

506

507 10 /solr/collections/collection1/state.json

508

509Maximum concurrent children watches above limit:

510

511 17 /solr/overseer/queue

512 11 /solr/live_nodes

513 9 /solr/collections

514 4 /solr/collections/collection1/state.json

515 4 /solr/overseer/collection-queue-work

516

517[info] CloudSolrServersSpec:

518[info] CloudSolrServers

519[info] - should compute state changes correctly

520[info] - should read all servers from ClusterState with multiple shards

521[info] AsyncSolrClientBasicAuthIntegrationSpec:

52215:10:07:082 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Solr on port 8889 with Solr home /tmp/base1764857407070/solrhome

52315:10:07:084 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Jetty...

52415:10:07:097 [pool-1-thread-1] WARN org.apache.solr.core.CoreContainer - Solr authentication is enabled, but SSL is off. Consider enabling SSL to protect user credentials and data with encryption.

52515:10:07:108 [coreLoadExecutor-128-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

526[info] Solr

527[info] - should support basic auth with a configured http client

52815:10:07:266 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Stopping Solr Jetty running on port 8889

52915:10:07:266 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 8889

530[info] AsyncSolrClientFunSpec:

531[info] Solr

532[info] - should add docs as iterable

533[info] - should add docs as iterator

534[info] - should add doc

535[info] - should add bean

536[info] - should add beans as iterable

537[info] - should add beans as iterator

538[info] - should commit

539[info] - should delete by id

540[info] - should delete by ids

541[info] - should delete by query

542[info] - should query

543[info] - should get by id

544[info] - should get by id absent

545[info] - should get by ids

546[info] - should get by ids absent

547[info] - should pass same query parameters

548[info] - should pass same query parameters in post and get

549[info] AsyncSolrClientSpec:

550[info] Solr

55115:10:07:802 [AsyncHttpClient-17-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server SolrServer(http://localhost:12345/solr, Enabled), not retrying. Exception was: java.net.ConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:12345

552java.net.ConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:12345

553 at org.asynchttpclient.netty.channel.NettyConnectListener.onFailure(NettyConnectListener.java:173)

554 at org.asynchttpclient.netty.channel.NettyChannelConnector$1.onFailure(NettyChannelConnector.java:107)

555 at org.asynchttpclient.netty.SimpleChannelFutureListener.operationComplete(SimpleChannelFutureListener.java:30)

556 at org.asynchttpclient.netty.SimpleChannelFutureListener.operationComplete(SimpleChannelFutureListener.java:22)

557 at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590)

558 at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583)

559 at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559)

560 at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492)

561 at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636)

562 at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629)

563 at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118)

564 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)

565 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)

566 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)

567 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

568 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

569 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

570 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

571 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

572 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

573 at java.base/java.lang.Thread.run(Thread.java:833)

574Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:12345

575Caused by: java.net.ConnectException: Connection refused

576 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

577 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

578 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

579 at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)

580 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)

581 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)

582 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

583 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

584 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

585 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

586 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

587 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

588 at java.base/java.lang.Thread.run(Thread.java:833)

589[info] - should return failed future on connection refused

59015:10:08:198 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientSpec] WARN io.ino.solrs.AsyncSolrClient - Request failed for server SolrServer(http://localhost:12345/solr, Enabled), not retrying. Exception was: io.ino.solrs.AsyncSolrClientSpec$$anon$1: Unexpected?!

591io.ino.solrs.AsyncSolrClientSpec$$anon$1: Unexpected?!

592[info] - should return failed future on AHC IOException

593[info] - should shutdown http client if it was not provided

594[info] - should not shutdown http client if it was provided

595[info] FastestServerLBSpec:

596[info] FastestServerLB

597[info] - should support multiple instances

59815:10:08:368 [pool-1-thread-1-ScalaTest-running-FastestServerLBSpec] WARN io.ino.solrs.FastestServerLBSpec$$anon$6 - Error while unregistering MBean

599javax.management.InstanceNotFoundException: io.ino.solrs:type=FastestServerLB,instance=2

600 at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)

601 at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:423)

602 at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:411)

603 at java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:547)

604 at io.ino.solrs.FastestServerLBJmxSupport.shutdownJmx(LoadBalancer.scala:549)

605 at io.ino.solrs.FastestServerLBJmxSupport.shutdownJmx$(LoadBalancer.scala:530)

606 at io.ino.solrs.FastestServerLB.shutdownJmx(LoadBalancer.scala:175)

607 at io.ino.solrs.FastestServerLB.shutdown(LoadBalancer.scala:214)

608 at io.ino.solrs.FastestServerLBSpec.afterEach(FastestServerLBSpec.scala:61)

609 at org.scalatest.BeforeAndAfterEach.$anonfun$1(BeforeAndAfterEach.scala:247)

610 at org.scalatest.BeforeAndAfterEach.$anonfun$adapted$1(BeforeAndAfterEach.scala:254)

611 at scala.Function0.apply$mcV$sp(Function0.scala:45)

612 at org.scalatest.Status.withAfterEffect$$anonfun$1(Status.scala:377)

613 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

614 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

615 at org.scalatest.SucceededStatus$.whenCompleted(Status.scala:462)

616 at org.scalatest.Status.withAfterEffect(Status.scala:406)

617 at org.scalatest.Status.withAfterEffect$(Status.scala:54)

618 at org.scalatest.SucceededStatus$.withAfterEffect(Status.scala:434)

619 at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:254)

620 at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:122)

621 at io.ino.solrs.StandardFunSpec.runTest(StandardFunSpec.scala:17)

622 at org.scalatest.funspec.AnyFunSpecLike.runTests$$anonfun$1(AnyFunSpecLike.scala:528)

623 at org.scalatest.SuperEngine.traverseSubNodes$1$$anonfun$1(Engine.scala:413)

624 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

625 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

626 at scala.collection.immutable.List.foreach(List.scala:327)

627 at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:429)

628 at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:390)

629 at org.scalatest.SuperEngine.traverseSubNodes$1$$anonfun$1(Engine.scala:427)

630 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

631 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

632 at scala.collection.immutable.List.foreach(List.scala:327)

633 at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:429)

634 at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396)

635 at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475)

636 at org.scalatest.funspec.AnyFunSpecLike.runTests(AnyFunSpecLike.scala:528)

637 at org.scalatest.funspec.AnyFunSpecLike.runTests$(AnyFunSpecLike.scala:49)

638 at org.scalatest.funspec.AnyFunSpec.runTests(AnyFunSpec.scala:1631)

639 at org.scalatest.Suite.run(Suite.scala:1114)

640 at org.scalatest.Suite.run$(Suite.scala:564)

641 at org.scalatest.funspec.AnyFunSpec.org$scalatest$funspec$AnyFunSpecLike$$super$run(AnyFunSpec.scala:1631)

642 at org.scalatest.funspec.AnyFunSpecLike.run$$anonfun$1(AnyFunSpecLike.scala:532)

643 at org.scalatest.SuperEngine.runImpl(Engine.scala:535)

644 at org.scalatest.funspec.AnyFunSpecLike.run(AnyFunSpecLike.scala:532)

645 at org.scalatest.funspec.AnyFunSpecLike.run$(AnyFunSpecLike.scala:49)

646 at io.ino.solrs.StandardFunSpec.org$scalatest$BeforeAndAfterAll$$super$run(StandardFunSpec.scala:17)

647 at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213)

648 at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:217)

649 at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:135)

650 at io.ino.solrs.StandardFunSpec.run(StandardFunSpec.scala:17)

651 at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321)

652 at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517)

653 at sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414)

654 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

655 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

656 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

657 at java.base/java.lang.Thread.run(Thread.java:833)

658[info] - should return a Failure if no solr server matches

659[info] - should only return active solr servers

660[info] - should return the active leader for update requests if isUpdatesToLeaders=true and UpdateRequest.sendToLeaders=true

661[info] - should round robin update requests if isUpdatesToLeaders=true and UpdateRequest.sendToLeaders=false

662[info] - should round robin update requests by default

663[info] - should return replicas matching the given shard preferences / replica type

664[info] - should return the fastest server by default

665[info] - should round robin equally fast servers

666[info] - should consider the preferred server if it's one of the fastest servers

667[info] - should return the server with a better predicted response time

668[info] - should allow to quantize / consider (very) similar predicted response times to be equal

669[info] - should initially test servers to gather performance stats

670[info] - should test servers based on the real query rate restricted by min delay

671[info] - should test slow servers less frequently

672[info] - should test slow/all servers according to the specified maxDelay

673[info] HttpUtilsSpec:

674[info] HttpUtils

675[info] - should return null charset for content-type without charset

676[info] - should return charset for content-type with charset

677[info] - should return mime-type for content-type with charset

678[info] PerformanceStatsSpec:

679[info] PerformanceStats

680[info] - should calculate averages per second (for the last 10 seconds)

681[info] - should calculate averages for 10 second intervals

682[info] - should store the overall average

683[info] - should predict the response time based on ongoing requests

684[info] - should predict the response time based on finished requests from the current second

685[info] - should predict the response time based on finished requests from the current second, ignoring shorter active requests

686[info] - should predict the response time based on the last 10 seconds

687[info] - should predict the response time based on the overall average as fallback

688[info] EvictingQueue

689[info] - should initially be empty

690[info] - should return stored values

691[info] - should return a value by index

692[info] - should evict old values

693[info] - should return the oldest value if it's replaced

694[info] - should return the relative last updated value

695[info] RetryPolicySpec:

696[info] RetryPolicy.TryOnce

697[info] - should not retry

698[info] RetryPolicy.TryAvailableServers

699[info] - should not retry when no servers available

700[info] - should not retry when all servers already tried

701[info] - should retry server not yet tried

702[info] RetryPolicy.AtMost(x)

703[info] - should retry when limit is not reached

704[info] - should not retry when limit is reached

705[info] TwitterFutureFactorySpec:

706[info] TwitterFutureFactory

707[info] - should return promise/future that supports map

708[info] - should return promise/future that supports flatMap (success)

709[info] - should return promise/future that supports flatMap (failure in subject)

710[info] - should return promise/future that supports flatMap (failure in callback)

711[info] - should return promise/future that supports handle (unhandled)

712[info] - should return promise/future that supports handle (success)

713[info] - should return promise/future that supports handle (failure)

714[info] - should return promise/future that supports handleWith (unhandled)

715[info] - should return promise/future that supports handleWith (success)

716[info] - should return promise/future that supports handleWith (failure)

717[info] - should reduce a sequence of futures to a future of sequence

718[info] CloudSolrServersIntegrationSpec:

71915:10:08:751 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 4 node(s)

72015:10:08:752 [pool-1-thread-1] WARN org.apache.solr.cloud.MiniSolrCloudCluster - Unable to inject random recording flag due to outside randomized context

721java.lang.IllegalStateException: No context information for thread: Thread[id=15, name=pool-1-thread-1, state=RUNNABLE, group=main]. Is this thread running under a class com.carrotsearch.randomizedtesting.RandomizedRunner runner context? Add @RunWith(class com.carrotsearch.randomizedtesting.RandomizedRunner.class) to your test class. Make sure your code accesses random contexts within @BeforeClass and @AfterClass boundary (for example, static test class initializers are not permitted to access random contexts).

722 at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:249)

723 at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)

724 at org.apache.lucene.tests.util.LuceneTestCase.random(LuceneTestCase.java:796)

725 at org.apache.lucene.tests.util.LuceneTestCase.rarely(LuceneTestCase.java:894)

726 at org.apache.solr.cloud.MiniSolrCloudCluster.injectRandomRecordingFlag(MiniSolrCloudCluster.java:1377)

727 at org.apache.solr.cloud.MiniSolrCloudCluster$Builder.build(MiniSolrCloudCluster.java:1303)

728 at io.ino.solrs.SolrCloudRunner.start$$anonfun$2(SolrCloudRunner.scala:125)

729 at io.ino.solrs.SolrCloudRunner.start$$anonfun$adapted$1(SolrCloudRunner.scala:139)

730 at io.ino.solrs.SolrCloudRunner.timed(SolrCloudRunner.scala:244)

731 at io.ino.solrs.SolrCloudRunner.start(SolrCloudRunner.scala:139)

732 at io.ino.solrs.SolrCloudRunner$.start(SolrCloudRunner.scala:256)

733 at io.ino.solrs.CloudSolrServersIntegrationSpec.beforeAll(CloudSolrServersIntegrationSpec.scala:55)

734 at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:212)

735 at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:217)

736 at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:135)

737 at io.ino.solrs.StandardFunSpec.run(StandardFunSpec.scala:17)

738 at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321)

739 at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517)

740 at sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414)

741 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

742 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

743 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

744 at java.base/java.lang.Thread.run(Thread.java:833)

74515:10:08:857 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

74615:10:08:860 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

74715:10:08:862 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

74815:10:08:864 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

74915:10:08:864 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75015:10:08:867 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75115:10:08:975 [jetty-launcher-145-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75215:10:08:978 [jetty-launcher-145-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75315:10:08:978 [jetty-launcher-145-thread-3] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75415:10:08:978 [jetty-launcher-145-thread-4] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75515:10:08:979 [jetty-launcher-145-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75615:10:08:982 [jetty-launcher-145-thread-3] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75715:10:08:988 [jetty-launcher-145-thread-4] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75815:10:08:988 [jetty-launcher-145-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75915:10:09:162 [jetty-launcher-145-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

76015:10:09:162 [jetty-launcher-145-thread-3] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

76115:10:09:162 [jetty-launcher-145-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

76215:10:09:162 [jetty-launcher-145-thread-4] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

76315:10:09:187 [jetty-launcher-145-thread-4] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

76415:10:09:187 [jetty-launcher-145-thread-3] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

76515:10:09:188 [jetty-launcher-145-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

76615:10:09:189 [jetty-launcher-145-thread-3] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

76715:10:09:189 [jetty-launcher-145-thread-4] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

76815:10:09:200 [jetty-launcher-145-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

76915:10:09:223 [jetty-launcher-145-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

77015:10:09:224 [jetty-launcher-145-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

77115:10:09:391 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

77215:10:09:394 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

77315:10:09:396 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 4 node(s) took 644 ms

77415:10:09:396 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857408736/solrhome/collection1/conf

77515:10:09:396 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

77615:10:09:398 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

77715:10:09:534 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857408736/solrhome/collection1/conf took 137 ms

77815:10:09:534 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=2

77915:10:09:536 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

78015:10:09:538 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

78115:10:09:704 [qtp62707935-373] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

78215:10:09:708 [qtp1085088689-362] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

78315:10:09:710 [qtp1680179807-363] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

78415:10:09:710 [qtp49500961-350] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

78515:10:11:195 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=2 took 1660 ms

78615:10:11:195 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:33977_solr={responseHeader={status=0, QTime=1008}, core=collection1_shard1_replica_n4}, 127.0.0.1:40215_solr={responseHeader={status=0, QTime=1010}, core=collection1_shard2_replica_n1}, 127.0.0.1:38233_solr={responseHeader={status=0, QTime=1407}, core=collection1_shard2_replica_n2}, 127.0.0.1:37035_solr={responseHeader={status=0, QTime=1404}, core=collection1_shard1_replica_n6}}

78715:10:11:196 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:38233/solr/collection1_shard2_replica_n2

78815:10:11:196 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:33977/solr/collection1_shard1_replica_n4

78915:10:11:196 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:37035/solr/collection1_shard1_replica_n6

79015:10:11:196 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:40215/solr/collection1_shard2_replica_n1

791[info] CloudSolrServers

79215:10:11:288 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

79315:10:11:290 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

79415:10:11:290 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:44433/solr

79515:10:11:292 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:44433/solr

79615:10:11:293 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Enabled, NRT, false)))

797[info] - should list available solr instances

79815:10:11:484 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:40215_solr, 127.0.0.1:38233_solr, 127.0.0.1:37035_solr, 127.0.0.1:33977_solr]

799collections:{collection1=LazyCollectionRef(collection1)}

800org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

801 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

802 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

803 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

804 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

805 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

806 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

807 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

808 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

809 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

810 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

811 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

812 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

813 at java.base/java.lang.Thread.run(Thread.java:833)

814Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

815 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

816 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

817 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

818 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

819 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

820 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

821 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

822 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

823 ... 12 more

824java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@70ae1f6a[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@14df95d4[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@51dd192b]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@60c6eafc[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 0]

825 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

826 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

827 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

828 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

829 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

830 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

831 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

832 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

833 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

834 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

835 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

836 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

837 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

838 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

839 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

840 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

841 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

842 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

843 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

844 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

845 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

846 at java.base/java.lang.Thread.run(Thread.java:833)

84715:10:11:488 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

84815:10:11:490 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

84915:10:11:490 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:44433/solr

85015:10:11:493 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:44433/solr

85115:10:11:495 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Enabled, NRT, false)))

85215:10:11:497 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 38233

85315:10:11:698 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Failed, NRT, false)))

85415:10:11:725 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.SolrRunner - Starting Jetty...

85515:10:11:728 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

85615:10:11:730 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

85715:10:11:857 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

85815:10:11:874 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

85915:10:11:875 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

86015:10:11:895 [coreLoadExecutor-295-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

86115:10:12:013 [coreLoadExecutor-295-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

86215:10:12:310 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Disabled, NRT, false)))

86315:10:14:829 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Enabled, NRT, false)))

864[info] - should update available solr instances

86515:10:15:255 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:40215_solr, 127.0.0.1:38233_solr, 127.0.0.1:37035_solr, 127.0.0.1:33977_solr]

866collections:{collection1=LazyCollectionRef(collection1)}

867org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

868 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

869 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

870 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

871 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

872 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

873 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

874 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

875 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

876 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

877 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

878 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

879 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

880 at java.base/java.lang.Thread.run(Thread.java:833)

881Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

882 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

883 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

884 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

885 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

886 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

887 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

888 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

889 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

890 ... 12 more

891java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7d2ae5a8[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@4e1e3fb9[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@b1ca81e]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@3add40a2[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 36]

892 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

893 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

894 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

895 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

896 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

897 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

898 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

899 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

900 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

901 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

902 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

903 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

904 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

905 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

906 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

907 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

908 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

909 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

910 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

911 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

912 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

913 at java.base/java.lang.Thread.run(Thread.java:833)

91415:10:15:258 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

91515:10:15:260 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

91615:10:15:260 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:44433/solr

91715:10:15:263 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:44433/solr

91815:10:15:264 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Enabled, NRT, false)))

91915:10:15:656 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 38233

92015:10:15:770 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Failed, NRT, false)))

921[info] - should route requests according to _route_ param

92215:10:15:880 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:37035_solr, 127.0.0.1:40215_solr, 127.0.0.1:33977_solr]

923collections:{collection1=LazyCollectionRef(collection1)}

924org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

925 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

926 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

927 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

928 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

929 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

930 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

931 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

932 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

933 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

934 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

935 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

936 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

937 at java.base/java.lang.Thread.run(Thread.java:833)

938Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

939 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

940 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

941 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

942 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

943 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

944 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

945 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

946 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

947 ... 12 more

948java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@75d1e0b3[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@218f2c38[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@648da66d]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@55a32043[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 5]

949 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

950 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

951 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

952 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

953 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

954 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

955 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

956 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

957 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

958 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

959 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

960 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

961 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

962 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

963 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

964 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

965 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

966 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

967 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

968 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

969 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

970 at java.base/java.lang.Thread.run(Thread.java:833)

97115:10:15:881 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.SolrRunner - Starting Jetty...

97215:10:15:884 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

97315:10:15:886 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

97415:10:16:004 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

97515:10:16:015 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

97615:10:16:016 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

97715:10:16:039 [coreLoadExecutor-369-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

97815:10:16:165 [coreLoadExecutor-369-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

97915:10:16:297 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

98015:10:16:300 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

98115:10:16:301 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:44433/solr

98215:10:16:304 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:44433/solr

98315:10:16:314 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Failed, NRT, false)))

98415:10:17:312 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Disabled, NRT, false)))

98515:10:19:315 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:33977/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:37035/solr/collection1_shard1_replica_n6, Enabled, NRT, false), ShardReplica(http://127.0.0.1:40215/solr/collection1_shard2_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:38233/solr/collection1_shard2_replica_n2, Enabled, NRT, false)))

986[info] - should test solr instances according to the WarmupQueries

98715:10:19:535 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

98815:10:19:975 [ZkTestServer Run Thread] WARN org.apache.solr.cloud.ZkTestServer - Watch limit violations:

989Maximum concurrent create/delete watches above limit:

990

991 12 /solr/aliases.json

992 12 /solr/clusterprops.json

993 9 /solr/collections/collection1/terms/shard2

994 7 /solr/collections/collection1/terms/shard1

995 6 /solr/configs/collection1

996 6 /solr/packages.json

997 6 /solr/security.json

998 6 /solr/configs/collection1/managed-schema.xml

999 5 /solr/collections/collection1/collectionprops.json

1000

1001Maximum concurrent data watches above limit:

1002

1003 43 /solr/collections/collection1/state.json

1004 3 /solr/overseer_elect/election/72057617654611976-127.0.0.1:40215_solr-n_0000000000

1005 3 /solr/collections/collection1/leader_elect/shard2/election/72057617654611976-core_node3-n_0000000000

1006 2 /solr/overseer_elect/election/72057617654611978-127.0.0.1:33977_solr-n_0000000003

1007

1008Maximum concurrent children watches above limit:

1009

1010 62 /solr/live_nodes

1011 40 /solr/overseer/queue

1012 18 /solr/collections

1013 11 /solr/collections/collection1/state.json

1014 4 /solr/overseer/collection-queue-work

1015

1016[info] PingStatusObserverIntegrationSpec:

101715:10:20:041 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Solr on port 8889 with Solr home /tmp/base1764857420015/solrhome

101815:10:20:042 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Jetty...

101915:10:20:053 [pool-1-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

102015:10:20:064 [coreLoadExecutor-410-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

102115:10:20:064 [coreLoadExecutor-410-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

1022[info] PingStatusObserver

102315:10:20:245 [AsyncHttpClient-35-1] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8889/solr/collection1 from Enabled to Disabled.

1024[info] - should update status base on ping status

102515:10:20:252 [AsyncHttpClient-35-1] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8889/solr/collection1 from Disabled to Enabled.

102615:10:20:259 [AsyncHttpClient-35-1] WARN io.ino.solrs.PingStatusObserver - Got ping response status != 200 (404) from http://localhost:8889/solr/collection1/admin/ping?action=status&wt=xml, with response '<html>

1027<head>

1028<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>

1029<title>Error 404 Not Found</title>

1030</head>

1031<body><h2>HTTP ERROR 404 Not Found</h2>

1032<table>

1033<tr><th>URI:</th><td>/solr/collection1/admin/ping</td></tr>

1034<tr><th>STATUS:</th><td>404</td></tr>

1035<tr><th>MESSAGE:</th><td>Not Found</td></tr>

1036<tr><th>SERVLET:</th><td>org.apache.solr.embedded.JettySolrRunner$Servlet404-5839ac7e</td></tr>

1037</table>

1038<hr/><a href="https://jetty.org">Powered by Jetty:// 10.0.22</a><hr/>

1039

1040</body>

1041</html>

1042'

1043[info] - should disable server on status != 200

104415:10:20:267 [AsyncHttpClient-35-1] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8889/solr/collection1 from Failed to Enabled.

104515:10:20:568 [AsyncHttpClient-timer-36-1] ERROR io.ino.solrs.PingStatusObserver - An error occurred when trying to get ping status from http://localhost:8889/solr/collection1/admin/ping?action=status&wt=xml, changing status to Failed.

1046java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:8889 after 100 ms

1047 at org.asynchttpclient.netty.timeout.TimeoutTimerTask.expire(TimeoutTimerTask.java:45)

1048 at org.asynchttpclient.netty.timeout.ReadTimeoutTimerTask.run(ReadTimeoutTimerTask.java:56)

1049 at io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)

1050 at io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)

1051 at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)

1052 at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:788)

1053 at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)

1054 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1055 at java.base/java.lang.Thread.run(Thread.java:833)

1056[info] - should disable server on read timeout

105715:10:20:578 [AsyncHttpClient-35-2] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8889/solr/collection1 from Failed to Enabled.

105815:10:20:578 [pool-1-thread-1-ScalaTest-running-PingStatusObserverIntegrationSpec] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 8889

105915:10:23:089 [AsyncHttpClient-35-2] ERROR io.ino.solrs.PingStatusObserver - An error occurred when trying to get ping status from http://localhost:8889/solr/collection1/admin/ping?action=status&wt=xml, changing status to Failed.

1060java.net.ConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:8889

1061 at org.asynchttpclient.netty.channel.NettyConnectListener.onFailure(NettyConnectListener.java:173)

1062 at org.asynchttpclient.netty.channel.NettyChannelConnector$1.onFailure(NettyChannelConnector.java:107)

1063 at org.asynchttpclient.netty.SimpleChannelFutureListener.operationComplete(SimpleChannelFutureListener.java:30)

1064 at org.asynchttpclient.netty.SimpleChannelFutureListener.operationComplete(SimpleChannelFutureListener.java:22)

1065 at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590)

1066 at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583)

1067 at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559)

1068 at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492)

1069 at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636)

1070 at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629)

1071 at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118)

1072 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)

1073 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)

1074 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)

1075 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

1076 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

1077 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

1078 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

1079 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

1080 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1081 at java.base/java.lang.Thread.run(Thread.java:833)

1082Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:8889

1083Caused by: java.net.ConnectException: Connection refused

1084 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1085 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1086 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1087 at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)

1088 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)

1089 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)

1090 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

1091 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

1092 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

1093 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

1094 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

1095 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1096 at java.base/java.lang.Thread.run(Thread.java:833)

1097[info] - should disable server on connection error

109815:10:23:102 [pool-1-thread-1-ScalaTest-running-PingStatusObserverIntegrationSpec] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

109915:10:23:110 [coreLoadExecutor-438-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

110015:10:23:110 [coreLoadExecutor-438-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

110115:10:23:719 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Stopping Solr Jetty running on port 8889

110215:10:23:719 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 8889

1103[info] CloudSolrServersUninitializedIntegrationSpec:

1104[info] CloudSolrServers

110515:10:23:727 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

110615:10:23:728 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(localhost:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for server localhost/[0:0:0:0:0:0:0:1]:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1107java.net.ConnectException: Connection refused

1108 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1109 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1110 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1111 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1112 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

111315:10:24:930 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-EventThread] ERROR org.apache.zookeeper.ClientCnxn - Error while calling watcher.

1114java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$368/0x00007fbab83c6000@7a2272af rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@74e5939b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]

1115 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

1116 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

1117 at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)

1118 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:361)

1119 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.process(SolrZkClient.java:1096)

1120 at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:564)

1121 at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:539)

112215:10:24:930 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN io.ino.solrs.CloudSolrServers$ - Could not connect to ZK, seems to be unavailable. Retrying in 1 second. Original exception: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper localhost:2181 within 1000 ms

1123[info] - should be able to start and stop with unavailable ZK

112415:10:24:933 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

112515:10:24:934 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(localhost:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1126java.net.ConnectException: Connection refused

1127 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1128 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1129 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1130 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1131 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

113215:10:26:135 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN io.ino.solrs.CloudSolrServers$ - Could not connect to ZK, seems to be unavailable. Retrying in 1 second. Original exception: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper localhost:2181/solr within 1000 ms

113315:10:26:135 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-EventThread] ERROR org.apache.zookeeper.ClientCnxn - Error while calling watcher.

1134java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$368/0x00007fbab83c6000@60124cb3 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@6ed5aec1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]

1135 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

1136 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

1137 at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)

1138 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:361)

1139 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.process(SolrZkClient.java:1096)

1140 at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:564)

1141 at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:539)

114215:10:26:149 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

114315:10:26:250 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114415:10:26:253 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114515:10:26:254 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114615:10:26:256 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114715:10:26:256 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 107 ms

114815:10:26:257 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

114915:10:26:257 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

115015:10:26:258 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

115115:10:26:364 [jetty-launcher-465-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

115215:10:26:364 [jetty-launcher-465-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

115315:10:26:366 [jetty-launcher-465-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

115415:10:26:366 [jetty-launcher-465-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

115515:10:26:507 [jetty-launcher-465-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

115615:10:26:507 [jetty-launcher-465-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

115715:10:26:519 [jetty-launcher-465-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

115815:10:26:519 [jetty-launcher-465-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

115915:10:26:532 [jetty-launcher-465-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

116015:10:26:534 [jetty-launcher-465-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

116115:10:26:605 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

116215:10:26:607 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

116315:10:26:609 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 352 ms

116415:10:26:609 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857426136/solrhome/collection1/conf

116515:10:26:609 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

116615:10:26:612 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

116715:10:26:752 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857426136/solrhome/collection1/conf took 142 ms

116815:10:26:752 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

116915:10:26:754 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

117015:10:26:757 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

117115:10:26:901 [qtp2145756149-1069] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

117215:10:26:904 [qtp1970136698-1074] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

117315:10:27:136 [solrs-CloudSolrServersUpdateThread-01] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

117415:10:27:137 [solrs-CloudSolrServersUpdateThread-01-SendThread(localhost:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for server localhost/[0:0:0:0:0:0:0:1]:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1175java.net.ConnectException: Connection refused

1176 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1177 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1178 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1179 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1180 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

118115:10:28:175 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1423 ms

118215:10:28:176 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:38731_solr={responseHeader={status=0, QTime=780}, core=collection1_shard1_replica_n1}, 127.0.0.1:35147_solr={responseHeader={status=0, QTime=1183}, core=collection1_shard1_replica_n2}}

118315:10:28:176 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:38731/solr/collection1_shard1_replica_n1

118415:10:28:176 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:35147/solr/collection1_shard1_replica_n2

118515:10:28:338 [solrs-CloudSolrServersUpdateThread-01-EventThread] ERROR org.apache.zookeeper.ClientCnxn - Error while calling watcher.

1186java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$368/0x00007fbab83c6000@15c76cb4 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@1b00807c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]

1187 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

1188 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

1189 at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)

1190 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:361)

1191 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.process(SolrZkClient.java:1096)

1192 at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:564)

1193 at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:539)

119415:10:28:338 [solrs-CloudSolrServersUpdateThread-01] WARN io.ino.solrs.CloudSolrServers$ - Could not connect to ZK, seems to be unavailable. Retrying in 1 second. Original exception: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper localhost:2181/solr within 1000 ms

119515:10:29:338 [solrs-CloudSolrServersUpdateThread-01] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

119615:10:29:340 [solrs-CloudSolrServersUpdateThread-01] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

119715:10:29:340 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at localhost:2181/solr

119815:10:29:343 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at localhost:2181/solr

119915:10:29:343 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:38731/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35147/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

1200[info] - should be able to start with unavailable ZK and should be connected as soon as ZK is available

120115:10:29:457 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:35147_solr, 127.0.0.1:38731_solr]

1202collections:{collection1=LazyCollectionRef(collection1)}

1203org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

1204 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

1205 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

1206 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

1207 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

1208 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

1209 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

1210 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

1211 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

1212 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

1213 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

1214 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1215 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1216 at java.base/java.lang.Thread.run(Thread.java:833)

1217Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

1218 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

1219 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1220 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1221 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1222 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1223 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1224 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

1225 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

1226 ... 12 more

1227java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@264f8f65[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@5ed54cc5[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@ba84e93]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@5af72cc9[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 2]

1228 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

1229 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

1230 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

1231 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

1232 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

1233 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

1234 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

1235 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

1236 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

1237 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

1238 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

1239 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

1240 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

1241 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

1242 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

1243 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

1244 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

1245 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

1246 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

1247 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1248 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1249 at java.base/java.lang.Thread.run(Thread.java:833)

125015:10:29:458 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

125115:10:29:674 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

125215:10:29:877 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1253EndOfStreamException: Unable to read additional data from server sessionid 0x1000005c39a0009, likely server has closed socket

1254 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1255 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1256 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

1257[info] ScalaFutureFactorySpec:

1258[info] ScalaFutureFactory

1259[info] - should return promise/future that supports map

1260[info] - should return promise/future that supports flatMap (success)

1261[info] - should return promise/future that supports flatMap (failure in subject)

1262[info] - should return promise/future that supports flatMap (failure in callback)

1263[info] - should return promise/future that supports handle (unhandled)

1264[info] - should return promise/future that supports handle (success)

1265[info] - should return promise/future that supports handle (failure)

1266[info] - should return promise/future that supports handleWith (unhandled)

1267[info] - should return promise/future that supports handleWith (success)

1268[info] - should return promise/future that supports handleWith (failure)

1269[info] - should reduce a sequence of futures to a future of sequence

1270[info] AsyncSolrClientIntegrationSpec:

1271[info] Solr

1272[info] - should allow to transform the response

127315:10:29:972 [AsyncHttpClient-39-2] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8888/solr/collection1 from Enabled to Disabled.

127415:10:29:978 [zkCallback-517-thread-1] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@1fd9302f name: ZooKeeperConnection Watcher:127.0.0.1:2181/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

127515:10:29:978 [zkCallback-517-thread-1] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

127615:10:29:990 [AsyncHttpClient-39-2] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8888/solr/collection1 from Disabled to Enabled.

127715:10:30:010 [AsyncHttpClient-39-2] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8888/solr/collection1 from Enabled to Disabled.

1278[info] - should allow to regularly observe the server status

1279[info] - should be built with LoadBalancer

1280[info] - should allow to set the http client

1281[info] - should allow to set the response parser

1282[info] - should allow to override the response parser per request

128315:10:30:144 [qtp2023344443-21] ERROR org.apache.solr.handler.RequestHandlerBase - Client exception

1284org.apache.solr.common.SolrException: undefined field fieldDoesNotExist

1285 at org.apache.solr.schema.IndexSchema.getDynamicFieldType(IndexSchema.java:1485)

1286 at org.apache.solr.schema.IndexSchema$SolrQueryAnalyzer.getWrappedAnalyzer(IndexSchema.java:506)

1287 at org.apache.lucene.analysis.DelegatingAnalyzerWrapper$DelegatingReuseStrategy.getReusableComponents(DelegatingAnalyzerWrapper.java:83)

1288 at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:184)

1289 at org.apache.lucene.util.QueryBuilder.createFieldQuery(QueryBuilder.java:257)

1290 at org.apache.solr.parser.SolrQueryParserBase.newFieldQuery(SolrQueryParserBase.java:530)

1291 at org.apache.solr.parser.QueryParser.newFieldQuery(QueryParser.java:68)

1292 at org.apache.solr.parser.SolrQueryParserBase.getFieldQuery(SolrQueryParserBase.java:1143)

1293 at org.apache.solr.parser.SolrQueryParserBase.handleBareTokenQuery(SolrQueryParserBase.java:859)

1294 at org.apache.solr.parser.QueryParser.Term(QueryParser.java:454)

1295 at org.apache.solr.parser.QueryParser.Clause(QueryParser.java:293)

1296 at org.apache.solr.parser.QueryParser.Query(QueryParser.java:173)

1297 at org.apache.solr.parser.QueryParser.TopLevelQuery(QueryParser.java:143)

1298 at org.apache.solr.parser.SolrQueryParserBase.parse(SolrQueryParserBase.java:276)

1299 at org.apache.solr.search.LuceneQParser.parse(LuceneQParser.java:51)

1300 at org.apache.solr.search.QParser.getQuery(QParser.java:189)

1301 at org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:186)

1302 at org.apache.solr.handler.component.SearchHandler.prepareComponents(SearchHandler.java:695)

1303 at org.apache.solr.handler.component.SearchHandler.processComponents(SearchHandler.java:477)

1304 at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:426)

1305 at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:228)

1306 at org.apache.solr.core.SolrCore.execute(SolrCore.java:2880)

1307 at org.apache.solr.servlet.HttpSolrCall.executeCoreRequest(HttpSolrCall.java:889)

1308 at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:575)

1309 at org.apache.solr.servlet.SolrDispatchFilter.dispatch(SolrDispatchFilter.java:241)

1310 at org.apache.solr.servlet.SolrDispatchFilter.lambda$doFilterRetry$0(SolrDispatchFilter.java:198)

1311 at org.apache.solr.servlet.ServletUtils.traceHttpRequestExecution2(ServletUtils.java:227)

1312 at org.apache.solr.servlet.ServletUtils.rateLimitRequest(ServletUtils.java:197)

1313 at org.apache.solr.servlet.SolrDispatchFilter.doFilterRetry(SolrDispatchFilter.java:192)

1314 at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:181)

1315 at javax.servlet.http.HttpFilter.doFilter(HttpFilter.java:97)

1316 at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)

1317 at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)

1318 at org.apache.solr.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:184)

1319 at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)

1320 at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)

1321 at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)

1322 at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)

1323 at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1580)

1324 at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)

1325 at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1384)

1326 at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)

1327 at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)

1328 at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1553)

1329 at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)

1330 at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1306)

1331 at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)

1332 at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)

1333 at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:301)

1334 at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)

1335 at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:822)

1336 at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)

1337 at org.eclipse.jetty.server.Server.handle(Server.java:563)

1338 at org.eclipse.jetty.server.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1598)

1339 at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:753)

1340 at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:501)

1341 at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:287)

1342 at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)

1343 at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)

1344 at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)

1345 at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)

1346 at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)

1347 at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)

1348 at java.base/java.lang.Thread.run(Thread.java:833)

134915:10:30:146 [AsyncHttpClient-41-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server SolrServer(http://localhost:8888/solr/collection1, Enabled), not retrying. Exception was: io.ino.solrs.RemoteSolrException: Server at http://localhost:8888/solr/collection1 returned non ok status:400, message: Bad Request, undefined field fieldDoesNotExist

1350io.ino.solrs.RemoteSolrException: Server at http://localhost:8888/solr/collection1 returned non ok status:400, message: Bad Request, undefined field fieldDoesNotExist

1351 at io.ino.solrs.AsyncSolrClient.validateResponse(AsyncSolrClient.scala:729)

1352 at io.ino.solrs.AsyncSolrClient.toSolrResponse$$anonfun$1(AsyncSolrClient.scala:687)

1353 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

1354 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

1355 at io.ino.solrs.AsyncSolrClient.withResponseParserFromRequest(AsyncSolrClient.scala:718)

1356 at io.ino.solrs.AsyncSolrClient.toSolrResponse(AsyncSolrClient.scala:687)

1357 at io.ino.solrs.AsyncSolrClient$$anon$3.onCompleted(AsyncSolrClient.scala:656)

1358 at io.ino.solrs.AsyncSolrClient$$anon$3.onCompleted(AsyncSolrClient.scala:654)

1359 at org.asynchttpclient.AsyncCompletionHandler.onCompleted(AsyncCompletionHandler.java:71)

1360 at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:231)

1361 at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:268)

1362 at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:194)

1363 at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:97)

1364 at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:125)

1365 at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:75)

1366 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

1367 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1368 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1369 at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:107)

1370 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

1371 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1372 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1373 at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)

1374 at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)

1375 at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)

1376 at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)

1377 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)

1378 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1379 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1380 at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357)

1381 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)

1382 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1383 at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868)

1384 at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)

1385 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)

1386 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

1387 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

1388 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

1389 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

1390 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

1391 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1392 at java.base/java.lang.Thread.run(Thread.java:833)

1393[info] - should return failed future on request with bad query

139415:10:30:183 [AsyncHttpClient-53-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server SolrServer(http://localhost:8888, Enabled), not retrying. Exception was: io.ino.solrs.RemoteSolrException: Expected a mime type of [application/octet-stream, application/vnd.apache.solr.javabin] but got [text/html].

1395<html>

1396<head>

1397<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>

1398<title>Error 404 Not Found</title>

1399</head>

1400<body><h2>HTTP ERROR 404 Not Found</h2>

1401<table>

1402<tr><th>URI:</th><td>/select</td></tr>

1403<tr><th>STATUS:</th><td>404</td></tr>

1404<tr><th>MESSAGE:</th><td>Not Found</td></tr>

1405<tr><th>SERVLET:</th><td>-</td></tr>

1406</table>

1407<hr/><a href="https://jetty.org">Powered by Jetty:// 10.0.22</a><hr/>

1408

1409</body>

1410</html>

1411

1412io.ino.solrs.RemoteSolrException: Expected a mime type of [application/octet-stream, application/vnd.apache.solr.javabin] but got [text/html].

1413<html>

1414<head>

1415<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>

1416<title>Error 404 Not Found</title>

1417</head>

1418<body><h2>HTTP ERROR 404 Not Found</h2>

1419<table>

1420<tr><th>URI:</th><td>/select</td></tr>

1421<tr><th>STATUS:</th><td>404</td></tr>

1422<tr><th>MESSAGE:</th><td>Not Found</td></tr>

1423<tr><th>SERVLET:</th><td>-</td></tr>

1424</table>

1425<hr/><a href="https://jetty.org">Powered by Jetty:// 10.0.22</a><hr/>

1426

1427</body>

1428</html>

1429

1430 at io.ino.solrs.AsyncSolrClient.validateMimeType(AsyncSolrClient.scala:754)

1431 at io.ino.solrs.AsyncSolrClient.validateResponse(AsyncSolrClient.scala:723)

1432 at io.ino.solrs.AsyncSolrClient.toSolrResponse$$anonfun$1(AsyncSolrClient.scala:687)

1433 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

1434 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

1435 at io.ino.solrs.AsyncSolrClient.withResponseParserFromRequest(AsyncSolrClient.scala:718)

1436 at io.ino.solrs.AsyncSolrClient.toSolrResponse(AsyncSolrClient.scala:687)

1437 at io.ino.solrs.AsyncSolrClient$$anon$3.onCompleted(AsyncSolrClient.scala:656)

1438 at io.ino.solrs.AsyncSolrClient$$anon$3.onCompleted(AsyncSolrClient.scala:654)

1439 at org.asynchttpclient.AsyncCompletionHandler.onCompleted(AsyncCompletionHandler.java:71)

1440 at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:231)

1441 at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:268)

1442 at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:194)

1443 at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:97)

1444 at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:125)

1445 at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:75)

1446 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

1447 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1448 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1449 at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:107)

1450 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

1451 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1452 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1453 at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)

1454 at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)

1455 at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)

1456 at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)

1457 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)

1458 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1459 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1460 at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357)

1461 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)

1462 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1463 at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868)

1464 at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)

1465 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)

1466 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

1467 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

1468 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

1469 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

1470 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

1471 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1472 at java.base/java.lang.Thread.run(Thread.java:833)

1473[info] - should return failed future on wrong request path

1474[info] - should gather request time metrics

1475[info] - should allow to intercept requests

1476[info] JavaFutureFactorySpec:

1477[info] JavaFutureFactory

1478[info] - should return promise/future that supports map

1479[info] - should return promise/future that supports flatMap (success)

1480[info] - should return promise/future that supports flatMap (failure in subject)

1481[info] - should return promise/future that supports flatMap (failure in callback)

1482[info] - should return promise/future that supports handle (unhandled)

1483[info] - should return promise/future that supports handle (success)

1484[info] - should return promise/future that supports handle (failure)

1485[info] - should return promise/future that supports handleWith (unhandled)

1486[info] - should return promise/future that supports handleWith (success)

1487[info] - should return promise/future that supports handleWith (failure)

1488[info] - should reduce a sequence of futures to a future of sequence

1489[info] AsyncSolrClientCloudIntegrationSpec:

1490[info] AsyncSolrClient with CloudSolrServers + RoundRobinLB

149115:10:30:289 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

149215:10:30:391 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

149315:10:30:394 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

149415:10:30:396 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

149515:10:30:398 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

149615:10:30:398 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 108 ms

149715:10:30:398 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

149815:10:30:398 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

149915:10:30:403 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

150015:10:30:509 [jetty-launcher-556-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

150115:10:30:510 [jetty-launcher-556-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

150215:10:30:513 [jetty-launcher-556-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

150315:10:30:513 [jetty-launcher-556-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

150415:10:30:651 [jetty-launcher-556-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

150515:10:30:651 [jetty-launcher-556-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

150615:10:30:664 [jetty-launcher-556-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

150715:10:30:665 [jetty-launcher-556-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

150815:10:30:673 [jetty-launcher-556-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

150915:10:30:674 [jetty-launcher-556-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

151015:10:30:755 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

151115:10:30:758 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

151215:10:30:760 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 362 ms

151315:10:30:761 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857430278/solrhome/collection1/conf

151415:10:30:761 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

151515:10:30:763 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

151615:10:30:900 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857430278/solrhome/collection1/conf took 139 ms

151715:10:30:900 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

151815:10:30:904 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

151915:10:30:907 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

152015:10:31:048 [qtp2058703760-1272] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

152115:10:31:048 [qtp946447633-1267] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

152215:10:31:408 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1523java.net.ConnectException: Connection refused

1524 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1525 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1526 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1527 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1528 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

152915:10:32:320 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1420 ms

153015:10:32:321 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:45287_solr={responseHeader={status=0, QTime=289}, core=collection1_shard1_replica_n1}, 127.0.0.1:33669_solr={responseHeader={status=0, QTime=1178}, core=collection1_shard1_replica_n2}}

153115:10:32:321 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1764857430278/solrhome/collection2/conf

153215:10:32:321 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

153315:10:32:323 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

153415:10:32:453 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1764857430278/solrhome/collection2/conf took 132 ms

153515:10:32:453 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1

153615:10:32:518 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1537java.net.ConnectException: Connection refused

1538 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1539 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1540 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1541 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1542 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

154315:10:32:683 [qtp2058703760-1275] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

154415:10:32:683 [qtp946447633-1273] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

154515:10:33:941 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1 took 1487 ms

154615:10:33:941 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:33669_solr={responseHeader={status=0, QTime=272}, core=collection2_shard1_replica_n2}, 127.0.0.1:45287_solr={responseHeader={status=0, QTime=1163}, core=collection2_shard1_replica_n1}}

154715:10:33:941 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:33669/solr/collection1_shard1_replica_n2

154815:10:33:941 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:33669/solr/collection2_shard1_replica_n2

154915:10:33:941 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:45287/solr/collection1_shard1_replica_n1

155015:10:33:941 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:45287/solr/collection2_shard1_replica_n1

155115:10:33:944 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

155215:10:33:945 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

155315:10:33:945 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:45549/solr

155415:10:33:947 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:45549/solr

155515:10:33:948 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

155615:10:34:016 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

155715:10:34:023 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 45287

155815:10:34:032 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

155915:10:34:041 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

156015:10:34:047 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1561java.net.ConnectException: Connection refused

1562 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1563 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1564 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1565 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1566 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

156715:10:34:050 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

156815:10:34:058 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

156915:10:34:062 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157015:10:34:066 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157115:10:34:070 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157215:10:34:074 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157315:10:34:081 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157415:10:34:086 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157515:10:34:095 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157615:10:34:101 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157715:10:34:106 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157815:10:34:110 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

157915:10:34:113 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158015:10:34:116 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158115:10:34:119 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158215:10:34:123 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158315:10:34:127 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158415:10:34:130 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158515:10:34:134 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158615:10:34:137 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158715:10:34:142 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158815:10:34:147 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

158915:10:34:151 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159015:10:34:155 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159115:10:34:159 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159215:10:34:163 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159315:10:34:167 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159415:10:34:171 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159515:10:34:174 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159615:10:34:178 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159715:10:34:181 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159815:10:34:184 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

159915:10:34:187 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160015:10:34:190 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160115:10:34:194 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160215:10:34:197 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160315:10:34:201 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160415:10:34:205 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160515:10:34:208 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160615:10:34:213 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160715:10:34:217 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160815:10:34:220 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

160915:10:34:223 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161015:10:34:226 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161115:10:34:229 [scala-execution-context-global-211] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161215:10:34:232 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161315:10:34:236 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161415:10:34:239 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161515:10:34:242 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161615:10:34:245 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161715:10:34:248 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161815:10:34:251 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

161915:10:34:255 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

162015:10:34:259 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

162115:10:34:263 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, true), trying next server ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:45287

162215:10:34:264 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection2_shard1_replica_n1, Failed, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Failed, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

162315:10:34:359 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrRunner - Starting Jetty...

162415:10:34:364 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

162515:10:34:369 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

162615:10:34:508 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

162715:10:34:537 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

162815:10:34:539 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

162915:10:34:577 [coreLoadExecutor-664-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

163015:10:34:582 [coreLoadExecutor-664-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

163115:10:34:832 [coreLoadExecutor-664-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

163215:10:34:835 [coreLoadExecutor-664-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

163315:10:35:293 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection2_shard1_replica_n1, Disabled, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Failed, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

163415:10:35:443 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

163515:10:35:455 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

163615:10:35:466 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

163715:10:35:476 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

163815:10:35:487 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

163915:10:35:497 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164015:10:35:506 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1641java.net.ConnectException: Connection refused

1642 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1643 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1644 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1645 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1646 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

164715:10:35:507 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164815:10:35:518 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164915:10:35:528 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165015:10:35:539 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165115:10:35:549 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165215:10:35:650 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165315:10:35:750 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165415:10:35:851 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165515:10:35:951 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165615:10:36:052 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165715:10:36:153 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165815:10:36:253 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165915:10:36:354 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

166015:10:36:454 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

166115:10:36:555 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

166215:10:36:655 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

166315:10:36:709 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection2_shard1_replica_n1, Disabled, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Failed, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

166415:10:36:756 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

166515:10:36:827 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1666java.net.ConnectException: Connection refused

1667 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1668 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1669 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1670 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1671 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

167215:10:36:856 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

167315:10:36:957 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

167415:10:37:057 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

167515:10:37:158 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

167615:10:37:258 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

167715:10:37:316 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection2_shard1_replica_n1, Disabled, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Disabled, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

167815:10:37:359 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

167915:10:37:459 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

168015:10:37:560 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

168115:10:37:661 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

168215:10:37:723 [recoveryExecutor-656-thread-1] WARN org.apache.solr.update.PeerSyncWithLeader - no frame of reference to tell if we've missed updates

168315:10:37:761 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

168415:10:37:862 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

168515:10:37:922 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Disabled, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

168615:10:37:962 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

168715:10:38:063 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

168815:10:38:163 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

168915:10:38:264 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

169015:10:38:364 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

169115:10:38:465 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

169215:10:38:565 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

169315:10:38:666 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

169415:10:38:766 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

169515:10:38:818 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1696java.net.ConnectException: Connection refused

1697 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1698 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1699 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1700 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1701 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

170215:10:38:867 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

170315:10:38:967 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

170415:10:39:068 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

170515:10:39:168 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

170615:10:39:269 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

170715:10:39:369 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

170815:10:39:470 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

170915:10:39:570 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

171015:10:39:671 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

171115:10:39:771 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

171215:10:39:839 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:45287/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:33669/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

171315:10:39:872 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

1714[info] - should serve queries while solr server is restarted

171515:10:40:077 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:33669_solr, 127.0.0.1:45287_solr]

1716collections:{collection1=LazyCollectionRef(collection1), collection2=LazyCollectionRef(collection2)}

1717org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

1718 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

1719 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

1720 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

1721 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

1722 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

1723 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

1724 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

1725 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

1726 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

1727 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

1728 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1729 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1730 at java.base/java.lang.Thread.run(Thread.java:833)

1731Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

1732 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

1733 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1734 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1735 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1736 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1737 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1738 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

1739 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

1740 ... 12 more

1741java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@dad76dd[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@14d03a17[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@51d2b6e9]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@60c94296[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 59]

1742 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

1743 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

1744 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

1745 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

1746 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

1747 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

1748 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

1749 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

1750 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

1751 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

1752 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

1753 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

1754 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

1755 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

1756 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

1757 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

1758 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

1759 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

1760 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

1761 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1762 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1763 at java.base/java.lang.Thread.run(Thread.java:833)

176415:10:40:078 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

176515:10:40:296 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

176615:10:40:528 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

176715:10:40:629 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

176815:10:40:633 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

176915:10:40:634 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

177015:10:40:636 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

177115:10:40:636 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 107 ms

177215:10:40:636 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

177315:10:40:636 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

177415:10:40:638 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

177515:10:40:706 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1776java.net.ConnectException: Connection refused

1777 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1778 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1779 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1780 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1781 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

178215:10:40:743 [jetty-launcher-693-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

178315:10:40:743 [jetty-launcher-693-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

178415:10:40:745 [jetty-launcher-693-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

178515:10:40:745 [jetty-launcher-693-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

178615:10:40:881 [jetty-launcher-693-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

178715:10:40:882 [jetty-launcher-693-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

178815:10:40:892 [jetty-launcher-693-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

178915:10:40:893 [jetty-launcher-693-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

179015:10:40:899 [jetty-launcher-693-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

179115:10:40:900 [jetty-launcher-693-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

179215:10:40:961 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

179315:10:40:964 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

179415:10:40:966 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 329 ms

179515:10:40:966 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857440519/solrhome/collection1/conf

179615:10:40:966 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

179715:10:40:968 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

179815:10:41:116 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857440519/solrhome/collection1/conf took 150 ms

179915:10:41:116 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

180015:10:41:118 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

180115:10:41:120 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

180215:10:41:255 [qtp2123643656-1514] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

180315:10:41:256 [qtp49968675-1511] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

180415:10:42:185 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1805java.net.ConnectException: Connection refused

1806 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1807 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1808 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1809 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1810 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

181115:10:42:497 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1380 ms

181215:10:42:497 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:36035_solr={responseHeader={status=0, QTime=258}, core=collection1_shard1_replica_n2}, 127.0.0.1:40671_solr={responseHeader={status=0, QTime=1148}, core=collection1_shard1_replica_n1}}

181315:10:42:497 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1764857440519/solrhome/collection2/conf

181415:10:42:497 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

181515:10:42:499 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

181615:10:42:630 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1764857440519/solrhome/collection2/conf took 132 ms

181715:10:42:630 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1

181815:10:42:858 [qtp2123643656-1516] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

181915:10:42:858 [qtp49968675-1517] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

182015:10:43:867 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1821java.net.ConnectException: Connection refused

1822 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1823 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1824 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1825 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1826 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

182715:10:44:115 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1 took 1485 ms

182815:10:44:115 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:36035_solr={responseHeader={status=0, QTime=269}, core=collection2_shard1_replica_n2}, 127.0.0.1:40671_solr={responseHeader={status=0, QTime=1163}, core=collection2_shard1_replica_n1}}

182915:10:44:116 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:36035/solr/collection1_shard1_replica_n2

183015:10:44:116 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:36035/solr/collection2_shard1_replica_n2

183115:10:44:116 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:40671/solr/collection1_shard1_replica_n1

183215:10:44:116 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:40671/solr/collection2_shard1_replica_n1

183315:10:44:117 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

183415:10:44:119 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

183515:10:44:119 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:38269/solr

183615:10:44:121 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:38269/solr

183715:10:44:122 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:40671/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:36035/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:40671/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:36035/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

183815:10:44:177 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

183915:10:44:178 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Restarting Zookeeper with zkDir = /tmp/base1764857440519/zookeeper/server1/data and port = 38269...

184015:10:44:382 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec-SendThread(127.0.0.1:38269)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005fbc60009 for server localhost/127.0.0.1:38269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1841EndOfStreamException: Unable to read additional data from server sessionid 0x1000005fbc60009, likely server has closed socket

1842 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1843 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1844 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

184515:10:44:383 [jetty-launcher-693-thread-2-SendThread(127.0.0.1:38269)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005fbc60005 for server localhost/127.0.0.1:38269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1846EndOfStreamException: Unable to read additional data from server sessionid 0x1000005fbc60005, likely server has closed socket

1847 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1848 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1849 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

185015:10:44:383 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec-SendThread(127.0.0.1:38269)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005fbc6000b for server localhost/127.0.0.1:38269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1851EndOfStreamException: Unable to read additional data from server sessionid 0x1000005fbc6000b, likely server has closed socket

1852 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1853 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1854 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

185515:10:44:383 [jetty-launcher-693-thread-1-SendThread(127.0.0.1:38269)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005fbc60006 for server localhost/127.0.0.1:38269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1856EndOfStreamException: Unable to read additional data from server sessionid 0x1000005fbc60006, likely server has closed socket

1857 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1858 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1859 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

186015:10:44:385 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec-SendThread(127.0.0.1:38269)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005fbc60007 for server localhost/127.0.0.1:38269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1861EndOfStreamException: Unable to read additional data from server sessionid 0x1000005fbc60007, likely server has closed socket

1862 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1863 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1864 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

186515:10:44:389 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Zookeeper was stopped, starting new one...

186615:10:44:484 [zkCallback-745-thread-3] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@353d60e1 name: ZooKeeperConnection Watcher:127.0.0.1:38269/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

186715:10:44:484 [zkCallback-745-thread-3] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

186815:10:44:485 [zkCallback-776-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@9023afa name: ZooKeeperConnection Watcher:127.0.0.1:38269/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

186915:10:44:485 [zkCallback-776-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

187015:10:44:485 [zkCallback-718-thread-3] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@64d754e3 name: ZooKeeperConnection Watcher:127.0.0.1:38269/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

187115:10:44:485 [zkCallback-718-thread-3] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

187215:10:44:486 [zkCallback-737-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@33806c28 name: ZooKeeperConnection Watcher:127.0.0.1:38269/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

187315:10:44:486 [zkCallback-737-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

187415:10:44:490 [zkCallback-720-thread-7] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@25626a39 name: ZooKeeperConnection Watcher:127.0.0.1:38269/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

187515:10:44:490 [zkCallback-720-thread-7] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

187615:10:44:491 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

187715:10:44:503 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

187815:10:44:646 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

187915:10:44:649 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

188015:10:44:650 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - New Zookeeper was started

188115:10:45:220 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

1882[info] - should serve queries when ZK is not available

188315:10:45:539 [zkCallback-737-thread-1] WARN org.apache.solr.common.cloud.ZkStateReader - Error fetching collection names:

1884org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections

1885 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1886 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1887 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1888 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1889 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1890 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1891 at org.apache.solr.common.cloud.ZkStateReader.refreshCollectionList(ZkStateReader.java:657)

1892 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.refreshAndWatch(ZkStateReader.java:1343)

1893 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.process(ZkStateReader.java:1334)

1894 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1895 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1896 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1897 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1898 at java.base/java.lang.Thread.run(Thread.java:833)

189915:10:45:569 [OverseerCollectionConfigSetProcessor-72057619736821766-127.0.0.1:40671_solr-n_0000000000] WARN org.apache.solr.cloud.OverseerTaskProcessor -

1900org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer_elect/leader

1901 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1902 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1903 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1904 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1905 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1906 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1907 at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:486)

1908 at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:231)

1909 at java.base/java.lang.Thread.run(Thread.java:833)

191015:10:45:569 [zkCallback-720-thread-4] WARN org.apache.solr.schema.ZkIndexSchemaReader - ZooKeeper watch triggered, but schema does not exist in ZK - skipping update

191115:10:45:569 [zkCallback-720-thread-6] WARN org.apache.solr.schema.ZkIndexSchemaReader - ZooKeeper watch triggered, but schema does not exist in ZK - skipping update

191215:10:45:570 [zkCallback-720-thread-9] WARN org.apache.solr.cloud.LeaderElector -

1913org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election

1914 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1915 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1916 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1917 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1918 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1919 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1920 at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:99)

1921 at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:351)

1922 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1923 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1924 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1925 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1926 at java.base/java.lang.Thread.run(Thread.java:833)

192715:10:45:572 [zkCallback-720-thread-5] WARN org.apache.solr.cloud.LeaderElector -

1928org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection2/leader_elect/shard1/election

1929 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1930 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1931 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1932 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1933 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1934 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1935 at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:99)

1936 at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:351)

1937 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1938 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1939 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1940 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1941 at java.base/java.lang.Thread.run(Thread.java:833)

194215:10:45:572 [zkCallback-720-thread-6] WARN org.apache.solr.common.cloud.ZkStateReader - Error fetching collection names:

1943org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections

1944 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1945 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1946 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1947 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1948 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1949 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1950 at org.apache.solr.common.cloud.ZkStateReader.refreshCollectionList(ZkStateReader.java:657)

1951 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.refreshAndWatch(ZkStateReader.java:1343)

1952 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.process(ZkStateReader.java:1334)

1953 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1954 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1955 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1956 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1957 at java.base/java.lang.Thread.run(Thread.java:833)

195815:10:45:684 [OverseerStateUpdate-72057619736821766-127.0.0.1:40671_solr-n_0000000000] ERROR org.apache.solr.cloud.Overseer - Exception in Overseer main queue loop

1959org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/state.json

1960 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1961 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1962 at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:1450)

1963 at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:1419)

1964 at org.apache.solr.common.cloud.SolrZkClient.lambda$create$10(SolrZkClient.java:572)

1965 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1966 at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:571)

1967 at org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:313)

1968 at org.apache.solr.cloud.overseer.ZkStateWriter.writePendingUpdates(ZkStateWriter.java:224)

1969 at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:395)

1970 at java.base/java.lang.Thread.run(Thread.java:833)

197115:10:45:685 [OverseerStateUpdate-72057619736821766-127.0.0.1:40671_solr-n_0000000000] WARN org.apache.solr.cloud.Overseer -

1972org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer_elect/leader

1973 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1974 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1975 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1976 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1977 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1978 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1979 at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:619)

1980 at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:268)

1981 at java.base/java.lang.Thread.run(Thread.java:833)

198215:10:45:686 [OverseerExitThread] WARN org.apache.solr.cloud.Overseer - Error communicating with ZooKeeper

1983org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer_elect/leader

1984 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1985 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1986 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1987 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1988 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1989 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1990 at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:482)

1991 at java.base/java.lang.Thread.run(Thread.java:833)

199215:10:45:911 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1993java.net.ConnectException: Connection refused

1994 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1995 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1996 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1997 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1998 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

199915:10:45:922 [zkCallback-718-thread-2] WARN org.apache.solr.schema.ZkIndexSchemaReader - ZooKeeper watch triggered, but schema does not exist in ZK - skipping update

200015:10:45:923 [zkCallback-718-thread-5] WARN org.apache.solr.schema.ZkIndexSchemaReader - ZooKeeper watch triggered, but schema does not exist in ZK - skipping update

200115:10:45:923 [zkCallback-718-thread-7] WARN org.apache.solr.cloud.LeaderElector -

2002org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer_elect/election

2003 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

2004 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

2005 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

2006 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

2007 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

2008 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

2009 at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:99)

2010 at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:351)

2011 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

2012 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

2013 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2014 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2015 at java.base/java.lang.Thread.run(Thread.java:833)

201615:10:45:925 [zkCallback-718-thread-5] WARN org.apache.solr.common.cloud.ZkStateReader - Error fetching collection names:

2017org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections

2018 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

2019 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

2020 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

2021 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

2022 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

2023 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

2024 at org.apache.solr.common.cloud.ZkStateReader.refreshCollectionList(ZkStateReader.java:657)

2025 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.refreshAndWatch(ZkStateReader.java:1343)

2026 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.process(ZkStateReader.java:1334)

2027 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

2028 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

2029 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2030 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2031 at java.base/java.lang.Thread.run(Thread.java:833)

203215:10:45:933 [watches-722-thread-2] WARN org.apache.solr.cloud.ZkController - Failed to unregister core:collection2_shard1_replica_n2

2033org.apache.solr.common.SolrException: Error unregistering core [collection2_shard1_replica_n2] from cloud state

2034 at org.apache.solr.core.CoreContainer.unload(CoreContainer.java:2211)

2035 at org.apache.solr.cloud.ZkController$UnloadCoreOnDeletedWatcher.onStateChanged(ZkController.java:2838)

2036 at org.apache.solr.common.cloud.ZkStateReader$Notification.run(ZkStateReader.java:1895)

2037 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

2038 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2039 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2040 at java.base/java.lang.Thread.run(Thread.java:833)

2041Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode

2042 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

2043 at org.apache.zookeeper.ZooKeeper.multiInternal(ZooKeeper.java:1778)

2044 at org.apache.zookeeper.ZooKeeper.multi(ZooKeeper.java:1650)

2045 at org.apache.solr.common.cloud.SolrZkClient.lambda$multi$12(SolrZkClient.java:792)

2046 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

2047 at org.apache.solr.common.cloud.SolrZkClient.multi(SolrZkClient.java:792)

2048 at org.apache.solr.cloud.ShardLeaderElectionContextBase.cancelElection(ShardLeaderElectionContextBase.java:112)

2049 at org.apache.solr.cloud.ShardLeaderElectionContext.cancelElection(ShardLeaderElectionContext.java:87)

2050 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1839)

2051 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1816)

2052 at org.apache.solr.core.CoreContainer.unload(CoreContainer.java:2204)

2053 ... 6 more

205415:10:45:934 [watches-722-thread-1] WARN org.apache.solr.cloud.ZkController - Failed to unregister core:collection1_shard1_replica_n2

2055org.apache.solr.common.SolrException: Error unregistering core [collection1_shard1_replica_n2] from cloud state

2056 at org.apache.solr.core.CoreContainer.unload(CoreContainer.java:2211)

2057 at org.apache.solr.cloud.ZkController$UnloadCoreOnDeletedWatcher.onStateChanged(ZkController.java:2838)

2058 at org.apache.solr.common.cloud.ZkStateReader$Notification.run(ZkStateReader.java:1895)

2059 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

2060 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2061 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2062 at java.base/java.lang.Thread.run(Thread.java:833)

2063Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode

2064 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

2065 at org.apache.zookeeper.ZooKeeper.multiInternal(ZooKeeper.java:1778)

2066 at org.apache.zookeeper.ZooKeeper.multi(ZooKeeper.java:1650)

2067 at org.apache.solr.common.cloud.SolrZkClient.lambda$multi$12(SolrZkClient.java:792)

2068 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

2069 at org.apache.solr.common.cloud.SolrZkClient.multi(SolrZkClient.java:792)

2070 at org.apache.solr.cloud.ShardLeaderElectionContextBase.cancelElection(ShardLeaderElectionContextBase.java:112)

2071 at org.apache.solr.cloud.ShardLeaderElectionContext.cancelElection(ShardLeaderElectionContext.java:87)

2072 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1839)

2073 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1816)

2074 at org.apache.solr.core.CoreContainer.unload(CoreContainer.java:2204)

2075 ... 6 more

207615:10:46:335 [zkCallback-776-thread-2] WARN org.apache.solr.common.cloud.ZkStateReader - Error fetching collection names:

2077org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections

2078 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

2079 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

2080 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

2081 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

2082 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

2083 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

2084 at org.apache.solr.common.cloud.ZkStateReader.refreshCollectionList(ZkStateReader.java:657)

2085 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.refreshAndWatch(ZkStateReader.java:1343)

2086 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.process(ZkStateReader.java:1334)

2087 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

2088 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

2089 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2090 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2091 at java.base/java.lang.Thread.run(Thread.java:833)

209215:10:46:336 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map()

209315:10:46:620 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

209415:10:46:838 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

209515:10:47:060 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

209615:10:47:162 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

209715:10:47:167 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

209815:10:47:168 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

209915:10:47:170 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210015:10:47:170 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 109 ms

210115:10:47:170 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

210215:10:47:170 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210315:10:47:172 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210415:10:47:278 [jetty-launcher-796-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210515:10:47:278 [jetty-launcher-796-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210615:10:47:279 [jetty-launcher-796-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210715:10:47:280 [jetty-launcher-796-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210815:10:47:416 [jetty-launcher-796-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

210915:10:47:416 [jetty-launcher-796-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

211015:10:47:427 [jetty-launcher-796-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

211115:10:47:428 [jetty-launcher-796-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

211215:10:47:435 [jetty-launcher-796-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

211315:10:47:435 [jetty-launcher-796-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

211415:10:47:504 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

211515:10:47:506 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

211615:10:47:507 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 337 ms

211715:10:47:507 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857447052/solrhome/collection1/conf

211815:10:47:507 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

211915:10:47:510 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

212015:10:47:642 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857447052/solrhome/collection1/conf took 134 ms

212115:10:47:642 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

212215:10:47:643 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

212315:10:47:646 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

212415:10:47:785 [qtp1095386560-1729] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

212515:10:47:785 [qtp105514612-1734] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

212615:10:47:800 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2127java.net.ConnectException: Connection refused

2128 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2129 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2130 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2131 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2132 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

213315:10:49:040 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1398 ms

213415:10:49:040 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:45507_solr={responseHeader={status=0, QTime=271}, core=collection1_shard1_replica_n2}, 127.0.0.1:44537_solr={responseHeader={status=0, QTime=1160}, core=collection1_shard1_replica_n1}}

213515:10:49:040 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1764857447052/solrhome/collection2/conf

213615:10:49:040 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

213715:10:49:043 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

213815:10:49:052 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2139java.net.ConnectException: Connection refused

2140 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2141 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2142 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2143 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2144 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

214515:10:49:177 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1764857447052/solrhome/collection2/conf took 137 ms

214615:10:49:177 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1

214715:10:49:405 [qtp105514612-1732] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

214815:10:49:405 [qtp1095386560-1735] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

214915:10:50:404 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2150java.net.ConnectException: Connection refused

2151 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2152 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2153 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2154 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2155 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

215615:10:50:647 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1 took 1469 ms

215715:10:50:647 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:45507_solr={responseHeader={status=0, QTime=254}, core=collection2_shard1_replica_n2}, 127.0.0.1:44537_solr={responseHeader={status=0, QTime=1146}, core=collection2_shard1_replica_n1}}

215815:10:50:647 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:45507/solr/collection1_shard1_replica_n2

215915:10:50:647 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:45507/solr/collection2_shard1_replica_n2

216015:10:50:647 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:44537/solr/collection1_shard1_replica_n1

216115:10:50:647 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:44537/solr/collection2_shard1_replica_n1

216215:10:50:648 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

216315:10:50:650 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

216415:10:50:650 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:35075/solr

216515:10:50:651 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:35075/solr

216615:10:50:652 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:44537/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:45507/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:44537/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:45507/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

216715:10:50:714 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

2168[info] - should handle a standard (non-routed) collection alias

216915:10:51:316 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:45507_solr, 127.0.0.1:44537_solr]

2170collections:{collection1=LazyCollectionRef(collection1), collection2=LazyCollectionRef(collection2)}

2171org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

2172 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

2173 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

2174 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

2175 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

2176 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

2177 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

2178 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2179 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2180 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2181 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2182 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2183 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2184 at java.base/java.lang.Thread.run(Thread.java:833)

2185Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

2186 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

2187 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

2188 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

2189 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

2190 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

2191java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@29abbcf6[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@68e4b1c3[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@2de622bb]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@1c010e6b[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 5]

2192 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

2193 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

2194 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

2195 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

2196 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

2197 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

2198 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

2199 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

2200 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

2201 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

2202 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

2203 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

2204 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

2205 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

2206 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

2207 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2208 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2209 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2210 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2211 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2212 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2213 at java.base/java.lang.Thread.run(Thread.java:833)

2214 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

2215 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

2216 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

2217 ... 12 more

221815:10:51:317 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

221915:10:51:517 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2220java.net.ConnectException: Connection refused

2221 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2222 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2223 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2224 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2225 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

222615:10:51:533 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

222715:10:51:766 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

222815:10:51:867 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

222915:10:51:869 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223015:10:51:871 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223115:10:51:872 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223215:10:51:872 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 106 ms

223315:10:51:872 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

223415:10:51:873 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223515:10:51:874 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223615:10:51:979 [jetty-launcher-897-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223715:10:51:979 [jetty-launcher-897-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223815:10:51:981 [jetty-launcher-897-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223915:10:51:982 [jetty-launcher-897-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

224015:10:52:117 [jetty-launcher-897-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

224115:10:52:117 [jetty-launcher-897-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

224215:10:52:128 [jetty-launcher-897-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

224315:10:52:128 [jetty-launcher-897-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

224415:10:52:134 [jetty-launcher-897-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

224515:10:52:134 [jetty-launcher-897-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

224615:10:52:194 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

224715:10:52:196 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

224815:10:52:198 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 325 ms

224915:10:52:198 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857451757/solrhome/collection1/conf

225015:10:52:198 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

225115:10:52:199 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

225215:10:52:331 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1764857451757/solrhome/collection1/conf took 133 ms

225315:10:52:331 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

225415:10:52:333 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

225515:10:52:335 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

225615:10:52:467 [qtp412264480-1899] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

225715:10:52:467 [qtp909388786-1904] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

225815:10:52:855 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2259java.net.ConnectException: Connection refused

2260 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2261 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2262 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2263 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2264 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

226515:10:53:699 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1367 ms

226615:10:53:699 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:33377_solr={responseHeader={status=0, QTime=245}, core=collection1_shard1_replica_n1}, 127.0.0.1:41405_solr={responseHeader={status=0, QTime=1137}, core=collection1_shard1_replica_n2}}

226715:10:53:699 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1764857451757/solrhome/collection2/conf

226815:10:53:699 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

226915:10:53:701 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

227015:10:53:829 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1764857451757/solrhome/collection2/conf took 129 ms

227115:10:53:829 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1

227215:10:54:054 [qtp909388786-1902] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

227315:10:54:054 [qtp412264480-1905] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

227415:10:54:566 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000005c39a0009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2275java.net.ConnectException: Connection refused

2276 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2277 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2278 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2279 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2280 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

228115:10:55:300 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1 took 1471 ms

228215:10:55:301 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:33377_solr={responseHeader={status=0, QTime=256}, core=collection2_shard1_replica_n1}, 127.0.0.1:41405_solr={responseHeader={status=0, QTime=1150}, core=collection2_shard1_replica_n2}}

228315:10:55:301 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:33377/solr/collection1_shard1_replica_n1

228415:10:55:301 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:33377/solr/collection2_shard1_replica_n1

228515:10:55:301 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:41405/solr/collection1_shard1_replica_n2

228615:10:55:301 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:41405/solr/collection2_shard1_replica_n2

228715:10:55:302 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

228815:10:55:304 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

228915:10:55:304 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:46137/solr

229015:10:55:306 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:46137/solr

229115:10:55:307 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:33377/solr/collection2_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:41405/solr/collection2_shard1_replica_n2, Enabled, NRT, false)), collection1 -> Vector(ShardReplica(http://127.0.0.1:33377/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:41405/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

229215:10:55:357 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

2293[info] - should handle multiple collections param

229415:10:55:615 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:33377_solr, 127.0.0.1:41405_solr]

2295collections:{collection1=LazyCollectionRef(collection1), collection2=LazyCollectionRef(collection2)}

2296org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

2297 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

2298 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

2299 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

2300 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

2301 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

2302 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

2303 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2304 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2305 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2306 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2307 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2308 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2309 at java.base/java.lang.Thread.run(Thread.java:833)

2310Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

2311 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

2312 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

2313 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

2314 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

2315 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

2316 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

2317 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

2318 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

2319 ... 12 more

2320java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1a00ceae[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@3472c947[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@717041ad]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@404b3783[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 2]

2321 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

2322 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

2323 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

2324 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

2325 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

2326 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

2327 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

2328 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

2329 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

2330 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

2331 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

2332 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

2333 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

2334 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

2335 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

2336 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2337 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2338 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2339 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2340 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

234115:10:55:616 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

2342 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2343 at java.base/java.lang.Thread.run(Thread.java:833)

234415:10:55:831 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

2345[info] SolrServersSpec:

2346[info] StaticSolrServers

2347[info] - should return consecutive solr servers

2348[info] ReloadingSolrServers

234915:10:56:063 [pool-1-thread-1-ScalaTest-running-SolrServersSpec] INFO io.ino.solrs.SolrServersSpec$$anon$1 - Changed solr servers from Vector() to ArraySeq(SolrServer(host1, Enabled), SolrServer(host2, Enabled))

2350[info] - should return iterator that reflects updated solr servers

235115:10:56:074 [Thread-10] INFO io.ino.solrs.SolrRunner - Stopping Solr Jetty running on port 8888

235215:10:56:074 [Thread-10] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 8888

2353

2354************************

2355Build summary:

2356[{

2357 "module": "solrs",

2358 "compile": {"status": "ok", "tookMs": 13942, "warnings": 2, "errors": 0, "sourceVersion": "3.8"},

2359 "doc": {"status": "skipped", "tookMs": 0, "files": 0, "totalSizeKb": 0},

2360 "test-compile": {"status": "ok", "tookMs": 11511, "warnings": 1, "errors": 0, "sourceVersion": "3.8"},

2361 "test": {"status": "ok", "tookMs": 58233, "passed": 154, "failed": 0, "ignored": 0, "skipped": 0, "total": 154, "byFramework": [{"framework": "unknown", "stats": {"passed": 154, "failed": 0, "ignored": 0, "skipped": 0, "total": 154}}]},

2362 "publish": {"status": "skipped", "tookMs": 0},

2363 "metadata": {

2364 "crossScalaVersions": ["2.12.20", "2.13.16", "3.7.0"]

2365}

2366}]

2367************************

2368[success] Total time: 93 s (0:01:33.0), completed Dec 4, 2025, 3:10:56 PM

2369[0JChecking patch project/plugins.sbt...

2370Checking patch project/build.properties...

2371Checking patch build.sbt...

2372Applied patch project/plugins.sbt cleanly.

2373Applied patch project/build.properties cleanly.

2374Applied patch build.sbt cleanly.