Build Logs

inoio/solrs • 3.8.1-RC1:2026-01-13

Errors

177

Warnings

Total Lines

2358

1##################################

2Clonning https://github.com/inoio/solrs.git into /build/repo using revision

3##################################

4Using target Scala version for migration: 3.7.4

5Migrating project for -source:3.4 using Scala 3.7.4

6----

7Preparing build for 3.7.4

8Would try to apply common scalacOption (best-effort, sbt/mill only):

9Append: -rewrite,REQUIRE:-source:3.4-migration

10Remove: -indent,-no-indent,-new-syntax,,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

11----

12Starting build for 3.7.4

13Execute tests: false

14sbt project found:

15Sbt version 1.11.0 is not supported, minimal supported version is 1.11.5

16Enforcing usage of sbt in version 1.11.5

17No prepare script found for project inoio/solrs

18##################################

19Scala version: 3.7.4

20Targets: io.ino%solrs

21Project projectConfig: {"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"compile-only","migrationVersions":["3.4"],"sourcePatches":[]}

22##################################

23Using extra scalacOptions: -rewrite,REQUIRE:-source:3.4-migration

24Filtering out scalacOptions: -indent,-no-indent,-new-syntax,,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

25[sbt_options] declare -a sbt_options=()

26[process_args] java_version = '17'

27[copyRt] java9_rt = '/root/.sbt/1.0/java9-rt-ext-eclipse_adoptium_17_0_8/rt.jar'

28# Executing command line:

29java

30-Dfile.encoding=UTF-8

31-Dcommunitybuild.scala=3.7.4

32-Dcommunitybuild.project.dependencies.add=

33-Xmx7G

34-Xms4G

35-Xss8M

36-Dsbt.script=/root/.sdkman/candidates/sbt/current/bin/sbt

37-Dscala.ext.dirs=/root/.sbt/1.0/java9-rt-ext-eclipse_adoptium_17_0_8

38-jar

39/root/.sdkman/candidates/sbt/1.11.5/bin/sbt-launch.jar

40"setCrossScalaVersions 3.7.4"

41"++3.7.4 -v"

42"mapScalacOptions "-rewrite,REQUIRE:-source:3.4-migration,-Wconf:msg=can be rewritten automatically under:s" "-indent,-no-indent,-new-syntax,,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e""

43"set every credentials := Nil"

44"excludeLibraryDependency com.github.ghik:zerowaste_{scalaVersion} com.olegpy:better-monadic-for_3 org.polyvariant:better-tostring_{scalaVersion} org.wartremover:wartremover_{scalaVersion}"

45"removeScalacOptionsStartingWith -P:wartremover"

47moduleMappings

48"runBuild 3.7.4 """{"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"compile-only","migrationVersions":["3.4"],"sourcePatches":[]}""" io.ino%solrs"

50[info] welcome to sbt 1.11.5 (Eclipse Adoptium Java 17.0.8)

51[info] loading settings for project repo-build from akka.sbt, gpg.sbt, plugins.sbt, sonatype.sbt...

52[info] loading project definition from /build/repo/project

53[info] compiling 2 Scala sources to /build/repo/project/target/scala-2.12/sbt-1.0/classes ...

54[info] Non-compiled module 'compiler-bridge_2.12' for Scala 2.12.20. Compiling...

55[info] Compilation completed in 9.052s.

56[info] done compiling

57[info] loading settings for project repo from build.sbt, version.sbt...

58[info] set current project to solrs (in build file:/build/repo/)

59Execute setCrossScalaVersions: 3.7.4

60OpenCB::Changing crossVersion 3.7.0 -> 3.7.4 in repo/crossScalaVersions

61[info] set current project to solrs (in build file:/build/repo/)

62[info] Setting Scala version to 3.7.4 on 1 projects.

63[info] Switching Scala version on:

64[info] * repo (2.12.20, 2.13.16, 3.7.4)

65[info] Excluding projects:

66[info] Reapplying settings...

67[info] set current project to solrs (in build file:/build/repo/)

68Execute mapScalacOptions: -rewrite,REQUIRE:-source:3.4-migration,-Wconf:msg=can be rewritten automatically under:s -indent,-no-indent,-new-syntax,,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

69[info] Reapplying settings...

70[info] set current project to solrs (in build file:/build/repo/)

71[info] Defining Global / credentials, credentials

72[info] The new values will be used by Global / pgpSelectPassphrase, Global / pgpSigningKey and 5 others.

73[info] Run `last` for details.

74[info] Reapplying settings...

75[info] set current project to solrs (in build file:/build/repo/)

76Execute excludeLibraryDependency: com.github.ghik:zerowaste_{scalaVersion} com.olegpy:better-monadic-for_3 org.polyvariant:better-tostring_{scalaVersion} org.wartremover:wartremover_{scalaVersion}

77[info] Reapplying settings...

78OpenCB::Failed to reapply settings in excludeLibraryDependency: Reference to undefined setting:

80 Global / allExcludeDependencies from Global / allExcludeDependencies (CommunityBuildPlugin.scala:331)

81 Did you mean allExcludeDependencies ?

82 , retry without global scopes

83[info] Reapplying settings...

84[info] set current project to solrs (in build file:/build/repo/)

85Execute removeScalacOptionsStartingWith: -P:wartremover

86[info] Reapplying settings...

87[info] set current project to solrs (in build file:/build/repo/)

88[success] Total time: 0 s, completed Jan 13, 2026, 8:41:00 PM

89Build config: {"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"compile-only","migrationVersions":["3.4"],"sourcePatches":[]}

90Parsed config: Success(ProjectBuildConfig(ProjectsConfig(List(),Map()),CompileOnly,List()))

91Starting build...

92Projects: Set(repo)

93Starting build for ProjectRef(file:/build/repo/,repo) (solrs)... [0/1]

94OpenCB::Exclude Scala3 specific scalacOption `-rewrite` in Scala 2.12.20 module Global

95OpenCB::Exclude Scala3 specific scalacOption `REQUIRE:-source:3.4-migration` in Scala 2.12.20 module Global

96OpenCB::Filter out '-deprecation', matches setting pattern '^-?-deprecation'

97OpenCB::Filter out '-feature', matches setting pattern '^-?-feature'

98Compile scalacOptions: -unchecked, -language:existentials, -language:higherKinds, -language:implicitConversions, -language:postfixOps, -rewrite, -Wconf:msg=can be rewritten automatically under:s, -source:3.4-migration

99[info] compiling 21 Scala sources and 1 Java source to /build/repo/target/scala-3.7.4/classes ...

100[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/AsyncSolrClient.scala:159:13

101[warn] 159 | case aware: AsyncSolrClientAware[F] => aware.setAsyncSolrClient(solr)

102[warn] | ^

103[warn] |the type test for io.ino.solrs.AsyncSolrClientAware[F] cannot be checked at runtime because its type arguments can't be determined from AnyRef

104[warn] |

105[warn] | longer explanation available when compiling with `-explain`

106[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/future/JavaFutureFactory.scala:14:9

107[warn] 14 | case sf: JavaFuture[T] => sf.inner

108[warn] | ^

109[warn] |the type test for JavaFutureFactory.this.JavaFuture[T] cannot be checked at runtime because its type arguments can't be determined from io.ino.solrs.future.Future[T]

110[warn] |

111[warn] | longer explanation available when compiling with `-explain`

112[info] [patched file /build/repo/src/main/scala/io/ino/solrs/LoadBalancer.scala]

113[info] [patched file /build/repo/src/main/scala/io/ino/solrs/RetryPolicy.scala]

114[info] [patched file /build/repo/src/main/scala/io/ino/solrs/RequestContext.scala]

115[info] [patched file /build/repo/src/main/scala/io/ino/solrs/future/Future.scala]

116[info] [patched file /build/repo/src/main/scala/io/ino/solrs/SolrServers.scala]

117[info] [patched file /build/repo/src/main/scala/io/ino/solrs/SolrServer.scala]

118[info] [patched file /build/repo/src/main/scala/io/ino/solrs/SolrResponseFactory.scala]

119[info] [patched file /build/repo/src/main/scala/io/ino/solrs/JavaAsyncSolrClient.scala]

120[info] [patched file /build/repo/src/main/scala/io/ino/solrs/AsyncSolrClient.scala]

121[info] [patched file /build/repo/src/main/scala/io/ino/solrs/RequestInterceptor.scala]

122[warn] there were 6 deprecation warnings; re-run with -deprecation for details

123[warn] three warnings found

124[info] done compiling

125[info] compiling 10 Scala sources to /build/repo/target/scala-3.7.4/classes ...

126[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/AsyncSolrClient.scala:159:13

127[warn] 159 | case aware: AsyncSolrClientAware[F] => aware.setAsyncSolrClient(solr)

128[warn] | ^

129[warn] |the type test for io.ino.solrs.AsyncSolrClientAware[F] cannot be checked at runtime because its type arguments can't be determined from AnyRef

130[warn] |

131[warn] | longer explanation available when compiling with `-explain`

132[warn] there were 6 deprecation warnings; re-run with -deprecation for details

133[warn] two warnings found

134[info] done compiling

135[info] compiling 30 Scala sources and 3 Java sources to /build/repo/target/scala-3.7.4/test-classes ...

136[warn] -- [E121] Pattern Match Warning: /build/repo/src/test/scala/io/ino/solrs/SolrMatchers.scala:20:13

137[warn] 20 | case _ => false

138[warn] | ^

139[warn] |Unreachable case except for null (if this is intentional, consider writing case null => instead).

140[info] [patched file /build/repo/src/test/scala/io/ino/solrs/FastestServerLBSpec.scala]

141[info] [patched file /build/repo/src/test/scala/io/ino/solrs/usage/UsageScala.scala]

142[info] [patched file /build/repo/src/test/scala/io/ino/solrs/RetryPolicySpec.scala]

143[info] [patched file /build/repo/src/test/scala/io/ino/solrs/AsyncSolrClientCloudIntegrationSpec.scala]

144[info] [patched file /build/repo/src/test/scala/io/ino/solrs/CloudSolrServersUninitializedIntegrationSpec.scala]

145[info] [patched file /build/repo/src/test/scala/io/ino/solrs/StandardFunSpec.scala]

146[info] [patched file /build/repo/src/test/scala/io/ino/solrs/AsyncSolrClientIntegrationSpec.scala]

147[info] [patched file /build/repo/src/test/scala/io/ino/solrs/CloudSolrServersIntegrationSpec.scala]

148[info] [patched file /build/repo/src/test/scala/io/ino/solrs/SolrCloudRunner.scala]

149[info] [patched file /build/repo/src/test/scala/io/ino/solrs/RunningSolr.scala]

150[info] [patched file /build/repo/src/test/scala/io/ino/solrs/PingStatusObserverIntegrationSpec.scala]

151[info] [patched file /build/repo/src/test/scala/io/ino/solrs/RoundRobinLBSpec.scala]

152[info] [patched file /build/repo/src/test/scala/io/ino/solrs/SolrRunner.scala]

153[info] [patched file /build/repo/src/test/scala/io/ino/solrs/AsyncSolrClientBasicAuthCloudIntegrationSpec.scala]

154[info] [patched file /build/repo/src/test/scala/io/ino/solrs/AsyncSolrClientBasicAuthIntegrationSpec.scala]

155[warn] there were 5 deprecation warnings; re-run with -deprecation for details

156[warn] two warnings found

157[info] done compiling

158[info] compiling 15 Scala sources to /build/repo/target/scala-3.7.4/test-classes ...

159[warn] there were 2 deprecation warnings; re-run with -deprecation for details

160[warn] one warning found

161[info] done compiling

162

163************************

164Build summary:

165[{

166 "module": "solrs",

167 "compile": {"status": "ok", "tookMs": 11890, "warnings": 2, "errors": 0, "sourceVersion": "3.4-migration"},

168 "doc": {"status": "skipped", "tookMs": 0, "files": 0, "totalSizeKb": 0},

169 "test-compile": {"status": "ok", "tookMs": 14854, "warnings": 1, "errors": 0, "sourceVersion": "3.4-migration"},

170 "test": {"status": "skipped", "tookMs": 0, "passed": 0, "failed": 0, "ignored": 0, "skipped": 0, "total": 0, "byFramework": []},

171 "publish": {"status": "skipped", "tookMs": 0},

172 "metadata": {

173 "crossScalaVersions": ["2.12.20", "2.13.16", "3.7.0"]

174}

175}]

176************************

177[success] Total time: 37 s, completed Jan 13, 2026, 8:41:37 PM

178[0JChecking patch project/plugins.sbt...

179Checking patch project/build.properties...

180Checking patch build.sbt...

181Applied patch project/plugins.sbt cleanly.

182Applied patch project/build.properties cleanly.

183Applied patch build.sbt cleanly.

184Commit migration rewrites

185Switched to a new branch 'opencb/migrate-source-3.4'

186[opencb/migrate-source-3.4 9c34370] Apply Scala compiler rewrites using -source:3.4-migration using Scala 3.7.4

187 25 files changed, 106 insertions(+), 106 deletions(-)

188----

189Preparing build for 3.8.1-RC1

190Scala binary version found: 3.8

191Implicitly using source version 3.8

192Scala binary version found: 3.8

193Implicitly using source version 3.8

194Would try to apply common scalacOption (best-effort, sbt/mill only):

195Append: ,REQUIRE:-source:3.8

196Remove: ,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

197----

198Starting build for 3.8.1-RC1

199Execute tests: true

200sbt project found:

201Sbt version 1.11.0 is not supported, minimal supported version is 1.11.5

202Enforcing usage of sbt in version 1.11.5

203No prepare script found for project inoio/solrs

204##################################

205Scala version: 3.8.1-RC1

206Targets: io.ino%solrs

207Project projectConfig: {"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"full","migrationVersions":["3.4"],"sourcePatches":[]}

208##################################

209Using extra scalacOptions: ,REQUIRE:-source:3.8

210Filtering out scalacOptions: ,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

211[sbt_options] declare -a sbt_options=()

212[process_args] java_version = '17'

213[copyRt] java9_rt = '/root/.sbt/1.0/java9-rt-ext-eclipse_adoptium_17_0_8/rt.jar'

214# Executing command line:

215java

216-Dfile.encoding=UTF-8

217-Dcommunitybuild.scala=3.8.1-RC1

218-Dcommunitybuild.project.dependencies.add=

219-Xmx7G

220-Xms4G

221-Xss8M

222-Dsbt.script=/root/.sdkman/candidates/sbt/current/bin/sbt

223-Dscala.ext.dirs=/root/.sbt/1.0/java9-rt-ext-eclipse_adoptium_17_0_8

224-jar

225/root/.sdkman/candidates/sbt/1.11.5/bin/sbt-launch.jar

226"setCrossScalaVersions 3.8.1-RC1"

227"++3.8.1-RC1 -v"

228"mapScalacOptions ",REQUIRE:-source:3.8,-Wconf:msg=can be rewritten automatically under:s" ",-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e""

229"set every credentials := Nil"

230"excludeLibraryDependency com.github.ghik:zerowaste_{scalaVersion} com.olegpy:better-monadic-for_3 org.polyvariant:better-tostring_{scalaVersion} org.wartremover:wartremover_{scalaVersion}"

231"removeScalacOptionsStartingWith -P:wartremover"

232

233moduleMappings

234"runBuild 3.8.1-RC1 """{"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"full","migrationVersions":["3.4"],"sourcePatches":[]}""" io.ino%solrs"

235

236[info] welcome to sbt 1.11.5 (Eclipse Adoptium Java 17.0.8)

237[info] loading settings for project repo-build from akka.sbt, gpg.sbt, plugins.sbt, sonatype.sbt...

238[info] loading project definition from /build/repo/project

239[info] loading settings for project repo from build.sbt, version.sbt...

240[info] set current project to solrs (in build file:/build/repo/)

241Execute setCrossScalaVersions: 3.8.1-RC1

242OpenCB::Changing crossVersion 3.7.0 -> 3.8.1-RC1 in repo/crossScalaVersions

243[info] set current project to solrs (in build file:/build/repo/)

244[info] Setting Scala version to 3.8.1-RC1 on 1 projects.

245[info] Switching Scala version on:

246[info] * repo (2.12.20, 2.13.16, 3.8.1-RC1)

247[info] Excluding projects:

248[info] Reapplying settings...

249[info] set current project to solrs (in build file:/build/repo/)

250Execute mapScalacOptions: ,REQUIRE:-source:3.8,-Wconf:msg=can be rewritten automatically under:s ,-deprecation,-feature,-Xfatal-warnings,-Werror,MATCH:.*-Wconf.*any:e

251[info] Reapplying settings...

252[info] set current project to solrs (in build file:/build/repo/)

253[info] Defining Global / credentials, credentials

254[info] The new values will be used by Global / pgpSelectPassphrase, Global / pgpSigningKey and 5 others.

255[info] Run `last` for details.

256[info] Reapplying settings...

257[info] set current project to solrs (in build file:/build/repo/)

258Execute excludeLibraryDependency: com.github.ghik:zerowaste_{scalaVersion} com.olegpy:better-monadic-for_3 org.polyvariant:better-tostring_{scalaVersion} org.wartremover:wartremover_{scalaVersion}

259[info] Reapplying settings...

260OpenCB::Failed to reapply settings in excludeLibraryDependency: Reference to undefined setting:

261

262 Global / allExcludeDependencies from Global / allExcludeDependencies (CommunityBuildPlugin.scala:331)

263 Did you mean allExcludeDependencies ?

264 , retry without global scopes

265[info] Reapplying settings...

266[info] set current project to solrs (in build file:/build/repo/)

267Execute removeScalacOptionsStartingWith: -P:wartremover

268[info] Reapplying settings...

269[info] set current project to solrs (in build file:/build/repo/)

270[success] Total time: 0 s, completed Jan 13, 2026, 8:41:47 PM

271Build config: {"projects":{"exclude":[],"overrides":{}},"java":{"version":"17"},"sbt":{"commands":[],"options":[]},"mill":{"options":[]},"tests":"full","migrationVersions":["3.4"],"sourcePatches":[]}

272Parsed config: Success(ProjectBuildConfig(ProjectsConfig(List(),Map()),Full,List()))

273Starting build...

274Projects: Set(repo)

275Starting build for ProjectRef(file:/build/repo/,repo) (solrs)... [0/1]

276OpenCB::Exclude Scala3 specific scalacOption `REQUIRE:-source:3.8` in Scala 2.12.20 module Global

277OpenCB::Filter out '-deprecation', matches setting pattern '^-?-deprecation'

278OpenCB::Filter out '-feature', matches setting pattern '^-?-feature'

279Compile scalacOptions: -unchecked, -language:existentials, -language:higherKinds, -language:implicitConversions, -language:postfixOps, -Wconf:msg=can be rewritten automatically under:s, -source:3.8

280[info] compiling 21 Scala sources and 1 Java source to /build/repo/target/scala-3.8.1-RC1/classes ...

281[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/AsyncSolrClient.scala:159:13

282[warn] 159 | case aware: AsyncSolrClientAware[F] => aware.setAsyncSolrClient(solr)

283[warn] | ^

284[warn] |the type test for io.ino.solrs.AsyncSolrClientAware[F] cannot be checked at runtime because its type arguments can't be determined from AnyRef

285[warn] |

286[warn] | longer explanation available when compiling with `-explain`

287[warn] -- [E092] Pattern Match Unchecked Warning: /build/repo/src/main/scala/io/ino/solrs/future/JavaFutureFactory.scala:14:9

288[warn] 14 | case sf: JavaFuture[T] => sf.inner

289[warn] | ^

290[warn] |the type test for JavaFutureFactory.this.JavaFuture[T] cannot be checked at runtime because its type arguments can't be determined from io.ino.solrs.future.Future[T]

291[warn] |

292[warn] | longer explanation available when compiling with `-explain`

293[warn] there were 6 deprecation warnings; re-run with -deprecation for details

294[warn] three warnings found

295[info] done compiling

296[info] compiling 30 Scala sources and 3 Java sources to /build/repo/target/scala-3.8.1-RC1/test-classes ...

297[warn] -- [E121] Pattern Match Warning: /build/repo/src/test/scala/io/ino/solrs/SolrMatchers.scala:20:13

298[warn] 20 | case _ => false

299[warn] | ^

300[warn] |Unreachable case except for null (if this is intentional, consider writing case null => instead).

301[warn] there were 5 deprecation warnings; re-run with -deprecation for details

302[warn] two warnings found

303[info] done compiling

304[info] JavaAPITest:

30520:42:17:416 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Solr on port 8888 with Solr home /tmp/base1768333337372/solrhome

30620:42:17:653 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Jetty...

30720:42:18:266 [pool-1-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

30820:42:18:385 [coreLoadExecutor-13-thread-1] WARN org.apache.solr.core.SolrConfig - You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.

30920:42:18:399 [coreLoadExecutor-13-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

31020:42:18:399 [coreLoadExecutor-13-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

311[info] - testRetryPolicy

312[info] - testCloudSolrServers

313found 0 docs

314[info] - testAsyncSolrClientBuilderUrl

315[info] - testRoundRobinLB

316[info] - testStaticSolrServers

317[info] - testFastestServerLB

318found 0 docs

319[info] - testAsyncSolrClientBuilderLB

320[info] JavaAPIFunTest:

321[info] - testDeleteByIds

322[info] - testGetByIds

323[info] - testAddBean

324[info] - testGetByIdAbsent

325[info] - testQuery

326[info] - testGetById

327[info] - testExecuteQuery

328[info] - testAddDocsAsCollection

329[info] - testGetByIdsAbsent

330[info] - testDeleteById

331[info] - testAddDoc

332[info] - testCommit

333[info] - testAddDocsAsIterator

334[info] - testAddBeansAsIterable

335[info] - testAddBeansAsIterator

336[info] - testDeleteByQuery

337[info] RoundRobinLBSpec:

338[info] RoundRobinLB

339[info] - should return None if no solr server matches

340[info] - should return consecutive solr servers

341[info] - should only return active solr servers

342[info] - should return the active leader for update requests if isUpdatesToLeaders=true and UpdateRequest.sendToLeaders=true

343[info] - should round robin update requests if isUpdatesToLeaders=true and UpdateRequest.sendToLeaders=false

344[info] - should round robin update requests by default

345[info] - should return replicas matching the given shard preferences / replica type

346[info] - should consider the preferred server if active

347[info] AsyncSolrClientBasicAuthCloudIntegrationSpec:

348[info] AsyncSolrClient with CloudSolrServers

34920:42:21:210 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

35020:42:21:215 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.cloud.MiniSolrCloudCluster - Unable to inject random recording flag due to outside randomized context

351java.lang.IllegalStateException: No context information for thread: Thread[id=15, name=pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec, state=RUNNABLE, group=main]. Is this thread running under a class com.carrotsearch.randomizedtesting.RandomizedRunner runner context? Add @RunWith(class com.carrotsearch.randomizedtesting.RandomizedRunner.class) to your test class. Make sure your code accesses random contexts within @BeforeClass and @AfterClass boundary (for example, static test class initializers are not permitted to access random contexts).

352 at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:249)

353 at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)

354 at org.apache.lucene.tests.util.LuceneTestCase.random(LuceneTestCase.java:796)

355 at org.apache.lucene.tests.util.LuceneTestCase.rarely(LuceneTestCase.java:894)

356 at org.apache.solr.cloud.MiniSolrCloudCluster.injectRandomRecordingFlag(MiniSolrCloudCluster.java:1377)

357 at org.apache.solr.cloud.MiniSolrCloudCluster$Builder.build(MiniSolrCloudCluster.java:1303)

358 at io.ino.solrs.SolrCloudRunner.start$$anonfun$2(SolrCloudRunner.scala:130)

359 at io.ino.solrs.SolrCloudRunner.start$$anonfun$adapted$1(SolrCloudRunner.scala:139)

360 at io.ino.solrs.SolrCloudRunner.timed(SolrCloudRunner.scala:244)

361 at io.ino.solrs.SolrCloudRunner.start(SolrCloudRunner.scala:139)

362 at io.ino.solrs.SolrCloudRunner$.start(SolrCloudRunner.scala:256)

363 at io.ino.solrs.AsyncSolrClientBasicAuthCloudIntegrationSpec.beforeEach(AsyncSolrClientBasicAuthCloudIntegrationSpec.scala:47)

364 at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:233)

365 at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:122)

366 at io.ino.solrs.StandardFunSpec.runTest(StandardFunSpec.scala:17)

367 at org.scalatest.funspec.AnyFunSpecLike.runTests$$anonfun$1(AnyFunSpecLike.scala:528)

368 at org.scalatest.SuperEngine.traverseSubNodes$1$$anonfun$1(Engine.scala:413)

369 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

370 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

371 at scala.collection.immutable.List.foreach(List.scala:327)

372 at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:429)

373 at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:390)

374 at org.scalatest.SuperEngine.traverseSubNodes$1$$anonfun$1(Engine.scala:427)

375 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

376 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

377 at scala.collection.immutable.List.foreach(List.scala:327)

378 at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:429)

379 at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396)

380 at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475)

381 at org.scalatest.funspec.AnyFunSpecLike.runTests(AnyFunSpecLike.scala:528)

382 at org.scalatest.funspec.AnyFunSpecLike.runTests$(AnyFunSpecLike.scala:49)

383 at org.scalatest.funspec.AnyFunSpec.runTests(AnyFunSpec.scala:1631)

384 at org.scalatest.Suite.run(Suite.scala:1114)

385 at org.scalatest.Suite.run$(Suite.scala:564)

386 at org.scalatest.funspec.AnyFunSpec.org$scalatest$funspec$AnyFunSpecLike$$super$run(AnyFunSpec.scala:1631)

387 at org.scalatest.funspec.AnyFunSpecLike.run$$anonfun$1(AnyFunSpecLike.scala:532)

388 at org.scalatest.SuperEngine.runImpl(Engine.scala:535)

389 at org.scalatest.funspec.AnyFunSpecLike.run(AnyFunSpecLike.scala:532)

390 at org.scalatest.funspec.AnyFunSpecLike.run$(AnyFunSpecLike.scala:49)

391 at io.ino.solrs.StandardFunSpec.org$scalatest$BeforeAndAfterAll$$super$run(StandardFunSpec.scala:17)

392 at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213)

393 at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:217)

394 at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:135)

395 at io.ino.solrs.StandardFunSpec.run(StandardFunSpec.scala:17)

396 at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321)

397 at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517)

398 at sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414)

399 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

400 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

401 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

402 at java.base/java.lang.Thread.run(Thread.java:833)

40320:42:21:344 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40420:42:21:368 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40520:42:21:377 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40620:42:21:380 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40720:42:21:380 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40820:42:21:382 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

40920:42:21:495 [jetty-launcher-35-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

41020:42:21:495 [jetty-launcher-35-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

41120:42:21:499 [jetty-launcher-35-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

41220:42:21:499 [jetty-launcher-35-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

41320:42:21:501 [jetty-launcher-35-thread-2] WARN org.apache.solr.DEPRECATED.solrxml-zookeeper - Loading solr.xml from zookeeper is deprecated. See reference guide for details.

41420:42:21:710 [jetty-launcher-35-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

41520:42:21:710 [jetty-launcher-35-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

41620:42:21:773 [jetty-launcher-35-thread-2] WARN org.apache.solr.core.CoreContainer - Solr authentication is enabled, but SSL is off. Consider enabling SSL to protect user credentials and data with encryption.

41720:42:21:775 [jetty-launcher-35-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

41820:42:21:820 [jetty-launcher-35-thread-1] WARN org.apache.solr.core.CoreContainer - Solr authentication is enabled, but SSL is off. Consider enabling SSL to protect user credentials and data with encryption.

41920:42:21:821 [jetty-launcher-35-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

42020:42:22:169 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42120:42:22:173 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42220:42:22:178 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 966 ms

42320:42:22:179 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333341201/solrhome/collection1/conf

42420:42:22:181 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42520:42:22:184 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42620:42:22:341 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333341201/solrhome/collection1/conf took 161 ms

42720:42:22:343 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

42820:42:22:347 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

42920:42:22:349 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

43020:42:22:671 [qtp590687179-119] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

43120:42:22:679 [qtp582153848-124] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

43220:42:24:122 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1778 ms

43320:42:24:123 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:46805_solr={responseHeader={status=0, QTime=990}, core=collection1_shard1_replica_n3}, 127.0.0.1:44089_solr={responseHeader={status=0, QTime=1369}, core=collection1_shard1_replica_n1}}

43420:42:24:125 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:44089/solr/collection1_shard1_replica_n1

43520:42:24:125 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:46805/solr/collection1_shard1_replica_n3

43620:42:24:281 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

43720:42:24:284 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

43820:42:24:284 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:40555/solr

43920:42:24:287 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:40555/solr

44020:42:24:296 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:44089/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:46805/solr/collection1_shard1_replica_n3, Enabled, NRT, true)))

44120:42:24:304 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientBasicAuthCloudIntegrationSpec - Awaiting all servers status is Enabled

442[info] - should support basic auth with a configured http client

44320:42:24:535 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:46805_solr, 127.0.0.1:44089_solr]

444collections:{collection1=LazyCollectionRef(collection1)}

445org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

446 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

447 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

448 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

449 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

450 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

451 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

452 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

453 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

454 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

455 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

456 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

457 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

458 at java.base/java.lang.Thread.run(Thread.java:833)

459Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

460 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

461 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

462 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

463 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

464 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

465 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

466 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

467 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

468 ... 12 more

469java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@6e28eb6a[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@1011eabc[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@d82dc7e]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@98e98b9[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 1]

470 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

471 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

472 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

473 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

474 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

475 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

476 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

477 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

478 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

479 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

480 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

481 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

482 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

483 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

484 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

485 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

486 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

487 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

488 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

489 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

490 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

491 at java.base/java.lang.Thread.run(Thread.java:833)

49220:42:24:538 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientBasicAuthCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

49320:42:24:983 [ZkTestServer Run Thread] WARN org.apache.solr.cloud.ZkTestServer - Watch limit violations:

494Maximum concurrent create/delete watches above limit:

495

496 7 /solr/collections/collection1/terms/shard1

497 5 /solr/aliases.json

498 5 /solr/clusterprops.json

499 2 /solr/configs/collection1

500 2 /solr/packages.json

501 2 /solr/security.json

502 2 /solr/collections/collection1/collectionprops.json

503 2 /solr/configs/collection1/managed-schema.xml

504

505Maximum concurrent data watches above limit:

506

507 10 /solr/collections/collection1/state.json

508

509Maximum concurrent children watches above limit:

510

511 19 /solr/overseer/queue

512 11 /solr/live_nodes

513 9 /solr/collections

514 4 /solr/collections/collection1/state.json

515 4 /solr/overseer/collection-queue-work

516

517[info] CloudSolrServersSpec:

518[info] CloudSolrServers

519[info] - should compute state changes correctly

520[info] - should read all servers from ClusterState with multiple shards

521[info] AsyncSolrClientBasicAuthIntegrationSpec:

52220:42:25:058 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Solr on port 8889 with Solr home /tmp/base1768333345046/solrhome

52320:42:25:060 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Jetty...

52420:42:25:074 [pool-1-thread-1] WARN org.apache.solr.core.CoreContainer - Solr authentication is enabled, but SSL is off. Consider enabling SSL to protect user credentials and data with encryption.

52520:42:25:085 [coreLoadExecutor-128-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

526[info] Solr

527[info] - should support basic auth with a configured http client

52820:42:25:275 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Stopping Solr Jetty running on port 8889

52920:42:25:275 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 8889

530[info] AsyncSolrClientFunSpec:

531[info] Solr

532[info] - should add docs as iterable

533[info] - should add docs as iterator

534[info] - should add doc

535[info] - should add bean

536[info] - should add beans as iterable

537[info] - should add beans as iterator

538[info] - should commit

539[info] - should delete by id

540[info] - should delete by ids

541[info] - should delete by query

542[info] - should query

543[info] - should get by id

544[info] - should get by id absent

545[info] - should get by ids

546[info] - should get by ids absent

547[info] - should pass same query parameters

548[info] - should pass same query parameters in post and get

549[info] AsyncSolrClientSpec:

550[info] Solr

55120:42:25:880 [AsyncHttpClient-17-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server SolrServer(http://localhost:12345/solr, Enabled), not retrying. Exception was: java.net.ConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:12345

552java.net.ConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:12345

553 at org.asynchttpclient.netty.channel.NettyConnectListener.onFailure(NettyConnectListener.java:173)

554 at org.asynchttpclient.netty.channel.NettyChannelConnector$1.onFailure(NettyChannelConnector.java:107)

555 at org.asynchttpclient.netty.SimpleChannelFutureListener.operationComplete(SimpleChannelFutureListener.java:30)

556 at org.asynchttpclient.netty.SimpleChannelFutureListener.operationComplete(SimpleChannelFutureListener.java:22)

557 at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590)

558 at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583)

559 at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559)

560 at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492)

561 at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636)

562 at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629)

563 at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118)

564 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)

565 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)

566 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)

567 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

568 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

569 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

570 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

571 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

572 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

573 at java.base/java.lang.Thread.run(Thread.java:833)

574Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:12345

575Caused by: java.net.ConnectException: Connection refused

576 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

577 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

578 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

579 at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)

580 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)

581 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)

582 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

583 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

584 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

585 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

586 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

587 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

588 at java.base/java.lang.Thread.run(Thread.java:833)

589[info] - should return failed future on connection refused

59020:42:26:277 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientSpec] WARN io.ino.solrs.AsyncSolrClient - Request failed for server SolrServer(http://localhost:12345/solr, Enabled), not retrying. Exception was: io.ino.solrs.AsyncSolrClientSpec$$anon$1: Unexpected?!

591io.ino.solrs.AsyncSolrClientSpec$$anon$1: Unexpected?!

592[info] - should return failed future on AHC IOException

593[info] - should shutdown http client if it was not provided

594[info] - should not shutdown http client if it was provided

595[info] FastestServerLBSpec:

596[info] FastestServerLB

597[info] - should support multiple instances

59820:42:26:455 [pool-1-thread-1-ScalaTest-running-FastestServerLBSpec] WARN io.ino.solrs.FastestServerLBSpec$$anon$6 - Error while unregistering MBean

599javax.management.InstanceNotFoundException: io.ino.solrs:type=FastestServerLB,instance=2

600 at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1088)

601 at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:423)

602 at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:411)

603 at java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:547)

604 at io.ino.solrs.FastestServerLBJmxSupport.shutdownJmx(LoadBalancer.scala:549)

605 at io.ino.solrs.FastestServerLBJmxSupport.shutdownJmx$(LoadBalancer.scala:530)

606 at io.ino.solrs.FastestServerLB.shutdownJmx(LoadBalancer.scala:175)

607 at io.ino.solrs.FastestServerLB.shutdown(LoadBalancer.scala:214)

608 at io.ino.solrs.FastestServerLBSpec.afterEach(FastestServerLBSpec.scala:61)

609 at org.scalatest.BeforeAndAfterEach.$anonfun$1(BeforeAndAfterEach.scala:247)

610 at org.scalatest.BeforeAndAfterEach.$anonfun$adapted$1(BeforeAndAfterEach.scala:254)

611 at scala.Function0.apply$mcV$sp(Function0.scala:45)

612 at org.scalatest.Status.withAfterEffect$$anonfun$1(Status.scala:377)

613 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

614 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

615 at org.scalatest.SucceededStatus$.whenCompleted(Status.scala:462)

616 at org.scalatest.Status.withAfterEffect(Status.scala:406)

617 at org.scalatest.Status.withAfterEffect$(Status.scala:54)

618 at org.scalatest.SucceededStatus$.withAfterEffect(Status.scala:434)

619 at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:254)

620 at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:122)

621 at io.ino.solrs.StandardFunSpec.runTest(StandardFunSpec.scala:17)

622 at org.scalatest.funspec.AnyFunSpecLike.runTests$$anonfun$1(AnyFunSpecLike.scala:528)

623 at org.scalatest.SuperEngine.traverseSubNodes$1$$anonfun$1(Engine.scala:413)

624 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

625 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

626 at scala.collection.immutable.List.foreach(List.scala:327)

627 at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:429)

628 at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:390)

629 at org.scalatest.SuperEngine.traverseSubNodes$1$$anonfun$1(Engine.scala:427)

630 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

631 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

632 at scala.collection.immutable.List.foreach(List.scala:327)

633 at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:429)

634 at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396)

635 at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475)

636 at org.scalatest.funspec.AnyFunSpecLike.runTests(AnyFunSpecLike.scala:528)

637 at org.scalatest.funspec.AnyFunSpecLike.runTests$(AnyFunSpecLike.scala:49)

638 at org.scalatest.funspec.AnyFunSpec.runTests(AnyFunSpec.scala:1631)

639 at org.scalatest.Suite.run(Suite.scala:1114)

640 at org.scalatest.Suite.run$(Suite.scala:564)

641 at org.scalatest.funspec.AnyFunSpec.org$scalatest$funspec$AnyFunSpecLike$$super$run(AnyFunSpec.scala:1631)

642 at org.scalatest.funspec.AnyFunSpecLike.run$$anonfun$1(AnyFunSpecLike.scala:532)

643 at org.scalatest.SuperEngine.runImpl(Engine.scala:535)

644 at org.scalatest.funspec.AnyFunSpecLike.run(AnyFunSpecLike.scala:532)

645 at org.scalatest.funspec.AnyFunSpecLike.run$(AnyFunSpecLike.scala:49)

646 at io.ino.solrs.StandardFunSpec.org$scalatest$BeforeAndAfterAll$$super$run(StandardFunSpec.scala:17)

647 at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213)

648 at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:217)

649 at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:135)

650 at io.ino.solrs.StandardFunSpec.run(StandardFunSpec.scala:17)

651 at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321)

652 at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517)

653 at sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414)

654 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

655 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

656 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

657 at java.base/java.lang.Thread.run(Thread.java:833)

658[info] - should return a Failure if no solr server matches

659[info] - should only return active solr servers

660[info] - should return the active leader for update requests if isUpdatesToLeaders=true and UpdateRequest.sendToLeaders=true

661[info] - should round robin update requests if isUpdatesToLeaders=true and UpdateRequest.sendToLeaders=false

662[info] - should round robin update requests by default

663[info] - should return replicas matching the given shard preferences / replica type

664[info] - should return the fastest server by default

665[info] - should round robin equally fast servers

666[info] - should consider the preferred server if it's one of the fastest servers

667[info] - should return the server with a better predicted response time

668[info] - should allow to quantize / consider (very) similar predicted response times to be equal

669[info] - should initially test servers to gather performance stats

670[info] - should test servers based on the real query rate restricted by min delay

671[info] - should test slow servers less frequently

672[info] - should test slow/all servers according to the specified maxDelay

673[info] HttpUtilsSpec:

674[info] HttpUtils

675[info] - should return null charset for content-type without charset

676[info] - should return charset for content-type with charset

677[info] - should return mime-type for content-type with charset

678[info] PerformanceStatsSpec:

679[info] PerformanceStats

680[info] - should calculate averages per second (for the last 10 seconds)

681[info] - should calculate averages for 10 second intervals

682[info] - should store the overall average

683[info] - should predict the response time based on ongoing requests

684[info] - should predict the response time based on finished requests from the current second

685[info] - should predict the response time based on finished requests from the current second, ignoring shorter active requests

686[info] - should predict the response time based on the last 10 seconds

687[info] - should predict the response time based on the overall average as fallback

688[info] EvictingQueue

689[info] - should initially be empty

690[info] - should return stored values

691[info] - should return a value by index

692[info] - should evict old values

693[info] - should return the oldest value if it's replaced

694[info] - should return the relative last updated value

695[info] RetryPolicySpec:

696[info] RetryPolicy.TryOnce

697[info] - should not retry

698[info] RetryPolicy.TryAvailableServers

699[info] - should not retry when no servers available

700[info] - should not retry when all servers already tried

701[info] - should retry server not yet tried

702[info] RetryPolicy.AtMost(x)

703[info] - should retry when limit is not reached

704[info] - should not retry when limit is reached

705[info] TwitterFutureFactorySpec:

706[info] TwitterFutureFactory

707[info] - should return promise/future that supports map

708[info] - should return promise/future that supports flatMap (success)

709[info] - should return promise/future that supports flatMap (failure in subject)

710[info] - should return promise/future that supports flatMap (failure in callback)

711[info] - should return promise/future that supports handle (unhandled)

712[info] - should return promise/future that supports handle (success)

713[info] - should return promise/future that supports handle (failure)

714[info] - should return promise/future that supports handleWith (unhandled)

715[info] - should return promise/future that supports handleWith (success)

716[info] - should return promise/future that supports handleWith (failure)

717[info] - should reduce a sequence of futures to a future of sequence

718[info] CloudSolrServersIntegrationSpec:

71920:42:26:856 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 4 node(s)

72020:42:26:857 [pool-1-thread-1] WARN org.apache.solr.cloud.MiniSolrCloudCluster - Unable to inject random recording flag due to outside randomized context

721java.lang.IllegalStateException: No context information for thread: Thread[id=15, name=pool-1-thread-1, state=RUNNABLE, group=main]. Is this thread running under a class com.carrotsearch.randomizedtesting.RandomizedRunner runner context? Add @RunWith(class com.carrotsearch.randomizedtesting.RandomizedRunner.class) to your test class. Make sure your code accesses random contexts within @BeforeClass and @AfterClass boundary (for example, static test class initializers are not permitted to access random contexts).

722 at com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:249)

723 at com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)

724 at org.apache.lucene.tests.util.LuceneTestCase.random(LuceneTestCase.java:796)

725 at org.apache.lucene.tests.util.LuceneTestCase.rarely(LuceneTestCase.java:894)

726 at org.apache.solr.cloud.MiniSolrCloudCluster.injectRandomRecordingFlag(MiniSolrCloudCluster.java:1377)

727 at org.apache.solr.cloud.MiniSolrCloudCluster$Builder.build(MiniSolrCloudCluster.java:1303)

728 at io.ino.solrs.SolrCloudRunner.start$$anonfun$2(SolrCloudRunner.scala:125)

729 at io.ino.solrs.SolrCloudRunner.start$$anonfun$adapted$1(SolrCloudRunner.scala:139)

730 at io.ino.solrs.SolrCloudRunner.timed(SolrCloudRunner.scala:244)

731 at io.ino.solrs.SolrCloudRunner.start(SolrCloudRunner.scala:139)

732 at io.ino.solrs.SolrCloudRunner$.start(SolrCloudRunner.scala:256)

733 at io.ino.solrs.CloudSolrServersIntegrationSpec.beforeAll(CloudSolrServersIntegrationSpec.scala:55)

734 at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:212)

735 at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:217)

736 at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:135)

737 at io.ino.solrs.StandardFunSpec.run(StandardFunSpec.scala:17)

738 at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:321)

739 at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:517)

740 at sbt.ForkMain$Run.lambda$runTest$1(ForkMain.java:414)

741 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

742 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

743 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

744 at java.base/java.lang.Thread.run(Thread.java:833)

74520:42:26:959 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

74620:42:26:963 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

74720:42:26:965 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

74820:42:26:968 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

74920:42:26:968 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75020:42:26:970 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75120:42:27:079 [jetty-launcher-145-thread-3] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75220:42:27:080 [jetty-launcher-145-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75320:42:27:082 [jetty-launcher-145-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75420:42:27:083 [jetty-launcher-145-thread-3] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75520:42:27:084 [jetty-launcher-145-thread-4] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75620:42:27:086 [jetty-launcher-145-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75720:42:27:087 [jetty-launcher-145-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75820:42:27:088 [jetty-launcher-145-thread-4] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

75920:42:27:266 [jetty-launcher-145-thread-4] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

76020:42:27:266 [jetty-launcher-145-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

76120:42:27:266 [jetty-launcher-145-thread-3] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

76220:42:27:266 [jetty-launcher-145-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

76320:42:27:290 [jetty-launcher-145-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

76420:42:27:290 [jetty-launcher-145-thread-3] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

76520:42:27:290 [jetty-launcher-145-thread-4] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

76620:42:27:291 [jetty-launcher-145-thread-4] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

76720:42:27:291 [jetty-launcher-145-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

76820:42:27:292 [jetty-launcher-145-thread-3] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

76920:42:27:318 [jetty-launcher-145-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

77020:42:27:318 [jetty-launcher-145-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

77120:42:27:573 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

77220:42:27:576 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

77320:42:27:579 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 4 node(s) took 722 ms

77420:42:27:580 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333346842/solrhome/collection1/conf

77520:42:27:580 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

77620:42:27:583 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

77720:42:27:730 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333346842/solrhome/collection1/conf took 150 ms

77820:42:27:730 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=2

77920:42:27:733 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

78020:42:27:736 [pool-1-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

78120:42:27:917 [qtp1012990705-349] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

78220:42:27:917 [qtp1097515309-377] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

78320:42:27:918 [qtp988512889-367] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

78420:42:27:922 [qtp1144718078-357] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

78520:42:29:470 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=2 took 1739 ms

78620:42:29:470 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:35031_solr={responseHeader={status=0, QTime=1075}, core=collection1_shard1_replica_n4}, 127.0.0.1:44955_solr={responseHeader={status=0, QTime=1074}, core=collection1_shard2_replica_n6}, 127.0.0.1:32951_solr={responseHeader={status=0, QTime=1475}, core=collection1_shard1_replica_n1}, 127.0.0.1:42593_solr={responseHeader={status=0, QTime=1480}, core=collection1_shard2_replica_n2}}

78720:42:29:471 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:35031/solr/collection1_shard1_replica_n4

78820:42:29:471 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:42593/solr/collection1_shard2_replica_n2

78920:42:29:471 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:32951/solr/collection1_shard1_replica_n1

79020:42:29:471 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:44955/solr/collection1_shard2_replica_n6

791[info] CloudSolrServers

79220:42:29:599 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

79320:42:29:602 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

79420:42:29:602 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:45699/solr

79520:42:29:604 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:45699/solr

79620:42:29:605 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

797[info] - should list available solr instances

79820:42:29:831 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:42593_solr, 127.0.0.1:44955_solr, 127.0.0.1:35031_solr, 127.0.0.1:32951_solr]

799collections:{collection1=LazyCollectionRef(collection1)}

800org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

801 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

802 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

803 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

804 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

805java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@254154d2[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@6fc53df6[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@2ac7be6a]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@1ba73417[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 1]

806 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

807 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

808 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

809 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

810 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

811 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

812 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

813 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

814 at java.base/java.lang.Thread.run(Thread.java:833)

815Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

816 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

817 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

818 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

819 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

820 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

821 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

822 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

823 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

824 ... 12 more

825 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

826 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

827 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

828 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

829 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

830 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

831 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

832 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

833 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

834 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

835 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

836 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

837 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

838 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

839 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

840 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

841 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

842 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

843 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

844 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

845 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

846 at java.base/java.lang.Thread.run(Thread.java:833)

84720:42:29:838 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

84820:42:29:841 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

84920:42:29:842 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:45699/solr

85020:42:29:845 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:45699/solr

85120:42:29:846 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Enabled, NRT, true), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

85220:42:29:848 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 35031

85320:42:30:049 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Failed, NRT, false), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

85420:42:30:080 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.SolrRunner - Starting Jetty...

85520:42:30:083 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

85620:42:30:084 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

85720:42:30:204 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

85820:42:30:218 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

85920:42:30:219 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

86020:42:30:242 [coreLoadExecutor-295-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

86120:42:30:373 [coreLoadExecutor-295-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

86220:42:32:474 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Failed, NRT, false), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

86320:42:32:676 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Disabled, NRT, false), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

86420:42:35:200 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Enabled, NRT, false), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

865[info] - should update available solr instances

86620:42:35:616 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:42593_solr, 127.0.0.1:44955_solr, 127.0.0.1:35031_solr, 127.0.0.1:32951_solr]

867collections:{collection1=LazyCollectionRef(collection1)}

868org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

869 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

870 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

871 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

872 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

873 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

874 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

875 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

876 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

877 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

878 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

879 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

880 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

881 at java.base/java.lang.Thread.run(Thread.java:833)

882Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

883 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

884 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

885 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

886java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@b95c2a9[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@ef0fe81[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@4bf2713b]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@7af3bfa0[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 56]

887 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

888 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

889 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

890 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

891 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

892 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

893 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

894 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

895 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

896 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

897 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

898 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

899 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

900 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

901 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

902 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

903 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

904 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

905 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

906 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

907 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

908 at java.base/java.lang.Thread.run(Thread.java:833)

909 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

910 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

911 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

912 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

913 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

914 ... 12 more

91520:42:35:620 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

91620:42:35:622 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

91720:42:35:622 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:45699/solr

91820:42:35:624 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:45699/solr

91920:42:35:625 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Enabled, NRT, false), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

92020:42:36:123 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 35031

92120:42:36:334 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Failed, NRT, false), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

922[info] - should route requests according to _route_ param

92320:42:36:449 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:44955_solr, 127.0.0.1:42593_solr, 127.0.0.1:32951_solr]

924collections:{collection1=LazyCollectionRef(collection1)}

925org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

926 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

927 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

928 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

929 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

930 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

931 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

932 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

933 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

934 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

935 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

936 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

937 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

938 at java.base/java.lang.Thread.run(Thread.java:833)

939Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

940 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

941 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

942 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

943 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

944 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

945 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

946 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

947 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

948 ... 12 more

949java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@6da16dfd[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@7f7c2af1[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@3a7ebb7a]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@b8e00b1[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 7]

950 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

951 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

952 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

953 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

954 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

955 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

956 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

957 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

958 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

959 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

960 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

961 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

962 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

963 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

964 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

965 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

966 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

967 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

968 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

969 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

970 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

971 at java.base/java.lang.Thread.run(Thread.java:833)

97220:42:36:450 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.SolrRunner - Starting Jetty...

97320:42:36:453 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

97420:42:36:455 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

97520:42:36:571 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

97620:42:36:582 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

97720:42:36:583 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

97820:42:36:601 [coreLoadExecutor-369-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

97920:42:36:726 [coreLoadExecutor-369-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

98020:42:36:859 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

98120:42:36:862 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

98220:42:36:862 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:45699/solr

98320:42:36:866 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:45699/solr

98420:42:36:876 [pool-1-thread-1-ScalaTest-running-CloudSolrServersIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Failed, NRT, false), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

98520:42:37:874 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Disabled, NRT, false), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

98620:42:39:876 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:32951/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35031/solr/collection1_shard1_replica_n4, Enabled, NRT, false), ShardReplica(http://127.0.0.1:42593/solr/collection1_shard2_replica_n2, Enabled, NRT, false), ShardReplica(http://127.0.0.1:44955/solr/collection1_shard2_replica_n6, Enabled, NRT, true)))

987[info] - should test solr instances according to the WarmupQueries

98820:42:40:097 [pool-1-thread-1] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

98920:42:40:540 [ZkTestServer Run Thread] WARN org.apache.solr.cloud.ZkTestServer - Watch limit violations:

990Maximum concurrent create/delete watches above limit:

991

992 12 /solr/aliases.json

993 12 /solr/clusterprops.json

994 9 /solr/collections/collection1/terms/shard1

995 7 /solr/collections/collection1/terms/shard2

996 6 /solr/configs/collection1

997 6 /solr/packages.json

998 6 /solr/security.json

999 6 /solr/configs/collection1/managed-schema.xml

1000 5 /solr/collections/collection1/collectionprops.json

1001

1002Maximum concurrent data watches above limit:

1003

1004 46 /solr/collections/collection1/state.json

1005 2 /solr/overseer_elect/election/72057678553284615-127.0.0.1:42593_solr-n_0000000003

1006 2 /solr/overseer_elect/election/72057678553284617-127.0.0.1:44955_solr-n_0000000000

1007 2 /solr/collections/collection1/leader_elect/shard1/election/72057678553284616-core_node3-n_0000000001

1008 2 /solr/overseer_elect/election/72057678553284616-127.0.0.1:32951_solr-n_0000000001

1009

1010Maximum concurrent children watches above limit:

1011

1012 55 /solr/live_nodes

1013 44 /solr/overseer/queue

1014 18 /solr/collections

1015 11 /solr/collections/collection1/state.json

1016 4 /solr/overseer/collection-queue-work

1017

1018[info] PingStatusObserverIntegrationSpec:

101920:42:40:590 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Solr on port 8889 with Solr home /tmp/base1768333360572/solrhome

102020:42:40:591 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Starting Jetty...

102120:42:40:602 [pool-1-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

102220:42:40:610 [coreLoadExecutor-410-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

102320:42:40:613 [coreLoadExecutor-410-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

1024[info] PingStatusObserver

102520:42:40:807 [AsyncHttpClient-35-1] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8889/solr/collection1 from Enabled to Disabled.

1026[info] - should update status base on ping status

102720:42:40:817 [AsyncHttpClient-35-1] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8889/solr/collection1 from Disabled to Enabled.

102820:42:40:839 [AsyncHttpClient-35-1] WARN io.ino.solrs.PingStatusObserver - Got ping response status != 200 (404) from http://localhost:8889/solr/collection1/admin/ping?action=status&wt=xml, with response '<html>

1029<head>

1030<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>

1031<title>Error 404 Not Found</title>

1032</head>

1033<body><h2>HTTP ERROR 404 Not Found</h2>

1034<table>

1035<tr><th>URI:</th><td>/solr/collection1/admin/ping</td></tr>

1036<tr><th>STATUS:</th><td>404</td></tr>

1037<tr><th>MESSAGE:</th><td>Not Found</td></tr>

1038<tr><th>SERVLET:</th><td>org.apache.solr.embedded.JettySolrRunner$Servlet404-4bbb4511</td></tr>

1039</table>

1040<hr/><a href="https://jetty.org">Powered by Jetty:// 10.0.22</a><hr/>

1041

1042</body>

1043</html>

1044'

1045[info] - should disable server on status != 200

104620:42:40:846 [AsyncHttpClient-35-1] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8889/solr/collection1 from Failed to Enabled.

104720:42:41:151 [AsyncHttpClient-timer-36-1] ERROR io.ino.solrs.PingStatusObserver - An error occurred when trying to get ping status from http://localhost:8889/solr/collection1/admin/ping?action=status&wt=xml, changing status to Failed.

1048java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:8889 after 100 ms

1049 at org.asynchttpclient.netty.timeout.TimeoutTimerTask.expire(TimeoutTimerTask.java:45)

1050 at org.asynchttpclient.netty.timeout.ReadTimeoutTimerTask.run(ReadTimeoutTimerTask.java:56)

1051 at io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)

1052 at io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)

1053 at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)

1054 at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:788)

1055 at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)

1056 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1057 at java.base/java.lang.Thread.run(Thread.java:833)

1058[info] - should disable server on read timeout

105920:42:41:161 [AsyncHttpClient-35-2] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8889/solr/collection1 from Failed to Enabled.

106020:42:41:162 [pool-1-thread-1-ScalaTest-running-PingStatusObserverIntegrationSpec] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 8889

106120:42:43:672 [AsyncHttpClient-35-2] ERROR io.ino.solrs.PingStatusObserver - An error occurred when trying to get ping status from http://localhost:8889/solr/collection1/admin/ping?action=status&wt=xml, changing status to Failed.

1062java.net.ConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:8889

1063 at org.asynchttpclient.netty.channel.NettyConnectListener.onFailure(NettyConnectListener.java:173)

1064 at org.asynchttpclient.netty.channel.NettyChannelConnector$1.onFailure(NettyChannelConnector.java:107)

1065 at org.asynchttpclient.netty.SimpleChannelFutureListener.operationComplete(SimpleChannelFutureListener.java:30)

1066 at org.asynchttpclient.netty.SimpleChannelFutureListener.operationComplete(SimpleChannelFutureListener.java:22)

1067 at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590)

1068 at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583)

1069 at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559)

1070 at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492)

1071 at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636)

1072 at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629)

1073 at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118)

1074 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)

1075 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)

1076 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)

1077 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

1078 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

1079 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

1080 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

1081 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

1082 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1083 at java.base/java.lang.Thread.run(Thread.java:833)

1084Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/[0:0:0:0:0:0:0:1]:8889

1085Caused by: java.net.ConnectException: Connection refused

1086 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1087 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1088 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1089 at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)

1090 at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)

1091 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)

1092 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

1093 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

1094 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

1095 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

1096 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

1097 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1098 at java.base/java.lang.Thread.run(Thread.java:833)

1099[info] - should disable server on connection error

110020:42:43:684 [pool-1-thread-1-ScalaTest-running-PingStatusObserverIntegrationSpec] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

110120:42:43:691 [coreLoadExecutor-438-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

110220:42:43:691 [coreLoadExecutor-438-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

110320:42:43:801 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Stopping Solr Jetty running on port 8889

110420:42:43:802 [pool-1-thread-1] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 8889

110520:42:43:812 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

110620:42:43:814 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(localhost:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1107java.net.ConnectException: Connection refused

1108 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1109 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1110 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1111 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1112 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

1113[info] CloudSolrServersUninitializedIntegrationSpec:

1114[info] CloudSolrServers

111520:42:45:017 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN io.ino.solrs.CloudSolrServers$ - Could not connect to ZK, seems to be unavailable. Retrying in 1 second. Original exception: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper localhost:2181 within 1000 ms

1116[info] - should be able to start and stop with unavailable ZK

111720:42:45:021 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

111820:42:45:021 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(localhost:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for server localhost/[0:0:0:0:0:0:0:1]:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1119java.net.ConnectException: Connection refused

1120 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1121 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1122 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1123 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1124 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

112520:42:46:223 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN io.ino.solrs.CloudSolrServers$ - Could not connect to ZK, seems to be unavailable. Retrying in 1 second. Original exception: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper localhost:2181/solr within 1000 ms

112620:42:46:223 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-EventThread] ERROR org.apache.zookeeper.ClientCnxn - Error while calling watcher.

1127java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$368/0x00007f077c3c5550@39fdd794 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@3dc24473[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]

1128 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

1129 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

1130 at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365)

1131 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:361)

1132 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.process(SolrZkClient.java:1096)

1133 at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:564)

1134 at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:539)

113520:42:46:236 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

113620:42:46:337 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

113720:42:46:341 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

113820:42:46:342 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

113920:42:46:344 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114020:42:46:344 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 108 ms

114120:42:46:344 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

114220:42:46:344 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114320:42:46:346 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114420:42:46:451 [jetty-launcher-465-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114520:42:46:451 [jetty-launcher-465-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114620:42:46:454 [jetty-launcher-465-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114720:42:46:454 [jetty-launcher-465-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

114820:42:46:593 [jetty-launcher-465-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

114920:42:46:594 [jetty-launcher-465-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

115020:42:46:605 [jetty-launcher-465-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

115120:42:46:606 [jetty-launcher-465-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

115220:42:46:615 [jetty-launcher-465-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

115320:42:46:616 [jetty-launcher-465-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

115420:42:46:687 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

115520:42:46:690 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

115620:42:46:692 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 347 ms

115720:42:46:692 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333366223/solrhome/collection1/conf

115820:42:46:692 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

115920:42:46:695 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

116020:42:46:840 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333366223/solrhome/collection1/conf took 147 ms

116120:42:46:840 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

116220:42:46:842 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

116320:42:46:844 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

116420:42:46:983 [qtp1559702128-1096] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

116520:42:46:983 [qtp1707519789-1091] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

116620:42:47:223 [solrs-CloudSolrServersUpdateThread-01] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

116720:42:47:226 [solrs-CloudSolrServersUpdateThread-01] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

116820:42:47:226 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at localhost:2181/solr

116920:42:47:230 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at localhost:2181/solr

117020:42:47:231 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:40209/solr/collection1_shard1_replica_n1, Failed, NRT, false), ShardReplica(http://127.0.0.1:43475/solr/collection1_shard1_replica_n2, Failed, NRT, false)))

117120:42:47:332 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:40209/solr/collection1_shard1_replica_n1, Failed, NRT, false), ShardReplica(http://127.0.0.1:43475/solr/collection1_shard1_replica_n2, Failed, NRT, false)))

117220:42:47:837 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:40209/solr/collection1_shard1_replica_n1, Failed, NRT, true), ShardReplica(http://127.0.0.1:43475/solr/collection1_shard1_replica_n2, Failed, NRT, false)))

117320:42:47:938 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:40209/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:43475/solr/collection1_shard1_replica_n2, Failed, NRT, false)))

117420:42:48:283 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1442 ms

117520:42:48:283 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:40209_solr={responseHeader={status=0, QTime=814}, core=collection1_shard1_replica_n1}, 127.0.0.1:43475_solr={responseHeader={status=0, QTime=1206}, core=collection1_shard1_replica_n2}}

117620:42:48:283 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:43475/solr/collection1_shard1_replica_n2

117720:42:48:283 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:40209/solr/collection1_shard1_replica_n1

117820:42:48:342 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection1 -> Vector(ShardReplica(http://127.0.0.1:40209/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:43475/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

1179[info] - should be able to start with unavailable ZK and should be connected as soon as ZK is available

118020:42:48:449 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:43475_solr, 127.0.0.1:40209_solr]

1181collections:{collection1=LazyCollectionRef(collection1)}

1182org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

1183 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

1184 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

1185 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

1186 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

1187 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

1188 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

1189 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

1190 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

1191 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

1192 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

1193 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1194 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1195 at java.base/java.lang.Thread.run(Thread.java:833)

1196Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

1197 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

1198 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1199 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1200 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1201 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1202 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1203 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

1204 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

1205 ... 12 more

1206java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@31d82cb9[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@12c963[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@e520b28]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@7672b050[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 12]

1207 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

1208 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

1209 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

1210 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

1211 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

1212 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

1213 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

1214 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

1215 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

1216 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

1217 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

1218 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

1219 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

1220 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

1221 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

1222 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

1223 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

1224 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

1225 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

1226 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1227 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1228 at java.base/java.lang.Thread.run(Thread.java:833)

122920:42:48:450 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

123020:42:48:665 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

123120:42:48:869 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1232EndOfStreamException: Unable to read additional data from server sessionid 0x1000013f9330009, likely server has closed socket

1233 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1234 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1235 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

1236[info] ScalaFutureFactorySpec:

1237[info] ScalaFutureFactory

1238[info] - should return promise/future that supports map

1239[info] - should return promise/future that supports flatMap (success)

1240[info] - should return promise/future that supports flatMap (failure in subject)

1241[info] - should return promise/future that supports flatMap (failure in callback)

1242[info] - should return promise/future that supports handle (unhandled)

1243[info] - should return promise/future that supports handle (success)

1244[info] - should return promise/future that supports handle (failure)

1245[info] - should return promise/future that supports handleWith (unhandled)

1246[info] - should return promise/future that supports handleWith (success)

1247[info] - should return promise/future that supports handleWith (failure)

1248[info] - should reduce a sequence of futures to a future of sequence

1249[info] AsyncSolrClientIntegrationSpec:

1250[info] Solr

1251[info] - should allow to transform the response

125220:42:48:966 [AsyncHttpClient-39-1] INFO io.ino.solrs.PingStatusObserver - Changing status for server http://localhost:8888/solr/collection1 from Enabled to Disabled.

125320:42:48:969 [zkCallback-517-thread-1] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@113da409 name: ZooKeeperConnection Watcher:127.0.0.1:2181/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

125420:42:48:969 [zkCallback-517-thread-1] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

1255[info] - should allow to regularly observe the server status

1256[info] - should be built with LoadBalancer

1257[info] - should allow to set the http client

1258[info] - should allow to set the response parser

1259[info] - should allow to override the response parser per request

126020:42:49:115 [qtp2082082018-25] ERROR org.apache.solr.handler.RequestHandlerBase - Client exception

1261org.apache.solr.common.SolrException: undefined field fieldDoesNotExist

1262 at org.apache.solr.schema.IndexSchema.getDynamicFieldType(IndexSchema.java:1485)

1263 at org.apache.solr.schema.IndexSchema$SolrQueryAnalyzer.getWrappedAnalyzer(IndexSchema.java:506)

1264 at org.apache.lucene.analysis.DelegatingAnalyzerWrapper$DelegatingReuseStrategy.getReusableComponents(DelegatingAnalyzerWrapper.java:83)

1265 at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:184)

1266 at org.apache.lucene.util.QueryBuilder.createFieldQuery(QueryBuilder.java:257)

1267 at org.apache.solr.parser.SolrQueryParserBase.newFieldQuery(SolrQueryParserBase.java:530)

1268 at org.apache.solr.parser.QueryParser.newFieldQuery(QueryParser.java:68)

1269 at org.apache.solr.parser.SolrQueryParserBase.getFieldQuery(SolrQueryParserBase.java:1143)

1270 at org.apache.solr.parser.SolrQueryParserBase.handleBareTokenQuery(SolrQueryParserBase.java:859)

1271 at org.apache.solr.parser.QueryParser.Term(QueryParser.java:454)

1272 at org.apache.solr.parser.QueryParser.Clause(QueryParser.java:293)

1273 at org.apache.solr.parser.QueryParser.Query(QueryParser.java:173)

1274 at org.apache.solr.parser.QueryParser.TopLevelQuery(QueryParser.java:143)

1275 at org.apache.solr.parser.SolrQueryParserBase.parse(SolrQueryParserBase.java:276)

1276 at org.apache.solr.search.LuceneQParser.parse(LuceneQParser.java:51)

1277 at org.apache.solr.search.QParser.getQuery(QParser.java:189)

1278 at org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:186)

1279 at org.apache.solr.handler.component.SearchHandler.prepareComponents(SearchHandler.java:695)

1280 at org.apache.solr.handler.component.SearchHandler.processComponents(SearchHandler.java:477)

1281 at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:426)

1282 at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:228)

1283 at org.apache.solr.core.SolrCore.execute(SolrCore.java:2880)

1284 at org.apache.solr.servlet.HttpSolrCall.executeCoreRequest(HttpSolrCall.java:889)

1285 at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:575)

1286 at org.apache.solr.servlet.SolrDispatchFilter.dispatch(SolrDispatchFilter.java:241)

1287 at org.apache.solr.servlet.SolrDispatchFilter.lambda$doFilterRetry$0(SolrDispatchFilter.java:198)

1288 at org.apache.solr.servlet.ServletUtils.traceHttpRequestExecution2(ServletUtils.java:227)

1289 at org.apache.solr.servlet.ServletUtils.rateLimitRequest(ServletUtils.java:197)

1290 at org.apache.solr.servlet.SolrDispatchFilter.doFilterRetry(SolrDispatchFilter.java:192)

1291 at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:181)

1292 at javax.servlet.http.HttpFilter.doFilter(HttpFilter.java:97)

1293 at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)

1294 at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)

1295 at org.apache.solr.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:184)

1296 at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202)

1297 at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635)

1298 at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527)

1299 at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)

1300 at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1580)

1301 at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)

1302 at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1384)

1303 at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)

1304 at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)

1305 at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1553)

1306 at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)

1307 at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1306)

1308 at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)

1309 at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)

1310 at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:301)

1311 at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)

1312 at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:822)

1313 at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)

1314 at org.eclipse.jetty.server.Server.handle(Server.java:563)

1315 at org.eclipse.jetty.server.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1598)

1316 at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:753)

1317 at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:501)

1318 at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:287)

1319 at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)

1320 at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)

1321 at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)

1322 at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)

1323 at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)

1324 at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)

1325 at java.base/java.lang.Thread.run(Thread.java:833)

132620:42:49:119 [AsyncHttpClient-41-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server SolrServer(http://localhost:8888/solr/collection1, Enabled), not retrying. Exception was: io.ino.solrs.RemoteSolrException: Server at http://localhost:8888/solr/collection1 returned non ok status:400, message: Bad Request, undefined field fieldDoesNotExist

1327io.ino.solrs.RemoteSolrException: Server at http://localhost:8888/solr/collection1 returned non ok status:400, message: Bad Request, undefined field fieldDoesNotExist

1328 at io.ino.solrs.AsyncSolrClient.validateResponse(AsyncSolrClient.scala:729)

1329 at io.ino.solrs.AsyncSolrClient.toSolrResponse$$anonfun$1(AsyncSolrClient.scala:687)

1330 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

1331 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

1332 at io.ino.solrs.AsyncSolrClient.withResponseParserFromRequest(AsyncSolrClient.scala:718)

1333 at io.ino.solrs.AsyncSolrClient.toSolrResponse(AsyncSolrClient.scala:687)

1334 at io.ino.solrs.AsyncSolrClient$$anon$3.onCompleted(AsyncSolrClient.scala:656)

1335 at io.ino.solrs.AsyncSolrClient$$anon$3.onCompleted(AsyncSolrClient.scala:654)

1336 at org.asynchttpclient.AsyncCompletionHandler.onCompleted(AsyncCompletionHandler.java:71)

1337 at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:231)

1338 at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:268)

1339 at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:194)

1340 at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:97)

1341 at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:125)

1342 at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:75)

1343 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

1344 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1345 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1346 at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:107)

1347 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

1348 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1349 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1350 at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)

1351 at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)

1352 at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)

1353 at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)

1354 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)

1355 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1356 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1357 at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357)

1358 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)

1359 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1360 at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868)

1361 at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)

1362 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)

1363 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

1364 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

1365 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

1366 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

1367 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

1368 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1369 at java.base/java.lang.Thread.run(Thread.java:833)

1370[info] - should return failed future on request with bad query

137120:42:49:160 [AsyncHttpClient-53-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server SolrServer(http://localhost:8888, Enabled), not retrying. Exception was: io.ino.solrs.RemoteSolrException: Expected a mime type of [application/octet-stream, application/vnd.apache.solr.javabin] but got [text/html].

1372<html>

1373<head>

1374<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>

1375<title>Error 404 Not Found</title>

1376</head>

1377<body><h2>HTTP ERROR 404 Not Found</h2>

1378<table>

1379<tr><th>URI:</th><td>/select</td></tr>

1380<tr><th>STATUS:</th><td>404</td></tr>

1381<tr><th>MESSAGE:</th><td>Not Found</td></tr>

1382<tr><th>SERVLET:</th><td>-</td></tr>

1383</table>

1384<hr/><a href="https://jetty.org">Powered by Jetty:// 10.0.22</a><hr/>

1385

1386</body>

1387</html>

1388

1389io.ino.solrs.RemoteSolrException: Expected a mime type of [application/octet-stream, application/vnd.apache.solr.javabin] but got [text/html].

1390<html>

1391<head>

1392<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>

1393<title>Error 404 Not Found</title>

1394</head>

1395<body><h2>HTTP ERROR 404 Not Found</h2>

1396<table>

1397<tr><th>URI:</th><td>/select</td></tr>

1398<tr><th>STATUS:</th><td>404</td></tr>

1399<tr><th>MESSAGE:</th><td>Not Found</td></tr>

1400<tr><th>SERVLET:</th><td>-</td></tr>

1401</table>

1402<hr/><a href="https://jetty.org">Powered by Jetty:// 10.0.22</a><hr/>

1403

1404</body>

1405</html>

1406

1407 at io.ino.solrs.AsyncSolrClient.validateMimeType(AsyncSolrClient.scala:754)

1408 at io.ino.solrs.AsyncSolrClient.validateResponse(AsyncSolrClient.scala:723)

1409 at io.ino.solrs.AsyncSolrClient.toSolrResponse$$anonfun$1(AsyncSolrClient.scala:687)

1410 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

1411 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

1412 at io.ino.solrs.AsyncSolrClient.withResponseParserFromRequest(AsyncSolrClient.scala:718)

1413 at io.ino.solrs.AsyncSolrClient.toSolrResponse(AsyncSolrClient.scala:687)

1414 at io.ino.solrs.AsyncSolrClient$$anon$3.onCompleted(AsyncSolrClient.scala:656)

1415 at io.ino.solrs.AsyncSolrClient$$anon$3.onCompleted(AsyncSolrClient.scala:654)

1416 at org.asynchttpclient.AsyncCompletionHandler.onCompleted(AsyncCompletionHandler.java:71)

1417 at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:231)

1418 at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:268)

1419 at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:194)

1420 at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:97)

1421 at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:125)

1422 at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:75)

1423 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

1424 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1425 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1426 at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:107)

1427 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)

1428 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1429 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1430 at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)

1431 at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)

1432 at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)

1433 at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)

1434 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)

1435 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1436 at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)

1437 at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357)

1438 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)

1439 at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)

1440 at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868)

1441 at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)

1442 at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)

1443 at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)

1444 at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)

1445 at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)

1446 at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)

1447 at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

1448 at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

1449 at java.base/java.lang.Thread.run(Thread.java:833)

1450[info] - should return failed future on wrong request path

1451[info] - should gather request time metrics

1452[info] - should allow to intercept requests

1453[info] JavaFutureFactorySpec:

1454[info] JavaFutureFactory

1455[info] - should return promise/future that supports map

1456[info] - should return promise/future that supports flatMap (success)

1457[info] - should return promise/future that supports flatMap (failure in subject)

1458[info] - should return promise/future that supports flatMap (failure in callback)

1459[info] - should return promise/future that supports handle (unhandled)

1460[info] - should return promise/future that supports handle (success)

1461[info] - should return promise/future that supports handle (failure)

1462[info] - should return promise/future that supports handleWith (unhandled)

1463[info] - should return promise/future that supports handleWith (success)

1464[info] - should return promise/future that supports handleWith (failure)

1465[info] - should reduce a sequence of futures to a future of sequence

1466[info] AsyncSolrClientCloudIntegrationSpec:

1467[info] AsyncSolrClient with CloudSolrServers + RoundRobinLB

146820:42:49:263 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

146920:42:49:365 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

147020:42:49:368 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

147120:42:49:369 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

147220:42:49:371 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

147320:42:49:371 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 107 ms

147420:42:49:371 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

147520:42:49:371 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

147620:42:49:373 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

147720:42:49:480 [jetty-launcher-553-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

147820:42:49:480 [jetty-launcher-553-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

147920:42:49:483 [jetty-launcher-553-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

148020:42:49:484 [jetty-launcher-553-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

148120:42:49:624 [jetty-launcher-553-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

148220:42:49:624 [jetty-launcher-553-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

148320:42:49:637 [jetty-launcher-553-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

148420:42:49:637 [jetty-launcher-553-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

148520:42:49:645 [jetty-launcher-553-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

148620:42:49:647 [jetty-launcher-553-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

148720:42:49:729 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

148820:42:49:733 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

148920:42:49:736 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 365 ms

149020:42:49:737 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333369254/solrhome/collection1/conf

149120:42:49:738 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

149220:42:49:742 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

149320:42:49:886 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333369254/solrhome/collection1/conf took 148 ms

149420:42:49:886 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

149520:42:49:888 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

149620:42:49:890 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

149720:42:50:028 [qtp1337089494-1287] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

149820:42:50:028 [qtp781096939-1292] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

149920:42:50:358 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1500java.net.ConnectException: Connection refused

1501 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1502 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1503 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1504 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1505 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

150620:42:51:314 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1427 ms

150720:42:51:314 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:34667_solr={responseHeader={status=0, QTime=799}, core=collection1_shard1_replica_n2}, 127.0.0.1:43003_solr={responseHeader={status=0, QTime=1192}, core=collection1_shard1_replica_n1}}

150820:42:51:314 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1768333369254/solrhome/collection2/conf

150920:42:51:314 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

151020:42:51:316 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

151120:42:51:459 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1768333369254/solrhome/collection2/conf took 144 ms

151220:42:51:459 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1

151320:42:51:692 [qtp781096939-1290] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

151420:42:51:692 [qtp1337089494-1293] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

151520:42:52:284 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1516java.net.ConnectException: Connection refused

1517 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1518 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1519 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1520 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1521 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

152220:42:52:947 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1 took 1488 ms

152320:42:52:948 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:43003_solr={responseHeader={status=0, QTime=267}, core=collection2_shard1_replica_n2}, 127.0.0.1:34667_solr={responseHeader={status=0, QTime=1160}, core=collection2_shard1_replica_n1}}

152420:42:52:948 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:34667/solr/collection1_shard1_replica_n2

152520:42:52:948 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:34667/solr/collection2_shard1_replica_n1

152620:42:52:948 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:43003/solr/collection1_shard1_replica_n1

152720:42:52:948 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:43003/solr/collection2_shard1_replica_n2

152820:42:52:951 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

152920:42:52:953 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

153020:42:52:953 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:44719/solr

153120:42:52:955 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:44719/solr

153220:42:52:957 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:34667/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:43003/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

153320:42:53:026 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

153420:42:53:033 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrRunner - Stopping Jetty on port 43003

153520:42:53:046 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

153620:42:53:056 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

153720:42:53:062 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

153820:42:53:068 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

153920:42:53:074 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154020:42:53:080 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154120:42:53:087 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154220:42:53:092 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154320:42:53:095 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154420:42:53:098 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154520:42:53:102 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154620:42:53:105 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154720:42:53:108 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154820:42:53:111 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

154920:42:53:114 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155020:42:53:117 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155120:42:53:119 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155220:42:53:123 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155320:42:53:126 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155420:42:53:130 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155520:42:53:134 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155620:42:53:137 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155720:42:53:140 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155820:42:53:143 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

155920:42:53:147 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

156020:42:53:151 [AsyncHttpClient-59-3] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

156120:42:53:155 [AsyncHttpClient-59-4] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

156220:42:53:160 [AsyncHttpClient-59-1] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

156320:42:53:165 [AsyncHttpClient-59-2] WARN io.ino.solrs.AsyncSolrClient - Request failed for server ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), trying next server ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true). Exception was: java.net.ConnectException: Connection refused: /127.0.0.1:43003

156420:42:53:167 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:34667/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:43003/solr/collection2_shard1_replica_n2, Failed, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Failed, NRT, false), ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

156520:42:53:270 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:34667/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:43003/solr/collection2_shard1_replica_n2, Failed, NRT, false)), collection1 -> Vector(ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Failed, NRT, false), ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

156620:42:53:360 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrRunner - Starting Jetty...

156720:42:53:371 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

156820:42:53:377 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

156920:42:53:510 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

157020:42:53:533 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

157120:42:53:534 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

157220:42:53:568 [coreLoadExecutor-663-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

157320:42:53:580 [coreLoadExecutor-663-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

157420:42:53:758 [coreLoadExecutor-663-thread-2] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

157520:42:53:759 [coreLoadExecutor-663-thread-1] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

157620:42:54:131 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1577java.net.ConnectException: Connection refused

1578 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1579 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1580 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1581 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1582 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

158320:42:54:199 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:34667/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:43003/solr/collection2_shard1_replica_n2, Failed, NRT, false)), collection1 -> Vector(ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Disabled, NRT, false), ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

158420:42:54:296 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

158520:42:54:307 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

158620:42:54:318 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

158720:42:54:328 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

158820:42:54:339 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

158920:42:54:350 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159020:42:54:361 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159120:42:54:372 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159220:42:54:383 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159320:42:54:394 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159420:42:54:405 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159520:42:54:506 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159620:42:54:607 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159720:42:54:708 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159820:42:54:808 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

159920:42:54:909 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

160020:42:55:010 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

160120:42:55:110 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

160220:42:55:211 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

160320:42:55:312 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

160420:42:55:412 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

160520:42:55:513 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

160620:42:55:613 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

160720:42:55:714 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

160820:42:55:716 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:34667/solr/collection2_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:43003/solr/collection2_shard1_replica_n2, Failed, NRT, false)), collection1 -> Vector(ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Disabled, NRT, false), ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

160920:42:55:747 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1610java.net.ConnectException: Connection refused

1611 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1612 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1613 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1614 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1615 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

161620:42:55:815 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

161720:42:55:916 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

161820:42:56:017 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

161920:42:56:117 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

162020:42:56:120 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:34667/solr/collection2_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:43003/solr/collection2_shard1_replica_n2, Disabled, NRT, false)), collection1 -> Vector(ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Disabled, NRT, false), ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

162120:42:56:218 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

162220:42:56:319 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

162320:42:56:420 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

162420:42:56:520 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

162520:42:56:621 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

162620:42:56:722 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

162720:42:56:726 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:34667/solr/collection2_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:43003/solr/collection2_shard1_replica_n2, Disabled, NRT, false)), collection1 -> Vector(ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

162820:42:56:823 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

162920:42:56:885 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1630java.net.ConnectException: Connection refused

1631 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1632 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1633 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1634 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1635 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

163620:42:56:923 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

163720:42:57:024 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

163820:42:57:124 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

163920:42:57:225 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164020:42:57:326 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164120:42:57:427 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164220:42:57:527 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164320:42:57:628 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164420:42:57:729 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164520:42:57:829 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164620:42:57:930 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164720:42:58:031 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

164820:42:58:059 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1649java.net.ConnectException: Connection refused

1650 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1651 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1652 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1653 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1654 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

165520:42:58:132 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165620:42:58:232 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165720:42:58:333 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165820:42:58:434 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

165920:42:58:534 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

166020:42:58:597 [recoveryExecutor-655-thread-2] WARN org.apache.solr.update.PeerSyncWithLeader - no frame of reference to tell if we've missed updates

166120:42:58:635 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

166220:42:58:735 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

166320:42:58:745 [solrs-CloudSolrServersUpdateThread-01] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:34667/solr/collection2_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:43003/solr/collection2_shard1_replica_n2, Enabled, NRT, false)), collection1 -> Vector(ShardReplica(http://127.0.0.1:43003/solr/collection1_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:34667/solr/collection1_shard1_replica_n2, Enabled, NRT, true)))

166420:42:58:836 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

1665[info] - should serve queries while solr server is restarted

166620:42:59:042 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:34667_solr, 127.0.0.1:43003_solr]

1667collections:{collection1=LazyCollectionRef(collection1), collection2=LazyCollectionRef(collection2)}

1668org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

1669 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

1670 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

1671 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

1672 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

1673 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

1674 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

1675 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

1676 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

1677 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

1678 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

1679 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1680 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1681 at java.base/java.lang.Thread.run(Thread.java:833)

1682Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

1683 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

1684 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1685 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1686 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1687 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1688 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1689 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

1690 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

1691 ... 12 more

1692java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@73a9f9e5[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@2e7fe20b[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@6b7d79a0]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@5adc90a0[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 58]

1693 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

1694 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

1695 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

1696 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

1697 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

1698 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

1699 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

1700 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

1701 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

1702 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

1703 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

1704 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

1705 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

1706 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

1707 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

1708 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

1709 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

1710 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

1711 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

1712 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1713 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1714 at java.base/java.lang.Thread.run(Thread.java:833)

171520:42:59:043 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

171620:42:59:263 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

171720:42:59:499 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

171820:42:59:600 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

171920:42:59:603 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

172020:42:59:605 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

172120:42:59:607 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

172220:42:59:607 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 108 ms

172320:42:59:607 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

172420:42:59:607 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

172520:42:59:609 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

172620:42:59:715 [jetty-launcher-692-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

172720:42:59:715 [jetty-launcher-692-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

172820:42:59:717 [jetty-launcher-692-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

172920:42:59:717 [jetty-launcher-692-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

173020:42:59:824 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1731java.net.ConnectException: Connection refused

1732 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1733 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1734 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1735 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1736 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

173720:42:59:854 [jetty-launcher-692-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

173820:42:59:854 [jetty-launcher-692-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

173920:42:59:869 [jetty-launcher-692-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

174020:42:59:869 [jetty-launcher-692-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

174120:42:59:878 [jetty-launcher-692-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

174220:42:59:879 [jetty-launcher-692-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

174320:42:59:942 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

174420:42:59:944 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

174520:42:59:946 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 339 ms

174620:42:59:946 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333379489/solrhome/collection1/conf

174720:42:59:947 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

174820:42:59:949 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

174920:43:00:093 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333379489/solrhome/collection1/conf took 146 ms

175020:43:00:093 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

175120:43:00:096 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

175220:43:00:099 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

175320:43:00:241 [qtp1311024633-1535] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

175420:43:00:241 [qtp649304037-1538] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

175520:43:01:280 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1756java.net.ConnectException: Connection refused

1757 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1758 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1759 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1760 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1761 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

176220:43:01:498 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1404 ms

176320:43:01:498 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:45247_solr={responseHeader={status=0, QTime=274}, core=collection1_shard1_replica_n1}, 127.0.0.1:33313_solr={responseHeader={status=0, QTime=1167}, core=collection1_shard1_replica_n2}}

176420:43:01:498 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1768333379489/solrhome/collection2/conf

176520:43:01:498 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

176620:43:01:500 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

176720:43:01:633 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1768333379489/solrhome/collection2/conf took 134 ms

176820:43:01:633 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1

176920:43:01:864 [qtp649304037-1530] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

177020:43:01:864 [qtp1311024633-1537] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

177120:43:03:098 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1772java.net.ConnectException: Connection refused

1773 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

1774 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

1775 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

1776 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

1777 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

177820:43:03:139 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1 took 1506 ms

177920:43:03:139 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:33313_solr={responseHeader={status=0, QTime=292}, core=collection2_shard1_replica_n1}, 127.0.0.1:45247_solr={responseHeader={status=0, QTime=1181}, core=collection2_shard1_replica_n2}}

178020:43:03:139 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:33313/solr/collection1_shard1_replica_n2

178120:43:03:139 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:33313/solr/collection2_shard1_replica_n1

178220:43:03:139 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:45247/solr/collection1_shard1_replica_n1

178320:43:03:139 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:45247/solr/collection2_shard1_replica_n2

178420:43:03:141 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

178520:43:03:143 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

178620:43:03:143 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:37923/solr

178720:43:03:145 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:37923/solr

178820:43:03:147 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:33313/solr/collection2_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:45247/solr/collection2_shard1_replica_n2, Enabled, NRT, false)), collection1 -> Vector(ShardReplica(http://127.0.0.1:45247/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:33313/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

178920:43:03:212 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

179020:43:03:213 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Restarting Zookeeper with zkDir = /tmp/base1768333379489/zookeeper/server1/data and port = 37923...

179120:43:03:418 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec-SendThread(127.0.0.1:37923)] WARN org.apache.zookeeper.ClientCnxn - Session 0x10000142d020007 for server localhost/127.0.0.1:37923, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1792EndOfStreamException: Unable to read additional data from server sessionid 0x10000142d020007, likely server has closed socket

1793 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1794 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1795 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

179620:43:03:419 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec-SendThread(127.0.0.1:37923)] WARN org.apache.zookeeper.ClientCnxn - Session 0x10000142d020009 for server localhost/127.0.0.1:37923, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1797EndOfStreamException: Unable to read additional data from server sessionid 0x10000142d020009, likely server has closed socket

1798 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1799 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1800 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

180120:43:03:419 [jetty-launcher-692-thread-2-SendThread(127.0.0.1:37923)] WARN org.apache.zookeeper.ClientCnxn - Session 0x10000142d020006 for server localhost/127.0.0.1:37923, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1802EndOfStreamException: Unable to read additional data from server sessionid 0x10000142d020006, likely server has closed socket

1803 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1804 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1805 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

180620:43:03:419 [jetty-launcher-692-thread-1-SendThread(127.0.0.1:37923)] WARN org.apache.zookeeper.ClientCnxn - Session 0x10000142d020005 for server localhost/127.0.0.1:37923, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1807EndOfStreamException: Unable to read additional data from server sessionid 0x10000142d020005, likely server has closed socket

1808 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1809 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1810 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

181120:43:03:418 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec-SendThread(127.0.0.1:37923)] WARN org.apache.zookeeper.ClientCnxn - Session 0x10000142d02000b for server localhost/127.0.0.1:37923, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

1812EndOfStreamException: Unable to read additional data from server sessionid 0x10000142d02000b, likely server has closed socket

1813 at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)

1814 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

1815 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

181620:43:03:427 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Zookeeper was stopped, starting new one...

181720:43:03:522 [zkCallback-744-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@65013d29 name: ZooKeeperConnection Watcher:127.0.0.1:37923/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

181820:43:03:523 [zkCallback-744-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

181920:43:03:524 [zkCallback-719-thread-4] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@7d6c0742 name: ZooKeeperConnection Watcher:127.0.0.1:37923/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

182020:43:03:524 [zkCallback-719-thread-4] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

182120:43:03:527 [zkCallback-717-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@19542ae7 name: ZooKeeperConnection Watcher:127.0.0.1:37923/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

182220:43:03:529 [zkCallback-717-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

182320:43:03:529 [zkCallback-775-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@3e58d617 name: ZooKeeperConnection Watcher:127.0.0.1:37923/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

182420:43:03:530 [zkCallback-775-thread-2] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

182520:43:03:531 [zkCallback-736-thread-1] WARN org.apache.solr.common.cloud.ConnectionManager - Watcher org.apache.solr.common.cloud.ConnectionManager@77b2871f name: ZooKeeperConnection Watcher:127.0.0.1:37923/solr got event WatchedEvent state:Disconnected type:None path:null zxid: -1 path: null type: None

182620:43:03:532 [zkCallback-736-thread-1] WARN org.apache.solr.common.cloud.ConnectionManager - zkClient has disconnected

182720:43:03:533 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

182820:43:03:538 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

182920:43:03:687 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

183020:43:03:691 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

183120:43:03:691 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - New Zookeeper was started

183220:43:04:298 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

1833[info] - should serve queries when ZK is not available

183420:43:04:578 [OverseerCollectionConfigSetProcessor-72057680692379654-127.0.0.1:45247_solr-n_0000000000] WARN org.apache.solr.cloud.OverseerTaskProcessor -

1835org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer_elect/leader

1836 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1837 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1838 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1839 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1840 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1841 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1842 at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:486)

1843 at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:231)

1844 at java.base/java.lang.Thread.run(Thread.java:833)

184520:43:04:578 [zkCallback-719-thread-3] WARN org.apache.solr.schema.ZkIndexSchemaReader - ZooKeeper watch triggered, but schema does not exist in ZK - skipping update

184620:43:04:579 [zkCallback-719-thread-1] WARN org.apache.solr.schema.ZkIndexSchemaReader - ZooKeeper watch triggered, but schema does not exist in ZK - skipping update

184720:43:04:579 [zkCallback-719-thread-5] WARN org.apache.solr.cloud.LeaderElector -

1848org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection2/leader_elect/shard1/election

1849 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1850 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1851 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1852 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1853 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1854 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1855 at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:99)

1856 at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:351)

1857 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1858 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1859 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1860 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1861 at java.base/java.lang.Thread.run(Thread.java:833)

186220:43:04:582 [zkCallback-719-thread-1] WARN org.apache.solr.common.cloud.ZkStateReader - Error fetching collection names:

1863org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections

1864 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1865 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1866 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1867 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1868 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1869 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1870 at org.apache.solr.common.cloud.ZkStateReader.refreshCollectionList(ZkStateReader.java:657)

1871 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.refreshAndWatch(ZkStateReader.java:1343)

1872 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.process(ZkStateReader.java:1334)

1873 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1874 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1875 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1876 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1877 at java.base/java.lang.Thread.run(Thread.java:833)

187820:43:04:596 [watches-723-thread-2] WARN org.apache.solr.cloud.ZkController - Failed to unregister core:collection1_shard1_replica_n1

1879org.apache.solr.common.SolrException: Error unregistering core [collection1_shard1_replica_n1] from cloud state

1880 at org.apache.solr.core.CoreContainer.unload(CoreContainer.java:2211)

1881 at org.apache.solr.cloud.ZkController$UnloadCoreOnDeletedWatcher.onStateChanged(ZkController.java:2838)

1882 at org.apache.solr.common.cloud.ZkStateReader$Notification.run(ZkStateReader.java:1895)

1883 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1884 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1885 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1886 at java.base/java.lang.Thread.run(Thread.java:833)

1887Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode

1888 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1889 at org.apache.zookeeper.ZooKeeper.multiInternal(ZooKeeper.java:1778)

1890 at org.apache.zookeeper.ZooKeeper.multi(ZooKeeper.java:1650)

1891 at org.apache.solr.common.cloud.SolrZkClient.lambda$multi$12(SolrZkClient.java:792)

1892 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1893 at org.apache.solr.common.cloud.SolrZkClient.multi(SolrZkClient.java:792)

1894 at org.apache.solr.cloud.ShardLeaderElectionContextBase.cancelElection(ShardLeaderElectionContextBase.java:112)

1895 at org.apache.solr.cloud.ShardLeaderElectionContext.cancelElection(ShardLeaderElectionContext.java:87)

1896 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1839)

1897 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1816)

1898 at org.apache.solr.core.CoreContainer.unload(CoreContainer.java:2204)

1899 ... 6 more

190020:43:04:664 [zkCallback-736-thread-3] WARN org.apache.solr.common.cloud.ZkStateReader - Error fetching collection names:

1901org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections

1902 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1903 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1904 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1905 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1906 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1907 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1908 at org.apache.solr.common.cloud.ZkStateReader.refreshCollectionList(ZkStateReader.java:657)

1909 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.refreshAndWatch(ZkStateReader.java:1343)

1910 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.process(ZkStateReader.java:1334)

1911 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1912 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1913 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1914 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1915 at java.base/java.lang.Thread.run(Thread.java:833)

191620:43:04:698 [OverseerStateUpdate-72057680692379654-127.0.0.1:45247_solr-n_0000000000] WARN org.apache.solr.cloud.Overseer -

1917org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer_elect/leader

1918 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1919 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1920 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1921 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1922 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1923 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1924 at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:619)

1925 at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:268)

1926 at java.base/java.lang.Thread.run(Thread.java:833)

192720:43:04:699 [OverseerExitThread] WARN org.apache.solr.cloud.Overseer - Error communicating with ZooKeeper

1928org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer_elect/leader

1929 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1930 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1931 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

1932 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

1933 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1934 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

1935 at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:482)

1936 at java.base/java.lang.Thread.run(Thread.java:833)

193720:43:04:876 [zkCallback-717-thread-1] WARN org.apache.solr.schema.ZkIndexSchemaReader - ZooKeeper watch triggered, but schema does not exist in ZK - skipping update

193820:43:04:877 [zkCallback-717-thread-6] WARN org.apache.solr.cloud.LeaderElector -

1939org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election

1940 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1941 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1942 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1943 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1944 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1945 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1946 at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:99)

1947 at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:351)

1948 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1949 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1950 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1951 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1952 at java.base/java.lang.Thread.run(Thread.java:833)

195320:43:04:877 [zkCallback-717-thread-5] WARN org.apache.solr.schema.ZkIndexSchemaReader - ZooKeeper watch triggered, but schema does not exist in ZK - skipping update

195420:43:04:878 [zkCallback-717-thread-2] WARN org.apache.solr.cloud.LeaderElector -

1955org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer_elect/election

1956 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1957 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1958 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1959 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1960 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1961 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1962 at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:99)

1963 at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:351)

1964 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1965 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1966 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1967 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1968 at java.base/java.lang.Thread.run(Thread.java:833)

196920:43:04:879 [zkCallback-717-thread-5] WARN org.apache.solr.common.cloud.ZkStateReader - Error fetching collection names:

1970org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections

1971 at org.apache.zookeeper.KeeperException.create(KeeperException.java:117)

1972 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

1973 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366)

1974 at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:416)

1975 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

1976 at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:416)

1977 at org.apache.solr.common.cloud.ZkStateReader.refreshCollectionList(ZkStateReader.java:657)

1978 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.refreshAndWatch(ZkStateReader.java:1343)

1979 at org.apache.solr.common.cloud.ZkStateReader$CollectionsChildWatcher.process(ZkStateReader.java:1334)

1980 at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:1099)

1981 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1982 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1983 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1984 at java.base/java.lang.Thread.run(Thread.java:833)

198520:43:04:881 [coreZkRegister-700-thread-1] WARN org.apache.solr.cloud.ZkController - listener throws error

1986org.apache.solr.common.SolrException: Unable to reload core [collection2_shard1_replica_n1]

1987 at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:2093)

1988 at org.apache.solr.core.SolrCore.lambda$getConfListener$22(SolrCore.java:3458)

1989 at org.apache.solr.cloud.ZkController.lambda$fireEventListeners$26(ZkController.java:2775)

1990 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

1991 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

1992 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

1993 at java.base/java.lang.Thread.run(Thread.java:833)

1994Caused by: org.apache.solr.common.SolrException: Could not find collection : collection2

1995 at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:126)

1996 at org.apache.solr.cloud.ZkConfigSetService.createCoreResourceLoader(ZkConfigSetService.java:77)

1997 at org.apache.solr.core.ConfigSetService.loadConfigSet(ConfigSetService.java:268)

1998 at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:2046)

1999 ... 6 more

200020:43:04:884 [watches-721-thread-2] WARN org.apache.solr.cloud.ZkController - Failed to unregister core:collection2_shard1_replica_n1

2001org.apache.solr.common.SolrException: Error unregistering core [collection2_shard1_replica_n1] from cloud state

2002 at org.apache.solr.core.CoreContainer.unload(CoreContainer.java:2214)

2003 at org.apache.solr.cloud.ZkController$UnloadCoreOnDeletedWatcher.onStateChanged(ZkController.java:2838)

2004 at org.apache.solr.common.cloud.ZkStateReader$Notification.run(ZkStateReader.java:1895)

2005 at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380)

2006 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2007 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2008 at java.base/java.lang.Thread.run(Thread.java:833)

2009Caused by: org.apache.solr.core.SolrCoreInitializationException: SolrCore 'collection2_shard1_replica_n1' is not available due to init failure: Could not find collection : collection2

2010 at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:2298)

2011 at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:2267)

2012 at org.apache.solr.cloud.ShardLeaderElectionContext.cancelElection(ShardLeaderElectionContext.java:81)

2013 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1839)

2014 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1816)

2015 at org.apache.solr.core.CoreContainer.unload(CoreContainer.java:2204)

2016 ... 6 more

2017Caused by: org.apache.solr.common.SolrException: Could not find collection : collection2

2018 at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:126)

2019 at org.apache.solr.cloud.ZkConfigSetService.createCoreResourceLoader(ZkConfigSetService.java:77)

2020 at org.apache.solr.core.ConfigSetService.loadConfigSet(ConfigSetService.java:268)

2021 at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:2046)

2022 at org.apache.solr.core.SolrCore.lambda$getConfListener$22(SolrCore.java:3458)

2023 at org.apache.solr.cloud.ZkController.lambda$fireEventListeners$26(ZkController.java:2775)

2024 ... 4 more

202520:43:05:072 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2026java.net.ConnectException: Connection refused

2027 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2028 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2029 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2030 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2031 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

203220:43:05:350 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:33313_solr, 127.0.0.1:45247_solr]

2033collections:{collection1=LazyCollectionRef(collection1), collection2=LazyCollectionRef(collection2)}

2034org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

2035 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1403)

2036 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

2037 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

2038 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

2039 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

2040 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

2041 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2042 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2043 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2044 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2045 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2046 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2047 at java.base/java.lang.Thread.run(Thread.java:833)

2048Caused by: java.lang.InterruptedException: sleep interrupted

2049 at java.base/java.lang.Thread.sleep(Native Method)

2050 at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:101)

2051 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:80)

2052 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

2053 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

2054 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

2055 ... 12 more

2056java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5b775c43[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@6ad7168e[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@2083f352]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@58c9e730[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 2]

2057 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

2058 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

2059 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

2060 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

2061 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

2062 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

2063 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

2064 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

2065 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

2066 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

2067 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

2068 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

2069 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

2070 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

2071 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

2072 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2073 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2074 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2075 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2076 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2077 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2078 at java.base/java.lang.Thread.run(Thread.java:833)

207920:43:05:351 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

208020:43:05:568 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

208120:43:05:794 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

208220:43:05:896 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

208320:43:05:899 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

208420:43:05:901 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

208520:43:05:903 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

208620:43:05:903 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 108 ms

208720:43:05:903 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

208820:43:05:903 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

208920:43:05:904 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

209020:43:06:010 [jetty-launcher-795-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

209120:43:06:010 [jetty-launcher-795-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

209220:43:06:012 [jetty-launcher-795-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

209320:43:06:012 [jetty-launcher-795-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

209420:43:06:148 [jetty-launcher-795-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

209520:43:06:148 [jetty-launcher-795-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

209620:43:06:160 [jetty-launcher-795-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

209720:43:06:161 [jetty-launcher-795-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

209820:43:06:168 [jetty-launcher-795-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

209920:43:06:169 [jetty-launcher-795-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

210020:43:06:231 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210120:43:06:234 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210220:43:06:236 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 333 ms

210320:43:06:236 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333385786/solrhome/collection1/conf

210420:43:06:236 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210520:43:06:240 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210620:43:06:379 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333385786/solrhome/collection1/conf took 143 ms

210720:43:06:380 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

210820:43:06:381 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

210920:43:06:383 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

211020:43:06:519 [qtp1774361948-1752] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

211120:43:06:519 [qtp758322832-1749] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

211220:43:06:585 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2113java.net.ConnectException: Connection refused

2114 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2115 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2116 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2117 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2118 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

211920:43:07:797 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1417 ms

212020:43:07:797 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:44709_solr={responseHeader={status=0, QTime=295}, core=collection1_shard1_replica_n1}, 127.0.0.1:33505_solr={responseHeader={status=0, QTime=1184}, core=collection1_shard1_replica_n2}}

212120:43:07:797 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1768333385786/solrhome/collection2/conf

212220:43:07:797 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

212320:43:07:799 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

212420:43:07:935 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1768333385786/solrhome/collection2/conf took 138 ms

212520:43:07:935 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1

212620:43:07:954 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2127java.net.ConnectException: Connection refused

2128 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2129 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2130 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2131 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2132 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

213320:43:08:164 [qtp1774361948-1754] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

213420:43:08:164 [qtp758322832-1755] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

213520:43:09:386 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2136java.net.ConnectException: Connection refused

2137 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2138 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2139 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2140 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2141 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

214220:43:09:410 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1 took 1474 ms

214320:43:09:410 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:33505_solr={responseHeader={status=0, QTime=258}, core=collection2_shard1_replica_n2}, 127.0.0.1:44709_solr={responseHeader={status=0, QTime=1151}, core=collection2_shard1_replica_n1}}

214420:43:09:410 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:44709/solr/collection1_shard1_replica_n1

214520:43:09:410 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:44709/solr/collection2_shard1_replica_n1

214620:43:09:410 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:33505/solr/collection1_shard1_replica_n2

214720:43:09:410 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:33505/solr/collection2_shard1_replica_n2

214820:43:09:411 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

214920:43:09:413 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

215020:43:09:413 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:43997/solr

215120:43:09:415 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:43997/solr

215220:43:09:416 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:44709/solr/collection2_shard1_replica_n1, Enabled, NRT, false), ShardReplica(http://127.0.0.1:33505/solr/collection2_shard1_replica_n2, Enabled, NRT, true)), collection1 -> Vector(ShardReplica(http://127.0.0.1:44709/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:33505/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

215320:43:09:499 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

2154[info] - should handle a standard (non-routed) collection alias

215520:43:10:130 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:33505_solr, 127.0.0.1:44709_solr]

2156collections:{collection1=LazyCollectionRef(collection1), collection2=LazyCollectionRef(collection2)}

2157org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

2158 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

2159 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

2160 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

2161 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

2162 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

2163 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

2164 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2165 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2166 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2167 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2168 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2169 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2170 at java.base/java.lang.Thread.run(Thread.java:833)

2171Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

2172 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

2173 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

2174 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

2175 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

2176 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

2177 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

2178 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

2179 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

2180 ... 12 more

2181java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@48c20bd7[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@6bc880a1[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@2eca03bc]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@1fae8879[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 6]

2182 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

2183 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

2184 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

2185 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

2186 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

2187 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

2188 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

2189 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

2190 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

2191 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

2192 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

2193 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

2194 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

2195 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

2196 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

2197 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2198 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2199 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2200 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2201 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2202 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2203 at java.base/java.lang.Thread.run(Thread.java:833)

220420:43:10:131 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

220520:43:10:349 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

220620:43:10:568 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2207java.net.ConnectException: Connection refused

2208 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2209 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2210 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2211 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2212 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

221320:43:10:584 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server

221420:43:10:685 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

221520:43:10:688 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

221620:43:10:690 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

221720:43:10:692 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

221820:43:10:692 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Solr ZK Test Server took 107 ms

221920:43:10:692 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s)

222020:43:10:692 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

222120:43:10:694 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

222220:43:10:798 [jetty-launcher-896-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

222320:43:10:798 [jetty-launcher-896-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

222420:43:10:801 [jetty-launcher-896-thread-2] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

222520:43:10:801 [jetty-launcher-896-thread-1] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

222620:43:10:935 [jetty-launcher-896-thread-1] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

222720:43:10:935 [jetty-launcher-896-thread-2] WARN org.apache.solr.cloud.ZkController - Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html

222820:43:10:945 [jetty-launcher-896-thread-2] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

222920:43:10:945 [jetty-launcher-896-thread-2] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

223020:43:10:950 [jetty-launcher-896-thread-1] WARN org.apache.solr.core.CoreContainer - Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info

223120:43:10:951 [jetty-launcher-896-thread-1] WARN org.apache.solr.core.ConfigSetService - The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: /collection1/conf

223220:43:11:025 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223320:43:11:027 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223420:43:11:029 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Starting Mini Solr Cloud cluster with 2 node(s) took 337 ms

223520:43:11:030 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333390575/solrhome/collection1/conf

223620:43:11:030 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223720:43:11:032 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

223820:43:11:185 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection1' for collection 'collection1' from /tmp/base1768333390575/solrhome/collection1/conf took 155 ms

223920:43:11:185 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1

224020:43:11:187 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

224120:43:11:325 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

224220:43:11:457 [qtp1401069981-1929] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

224320:43:11:457 [qtp2143765421-1932] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

224420:43:12:433 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2245java.net.ConnectException: Connection refused

2246 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2247 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2248 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2249 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2250 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

225120:43:12:704 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection1' with replicas=2 and shards=1 took 1518 ms

225220:43:12:704 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:35625_solr={responseHeader={status=0, QTime=752}, core=collection1_shard1_replica_n1}, 127.0.0.1:45157_solr={responseHeader={status=0, QTime=1151}, core=collection1_shard1_replica_n2}}

225320:43:12:704 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1768333390575/solrhome/collection2/conf

225420:43:12:704 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

225520:43:12:706 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

225620:43:12:840 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Uploading config 'collection2' for collection 'collection2' from /tmp/base1768333390575/solrhome/collection2/conf took 136 ms

225720:43:12:840 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1

225820:43:13:070 [qtp2143765421-1934] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

225920:43:13:070 [qtp1401069981-1937] WARN org.apache.solr.core.SolrConfig - Ignored deprecated enableRemoteStreaming in config; use sys-prop

226020:43:14:021 [pool-1-thread-1-ScalaTest-running-CloudSolrServersUninitializedIntegrationSpec-SendThread(127.0.0.1:2181)] WARN org.apache.zookeeper.ClientCnxn - Session 0x1000013f9330009 for server localhost/127.0.0.1:2181, Closing socket connection. Attempting reconnect except it is a SessionExpiredException.

2261java.net.ConnectException: Connection refused

2262 at java.base/sun.nio.ch.Net.pollConnect(Native Method)

2263 at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)

2264 at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)

2265 at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:344)

2266 at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)

226720:43:14:319 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Creating collection 'collection2' with replicas=2 and shards=1 took 1478 ms

226820:43:14:320 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Success: true, Status: {127.0.0.1:45157_solr={responseHeader={status=0, QTime=759}, core=collection2_shard1_replica_n1}, 127.0.0.1:35625_solr={responseHeader={status=0, QTime=1154}, core=collection2_shard1_replica_n2}}

226920:43:14:320 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #0 running at http://127.0.0.1:45157/solr/collection1_shard1_replica_n2

227020:43:14:320 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #1 running at http://127.0.0.1:45157/solr/collection2_shard1_replica_n1

227120:43:14:320 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #2 running at http://127.0.0.1:35625/solr/collection1_shard1_replica_n1

227220:43:14:320 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Jetty core #3 running at http://127.0.0.1:35625/solr/collection2_shard1_replica_n2

227320:43:14:321 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

227420:43:14:323 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] WARN org.apache.solr.common.cloud.SolrZkClient - Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes

227520:43:14:323 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Connected to zookeeper at 127.0.0.1:34743/solr

227620:43:14:325 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Successfully created ZK cluster state watchers at 127.0.0.1:34743/solr

227720:43:14:327 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.CloudSolrServers$ - Updated server map: Map(collection2 -> Vector(ShardReplica(http://127.0.0.1:45157/solr/collection2_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:35625/solr/collection2_shard1_replica_n2, Enabled, NRT, false)), collection1 -> Vector(ShardReplica(http://127.0.0.1:35625/solr/collection1_shard1_replica_n1, Enabled, NRT, true), ShardReplica(http://127.0.0.1:45157/solr/collection1_shard1_replica_n2, Enabled, NRT, false)))

227820:43:14:384 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.AsyncSolrClientCloudIntegrationSpec - Awaiting all servers status is Enabled

2279[info] - should handle multiple collections param

228020:43:14:654 [solrs-CloudSolrServersUpdateThread-01] ERROR io.ino.solrs.CloudSolrServers$ - Could not process cluster state, server list might get outdated. Cluster state: live nodes:[127.0.0.1:45157_solr, 127.0.0.1:35625_solr]

2281collections:{collection1=LazyCollectionRef(collection1), collection2=LazyCollectionRef(collection2)}

2282org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

2283 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1399)

2284 at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:761)

2285 at org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:450)

2286 at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:182)

2287 at io.ino.solrs.CloudSolrServers$.getCollections(SolrServers.scala:399)

2288 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$updateFromClusterState(SolrServers.scala:222)

2289 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2290 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2291 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2292 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2293 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2294 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2295 at java.base/java.lang.Thread.run(Thread.java:833)

2296Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json

2297 at org.apache.zookeeper.KeeperException.create(KeeperException.java:133)

2298 at org.apache.zookeeper.KeeperException.create(KeeperException.java:53)

2299 at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972)

2300 at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:452)

2301 at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)

2302 at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:452)

2303 at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1414)

2304 at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1397)

2305 ... 12 more

2306java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@56e9c02e[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@167b49a7[Wrapped task = io.ino.solrs.CloudSolrServers$$anon$3@5379d50c]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@62e000a3[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 2]

2307 at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065)

2308 at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833)

2309 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340)

2310 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562)

2311 at io.ino.solrs.CloudSolrServers.io$ino$solrs$CloudSolrServers$$scheduleUpdateFromClusterState(SolrServers.scala:199)

2312 at io.ino.solrs.CloudSolrServers$$anon$3.run$$anonfun$1(SolrServers.scala:196)

2313 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:15)

2314 at scala.runtime.function.JProcedure1.apply(JProcedure1.java:10)

2315 at scala.concurrent.impl.Promise$Transformation.run(Promise.scala:520)

2316 at io.ino.concurrent.Execution$$anon$1.execute(Execution.scala:13)

2317 at scala.concurrent.impl.Promise$Transformation.submitWithValue(Promise.scala:465)

2318 at scala.concurrent.impl.Promise$DefaultPromise.submitWithValue(Promise.scala:374)

2319 at scala.concurrent.impl.Promise$DefaultPromise.dispatchOrAddCallbacks(Promise.scala:325)

2320 at scala.concurrent.impl.Promise$DefaultPromise.onComplete(Promise.scala:219)

2321 at io.ino.solrs.future.ScalaFutureFactory$ScalaFuture.onComplete(ScalaFutureFactory.scala:25)

2322 at io.ino.solrs.CloudSolrServers$$anon$3.run(SolrServers.scala:195)

2323 at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)

2324 at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)

2325 at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)

2326 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)

2327 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

2328 at java.base/java.lang.Thread.run(Thread.java:833)

232920:43:14:655 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Solr Cloud cluster

233020:43:14:874 [pool-1-thread-1-ScalaTest-running-AsyncSolrClientCloudIntegrationSpec] INFO io.ino.solrs.SolrCloudRunner - Shutting down Zookeeper

2331[info] SolrServersSpec:

2332[info] StaticSolrServers

2333[info] - should return consecutive solr servers

2334[info] ReloadingSolrServers

233520:43:15:108 [pool-1-thread-1-ScalaTest-running-SolrServersSpec] INFO io.ino.solrs.SolrServersSpec$$anon$1 - Changed solr servers from Vector() to ArraySeq(SolrServer(host1, Enabled), SolrServer(host2, Enabled))

2336[info] - should return iterator that reflects updated solr servers

2337

2338************************

2339Build summary:

2340[{

2341 "module": "solrs",

2342 "compile": {"status": "ok", "tookMs": 12386, "warnings": 2, "errors": 0, "sourceVersion": "3.8"},

2343 "doc": {"status": "skipped", "tookMs": 0, "files": 0, "totalSizeKb": 0},

2344 "test-compile": {"status": "ok", "tookMs": 12209, "warnings": 1, "errors": 0, "sourceVersion": "3.8"},

2345 "test": {"status": "ok", "tookMs": 59353, "passed": 154, "failed": 0, "ignored": 0, "skipped": 0, "total": 154, "byFramework": [{"framework": "unknown", "stats": {"passed": 154, "failed": 0, "ignored": 0, "skipped": 0, "total": 154}}]},

2346 "publish": {"status": "skipped", "tookMs": 0},

2347 "metadata": {

2348 "crossScalaVersions": ["2.12.20", "2.13.16", "3.7.0"]

2349}

2350}]

2351************************

2352[success] Total time: 88 s (0:01:28.0), completed Jan 13, 2026, 8:43:16 PM

2353[0JChecking patch project/plugins.sbt...

2354Checking patch project/build.properties...

2355Checking patch build.sbt...

2356Applied patch project/plugins.sbt cleanly.

2357Applied patch project/build.properties cleanly.

2358Applied patch build.sbt cleanly.