==> Building on centiskorch ==> Checking for remote environment... ==> Syncing package to remote host... sending incremental file list ./ .SRCINFO 4,466 100% 0.00kB/s 0:00:00 4,466 100% 0.00kB/s 0:00:00 (xfr#1, to-chk=32/34) .nvchecker.toml 98 100% 95.70kB/s 0:00:00 98 100% 95.70kB/s 0:00:00 (xfr#2, to-chk=31/34) PKGBUILD 3,504 44% 1.11MB/s 0:00:00 7,912 100% 1.51MB/s 0:00:00 (xfr#3, to-chk=30/34) allow-using-system-gradle.patch 700 48% 136.72kB/s 0:00:00 1,429 100% 232.58kB/s 0:00:00 (xfr#4, to-chk=29/34) skip-checks-for-git-repo.patch 700 45% 113.93kB/s 0:00:00 1,539 100% 250.49kB/s 0:00:00 (xfr#5, to-chk=28/34) skip-failing-test.patch 700 66% 97.66kB/s 0:00:00 1,047 100% 146.07kB/s 0:00:00 (xfr#6, to-chk=27/34) solr-9.8.0-1.log 1,000 100% 122.07kB/s 0:00:00 1,000 100% 108.51kB/s 0:00:00 (xfr#7, to-chk=26/34) solr.service 700 72% 68.36kB/s 0:00:00 962 100% 93.95kB/s 0:00:00 (xfr#8, to-chk=25/34) solr.sysusers 33 100% 3.22kB/s 0:00:00 33 100% 3.22kB/s 0:00:00 (xfr#9, to-chk=24/34) solr.tmpfiles 161 100% 15.72kB/s 0:00:00 161 100% 15.72kB/s 0:00:00 (xfr#10, to-chk=23/34) support-reproducible-builds.patch 700 30% 68.36kB/s 0:00:00 2,275 100% 222.17kB/s 0:00:00 (xfr#11, to-chk=22/34) keys/ keys/pgp/ keys/pgp/1CF0DAD1470504C4EA95C697140BC45803B03F7F.asc 3,163 100% 257.41kB/s 0:00:00 3,163 100% 257.41kB/s 0:00:00 (xfr#12, to-chk=19/34) keys/pgp/2085660D9C1FCCACC4A479A3BF160FF14992A24C.asc 700 22% 56.97kB/s 0:00:00 3,078 100% 250.49kB/s 0:00:00 (xfr#13, to-chk=18/34) keys/pgp/2289AC4180E130507D7A82F479C211E0AEFCA72E.asc 700 12% 56.97kB/s 0:00:00 5,592 100% 455.08kB/s 0:00:00 (xfr#14, to-chk=17/34) keys/pgp/3558857D1F5754B78C7F8B5A71A45A3D0D8D0B93.asc 700 41% 56.97kB/s 0:00:00 1,672 100% 136.07kB/s 0:00:00 (xfr#15, to-chk=16/34) keys/pgp/38DA0C3CE8181703A08E4D57377C3BA26AD29C0A.asc 700 22% 56.97kB/s 0:00:00 3,139 100% 255.45kB/s 0:00:00 (xfr#16, to-chk=15/34) keys/pgp/50E3EE1C91C7E0CB4DFB007B369424FC98F3F6EC.asc 700 22% 56.97kB/s 0:00:00 3,171 100% 258.06kB/s 0:00:00 (xfr#17, to-chk=14/34) keys/pgp/515EA995ED1DD799FA1422E5CA7514D8385D790B.asc 700 22% 56.97kB/s 0:00:00 3,171 100% 258.06kB/s 0:00:00 (xfr#18, to-chk=13/34) keys/pgp/7D8D90F8F64F23077AC87CF7CB77CB79928BB0EC.asc 700 53% 56.97kB/s 0:00:00 1,302 100% 105.96kB/s 0:00:00 (xfr#19, to-chk=12/34) keys/pgp/81D3EB0408B4E1EB10AF443BA4F4C886B29BC2F4.asc 700 22% 52.58kB/s 0:00:00 3,163 100% 237.61kB/s 0:00:00 (xfr#20, to-chk=11/34) keys/pgp/86EDB9C33B8517228E88A8F93E48C0C6EF362B9E.asc 700 22% 52.58kB/s 0:00:00 3,090 100% 232.12kB/s 0:00:00 (xfr#21, to-chk=10/34) keys/pgp/902CC51935C140BF820230961FD5295281436075.asc 700 22% 52.58kB/s 0:00:00 3,167 100% 237.91kB/s 0:00:00 (xfr#22, to-chk=9/34) keys/pgp/9722F25F650057E26C803B60A6D064D833B3A969.asc 700 22% 52.58kB/s 0:00:00 3,159 100% 237.30kB/s 0:00:00 (xfr#23, to-chk=8/34) keys/pgp/C3E7CBD9B9FE2B419EB14B89612B39A5BC981763.asc 700 27% 52.58kB/s 0:00:00 2,521 100% 189.38kB/s 0:00:00 (xfr#24, to-chk=7/34) keys/pgp/CFCE5FBB920C3C745CEEE084C38FF5EC3FCFDB3E.asc 700 22% 52.58kB/s 0:00:00 3,090 100% 232.12kB/s 0:00:00 (xfr#25, to-chk=6/34) keys/pgp/E05FDF113D89E7FB4A2DF4B2684D544160392455.asc 2,497 100% 187.58kB/s 0:00:00 2,497 100% 187.58kB/s 0:00:00 (xfr#26, to-chk=5/34) keys/pgp/E58A6F4D5B2B48AC66D5E53BD4F181881A42F9E6.asc 700 22% 52.58kB/s 0:00:00 3,155 100% 237.00kB/s 0:00:00 (xfr#27, to-chk=4/34) keys/pgp/E6E21FFCDCEA14C95910EA65051A0FAF76BC6507.asc 700 22% 52.58kB/s 0:00:00 3,094 100% 232.42kB/s 0:00:00 (xfr#28, to-chk=3/34) keys/pgp/EDF961FF03E647F9CA8A9C2C758051CCA3A13A7F.asc 2,513 100% 188.78kB/s 0:00:00 2,513 100% 188.78kB/s 0:00:00 (xfr#29, to-chk=2/34) keys/pgp/FBC25D7E1712025294FE66590A6AA179B9BBF45E.asc 700 22% 52.58kB/s 0:00:00 3,163 100% 237.61kB/s 0:00:00 (xfr#30, to-chk=1/34) keys/pgp/FDB3D11D716BB32ACF8C93AB919B21537AA80271.asc 700 22% 52.58kB/s 0:00:00 3,167 100% 237.91kB/s 0:00:00 (xfr#31, to-chk=0/34) sent 14,963 bytes received 1,314 bytes 32,554.00 bytes/sec total size is 80,157 speedup is 4.92 ==> Ensuring required PGP keys are present...  -> Checking for 2085660D9C1FCCACC4A479A3BF160FF14992A24C...  -> Checking for E58A6F4D5B2B48AC66D5E53BD4F181881A42F9E6...  -> Checking for 81D3EB0408B4E1EB10AF443BA4F4C886B29BC2F4...  -> Checking for 86EDB9C33B8517228E88A8F93E48C0C6EF362B9E...  -> Checking for 38DA0C3CE8181703A08E4D57377C3BA26AD29C0A...  -> Checking for 50E3EE1C91C7E0CB4DFB007B369424FC98F3F6EC...  -> Checking for 902CC51935C140BF820230961FD5295281436075...  -> Checking for 7D8D90F8F64F23077AC87CF7CB77CB79928BB0EC...  -> Checking for CFCE5FBB920C3C745CEEE084C38FF5EC3FCFDB3E...  -> Checking for FBC25D7E1712025294FE66590A6AA179B9BBF45E...  -> Checking for 9722F25F650057E26C803B60A6D064D833B3A969...  -> Checking for E6E21FFCDCEA14C95910EA65051A0FAF76BC6507...  -> Checking for 3558857D1F5754B78C7F8B5A71A45A3D0D8D0B93...  -> Checking for C3E7CBD9B9FE2B419EB14B89612B39A5BC981763...  -> Checking for FDB3D11D716BB32ACF8C93AB919B21537AA80271...  -> Checking for 2289AC4180E130507D7A82F479C211E0AEFCA72E...  -> Checking for 515EA995ED1DD799FA1422E5CA7514D8385D790B... pub rsa4096 2023-12-05 [SCEA] [expires: 2034-01-09] 515E A995 ED1D D799 FA14 22E5 CA75 14D8 385D 790B uid [ unknown] David Smiley (CODE SIGNING KEY) sub rsa4096 2023-12-05 [E]  -> Checking for E05FDF113D89E7FB4A2DF4B2684D544160392455...  -> Checking for 1CF0DAD1470504C4EA95C697140BC45803B03F7F...  -> Checking for EDF961FF03E647F9CA8A9C2C758051CCA3A13A7F... ==> Running pkgctl build --arch riscv64 --repo extra on remote host... ==> WARNING: unsupported architecture: riscv64 ==> Building solr  -> repo: extra  -> arch: riscv64  -> worker: felix-0 ==> Building solr for [extra] (riscv64) ]2;🔵 Container arch-nspawn-2091664 on centiskorch.felixc.at\[?25l:: Synchronizing package databases... core downloading... extra downloading... :: Starting full system upgrade... there is nothing to do [?25h==> Building in chroot for [extra] (riscv64)... ==> Synchronizing chroot copy [/var/lib/archbuild/extra-riscv64/root] -> [felix-0]...done ==> Making package: solr 9.8.0-1 (Tue Feb 18 13:14:39 2025) ==> Retrieving sources...  -> Downloading solr-9.8.0-src.tgz... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 0 86.3M 0 47941 0 0 22728 0 1:06:22 0:00:02 1:06:20 22742 0 86.3M 0 453k 0 0 146k 0 0:10:03 0:00:03 0:10:00 146k 1 86.3M 1 1242k 0 0 303k 0 0:04:50 0:00:04 0:04:46 303k 2 86.3M 2 2609k 0 0 512k 0 0:02:52 0:00:05 0:02:47 525k 4 86.3M 4 3929k 0 0 645k 0 0:02:16 0:00:06 0:02:10 789k 5 86.3M 5 5281k 0 0 745k 0 0:01:58 0:00:07 0:01:51 1051k 7 86.3M 7 6570k 0 0 812k 0 0:01:48 0:00:08 0:01:40 1224k 8 86.3M 8 7812k 0 0 859k 0 0:01:42 0:00:09 0:01:33 1313k 10 86.3M 10 9132k 0 0 905k 0 0:01:37 0:00:10 0:01:27 1305k 11 86.3M 11 10.3M 0 0 951k 0 0:01:32 0:00:11 0:01:21 1323k 13 86.3M 13 11.9M 0 0 1013k 0 0:01:27 0:00:12 0:01:15 1393k 15 86.3M 15 13.5M 0 0 1063k 0 0:01:23 0:00:13 0:01:10 1468k 17 86.3M 17 15.2M 0 0 1110k 0 0:01:19 0:00:14 0:01:05 1565k 19 86.3M 19 17.0M 0 0 1155k 0 0:01:16 0:00:15 0:01:01 1659k 21 86.3M 21 18.8M 0 0 1199k 0 0:01:13 0:00:16 0:00:57 1751k 23 86.3M 23 20.7M 0 0 1240k 0 0:01:11 0:00:17 0:00:54 1790k 26 86.3M 26 22.7M 0 0 1287k 0 0:01:08 0:00:18 0:00:50 1873k 28 86.3M 28 24.5M 0 0 1319k 0 0:01:07 0:00:19 0:00:48 1908k 30 86.3M 30 26.5M 0 0 1351k 0 0:01:05 0:00:20 0:00:45 1942k 33 86.3M 33 28.5M 0 0 1386k 0 0:01:03 0:00:21 0:00:42 1987k 36 86.3M 36 31.1M 0 0 1442k 0 0:01:01 0:00:22 0:00:39 2132k 39 86.3M 39 33.7M 0 0 1496k 0 0:00:59 0:00:23 0:00:36 2255k 41 86.3M 41 36.1M 0 0 1534k 0 0:00:57 0:00:24 0:00:33 2357k 44 86.3M 44 38.4M 0 0 1570k 0 0:00:56 0:00:25 0:00:31 2453k 47 86.3M 47 40.8M 0 0 1603k 0 0:00:55 0:00:26 0:00:29 2518k 49 86.3M 49 43.0M 0 0 1627k 0 0:00:54 0:00:27 0:00:27 2443k 52 86.3M 52 45.1M 0 0 1647k 0 0:00:53 0:00:28 0:00:25 2343k 54 86.3M 54 47.3M 0 0 1665k 0 0:00:53 0:00:29 0:00:24 2295k 57 86.3M 57 49.4M 0 0 1683k 0 0:00:52 0:00:30 0:00:22 2251k 59 86.3M 59 51.6M 0 0 1699k 0 0:00:52 0:00:31 0:00:21 2201k 62 86.3M 62 53.9M 0 0 1722k 0 0:00:51 0:00:32 0:00:19 2234k 65 86.3M 65 56.5M 0 0 1751k 0 0:00:50 0:00:33 0:00:17 2335k 68 86.3M 68 59.3M 0 0 1782k 0 0:00:49 0:00:34 0:00:15 2464k 71 86.3M 71 61.9M 0 0 1807k 0 0:00:48 0:00:35 0:00:13 2553k 75 86.3M 75 65.0M 0 0 1844k 0 0:00:47 0:00:36 0:00:11 2746k 78 86.3M 78 67.8M 0 0 1873k 0 0:00:47 0:00:37 0:00:10 2843k 82 86.3M 82 70.8M 0 0 1905k 0 0:00:46 0:00:38 0:00:08 2925k 84 86.3M 84 72.9M 0 0 1911k 0 0:00:46 0:00:39 0:00:07 2789k 87 86.3M 87 75.4M 0 0 1928k 0 0:00:45 0:00:40 0:00:05 2773k 90 86.3M 90 77.8M 0 0 1940k 0 0:00:45 0:00:41 0:00:04 2626k 93 86.3M 93 80.3M 0 0 1955k 0 0:00:45 0:00:42 0:00:03 2566k 96 86.3M 96 83.1M 0 0 1975k 0 0:00:44 0:00:43 0:00:01 2508k 98 86.3M 98 85.4M 0 0 1983k 0 0:00:44 0:00:44 --:--:-- 2550k 100 86.3M 100 86.3M 0 0 1984k 0 0:00:44 0:00:44 --:--:-- 2496k  -> Downloading solr-9.8.0-src.tgz.asc... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 863 100 863 0 0 881 0 --:--:-- --:--:-- --:--:-- 882  -> Found solr.service  -> Found solr.sysusers  -> Found solr.tmpfiles  -> Found support-reproducible-builds.patch  -> Found skip-failing-test.patch  -> Found skip-checks-for-git-repo.patch  -> Found allow-using-system-gradle.patch ==> Validating source files with sha512sums... solr-9.8.0-src.tgz ... Passed solr-9.8.0-src.tgz.asc ... Skipped solr.service ... Passed solr.sysusers ... Passed solr.tmpfiles ... Passed support-reproducible-builds.patch ... Passed skip-failing-test.patch ... Passed skip-checks-for-git-repo.patch ... Passed allow-using-system-gradle.patch ... Passed ==> Validating source files with b2sums... solr-9.8.0-src.tgz ... Passed solr-9.8.0-src.tgz.asc ... Skipped solr.service ... Passed solr.sysusers ... Passed solr.tmpfiles ... Passed support-reproducible-builds.patch ... Passed skip-failing-test.patch ... Passed skip-checks-for-git-repo.patch ... Passed allow-using-system-gradle.patch ... Passed ==> Verifying source file signatures with gpg... solr-9.8.0-src.tgz ... Passed (WARNING: the key has expired.) ==> WARNING: Warnings have occurred while verifying the signatures.  Please make sure you really trust them. ]2;🔵 Container arch-nspawn-2093086 on centiskorch.felixc.at\==> Making package: solr 9.8.0-1 (Tue Feb 18 13:15:44 2025) ==> Checking runtime dependencies... ==> Installing missing dependencies... [?25l:: There are 2 providers available for java-runtime=11: :: Repository extra 1) jdk11-openjdk 2) jre11-openjdk Enter a number (default=1): resolving dependencies... looking for conflicting packages... warning: dependency cycle detected: warning: harfbuzz will be installed before its freetype2 dependency Package (16) New Version Net Change extra/freetype2 2.13.3-3 1.58 MiB extra/giflib 5.2.2-1 0.23 MiB extra/graphite 1:1.3.14-4 0.18 MiB extra/harfbuzz 10.2.0-1 4.01 MiB extra/hicolor-icon-theme 0.18-1 0.05 MiB extra/java-environment-common 3-6 0.00 MiB extra/java-runtime-common 3-6 0.01 MiB extra/jbigkit 2.1-8 0.13 MiB extra/lcms2 2.17-1 0.64 MiB extra/libjpeg-turbo 3.1.0-1 1.99 MiB extra/libnet 2:1.3-1 1.46 MiB extra/libpng 1.6.46-1 0.54 MiB extra/libtiff 4.7.0-1 1.64 MiB core/nspr 4.36-1 0.70 MiB core/nss 3.107-1 4.65 MiB extra/jdk11-openjdk 11.0.26.u4-1 400.21 MiB Total Installed Size: 418.03 MiB :: Proceed with installation? [Y/n] checking keyring... checking package integrity... loading package files... checking for file conflicts... :: Processing package changes... installing java-runtime-common... For the complete set of Java binaries to be available in your PATH, you need to re-login or source /etc/profile Please note that this package does not support forcing JAVA_HOME as former package java-common did installing nspr... installing nss... installing libjpeg-turbo... Optional dependencies for libjpeg-turbo java-runtime>11: for TurboJPEG Java wrapper installing jbigkit... installing libtiff... Optional dependencies for libtiff freeglut: for using tiffgt installing lcms2... installing libnet... installing libpng... installing graphite... Optional dependencies for graphite graphite-docs: Documentation installing harfbuzz... Optional dependencies for harfbuzz harfbuzz-utils: utilities installing freetype2... installing java-environment-common... installing hicolor-icon-theme... installing giflib... installing jdk11-openjdk... Optional dependencies for jdk11-openjdk java-rhino: for some JavaScript support alsa-lib: for basic sound support gtk3: for the Gtk+ 3 look and feel - desktop usage :: Running post-transaction hooks... (1/1) Arming ConditionNeedsUpdate... [?25h==> Checking buildtime dependencies... ==> Installing missing dependencies... [?25lresolving dependencies... looking for conflicting packages... Package (14) New Version Net Change Download Size extra/c-ares 1.34.4-1 0.50 MiB extra/libngtcp2 1.10.0-1 0.51 MiB extra/libuv 1.50.0-1 0.59 MiB extra/node-gyp 11.0.0-1 8.89 MiB extra/nodejs 23.4.0-1 60.85 MiB extra/nodejs-nopt 7.2.1-1 0.03 MiB extra/perl-error 0.17029-7 0.04 MiB extra/perl-mailtools 2.22-1 0.10 MiB extra/perl-timedate 2.33-7 0.08 MiB extra/semver 7.6.3-1 0.09 MiB extra/git 2.48.1-1 27.35 MiB extra/gradle 8.12-1 144.13 MiB 127.52 MiB extra/groovy 4.0.24-1 24.23 MiB 21.40 MiB extra/npm 11.1.0-2 8.55 MiB Total Download Size: 148.92 MiB Total Installed Size: 275.95 MiB :: Proceed with installation? [Y/n] :: Retrieving packages... gradle-8.12-1-any downloading... groovy-4.0.24-1-any downloading... checking keyring... checking package integrity... loading package files... checking for file conflicts... :: Processing package changes... installing gradle... Optional dependencies for gradle gradle-doc: gradle documentation gradle-src: gradle sources installing perl-error... installing perl-timedate... installing perl-mailtools... installing git... Optional dependencies for git tk: gitk and git gui openssh: ssh transport and crypto perl-libwww: git svn perl-term-readkey: git svn and interactive.singlekey setting perl-io-socket-ssl: git send-email TLS support perl-authen-sasl: git send-email TLS support perl-mediawiki-api: git mediawiki support perl-datetime-format-iso8601: git mediawiki support perl-lwp-protocol-https: git mediawiki https support perl-cgi: gitweb (web interface) support python: git svn & git p4 subversion: git svn org.freedesktop.secrets: keyring credential helper libsecret: libsecret credential helper [installed] installing groovy... Optional dependencies for groovy groovy-docs: html and pdf documentation for Groovy installing c-ares... installing libngtcp2... installing libuv... installing nodejs... Optional dependencies for nodejs npm: nodejs package manager [pending] installing nodejs-nopt... installing semver... installing node-gyp... Optional dependencies for node-gyp gcc: to build C++ modules [installed] make: to build C++ modules [installed] python: to build C++ modules installing npm... Optional dependencies for npm git: for dependencies using Git URL's [installed] :: Running post-transaction hooks... (1/4) Creating system user accounts... Creating group 'git' with GID 972. Creating user 'git' (git daemon user) with UID 972 and GID 972. (2/4) Reloading system manager configuration... Skipped: Current root is not booted. (3/4) Arming ConditionNeedsUpdate... (4/4) Warn about old perl modules [?25h==> Retrieving sources...  -> Found solr-9.8.0-src.tgz  -> Found solr-9.8.0-src.tgz.asc  -> Found solr.service  -> Found solr.sysusers  -> Found solr.tmpfiles  -> Found support-reproducible-builds.patch  -> Found skip-failing-test.patch  -> Found skip-checks-for-git-repo.patch  -> Found allow-using-system-gradle.patch ==> WARNING: Skipping all source file integrity checks. ==> Extracting sources...  -> Extracting solr-9.8.0-src.tgz with bsdtar ==> Starting prepare()... patching file gradle/validation/precommit.gradle patching file solr/distribution/build.gradle Hunk #1 succeeded at 73 with fuzz 2 (offset 2 lines). Hunk #2 succeeded at 150 (offset 16 lines). patching file solr/distribution/source-release.gradle patching file gradle/globals.gradle Hunk #1 succeeded at 170 with fuzz 2. patching file gradle/java/jar-manifest.gradle patching file solr/modules/extraction/src/test/org/apache/solr/handler/extraction/TestXLSXResponseWriter.java ==> Starting build()... Downloading gradle-wrapper.jar from https://raw.githubusercontent.com/gradle/gradle/v8.10.2/gradle/wrapper/gradle-wrapper.jar Generating gradle.properties Downloading https://services.gradle.org/distributions/gradle-8.10-bin.zip .............10%.............20%.............30%.............40%.............50%.............60%.............70%.............80%.............90%.............100% Welcome to Gradle 8.10! Here are the highlights of this release: - Support for Java 23 - Faster configuration cache - Better configuration cache reports For more details see https://docs.gradle.org/8.10/release-notes.html Starting a Gradle Daemon (subsequent builds will be faster) > Task :buildSrc:compileJava Note: /build/solr/src/solr-9.8.0/buildSrc/src/main/java/org/apache/lucene/gradle/Checksum.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :buildSrc:compileGroovy NO-SOURCE > Task :buildSrc:processResources NO-SOURCE > Task :buildSrc:classes > Task :buildSrc:jar > Task :solr:modules:clustering:processResources NO-SOURCE > Task :solr:api:processResources NO-SOURCE > Task :solr:cross-dc-manager:processResources NO-SOURCE > Task :solr:modules:analytics:processResources NO-SOURCE > Task :solr:prometheus-exporter:processResources NO-SOURCE > Task :solr:solrj-zookeeper:processResources NO-SOURCE > Task :solr:modules:analysis-extras:processResources NO-SOURCE > Task :mavenLocalClean UP-TO-DATE > Task :solr:solrj-streaming:processResources > Task :solr:solrj:processResources > Task :solr:test-framework:processResources > Task :solr:core:processResources > Task :solr:api:generatePomFileForJarsPublication > Task :solr:modules:cross-dc:processResources NO-SOURCE > Task :gitStatus > Task :errorProneSkipped WARNING: errorprone disabled (skipped on builds not running inside CI environments, pass -Pvalidation.errorprone=true to enable) > Task :solr:solrj-streaming:generatePomFileForJarsPublication > Task :solr:modules:extraction:processResources > Task :solr:solrj-zookeeper:generatePomFileForJarsPublication > Task :solr:modules:gcs-repository:processResources NO-SOURCE > Task :solr-missing-doclet:compileJava > Task :solr-missing-doclet:processResources NO-SOURCE > Task :solr-missing-doclet:classes > Task :solr-missing-doclet:jar > Task :solr:solrj:generatePomFileForJarsPublication > Task :solr:modules:hadoop-auth:processResources NO-SOURCE > Task :solr:prometheus-exporter:generatePomFileForJarsPublication > Task :solr:modules:hdfs:processResources NO-SOURCE > Task :solr:modules:clustering:generatePomFileForJarsPublication > Task :solr:modules:jaegertracer-configurator:processResources NO-SOURCE > Task :solr:modules:analytics:generatePomFileForJarsPublication > Task :solr:modules:jwt-auth:processResources NO-SOURCE > Task :solr:modules:analysis-extras:generatePomFileForJarsPublication > Task :solr:modules:langid:processResources > Task :solr:api:compileJava > Task :solr:api:classes > Task :solr:api:jar > Task :solr:api:generateMetadataFileForJarsPublication SKIPPED > Task :solr:cross-dc-manager:generatePomFileForJarsPublication > Task :solr:modules:llm:processResources NO-SOURCE > Task :solr:modules:hdfs:generatePomFileForJarsPublication > Task :solr:modules:ltr:processResources NO-SOURCE > Task :solr:modules:cross-dc:generatePomFileForJarsPublication > Task :solr:modules:opentelemetry:processResources NO-SOURCE > Task :solr:test-framework:generatePomFileForJarsPublication > Task :solr:core:generatePomFileForJarsPublication > Task :solr:modules:s3-repository:processResources NO-SOURCE > Task :solr:modules:jaegertracer-configurator:generatePomFileForJarsPublication > Task :solr:modules:scripting:processResources NO-SOURCE > Task :solr:modules:jwt-auth:generatePomFileForJarsPublication > Task :solr:modules:sql:processResources > Task :solr:modules:langid:generatePomFileForJarsPublication > Task :solr:docker:createBodySnippetDockerfile > Task :solr:docker:createDockerfileLocal > Task :solr:docker:assemblePackaging > Task :solr:webapp:processResources NO-SOURCE > Task :solr:webapp:nodeSetup SKIPPED > Task :solr:webapp:npmSetup SKIPPED > Task :solr:modules:hadoop-auth:generatePomFileForJarsPublication > Task :solr:distribution:prepareGitRev > Task :solr:modules:extraction:generatePomFileForJarsPublication > Task :solr:modules:ltr:generatePomFileForJarsPublication > Task :solr:modules:llm:generatePomFileForJarsPublication > Task :solr:modules:scripting:generatePomFileForJarsPublication > Task :solr:modules:gcs-repository:generatePomFileForJarsPublication > Task :solr:modules:sql:generatePomFileForJarsPublication > Task :solr:modules:opentelemetry:generatePomFileForJarsPublication > Task :solr:modules:s3-repository:generatePomFileForJarsPublication > Task :solr:api:renderJavadoc > Task :solr:api:javadoc SKIPPED > Task :solr:api:javadocJar > Task :solr:api:sourcesJar > Task :solr:api:publishJarsPublicationToBuildRepository > Task :solr:api:resolve SLF4J(W): No SLF4J providers were found. SLF4J(W): Defaulting to no-operation (NOP) logger implementation SLF4J(W): See https://www.slf4j.org/codes.html#noProviders for further details. > Task :solr:webapp:downloadBrowserify npm warn deprecated inflight@1.0.6: This module is not supported, and leaks memory. Do not use it. Check out lru-cache if you want a good and tested way to coalesce async requests by a key value, which is much more comprehensive and powerful. npm warn deprecated glob@7.2.3: Glob versions prior to v9 are no longer supported added 173 packages, and changed 1 package in 23s 38 packages are looking for funding run `npm fund` for details > Task :solr:documentation:changesToHtml > Task :solr:solrj:openApiGenerate Cleaned up output directory /build/solr/src/solr-9.8.0/solr/solrj/build/generated/ before code generation (cleanupOutput set to true). Multiple schemas found in the OAS 'content' section, returning only the first one (application/json) Multiple schemas found in the OAS 'content' section, returning only the first one (application/json) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) ################################################################################ # Thanks for using OpenAPI Generator. # # Please consider donation to help us maintain this project 🙏 # # https://opencollective.com/openapi_generator/donate # ################################################################################ Successfully generated code to /build/solr/src/solr-9.8.0/solr/solrj/build/generated/ > Task :solr:api:buildJSClient allOf with multiple schemas defined. Using only the first one: RoutedAliasProperties allOf with multiple schemas defined. Using only the first one: RoutedAliasProperties > Task :spotlessInternalRegisterDependencies > Task :solr:api:buildJSClient Multiple schemas found in the OAS 'content' section, returning only the first one (application/json) Multiple schemas found in the OAS 'content' section, returning only the first one (application/json) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) ################################################################################ # Thanks for using OpenAPI Generator. # # Please consider donation to help us maintain this project 🙏 # # https://opencollective.com/openapi_generator/donate # ################################################################################ Successfully generated code to /build/solr/src/solr-9.8.0/solr/api/build/generated/js > Task :solr:webapp:syncJSClientSourceCode > Task :solr:solrj:compileJava > Task :solr:webapp:jsClientDownloadDeps > Task :solr:solrj:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:webapp:jsClientDownloadDeps npm warn deprecated inflight@1.0.6: This module is not supported, and leaks memory. Do not use it. Check out lru-cache if you want a good and tested way to coalesce async requests by a key value, which is much more comprehensive and powerful. npm warn deprecated glob@7.2.3: Glob versions prior to v9 are no longer supported npm warn deprecated formidable@1.2.6: Please upgrade to latest, formidable@v2 or formidable@v3! Check these notes: https://bit.ly/2ZEqIau npm warn deprecated @babel/plugin-proposal-optional-chaining@7.21.0: This proposal has been merged to the ECMAScript standard and thus this plugin is no longer maintained. Please use @babel/plugin-transform-optional-chaining instead. npm warn deprecated @babel/plugin-proposal-logical-assignment-operators@7.20.7: This proposal has been merged to the ECMAScript standard and thus this plugin is no longer maintained. Please use @babel/plugin-transform-logical-assignment-operators instead. npm warn deprecated @babel/plugin-proposal-nullish-coalescing-operator@7.18.6: This proposal has been merged to the ECMAScript standard and thus this plugin is no longer maintained. Please use @babel/plugin-transform-nullish-coalescing-operator instead. npm warn deprecated @babel/plugin-proposal-numeric-separator@7.18.6: This proposal has been merged to the ECMAScript standard and thus this plugin is no longer maintained. Please use @babel/plugin-transform-numeric-separator instead. npm warn deprecated @babel/plugin-proposal-export-namespace-from@7.18.9: This proposal has been merged to the ECMAScript standard and thus this plugin is no longer maintained. Please use @babel/plugin-transform-export-namespace-from instead. npm warn deprecated @babel/plugin-proposal-json-strings@7.18.6: This proposal has been merged to the ECMAScript standard and thus this plugin is no longer maintained. Please use @babel/plugin-transform-json-strings instead. npm warn deprecated @babel/plugin-proposal-class-properties@7.18.6: This proposal has been merged to the ECMAScript standard and thus this plugin is no longer maintained. Please use @babel/plugin-transform-class-properties instead. npm warn deprecated glob@7.1.6: Glob versions prior to v9 are no longer supported > Task :solr:prometheus-exporter:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:prometheus-exporter:classes > Task :solr:solrj-zookeeper:compileJava Note: /build/solr/src/solr-9.8.0/solr/solrj-zookeeper/src/java/org/apache/solr/common/cloud/ZkStateReader.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:solrj-zookeeper:classes > Task :solr:prometheus-exporter:jar > Task :solr:prometheus-exporter:generateMetadataFileForJarsPublication SKIPPED > Task :solr:prometheus-exporter:sourcesJar > Task :solr:solrj-zookeeper:jar > Task :solr:solrj-zookeeper:generateMetadataFileForJarsPublication SKIPPED > Task :solr:solrj-zookeeper:sourcesJar > Task :solr:webapp:jsClientDownloadDeps npm warn deprecated superagent@5.3.1: Please upgrade to v9.0.0+ as we have fixed a public vulnerability with formidable dependency. Note that v9.0.0+ requires Node.js v14.18.0+. See https://github.com/ladjs/superagent/pull/1800 for insight. This project is supported and maintained by the team at Forward Email @ https://forwardemail.net > Task :solr:solrj:generatedSpotlessHelper > Task :solr:solrj:generatedSpotless > Task :solr:webapp:jsClientDownloadDeps npm warn deprecated sinon@7.5.0: 16.1.1 > v2_api@9.8.0 prepare > npm run build > v2_api@9.8.0 build > babel src -d dist > Task :solr:solrj-streaming:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:solrj-streaming:classes > Task :solr:solrj-streaming:jar > Task :solr:solrj-streaming:generateMetadataFileForJarsPublication SKIPPED > Task :solr:solrj-streaming:sourcesJar > Task :solr:webapp:jsClientDownloadDeps Successfully compiled 124 files with Babel (17332ms). added 334 packages, and audited 335 packages in 1m 43 packages are looking for funding run `npm fund` for details 4 vulnerabilities (2 moderate, 2 high) To address all issues (including breaking changes), run: npm audit fix --force Run `npm audit` for details. > Task :solr:prometheus-exporter:assemblePackaging > Task :solr:solrj:renderJavadoc > Task :solr:core:compileJava > Task :solr:webapp:jsClientBuild > v2_api@9.8.0 build > babel src -d dist Successfully compiled 124 files with Babel (17528ms). > Task :solr:webapp:generateJsClientBundle npm warn exec The following package was not found and will be installed: browserify@17.0.1 npm warn deprecated inflight@1.0.6: This module is not supported, and leaks memory. Do not use it. Check out lru-cache if you want a good and tested way to coalesce async requests by a key value, which is much more comprehensive and powerful. npm warn deprecated glob@7.2.3: Glob versions prior to v9 are no longer supported > Task :solr:webapp:finalizeJsBundleDir > Task :solr:solrj:classes > Task :solr:solrj:jar > Task :solr:solrj:generateMetadataFileForJarsPublication SKIPPED > Task :solr:solrj:javadoc SKIPPED > Task :solr:solrj:javadocJar > Task :solr:solrj:sourcesJar > Task :solr:solrj:publishJarsPublicationToBuildRepository > Task :solr:solrj-zookeeper:renderJavadoc > Task :solr:solrj-zookeeper:javadoc SKIPPED > Task :solr:solrj-zookeeper:javadocJar > Task :solr:solrj-zookeeper:publishJarsPublicationToBuildRepository > Task :solr:prometheus-exporter:renderJavadoc > Task :solr:prometheus-exporter:javadoc SKIPPED > Task :solr:prometheus-exporter:javadocJar > Task :solr:prometheus-exporter:publishJarsPublicationToBuildRepository > Task :solr:solrj-streaming:renderJavadoc > Task :solr:solrj-streaming:javadoc SKIPPED > Task :solr:solrj-streaming:javadocJar > Task :solr:solrj-streaming:publishJarsPublicationToBuildRepository > Task :solr:core:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:core:classes > Task :solr:core:jar > Task :solr:core:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:extraction:compileJava > Task :solr:test-framework:compileJava > Task :solr:modules:analytics:compileJava > Task :solr:modules:analysis-extras:compileJava > Task :solr:modules:cross-dc:compileJava > Task :solr:modules:clustering:compileJava > Task :solr:modules:hadoop-auth:compileJava > Task :solr:modules:gcs-repository:compileJava > Task :solr:modules:hdfs:compileJava > Task :solr:modules:jaegertracer-configurator:compileJava > Task :solr:core:renderJavadoc > Task :solr:modules:clustering:classes > Task :solr:modules:cross-dc:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:clustering:jar > Task :solr:modules:clustering:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:clustering:sourcesJar > Task :solr:modules:hadoop-auth:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:jaegertracer-configurator:classes > Task :solr:modules:analytics:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:jaegertracer-configurator:jar > Task :solr:modules:jaegertracer-configurator:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:analysis-extras:compileJava Note: /build/solr/src/solr-9.8.0/solr/modules/analysis-extras/src/java/org/apache/solr/schema/ICUCollationField.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:jaegertracer-configurator:sourcesJar > Task :solr:modules:hdfs:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:jwt-auth:compileJava > Task :solr:modules:jwt-auth:classes > Task :solr:modules:jwt-auth:jar > Task :solr:modules:jwt-auth:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:jwt-auth:sourcesJar > Task :solr:modules:analytics:classes > Task :solr:modules:analytics:jar > Task :solr:modules:analytics:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:analytics:sourcesJar > Task :solr:modules:langid:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:llm:compileJava > Task :solr:modules:llm:classes > Task :solr:modules:gcs-repository:compileJava Note: /build/solr/src/solr-9.8.0/solr/modules/gcs-repository/src/java/org/apache/solr/gcs/GCSConfigParser.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:llm:jar > Task :solr:modules:llm:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:llm:sourcesJar > Task :solr:modules:ltr:compileJava Note: {0} uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:ltr:classes > Task :solr:modules:ltr:jar > Task :solr:modules:ltr:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:ltr:sourcesJar > Task :solr:modules:cross-dc:classes > Task :solr:modules:cross-dc:jar > Task :solr:modules:cross-dc:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:cross-dc:sourcesJar > Task :solr:modules:hadoop-auth:classes > Task :solr:modules:hadoop-auth:jar > Task :solr:modules:hadoop-auth:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:hadoop-auth:sourcesJar > Task :solr:modules:analysis-extras:classes > Task :solr:modules:analysis-extras:jar > Task :solr:modules:analysis-extras:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:analysis-extras:sourcesJar > Task :solr:test-framework:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:scripting:compileJava Note: /build/solr/src/solr-9.8.0/solr/modules/scripting/src/java/org/apache/solr/scripting/xslt/XSLTUpdateRequestHandler.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:scripting:classes > Task :solr:modules:scripting:jar > Task :solr:modules:scripting:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:scripting:sourcesJar > Task :solr:webapp:compileJava NO-SOURCE > Task :solr:webapp:classes UP-TO-DATE > Task :solr:modules:extraction:compileJava Note: /build/solr/src/solr-9.8.0/solr/modules/extraction/src/java/org/apache/solr/handler/extraction/ExtractingDocumentLoader.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:opentelemetry:compileJava > Task :solr:modules:s3-repository:compileJava > Task :solr:cross-dc-manager:compileJava > Task :solr:modules:sql:compileJava > Task :solr:webapp:war > Task :solr:server:assemblePackaging > Task :solr:test-framework:classes > Task :solr:test-framework:jar > Task :solr:test-framework:generateMetadataFileForJarsPublication SKIPPED > Task :solr:test-framework:sourcesJar > Task :solr:modules:langid:classes > Task :solr:modules:analytics:assemblePackaging > Task :solr:modules:langid:jar > Task :solr:modules:langid:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:clustering:assemblePackaging > Task :solr:modules:langid:sourcesJar > Task :solr:modules:analysis-extras:assemblePackaging > Task :solr:modules:gcs-repository:classes > Task :solr:modules:gcs-repository:jar > Task :solr:modules:gcs-repository:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:gcs-repository:sourcesJar > Task :solr:cross-dc-manager:compileJava Note: /build/solr/src/solr-9.8.0/solr/cross-dc-manager/src/java/org/apache/solr/crossdc/manager/consumer/Util.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:cross-dc:assemblePackaging > Task :solr:modules:sql:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:jwt-auth:assemblePackaging > Task :solr:modules:langid:assemblePackaging > Task :solr:modules:s3-repository:compileJava Note: /build/solr/src/solr-9.8.0/solr/modules/s3-repository/src/java/org/apache/solr/s3/S3StorageClient.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:hdfs:classes > Task :solr:modules:hdfs:jar > Task :solr:modules:hdfs:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:hdfs:sourcesJar > Task :solr:modules:opentelemetry:classes > Task :solr:modules:opentelemetry:jar > Task :solr:modules:opentelemetry:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:hadoop-auth:assemblePackaging > Task :solr:modules:opentelemetry:sourcesJar > Task :solr:modules:ltr:assemblePackaging > Task :solr:modules:scripting:assemblePackaging > Task :solr:modules:jaegertracer-configurator:assemblePackaging > Task :solr:modules:gcs-repository:assemblePackaging > Task :solr:modules:hdfs:assemblePackaging > Task :solr:cross-dc-manager:classes > Task :solr:cross-dc-manager:jar > Task :solr:cross-dc-manager:generateMetadataFileForJarsPublication SKIPPED > Task :solr:cross-dc-manager:sourcesJar > Task :solr:modules:llm:assemblePackaging > Task :solr:modules:opentelemetry:assemblePackaging > Task :solr:modules:s3-repository:classes > Task :solr:modules:s3-repository:jar > Task :solr:modules:s3-repository:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:s3-repository:sourcesJar > Task :solr:modules:extraction:classes > Task :solr:modules:extraction:jar > Task :solr:modules:extraction:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:extraction:sourcesJar > Task :solr:modules:s3-repository:assemblePackaging > Task :solr:modules:extraction:assemblePackaging > Task :solr:modules:sql:classes > Task :solr:modules:sql:jar > Task :solr:modules:sql:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:sql:sourcesJar > Task :solr:modules:sql:assemblePackaging > Task :solr:documentation:copyDocumentationAssets > Task :solr:documentation:markdownToHtml > Task :solr:documentation:copyChangesToHtmlForMiniSite > Task :solr:documentation:copyMiniDocumentationAssets > Task :solr:documentation:createMiniDocumentationIndex > Task :solr:documentation:documentationMinimal > Task :solr:cross-dc-manager:assemblePackaging > Task :solr:core:javadoc SKIPPED > Task :solr:core:javadocJar > Task :solr:core:sourcesJar > Task :solr:core:publishJarsPublicationToBuildRepository > Task :solr:modules:jaegertracer-configurator:renderJavadoc > Task :solr:modules:jaegertracer-configurator:javadoc SKIPPED > Task :solr:modules:hadoop-auth:renderJavadoc > Task :solr:modules:hadoop-auth:javadoc SKIPPED > Task :solr:modules:jaegertracer-configurator:javadocJar > Task :solr:modules:jaegertracer-configurator:publishJarsPublicationToBuildRepository > Task :solr:modules:hadoop-auth:javadocJar > Task :solr:modules:hadoop-auth:publishJarsPublicationToBuildRepository > Task :solr:modules:clustering:renderJavadoc > Task :solr:modules:clustering:javadoc SKIPPED > Task :solr:modules:clustering:javadocJar > Task :solr:modules:clustering:publishJarsPublicationToBuildRepository > Task :solr:modules:extraction:renderJavadoc > Task :solr:modules:extraction:javadoc SKIPPED > Task :solr:modules:extraction:javadocJar > Task :solr:modules:analysis-extras:renderJavadoc > Task :solr:modules:analysis-extras:javadoc SKIPPED > Task :solr:modules:extraction:publishJarsPublicationToBuildRepository > Task :solr:modules:analysis-extras:javadocJar > Task :solr:modules:analysis-extras:publishJarsPublicationToBuildRepository > Task :solr:modules:gcs-repository:renderJavadoc > Task :solr:modules:gcs-repository:javadoc SKIPPED > Task :solr:modules:gcs-repository:javadocJar > Task :solr:modules:gcs-repository:publishJarsPublicationToBuildRepository > Task :solr:modules:jwt-auth:renderJavadoc > Task :solr:modules:jwt-auth:javadoc SKIPPED > Task :solr:modules:jwt-auth:javadocJar > Task :solr:modules:jwt-auth:publishJarsPublicationToBuildRepository > Task :solr:core:assemblePostJar > Task :solr:example:assemblePackaging > Task :solr:modules:cross-dc:renderJavadoc > Task :solr:modules:hdfs:renderJavadoc > Task :solr:modules:cross-dc:javadoc SKIPPED > Task :solr:modules:cross-dc:javadocJar > Task :solr:modules:cross-dc:publishJarsPublicationToBuildRepository > Task :solr:modules:hdfs:javadoc SKIPPED > Task :solr:modules:hdfs:javadocJar > Task :solr:modules:hdfs:publishJarsPublicationToBuildRepository > Task :solr:test-framework:renderJavadoc > Task :solr:modules:analytics:renderJavadoc > Task :solr:modules:langid:renderJavadoc > Task :solr:modules:langid:javadoc SKIPPED > Task :solr:modules:llm:renderJavadoc > Task :solr:modules:llm:javadoc SKIPPED > Task :solr:modules:opentelemetry:renderJavadoc > Task :solr:modules:opentelemetry:javadoc SKIPPED > Task :solr:modules:langid:javadocJar > Task :solr:modules:llm:javadocJar > Task :solr:modules:opentelemetry:javadocJar > Task :solr:modules:llm:publishJarsPublicationToBuildRepository > Task :solr:modules:opentelemetry:publishJarsPublicationToBuildRepository > Task :solr:modules:langid:publishJarsPublicationToBuildRepository > Task :solr:modules:analytics:javadoc SKIPPED > Task :solr:modules:ltr:renderJavadoc > Task :solr:modules:ltr:javadoc SKIPPED > Task :solr:modules:ltr:javadocJar > Task :solr:modules:ltr:publishJarsPublicationToBuildRepository > Task :solr:modules:scripting:renderJavadoc > Task :solr:modules:scripting:javadoc SKIPPED > Task :solr:modules:scripting:javadocJar > Task :solr:modules:scripting:publishJarsPublicationToBuildRepository > Task :solr:modules:analytics:javadocJar > Task :solr:modules:s3-repository:renderJavadoc > Task :solr:modules:s3-repository:javadoc SKIPPED > Task :solr:modules:s3-repository:javadocJar > Task :solr:modules:s3-repository:publishJarsPublicationToBuildRepository > Task :solr:modules:analytics:publishJarsPublicationToBuildRepository > Task :solr:modules:sql:renderJavadoc > Task :solr:modules:sql:javadoc SKIPPED > Task :solr:modules:sql:javadocJar > Task :solr:modules:sql:publishJarsPublicationToBuildRepository > Task :solr:cross-dc-manager:renderJavadoc > Task :solr:cross-dc-manager:javadoc SKIPPED > Task :solr:cross-dc-manager:javadocJar > Task :solr:cross-dc-manager:publishJarsPublicationToBuildRepository > Task :solr:test-framework:javadoc SKIPPED > Task :solr:test-framework:javadocJar > Task :solr:test-framework:publishJarsPublicationToBuildRepository > Task :mavenToLocalFolder Local maven artifacts (poms, jars) created at: /build/solr/src/solr-9.8.0/build/maven-local > Task :solr:packaging:fullDistTar > Task :solr:packaging:slimDistTar > Task :solr:docker:createDockerfileOfficialFull > Task :solr:docker:createDockerfileOfficialSlim > Task :solr:distribution:computeChecksums > Task :solr:distribution:assembleRelease BUILD SUCCESSFUL in 24m 59s 241 actionable tasks: 240 executed, 1 up-to-date install: creating directory '/build/solr/src/solr-9.8.0/dist' ==> Starting check()... > Task :buildSrc:compileJava UP-TO-DATE > Task :buildSrc:compileGroovy NO-SOURCE > Task :buildSrc:processResources NO-SOURCE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :solr:api:processResources NO-SOURCE > Task :solr:cross-dc-manager:processResources NO-SOURCE > Task :solr:solrj-zookeeper:processResources NO-SOURCE > Task :solr:prometheus-exporter:processResources NO-SOURCE > Task :solr:modules:cross-dc:processResources NO-SOURCE > Task :solr:modules:analysis-extras:processResources NO-SOURCE > Task :solr:solr-ref-guide:processResources NO-SOURCE > Task :solr:core:processResources UP-TO-DATE > Task :solr:test-framework:processResources UP-TO-DATE > Task :gitStatus > Task :errorProneSkipped WARNING: errorprone disabled (skipped on builds not running inside CI environments, pass -Pvalidation.errorprone=true to enable) > Task :ensureJdkSupported > Task :randomizationInfo Running tests with randomization seed: tests.seed=E3003B68FEA969F8 > Task :solr:solrj:processResources UP-TO-DATE > Task :solr:solrj-streaming:processResources UP-TO-DATE > Task :solr:server:processResources NO-SOURCE > Task :solr:modules:sql:processResources UP-TO-DATE > Task :solr:server:compileJava SKIPPED > Task :solr:server:classes UP-TO-DATE > Task :solr:webapp:processResources NO-SOURCE > Task :solr:api:processTestResources > Task :solr:solrj-zookeeper:processTestResources > Task :solr:server:compileTestJava NO-SOURCE > Task :solr:server:processTestResources NO-SOURCE > Task :solr:server:testClasses UP-TO-DATE > Task :solr:benchmark:processResources > Task :solr:solr-ref-guide:copySolrjTestResources > Task :solr:solrj:processTestResources > Task :solr:webapp:processTestResources NO-SOURCE > Task :solr:server:test NO-SOURCE > Task :solr:solr-ref-guide:compileJava NO-SOURCE > Task :solr:modules:analytics:processResources NO-SOURCE > Task :solr:modules:clustering:processResources NO-SOURCE > Task :solr:solr-ref-guide:classes UP-TO-DATE > Task :solr:prometheus-exporter:processTestResources > Task :solr:cross-dc-manager:processTestResources > Task :solr:solrj-streaming:processTestResources > Task :solr:benchmark:processTestResources > Task :solr:test-framework:processTestResources > Task :solr:modules:extraction:processResources UP-TO-DATE > Task :solr:solr-ref-guide:processTestResources NO-SOURCE > Task :solr:server:wipeTaskTemp > Task :solr:modules:hadoop-auth:processResources NO-SOURCE > Task :solr:modules:jwt-auth:processResources NO-SOURCE > Task :solr:modules:gcs-repository:processResources NO-SOURCE > Task :solr:api:compileJava UP-TO-DATE > Task :solr:api:classes UP-TO-DATE > Task :solr:modules:gcs-repository:processTestResources > Task :solr:modules:hdfs:processResources NO-SOURCE > Task :solr:modules:jaegertracer-configurator:processResources NO-SOURCE > Task :solr:api:jar UP-TO-DATE > Task :solr:modules:langid:processResources UP-TO-DATE > Task :solr:modules:jwt-auth:processTestResources > Task :solr:modules:llm:processResources NO-SOURCE > Task :solr:modules:analysis-extras:processTestResources > Task :solr:modules:cross-dc:processTestResources > Task :solr:modules:extraction:processTestResources > Task :solr:modules:opentelemetry:processResources NO-SOURCE > Task :solr:modules:ltr:processResources NO-SOURCE > Task :solr:modules:s3-repository:processResources NO-SOURCE > Task :solr:modules:clustering:processTestResources > Task :solr:modules:langid:processTestResources > Task :solr:modules:jaegertracer-configurator:processTestResources > Task :solr:modules:scripting:processResources NO-SOURCE > Task :solr:modules:analytics:processTestResources > Task :solr:modules:llm:processTestResources > Task :solr:modules:s3-repository:processTestResources > Task :solr:api:resolve UP-TO-DATE > Task :solr:modules:opentelemetry:processTestResources > Task :solr:modules:scripting:processTestResources > Task :solr:modules:ltr:processTestResources > Task :solr:modules:hadoop-auth:copySolrCoreTestResources > Task :solr:modules:hdfs:copySolrCoreTestResources > Task :solr:core:processTestResources > Task :solr:modules:sql:copySolrCoreTestResources > Task :solr:solrj:openApiGenerate Cleaned up output directory /build/solr/src/solr-9.8.0/solr/solrj/build/generated/ before code generation (cleanupOutput set to true). > Task :solr:modules:hadoop-auth:processTestResources > Task :solr:modules:hdfs:processTestResources > Task :solr:modules:sql:processTestResources > Task :solr:solrj:openApiGenerate Multiple schemas found in the OAS 'content' section, returning only the first one (application/json) Multiple schemas found in the OAS 'content' section, returning only the first one (application/json) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) Multiple schemas found in the OAS 'content' section, returning only the first one (application/vnd.apache.solr.raw) ################################################################################ # Thanks for using OpenAPI Generator. # # Please consider donation to help us maintain this project 🙏 # # https://opencollective.com/openapi_generator/donate # ################################################################################ Successfully generated code to /build/solr/src/solr-9.8.0/solr/solrj/build/generated/ > Task :spotlessInternalRegisterDependencies UP-TO-DATE > Task :solr:solrj:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:solrj-zookeeper:compileJava UP-TO-DATE > Task :solr:prometheus-exporter:compileJava UP-TO-DATE > Task :solr:solrj-streaming:compileJava UP-TO-DATE > Task :solr:solrj-zookeeper:classes UP-TO-DATE > Task :solr:prometheus-exporter:classes UP-TO-DATE > Task :solr:solrj-streaming:classes UP-TO-DATE > Task :solr:solrj-zookeeper:jar UP-TO-DATE > Task :solr:solrj-streaming:jar UP-TO-DATE > Task :solr:core:compileJava UP-TO-DATE > Task :solr:core:classes UP-TO-DATE > Task :solr:modules:clustering:compileJava UP-TO-DATE > Task :solr:modules:clustering:classes UP-TO-DATE > Task :solr:core:jar UP-TO-DATE > Task :solr:modules:hdfs:compileJava UP-TO-DATE > Task :solr:modules:hdfs:classes UP-TO-DATE > Task :solr:modules:hadoop-auth:compileJava UP-TO-DATE > Task :solr:modules:hadoop-auth:classes UP-TO-DATE > Task :solr:test-framework:compileJava UP-TO-DATE > Task :solr:modules:analysis-extras:compileJava UP-TO-DATE > Task :solr:modules:jwt-auth:compileJava UP-TO-DATE > Task :solr:test-framework:classes UP-TO-DATE > Task :solr:modules:cross-dc:compileJava UP-TO-DATE > Task :solr:modules:analytics:compileJava UP-TO-DATE > Task :solr:modules:jaegertracer-configurator:compileJava UP-TO-DATE > Task :solr:modules:analysis-extras:classes UP-TO-DATE > Task :solr:modules:cross-dc:classes UP-TO-DATE > Task :solr:modules:gcs-repository:compileJava UP-TO-DATE > Task :solr:test-framework:jar UP-TO-DATE > Task :solr:modules:cross-dc:jar UP-TO-DATE > Task :solr:modules:analysis-extras:jar UP-TO-DATE > Task :solr:modules:langid:compileJava UP-TO-DATE > Task :solr:modules:sql:compileJava UP-TO-DATE > Task :solr:modules:sql:classes UP-TO-DATE > Task :solr:cross-dc-manager:compileJava UP-TO-DATE > Task :solr:cross-dc-manager:classes UP-TO-DATE > Task :solr:modules:extraction:compileJava UP-TO-DATE > Task :solr:modules:sql:jar UP-TO-DATE > Task :solr:modules:analytics:classes UP-TO-DATE > Task :solr:api:compileTestJava > Task :solr:api:testClasses > Task :solr:prometheus-exporter:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:prometheus-exporter:testClasses > Task :solr:solr-ref-guide:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:solr-ref-guide:testClasses > Task :solr:modules:extraction:classes UP-TO-DATE > Task :solr:solrj-zookeeper:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:solrj-zookeeper:testClasses > Task :solr:modules:gcs-repository:classes UP-TO-DATE > Task :solr:test-framework:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:clustering:compileTestJava > Task :solr:modules:clustering:testClasses > Task :solr:test-framework:testClasses > Task :solr:solrj:generatedSpotlessHelper > Task :solr:benchmark:compileJava > Task :solr:core:compileTestJava > Task :solr:solrj-streaming:compileTestJava > Task :solr:cross-dc-manager:compileTestJava > Task :solr:modules:analysis-extras:compileTestJava > Task :solr:modules:analytics:compileTestJava > Task :solr:modules:gcs-repository:compileTestJava Note: /build/solr/src/solr-9.8.0/solr/modules/gcs-repository/src/test/org/apache/solr/gcs/ConcurrentDelegatingStorage.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:gcs-repository:testClasses > Task :solr:modules:jaegertracer-configurator:classes UP-TO-DATE > Task :solr:modules:extraction:compileTestJava Note: /build/solr/src/solr-9.8.0/solr/modules/extraction/src/test/org/apache/solr/handler/extraction/ExtractingRequestHandlerTest.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:solrj:generatedSpotless > Task :solr:solrj:classes > Task :solr:solrj:jar UP-TO-DATE > Task :solr:modules:analysis-extras:compileTestJava Note: /build/solr/src/solr-9.8.0/solr/modules/analysis-extras/src/test/org/apache/solr/schema/TestICUCollationFieldUDVAS.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:cross-dc:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:jaegertracer-configurator:compileTestJava > Task :solr:cross-dc-manager:compileTestJava Note: /build/solr/src/solr-9.8.0/solr/cross-dc-manager/src/test/org/apache/solr/crossdc/manager/messageprocessor/TestMessageProcessor.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:hadoop-auth:compileTestJava > Task :solr:modules:hdfs:compileTestJava > Task :solr:api:test > Task :solr:prometheus-exporter:test > Task :solr:solr-ref-guide:test > Task :solr:modules:hadoop-auth:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:cross-dc-manager:testClasses > Task :solr:modules:analytics:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:webapp:compileJava NO-SOURCE > Task :solr:webapp:classes UP-TO-DATE > Task :solr:webapp:compileTestJava NO-SOURCE > Task :solr:webapp:testClasses UP-TO-DATE > Task :solr:webapp:test NO-SOURCE > Task :solr:webapp:wipeTaskTemp > Task :solr:modules:analysis-extras:testClasses > Task :solr:solrj-zookeeper:test > Task :solr:solrj:compileTestJava > Task :solr:test-framework:test > Task :solr:cross-dc-manager:test > Task :solr:modules:analysis-extras:test > Task :solr:modules:hdfs:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:solrj-streaming:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:solrj-streaming:testClasses > Task :solr:benchmark:compileJava Note: /build/solr/src/solr-9.8.0/solr/benchmark/src/java/org/apache/solr/bench/search/StreamingSearch.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:benchmark:classes > Task :solr:benchmark:compileTestJava > Task :solr:benchmark:testClasses > Task :solr:modules:analytics:testClasses > Task :solr:solrj:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:solrj:testClasses > Task :solr:solrj-streaming:test > Task :solr:benchmark:test > Task :solr:modules:analytics:test > Task :solr:solrj:test > Task :solr:core:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:core:testClasses > Task :solr:core:test > Task :solr:api:test :solr:api:test (SUCCESS): 6 test(s) > Task :solr:api:wipeTaskTemp > Task :solr:modules:clustering:test :solr:modules:clustering:test (SUCCESS): 15 test(s) > Task :solr:solr-ref-guide:test :solr:solr-ref-guide:test (SUCCESS): 32 test(s) > Task :solr:modules:clustering:wipeTaskTemp > Task :solr:modules:cross-dc:testClasses > Task :solr:benchmark:test :solr:benchmark:test (SUCCESS): 11 test(s) > Task :solr:modules:cross-dc:test > Task :solr:modules:analytics:test :solr:modules:analytics:test (SUCCESS): 472 test(s) > Task :solr:benchmark:wipeTaskTemp > Task :solr:modules:extraction:testClasses > Task :solr:modules:extraction:test > Task :solr:cross-dc-manager:test :solr:cross-dc-manager:test (SUCCESS): 37 test(s), 7 skipped > Task :solr:prometheus-exporter:test :solr:prometheus-exporter:test (SUCCESS): 23 test(s) > Task :solr:modules:cross-dc:test :solr:modules:cross-dc:test (SUCCESS): 26 test(s) > Task :solr:modules:cross-dc:wipeTaskTemp > Task :solr:prometheus-exporter:wipeTaskTemp > Task :solr:modules:hadoop-auth:testClasses > Task :solr:modules:gcs-repository:test > Task :solr:modules:hadoop-auth:test > Task :solr:solrj-streaming:test :solr:solrj-streaming:test (SUCCESS): 609 test(s), 3 skipped > Task :solr:core:test UnloadDistributedZkTest > test FAILED org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46399: ADDREPLICA failed to create replica at __randomizedtesting.SeedInfo.seed([E3003B68FEA969F8:6B5404B250550400]:0) at app//org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:729) at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:264) at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:243) at app//org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:574) at app//org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:511) at app//org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:475) at app//org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1200) at app//org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:898) at app//org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:826) at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:279) at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:295) at app//org.apache.solr.cloud.AbstractUnloadDistributedZkTestBase.testCoreUnloadAndLeaders(AbstractUnloadDistributedZkTestBase.java:270) at app//org.apache.solr.cloud.AbstractUnloadDistributedZkTestBase.test(AbstractUnloadDistributedZkTestBase.java:78) at java.base@11.0.26/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base@11.0.26/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base@11.0.26/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base@11.0.26/java.lang.reflect.Method.invoke(Method.java:566) at app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) at app//com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) at app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) at app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) at app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1154) at app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1125) at app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) at app//org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at app//org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) at app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) at app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) at app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at app//org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at app//org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) at app//org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) at java.base@11.0.26/java.lang.Thread.run(Thread.java:829) org.apache.solr.cloud.UnloadDistributedZkTest > test suite's output saved to /build/solr/src/solr-9.8.0/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.UnloadDistributedZkTest.txt, copied below: 2> 418937 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/build/solr/src/solr-9.8.0/solr/server/solr/configsets/_default/conf' 2> 418940 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom 2> 418946 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-30 after mutting 0 log messages 2> 418947 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-31 for ERROR logs matching regex: ignore_exception 2> 418956 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.SolrTestCaseJ4 Created dataDir: /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/data-dir-15-001 2> 418959 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true 2> 418964 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776") 2> 418965 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: / 2> 419018 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-31 after mutting 0 log messages 2> 419019 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-32 for ERROR logs matching regex: ignore_exception 2> 419024 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER 2> 419025 INFO (ZkTestServer Run Thread) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer client port: /127.0.0.1:0 2> 419026 INFO (ZkTestServer Run Thread) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer Starting server 2> 419033 WARN (ZkTestServer Run Thread) [n: c: s: r: x: t:] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. 2> 419125 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer start zk server on port: 42247 2> 419131 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 419138 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 419150 INFO (zkCallback-1821-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 419151 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 419151 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 419158 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 419164 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 419172 INFO (zkCallback-1823-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 419173 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 419173 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 419181 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml 2> 419190 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml 2> 419201 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml 2> 419210 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt 2> 419219 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt 2> 419228 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml 2> 419238 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml 2> 419247 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json 2> 419256 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt 2> 419265 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt 2> 419274 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer put /build/solr/src/solr-9.8.0/solr/core/build/resources/test/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt 2> 419284 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise 2> 421580 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0) 2> 421584 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ... 2> 421591 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.e.j.s.Server jetty-10.0.22; built: 2024-06-27T16:03:51.502Z; git: 5c8471e852d377fd726ad9b1692c35ffc5febb09; jvm 11.0.26+4 2> 421636 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.e.j.s.s.DefaultSessionIdManager Session workerName=node0 2> 421661 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/tempDir-001/control/data, hostPort=37255, coreRootDirectory=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/../../../../../../../../../build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/control-001/cores} 2> 421668 ERROR (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. 2> 421671 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2> 421673 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.8.0 2> 421675 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port null 2> 421676 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /build/solr/src/solr-9.8.0/solr 2> 421677 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2025-02-18T19:11:21.349737Z 2> 421693 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/control-001 (source: servlet config: solr.solr.home) 2> 421702 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 421720 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 421734 INFO (zkCallback-1825-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 421735 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 421735 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 421844 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2> 421845 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/control-001/solr.xml 2> 425294 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled. 2> 425500 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42247/solr 2> 425506 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 425533 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 425544 INFO (zkCallback-1838-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 425545 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 425546 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 425659 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 425676 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 425685 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 425686 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 425858 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2> 425902 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 425926 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37255_ 2> 425934 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.Overseer Overseer (id=72273000262598660-127.0.0.1:37255_-n_0000000000) starting 2> 426006 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:37255_ 2> 426009 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37255_ 2> 426021 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2> 426060 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2> 426793 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/control-001/cores 2> 427678 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 427968 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a1312b9{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,AVAILABLE} 2> 428012 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@411ff717{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:37255} 2> 428016 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n:127.0.0.1:37255_ c: s: r: x: t:] o.e.j.s.Server Started Server@c3ccffd{STARTING}[10.0.22,sto=0] @428230ms 2> 428095 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 428112 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 428123 INFO (zkCallback-1852-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 428123 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 428123 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 428131 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2> 428143 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42247/solr ready 2> 428224 INFO (OverseerThreadFactory-1846-thread-1) [n: c:control_collection s: r: x: t:] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection 2> 428243 INFO (OverseerThreadFactory-1846-thread-1) [n: c:control_collection s: r: x: t:] o.a.s.c.c.ZkStateReader /collections/control_collection/state.json is deleted, stop watching children 2> 428255 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/control_collection/state.json zxid: 149] for collection [control_collection] has occurred - updating... (live nodes size: [1]) 2> 428293 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2> "core":"control_collection_shard1_replica_n1", 2> "node_name":"127.0.0.1:37255_", 2> "base_url":"http://127.0.0.1:37255", 2> "collection":"control_collection", 2> "shard":"shard1", 2> "state":"down", 2> "type":"NRT", 2> "operation":"ADDREPLICA", 2> "waitForFinalState":"false"} 2> 428409 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json zxid: 155] for collection [control_collection] has occurred - updating... (live nodes size: [1]) 2> 428440 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c: s: r: x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=control_collection&version=2&replicaType=NRT&coreNodeName=core_node2&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin 2> 428530 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.11.1 2> 428582 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.s.IndexSchema Schema name=test 2> 428760 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id 2> 428916 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true 2> 428921 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.SolrCore Opening new SolrCore at [/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/control-001/cores/control_collection_shard1_replica_n1/data/] 2> 428937 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.45309530795817154] 2> 428964 WARN (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}} 2> 429349 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 429392 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2> 429393 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2> 429393 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.u.CommitTracker Hard AutoCommit: disabled 2> 429393 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.u.CommitTracker Soft AutoCommit: disabled 2> 429414 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.27249031949539704] 2> 429430 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 2> 429433 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 2> 429437 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2> 429468 INFO (searcherExecutor-1856-thread-1-processing-control_collection_shard1_replica_n1 null-1224 core_node2 127.0.0.1:37255_ control_collection shard1) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 429471 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0} for registerTerm 2> 429472 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1 2> 429499 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2> 429499 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2> 429499 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37255/control_collection_shard1_replica_n1/ 2> 429501 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2> 429503 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.SyncStrategy http://127.0.0.1:37255/control_collection_shard1_replica_n1/ has no replicas 2> 429504 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72273000262598660-core_node2-n_0000000000 2> 429522 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37255/control_collection_shard1_replica_n1/ shard1 2> 429633 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json zxid: 173] for collection [control_collection] has occurred - updating... (live nodes size: [1]) 2> 429640 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:null-1224] o.a.s.c.ZkController I am the leader, no recovery necessary 2> 429662 INFO (qtp835107587-3252-null-1224) [n:127.0.0.1:37255_ c: s: r: x: t:null-1224] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1225 2> 429686 INFO (qtp835107587-3249-null-1223) [n:127.0.0.1:37255_ c:control_collection s: r: x: t:null-1223] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas 2> 429756 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json zxid: 179] for collection [control_collection] has occurred - updating... (live nodes size: [1]) 2> 429762 INFO (qtp835107587-3249-null-1223) [n:127.0.0.1:37255_ c:control_collection s: r: x: t:null-1223] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37255_&wt=javabin&version=2} status=0 QTime=1566 2> 429797 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection 2> 429921 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 429927 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 429937 INFO (zkCallback-1863-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 429937 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 429938 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 429944 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2> 429954 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42247/solr ready 2> 429957 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false 2> 429987 INFO (OverseerThreadFactory-1846-thread-2) [n: c:collection1 s: r: x: t:] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1 2> 429991 INFO (OverseerCollectionConfigSetProcessor-72273000262598660-127.0.0.1:37255_-n_0000000000) [n: c: s: r: x: t:] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper 2> 430008 INFO (OverseerThreadFactory-1846-thread-2) [n: c:collection1 s: r: x: t:] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children 2> 430119 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/collection1/state.json zxid: 188] for collection [collection1] has occurred - updating... (live nodes size: [1]) 2> 430124 WARN (OverseerThreadFactory-1846-thread-2) [n: c:collection1 s: r: x: t:] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores. 2> 430132 INFO (qtp835107587-3251-null-1225) [n:127.0.0.1:37255_ c:collection1 s: r: x: t:null-1225] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas 2> 430136 INFO (qtp835107587-3251-null-1225) [n:127.0.0.1:37255_ c:collection1 s: r: x: t:null-1225] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2} status=0 QTime=172 2> 430151 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.SolrCloudTestCase active slice count: 1 expected: 1 2> 430151 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0 2> 430151 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=4 2> 432012 INFO (OverseerCollectionConfigSetProcessor-72273000262598660-127.0.0.1:37255_-n_0000000000) [n: c: s: r: x: t:] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper 2> 432063 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-1-001 of type NRT for shard1 2> 432100 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0) 2> 432101 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ... 2> 432103 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.e.j.s.Server jetty-10.0.22; built: 2024-06-27T16:03:51.502Z; git: 5c8471e852d377fd726ad9b1692c35ffc5febb09; jvm 11.0.26+4 2> 432134 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.e.j.s.s.DefaultSessionIdManager Session workerName=node0 2> 432154 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/tempDir-001/jetty1, hostPort=42863, coreRootDirectory=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/../../../../../../../../../build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-1-001/cores, replicaType=NRT} 2> 432158 ERROR (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. 2> 432161 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2> 432163 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.8.0 2> 432163 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port null 2> 432163 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /build/solr/src/solr-9.8.0/solr 2> 432164 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2025-02-18T19:11:31.836006Z 2> 432167 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-1-001 (source: servlet config: solr.solr.home) 2> 432170 WARN (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 432183 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 432202 INFO (zkCallback-1867-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 432203 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 432203 WARN (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 432311 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2> 432312 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-1-001/solr.xml 2> 433656 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42247/solr 2> 433658 WARN (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 433672 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 433684 INFO (zkCallback-1880-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 433684 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 433685 WARN (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 433793 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 433805 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 433813 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 433813 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 433870 WARN (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2> 433880 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2> 433904 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 433922 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.c.ZkController Publish node=127.0.0.1:42863_ as DOWN 2> 433942 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42863_ 2> 433955 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2> 433955 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2> 433955 INFO (zkCallback-1863-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) 2> 434060 WARN (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2> 434488 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-2-001 of type NRT for shard1 2> 434552 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0) 2> 434556 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ... 2> 434558 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.e.j.s.Server jetty-10.0.22; built: 2024-06-27T16:03:51.502Z; git: 5c8471e852d377fd726ad9b1692c35ffc5febb09; jvm 11.0.26+4 2> 434599 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.e.j.s.s.DefaultSessionIdManager Session workerName=node0 2> 434620 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/tempDir-001/jetty2, hostPort=46467, coreRootDirectory=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/../../../../../../../../../build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-2-001/cores, replicaType=NRT} 2> 434622 ERROR (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. 2> 434624 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2> 434626 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.8.0 2> 434627 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port null 2> 434627 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /build/solr/src/solr-9.8.0/solr 2> 434627 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2025-02-18T19:11:34.299875Z 2> 434636 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-2-001 (source: servlet config: solr.solr.home) 2> 434643 WARN (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 434659 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 434676 INFO (zkCallback-1888-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 434677 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 434677 WARN (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 434773 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-1-001/cores 2> 434786 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2> 434787 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-2-001/solr.xml 2> 435274 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 435476 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@70792755{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,AVAILABLE} 2> 435479 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@1205fdbf{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:42863} 2> 435481 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.e.j.s.Server Started Server@621a0d35{STARTING}[10.0.22,sto=0] @435695ms 2> 435481 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:42863_ 2> 436727 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-3-001 of type NRT for shard1 2> 436736 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0) 2> 436737 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ... 2> 436737 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.e.j.s.Server jetty-10.0.22; built: 2024-06-27T16:03:51.502Z; git: 5c8471e852d377fd726ad9b1692c35ffc5febb09; jvm 11.0.26+4 2> 436758 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.e.j.s.s.DefaultSessionIdManager Session workerName=node0 2> 436764 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/tempDir-001/jetty3, hostPort=38065, coreRootDirectory=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/../../../../../../../../../build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-3-001/cores, replicaType=NRT} 2> 436765 ERROR (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. 2> 436766 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2> 436766 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.8.0 2> 436766 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port null 2> 436767 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /build/solr/src/solr-9.8.0/solr 2> 436767 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2025-02-18T19:11:36.439299Z 2> 436768 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-3-001 (source: servlet config: solr.solr.home) 2> 436770 WARN (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 436779 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 436789 INFO (zkCallback-1894-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 436789 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 436790 WARN (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 436896 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2> 436897 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-3-001/solr.xml 2> 437326 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42247/solr 2> 437328 WARN (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 437340 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 437352 INFO (zkCallback-1907-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 437352 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 437353 WARN (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 437460 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 437472 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 437481 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 437481 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 437533 WARN (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2> 437540 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) 2> 437557 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 437604 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.c.ZkController Publish node=127.0.0.1:46467_ as DOWN 2> 437631 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46467_ 2> 437640 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2> 437640 INFO (zkCallback-1863-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2> 437641 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2> 437641 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) 2> 437657 WARN (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2> 438394 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-2-001/cores 2> 438884 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-4-001 of type NRT for shard1 2> 438899 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0) 2> 438900 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ... 2> 438900 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.e.j.s.Server jetty-10.0.22; built: 2024-06-27T16:03:51.502Z; git: 5c8471e852d377fd726ad9b1692c35ffc5febb09; jvm 11.0.26+4 2> 438926 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.e.j.s.s.DefaultSessionIdManager Session workerName=node0 2> 438946 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/tempDir-001/jetty4, hostPort=46399, coreRootDirectory=/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/../../../../../../../../../build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-4-001/cores, replicaType=NRT} 2> 438948 ERROR (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. 2> 438951 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2> 438952 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 9.8.0 2> 438952 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port null 2> 438953 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /build/solr/src/solr-9.8.0/solr 2> 438953 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2025-02-18T19:11:38.625631Z 2> 438955 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.s.CoreContainerProvider Solr Home: /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-4-001 (source: servlet config: solr.solr.home) 2> 438957 WARN (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 438990 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 438995 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 439012 INFO (zkCallback-1916-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 439013 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 439013 WARN (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 439121 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.NodeConfig Loading solr.xml from SolrHome (not found in ZooKeeper) 2> 439122 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.SolrXmlConfig Loading solr.xml from /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-4-001/solr.xml 2> 439341 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3d73659c{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,AVAILABLE} 2> 439393 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@3df78990{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:46467} 2> 439397 INFO (closeThreadPool-1866-thread-2) [n:127.0.0.1:46467_ c: s: r: x: t:] o.e.j.s.Server Started Server@712ec6a7{STARTING}[10.0.22,sto=0] @439611ms 2> 439412 INFO (closeThreadPool-1866-thread-2) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:46467_ 2> 441945 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42247/solr 2> 441946 WARN (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 441956 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 441974 INFO (zkCallback-1929-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 441975 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 441975 WARN (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 442084 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 442093 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 442101 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 442102 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 442143 WARN (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2> 442150 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) 2> 442164 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 442176 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.c.ZkController Publish node=127.0.0.1:46399_ as DOWN 2> 442187 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46399_ 2> 442196 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) 2> 442197 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) 2> 442197 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) 2> 442197 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) 2> 442197 INFO (zkCallback-1863-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) 2> 442217 WARN (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2> 442779 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-4-001/cores 2> 443201 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 443389 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a1a041e{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,AVAILABLE} 2> 443391 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@23bac7b3{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:46399} 2> 443392 INFO (closeThreadPool-1866-thread-3) [n:127.0.0.1:46399_ c: s: r: x: t:] o.e.j.s.Server Started Server@2e61ca9c{STARTING}[10.0.22,sto=0] @443607ms 2> 443393 INFO (closeThreadPool-1866-thread-3) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:46399_ 2> 443576 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42247/solr 2> 443577 WARN (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 443588 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 443597 INFO (zkCallback-1946-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 443597 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 443598 WARN (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 443705 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 443717 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 443726 INFO (zkCallback-1948-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 443726 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 443771 WARN (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2> 443778 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4) 2> 443796 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 443811 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.c.ZkController Publish node=127.0.0.1:38065_ as DOWN 2> 443825 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38065_ 2> 443832 INFO (zkCallback-1863-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) 2> 443832 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) 2> 443833 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) 2> 443833 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) 2> 443834 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) 2> 443834 INFO (zkCallback-1948-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) 2> 443848 WARN (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2> 444465 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-3-001/cores 2> 444905 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 445088 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3f290ef8{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,AVAILABLE} 2> 445091 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@617b86b1{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:38065} 2> 445092 INFO (closeThreadPool-1866-thread-1) [n:127.0.0.1:38065_ c: s: r: x: t:] o.e.j.s.Server Started Server@5241f34b{STARTING}[10.0.22,sto=0] @445307ms 2> 445093 INFO (closeThreadPool-1866-thread-1) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:38065_ 2> 445160 INFO (OverseerThreadFactory-1846-thread-3) [n: c:collection1 s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:46399_ for creating new replica of shard shard1 for collection collection1 2> 445173 INFO (OverseerThreadFactory-1846-thread-3) [n: c:collection1 s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command. 2> 445185 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2> "core":"collection1_shard1_replica_n1", 2> "node_name":"127.0.0.1:46399_", 2> "base_url":"http://127.0.0.1:46399", 2> "collection":"collection1", 2> "shard":"shard1", 2> "state":"down", 2> "type":"NRT", 2> "operation":"addreplica"} 2> 445200 INFO (zkCallback-1840-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 243] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 445219 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c: s: r: x:collection1_shard1_replica_n1 t:null-1231] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT 2> 445294 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.11.1 2> 445346 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.s.IndexSchema Schema name=test 2> 445519 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id 2> 445657 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from configset conf1, trusted=true 2> 445662 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.SolrCore Opening new SolrCore at [/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-4-001/cores/collection1_shard1_replica_n1], dataDir=[/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-4-001/cores/collection1_shard1_replica_n1/data/] 2> 445677 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.45309530795817154] 2> 445694 WARN (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}} 2> 446100 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 446140 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2> 446141 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2> 446141 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.u.CommitTracker Hard AutoCommit: disabled 2> 446141 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.u.CommitTracker Soft AutoCommit: disabled 2> 446171 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.27249031949539704] 2> 446195 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 2> 446197 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 2> 446203 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2> 446236 INFO (searcherExecutor-1958-thread-1-processing-collection1_shard1_replica_n1 null-1231 core_node2 127.0.0.1:46399_ collection1 shard1) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 446239 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node2=0}, version=0} for registerTerm 2> 446240 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 2> 446266 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2> 446267 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2> 446267 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46399/collection1_shard1_replica_n1/ 2> 446269 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2> 446271 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.SyncStrategy http://127.0.0.1:46399/collection1_shard1_replica_n1/ has no replicas 2> 446271 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/72273000262598672-core_node2-n_0000000000 2> 446287 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46399/collection1_shard1_replica_n1/ shard1 2> 446399 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 261] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 446407 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1231] o.a.s.c.ZkController I am the leader, no recovery necessary 2> 446433 INFO (qtp663050139-3372-null-1231) [n:127.0.0.1:46399_ c: s: r: x: t:null-1231] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1216 2> 446449 INFO (qtp663050139-3375-null-1227) [n:127.0.0.1:46399_ c:collection1 s: r: x: t:null-1227] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46399_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1327 2> 446529 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 267] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 447175 INFO (OverseerCollectionConfigSetProcessor-72273000262598660-127.0.0.1:37255_-n_0000000000) [n: c: s: r: x: t:] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper 2> 447186 INFO (OverseerThreadFactory-1846-thread-4) [n: c:collection1 s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:42863_ for creating new replica of shard shard1 for collection collection1 2> 447197 INFO (OverseerThreadFactory-1846-thread-4) [n: c:collection1 s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command. 2> 447210 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2> "core":"collection1_shard1_replica_n3", 2> "node_name":"127.0.0.1:42863_", 2> "base_url":"http://127.0.0.1:42863", 2> "collection":"collection1", 2> "shard":"shard1", 2> "state":"down", 2> "type":"NRT", 2> "operation":"addreplica"} 2> 447329 INFO (zkCallback-1840-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 274] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 447329 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 274] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 447350 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c: s: r: x:collection1_shard1_replica_n3 t:null-1232] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&name=collection1_shard1_replica_n3&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT 2> 447417 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.11.1 2> 447466 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.s.IndexSchema Schema name=test 2> 447481 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 277] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 447634 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id 2> 448533 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n3' using configuration from configset conf1, trusted=true 2> 448582 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.SolrCore Opening new SolrCore at [/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-1-001/cores/collection1_shard1_replica_n3], dataDir=[/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-1-001/cores/collection1_shard1_replica_n3/data/] 2> 448625 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.45309530795817154] 2> 448674 WARN (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}} 2> 449191 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 449237 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2> 449238 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2> 449239 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.CommitTracker Hard AutoCommit: disabled 2> 449239 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.CommitTracker Soft AutoCommit: disabled 2> 449265 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.27249031949539704] 2> 449305 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 2> 449309 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 2> 449314 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2> 449342 INFO (searcherExecutor-1965-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 449352 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node2=0, core_node4=0}, version=1} for registerTerm 2> 449353 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 2> 449378 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_n3 2> 449382 INFO (updateExecutor-1875-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.DefaultSolrCoreState Running recovery 2> 449387 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true 2> 449388 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy startupVersions is empty 2> 449410 INFO (qtp372927392-3300-null-1232) [n:127.0.0.1:42863_ c: s: r: x: t:null-1232] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&name=collection1_shard1_replica_n3&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2062 2> 449452 INFO (qtp663050139-3374-null-1228) [n:127.0.0.1:46399_ c:collection1 s: r: x: t:null-1228] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:42863_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=4330 2> 449489 INFO (qtp663050139-3375-null-1232) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1232] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=10 2> 449489 INFO (qtp663050139-3375-null-1232) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1232] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=11 2> 449492 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard1_replica_n3] 2> 449494 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} 2> 449495 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_n3] as recovering, leader is [http://127.0.0.1:46399/collection1_shard1_replica_n1/] and I am [http://127.0.0.1:42863/collection1_shard1_replica_n3/] 2> 449500 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:46399]; [WaitForState: action=PREPRECOVERY&core=collection1_shard1_replica_n1&nodeName=127.0.0.1:42863_&coreNodeName=core_node4&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true] 2> 449507 INFO (qtp663050139-3377-null-1232) [n:127.0.0.1:46399_ c: s: r: x:collection1_shard1_replica_n1 t:null-1232] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true 2> 449508 INFO (qtp663050139-3377-null-1232) [n:127.0.0.1:46399_ c: s: r: x: t:null-1232] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:42863_, coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{ 2> "core":"collection1_shard1_replica_n3", 2> "node_name":"127.0.0.1:42863_", 2> "base_url":"http://127.0.0.1:42863", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 449509 INFO (qtp663050139-3377-null-1232) [n:127.0.0.1:46399_ c: s: r: x: t:null-1232] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:42863_, coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{ 2> "core":"collection1_shard1_replica_n3", 2> "node_name":"127.0.0.1:42863_", 2> "base_url":"http://127.0.0.1:42863", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 449510 INFO (qtp663050139-3377-null-1232) [n:127.0.0.1:46399_ c: s: r: x: t:null-1232] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:42863_, coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{ 2> "core":"collection1_shard1_replica_n3", 2> "node_name":"127.0.0.1:42863_", 2> "base_url":"http://127.0.0.1:42863", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 449511 INFO (qtp663050139-3377-null-1232) [n:127.0.0.1:46399_ c: s: r: x: t:null-1232] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:42863_, coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{ 2> "core":"collection1_shard1_replica_n3", 2> "node_name":"127.0.0.1:42863_", 2> "base_url":"http://127.0.0.1:42863", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 449512 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 289] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 449512 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 289] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 449521 INFO (watches-1933-thread-1) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:42863_, coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{ 2> "core":"collection1_shard1_replica_n3", 2> "node_name":"127.0.0.1:42863_", 2> "base_url":"http://127.0.0.1:42863", 2> "state":"recovering", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 449522 INFO (qtp663050139-3377-null-1232) [n:127.0.0.1:46399_ c: s: r: x: t:null-1232] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:42863_&onlyIfLeaderActive=true&core=collection1_shard1_replica_n1&coreNodeName=core_node4&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=16 2> 450024 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:46399/collection1_shard1_replica_n1/] - recoveringAfterStartup=[true] 2> 450027 WARN (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.PeerSyncWithLeader no frame of reference to tell if we've missed updates 2> 450027 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy PeerSync Recovery was not successful - trying replication. 2> 450028 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Starting Replication Recovery. 2> 450028 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Attempting to replicate from core [collection1_shard1_replica_n1] on node [http://127.0.0.1:46399]. 2> 450099 INFO (qtp372927392-3303-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.p.DistributedUpdateProcessor Ignoring commit while not ACTIVE - state: BUFFERING replay: false 2> 450099 INFO (qtp372927392-3303-null-1232) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=false&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46399/collection1_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 10 2> 450102 INFO (qtp663050139-3374-null-1232) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1232] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 69 2> 450112 INFO (qtp663050139-3372-null-1232) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1232] o.a.s.c.S.Request webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=4 2> 450115 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.h.IndexFetcher Leader's generation: 1 2> 450115 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.h.IndexFetcher Leader's version: 0 2> 450115 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.h.IndexFetcher Follower's generation: 1 2> 450116 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.h.IndexFetcher Follower's version: 0 2> 450116 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy No replay needed. 2> 450124 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Replication Recovery was successful. 2> 450124 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Registering as Active after recovery. 2> 450129 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[true] msTimeTaken=741.0 2> 450130 INFO (recoveryExecutor-1878-thread-1-processing-collection1_shard1_replica_n3 null-1232 core_node4 127.0.0.1:42863_ collection1 shard1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1232] o.a.s.c.RecoveryStrategy Finished recovery process. recoveringAfterStartup=true msTimeTaken=741.0 2> 450240 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 292] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 450240 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 292] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 451208 INFO (OverseerCollectionConfigSetProcessor-72273000262598660-127.0.0.1:37255_-n_0000000000) [n: c: s: r: x: t:] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000005 doesn't exist. Requestor may have disconnected from ZooKeeper 2> 451219 INFO (OverseerThreadFactory-1846-thread-5) [n: c:collection1 s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:46467_ for creating new replica of shard shard1 for collection collection1 2> 451229 INFO (OverseerThreadFactory-1846-thread-5) [n: c:collection1 s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command. 2> 451241 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2> "core":"collection1_shard1_replica_n5", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "collection":"collection1", 2> "shard":"shard1", 2> "state":"down", 2> "type":"NRT", 2> "operation":"addreplica"} 2> 451358 INFO (zkCallback-1840-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 299] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 451358 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 299] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 451358 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 299] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 451383 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c: s: r: x:collection1_shard1_replica_n5 t:null-1233] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf1&name=collection1_shard1_replica_n5&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT 2> 451480 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.11.1 2> 451518 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 302] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 451518 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 302] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 451535 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.s.IndexSchema Schema name=test 2> 451711 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id 2> 451899 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n5' using configuration from configset conf1, trusted=true 2> 451903 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.SolrCore Opening new SolrCore at [/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-2-001/cores/collection1_shard1_replica_n5], dataDir=[/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-2-001/cores/collection1_shard1_replica_n5/data/] 2> 451921 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.45309530795817154] 2> 451936 WARN (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}} 2> 452338 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 452378 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2> 452379 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2> 452379 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.CommitTracker Hard AutoCommit: disabled 2> 452379 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.CommitTracker Soft AutoCommit: disabled 2> 452400 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.27249031949539704] 2> 452412 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 2> 452415 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 2> 452419 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2> 452461 INFO (searcherExecutor-1972-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 452463 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node2=0, core_node6=0, core_node4=0}, version=2} for registerTerm 2> 452464 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 2> 452482 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_n5 2> 452486 INFO (updateExecutor-1902-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.DefaultSolrCoreState Running recovery 2> 452489 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true 2> 452490 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy startupVersions is empty 2> 452505 INFO (qtp969411185-3328-null-1233) [n:127.0.0.1:46467_ c: s: r: x: t:null-1233] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf1&name=collection1_shard1_replica_n5&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1124 2> 452519 INFO (qtp663050139-3374-null-1233) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1233] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=3 2> 452520 INFO (qtp663050139-3374-null-1233) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1233] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=4 2> 452520 INFO (qtp663050139-3376-null-1230) [n:127.0.0.1:46399_ c:collection1 s: r: x: t:null-1230] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46467_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=7398 2> 452521 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard1_replica_n5] 2> 452523 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} 2> 452524 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_n5] as recovering, leader is [http://127.0.0.1:46399/collection1_shard1_replica_n1/] and I am [http://127.0.0.1:46467/collection1_shard1_replica_n5/] 2> 452529 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:46399]; [WaitForState: action=PREPRECOVERY&core=collection1_shard1_replica_n1&nodeName=127.0.0.1:46467_&coreNodeName=core_node6&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true] 2> 452534 INFO (qtp663050139-3372-null-1233) [n:127.0.0.1:46399_ c: s: r: x:collection1_shard1_replica_n1 t:null-1233] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node6, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true 2> 452535 INFO (qtp663050139-3372-null-1233) [n:127.0.0.1:46399_ c: s: r: x: t:null-1233] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node6, onlyIfActiveCheckResult=false, nodeProps: core_node6:{ 2> "core":"collection1_shard1_replica_n5", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 452536 INFO (qtp663050139-3372-null-1233) [n:127.0.0.1:46399_ c: s: r: x: t:null-1233] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node6, onlyIfActiveCheckResult=false, nodeProps: core_node6:{ 2> "core":"collection1_shard1_replica_n5", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 452537 INFO (qtp663050139-3372-null-1233) [n:127.0.0.1:46399_ c: s: r: x: t:null-1233] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node6, onlyIfActiveCheckResult=false, nodeProps: core_node6:{ 2> "core":"collection1_shard1_replica_n5", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 452537 INFO (qtp663050139-3372-null-1233) [n:127.0.0.1:46399_ c: s: r: x: t:null-1233] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node6, onlyIfActiveCheckResult=false, nodeProps: core_node6:{ 2> "core":"collection1_shard1_replica_n5", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 452639 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 314] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 452639 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 314] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 452639 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 314] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 452644 INFO (watches-1933-thread-1) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node6, onlyIfActiveCheckResult=false, nodeProps: core_node6:{ 2> "core":"collection1_shard1_replica_n5", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"recovering", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 452645 INFO (qtp663050139-3372-null-1233) [n:127.0.0.1:46399_ c: s: r: x: t:null-1233] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:46467_&onlyIfLeaderActive=true&core=collection1_shard1_replica_n1&coreNodeName=core_node6&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=111 2> 453147 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:46399/collection1_shard1_replica_n1/] - recoveringAfterStartup=[true] 2> 453150 WARN (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.PeerSyncWithLeader no frame of reference to tell if we've missed updates 2> 453151 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy PeerSync Recovery was not successful - trying replication. 2> 453151 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Starting Replication Recovery. 2> 453152 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Attempting to replicate from core [collection1_shard1_replica_n1] on node [http://127.0.0.1:46399]. 2> 453174 INFO (qtp372927392-3298-null-1233) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1233] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=false&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46399/collection1_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 4 2> 453196 INFO (qtp969411185-3331-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.p.DistributedUpdateProcessor Ignoring commit while not ACTIVE - state: BUFFERING replay: false 2> 453197 INFO (qtp969411185-3331-null-1233) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=false&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46399/collection1_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 10 2> 453199 INFO (qtp663050139-3375-null-1233) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1233] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 41 2> 453206 INFO (qtp663050139-3377-null-1233) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1233] o.a.s.c.S.Request webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=1 2> 453208 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.h.IndexFetcher Leader's generation: 1 2> 453208 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.h.IndexFetcher Leader's version: 0 2> 453208 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.h.IndexFetcher Follower's generation: 1 2> 453208 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.h.IndexFetcher Follower's version: 0 2> 453208 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy No replay needed. 2> 453215 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Replication Recovery was successful. 2> 453215 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Registering as Active after recovery. 2> 453219 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[true] msTimeTaken=728.0 2> 453219 INFO (recoveryExecutor-1905-thread-1-processing-collection1_shard1_replica_n5 null-1233 core_node6 127.0.0.1:46467_ collection1 shard1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1233] o.a.s.c.RecoveryStrategy Finished recovery process. recoveringAfterStartup=true msTimeTaken=729.0 2> 453221 INFO (OverseerCollectionConfigSetProcessor-72273000262598660-127.0.0.1:37255_-n_0000000000) [n: c: s: r: x: t:] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper 2> 453231 INFO (OverseerThreadFactory-1846-thread-5) [n: c:collection1 s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:38065_ for creating new replica of shard shard1 for collection collection1 2> 453241 INFO (OverseerThreadFactory-1846-thread-5) [n: c:collection1 s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command. 2> 453253 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2> "core":"collection1_shard1_replica_n7", 2> "node_name":"127.0.0.1:38065_", 2> "base_url":"http://127.0.0.1:38065", 2> "collection":"collection1", 2> "shard":"shard1", 2> "state":"down", 2> "type":"NRT", 2> "operation":"addreplica"} 2> 453369 INFO (zkCallback-1840-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 322] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 453369 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 322] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 453369 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 322] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 453369 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 322] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 453400 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c: s: r: x:collection1_shard1_replica_n7 t:null-1234] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&name=collection1_shard1_replica_n7&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT 2> 453506 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.11.1 2> 453535 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 325] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 453536 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 325] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 453536 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 325] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 453577 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.s.IndexSchema Schema name=test 2> 453780 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id 2> 453945 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n7' using configuration from configset conf1, trusted=true 2> 453949 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.SolrCore Opening new SolrCore at [/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-3-001/cores/collection1_shard1_replica_n7], dataDir=[/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-3-001/cores/collection1_shard1_replica_n7/data/] 2> 453972 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.45309530795817154] 2> 453986 WARN (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}} 2> 454418 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer 2> 454471 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2> 454471 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2> 454472 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.CommitTracker Hard AutoCommit: disabled 2> 454472 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.CommitTracker Soft AutoCommit: disabled 2> 454491 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.27249031949539704] 2> 454505 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 2> 454508 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 2> 454511 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2> 454537 INFO (searcherExecutor-1979-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 454540 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node6=0, core_node8=0, core_node2=0, core_node4=0}, version=3} for registerTerm 2> 454541 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1 2> 454557 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_n7 2> 454561 INFO (updateExecutor-1941-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.DefaultSolrCoreState Running recovery 2> 454564 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true 2> 454564 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy startupVersions is empty 2> 454578 INFO (qtp1930891732-3344-null-1234) [n:127.0.0.1:38065_ c: s: r: x: t:null-1234] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&name=collection1_shard1_replica_n7&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1180 2> 454593 INFO (qtp663050139-3373-null-1229) [n:127.0.0.1:46399_ c:collection1 s: r: x: t:null-1229] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:38065_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=9471 2> 454595 INFO (qtp663050139-3372-null-1234) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1234] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=3 2> 454595 INFO (qtp663050139-3372-null-1234) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1234] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=4 2> 454597 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard1_replica_n7] 2> 454599 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} 2> 454600 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_n7] as recovering, leader is [http://127.0.0.1:46399/collection1_shard1_replica_n1/] and I am [http://127.0.0.1:38065/collection1_shard1_replica_n7/] 2> 454602 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 4 active replicas in collection: collection1 2> 454605 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:46399]; [WaitForState: action=PREPRECOVERY&core=collection1_shard1_replica_n1&nodeName=127.0.0.1:38065_&coreNodeName=core_node8&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true] 2> 454611 INFO (qtp663050139-3375-null-1234) [n:127.0.0.1:46399_ c: s: r: x:collection1_shard1_replica_n1 t:null-1234] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node8, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true 2> 454614 INFO (qtp663050139-3375-null-1234) [n:127.0.0.1:46399_ c: s: r: x: t:null-1234] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:38065_, coreNodeName=core_node8, onlyIfActiveCheckResult=false, nodeProps: core_node8:{ 2> "core":"collection1_shard1_replica_n7", 2> "node_name":"127.0.0.1:38065_", 2> "base_url":"http://127.0.0.1:38065", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 454615 INFO (qtp663050139-3375-null-1234) [n:127.0.0.1:46399_ c: s: r: x: t:null-1234] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:38065_, coreNodeName=core_node8, onlyIfActiveCheckResult=false, nodeProps: core_node8:{ 2> "core":"collection1_shard1_replica_n7", 2> "node_name":"127.0.0.1:38065_", 2> "base_url":"http://127.0.0.1:38065", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 454615 INFO (qtp663050139-3375-null-1234) [n:127.0.0.1:46399_ c: s: r: x: t:null-1234] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:38065_, coreNodeName=core_node8, onlyIfActiveCheckResult=false, nodeProps: core_node8:{ 2> "core":"collection1_shard1_replica_n7", 2> "node_name":"127.0.0.1:38065_", 2> "base_url":"http://127.0.0.1:38065", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 454616 INFO (qtp663050139-3375-null-1234) [n:127.0.0.1:46399_ c: s: r: x: t:null-1234] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:38065_, coreNodeName=core_node8, onlyIfActiveCheckResult=false, nodeProps: core_node8:{ 2> "core":"collection1_shard1_replica_n7", 2> "node_name":"127.0.0.1:38065_", 2> "base_url":"http://127.0.0.1:38065", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 454716 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 337] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 454716 INFO (zkCallback-1863-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 337] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 454716 INFO (zkCallback-1948-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 337] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 454716 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 337] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 454716 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 337] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 454720 INFO (watches-1933-thread-1) [n:127.0.0.1:46399_ c: s: r: x: t:] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:38065_, coreNodeName=core_node8, onlyIfActiveCheckResult=false, nodeProps: core_node8:{ 2> "core":"collection1_shard1_replica_n7", 2> "node_name":"127.0.0.1:38065_", 2> "base_url":"http://127.0.0.1:38065", 2> "state":"recovering", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 454721 INFO (qtp663050139-3375-null-1234) [n:127.0.0.1:46399_ c: s: r: x: t:null-1234] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:38065_&onlyIfLeaderActive=true&core=collection1_shard1_replica_n1&coreNodeName=core_node8&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=111 2> 455223 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:46399/collection1_shard1_replica_n1/] - recoveringAfterStartup=[true] 2> 455226 WARN (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.PeerSyncWithLeader no frame of reference to tell if we've missed updates 2> 455226 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy PeerSync Recovery was not successful - trying replication. 2> 455227 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Starting Replication Recovery. 2> 455227 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Attempting to replicate from core [collection1_shard1_replica_n1] on node [http://127.0.0.1:46399]. 2> 455233 INFO (OverseerCollectionConfigSetProcessor-72273000262598660-127.0.0.1:37255_-n_0000000000) [n: c: s: r: x: t:] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper 2> 455250 INFO (qtp969411185-3326-null-1234) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:null-1234] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=false&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46399/collection1_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 6 2> 455250 INFO (qtp372927392-3299-null-1234) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:null-1234] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=false&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46399/collection1_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 7 2> 455294 INFO (qtp1930891732-3347-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.p.DistributedUpdateProcessor Ignoring commit while not ACTIVE - state: BUFFERING replay: false 2> 455294 INFO (qtp1930891732-3347-null-1234) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=false&commit=true&softCommit=false&distrib.from=http://127.0.0.1:46399/collection1_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 27 2> 455299 INFO (qtp663050139-3377-null-1234) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1234] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 67 2> 455306 INFO (qtp663050139-3374-null-1234) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:null-1234] o.a.s.c.S.Request webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=1 2> 455308 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.h.IndexFetcher Leader's generation: 1 2> 455308 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.h.IndexFetcher Leader's version: 0 2> 455308 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.h.IndexFetcher Follower's generation: 1 2> 455308 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.h.IndexFetcher Follower's version: 0 2> 455308 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy No replay needed. 2> 455316 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Replication Recovery was successful. 2> 455316 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Registering as Active after recovery. 2> 455320 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[true] msTimeTaken=755.0 2> 455320 INFO (recoveryExecutor-1944-thread-1-processing-collection1_shard1_replica_n7 null-1234 core_node8 127.0.0.1:38065_ collection1 shard1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:null-1234] o.a.s.c.RecoveryStrategy Finished recovery process. recoveringAfterStartup=true msTimeTaken=755.0 2> 455431 INFO (zkCallback-1863-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 342] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 455431 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 342] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 455431 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 342] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 455431 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 342] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 455431 INFO (zkCallback-1948-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 342] for collection [collection1] has occurred - updating... (live nodes size: [5]) 2> 455449 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.SolrTestCaseJ4 ###Starting test 2> 455494 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractUnloadDistributedZkTestBase ###Starting testCoreUnloadAndLeaders 2> 455553 INFO (OverseerThreadFactory-1846-thread-5) [n: c:unloadcollection s: r: x: t:] o.a.s.c.a.c.CreateCollectionCmd Create collection unloadcollection 2> 455578 INFO (OverseerThreadFactory-1846-thread-5) [n: c:unloadcollection s: r: x: t:] o.a.s.c.c.ZkStateReader /collections/unloadcollection/state.json is deleted, stop watching children 2> 455686 INFO (zkCallback-1840-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/unloadcollection/state.json zxid: 349] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 455720 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2> "core":"unloadcollection_shard1_replica_n1", 2> "node_name":"127.0.0.1:42863_", 2> "base_url":"http://127.0.0.1:42863", 2> "collection":"unloadcollection", 2> "shard":"shard1", 2> "state":"down", 2> "type":"NRT", 2> "operation":"ADDREPLICA", 2> "waitForFinalState":"false"} 2> 455836 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 355] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 455845 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c: s: r: x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=unloadcollection&version=2&replicaType=NRT&coreNodeName=core_node2&name=unloadcollection_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin 2> 455886 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.11.1 2> 455897 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.s.IndexSchema Schema name=test 2> 456052 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id 2> 456204 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.CoreContainer Creating SolrCore 'unloadcollection_shard1_replica_n1' using configuration from configset conf1, trusted=true 2> 456210 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.SolrCore Opening new SolrCore at [/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-1-001/cores/unloadcollection_shard1_replica_n1], dataDir=[/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-1-001/cores/unloadcollection_shard1_replica_n1/data/] 2> 456233 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.0] 2> 456249 WARN (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}} 2> 456426 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2> 456426 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2> 456427 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.u.CommitTracker Hard AutoCommit: disabled 2> 456427 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.u.CommitTracker Soft AutoCommit: disabled 2> 456452 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergedSegmentMB=97.44025802612305, floorSegmentMB=0.3986635208129883, forceMergeDeletesPctAllowed=28.343793604899123, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.590856346694595, deletesPctAllowed=32.13531022931884 2> 456467 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 2> 456470 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 2> 456474 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2> 456496 INFO (searcherExecutor-1986-thread-1-processing-unloadcollection_shard1_replica_n1 null-1236 core_node2 127.0.0.1:42863_ unloadcollection shard1) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 456502 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.ZkShardTerms Successful update of terms at /collections/unloadcollection/terms/shard1 to Terms{values={core_node2=0}, version=0} for registerTerm 2> 456503 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/unloadcollection/leaders/shard1 2> 456528 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. 2> 456529 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync 2> 456529 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/ 2> 456531 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me 2> 456534 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.SyncStrategy http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/ has no replicas 2> 456534 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/unloadcollection/leaders/shard1/leader after winning as /collections/unloadcollection/leader_elect/shard1/election/72273000262598665-core_node2-n_0000000000 2> 456551 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/ shard1 2> 456663 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 373] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 456670 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1236] o.a.s.c.ZkController I am the leader, no recovery necessary 2> 456691 INFO (qtp372927392-3300-null-1236) [n:127.0.0.1:42863_ c: s: r: x: t:null-1236] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=unloadcollection_shard1_replica_n1&action=CREATE&numShards=1&collection=unloadcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=848 2> 456702 INFO (qtp663050139-3376-null-1235) [n:127.0.0.1:46399_ c:unloadcollection s: r: x: t:null-1235] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas 2> 456787 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 379] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 456787 INFO (zkCallback-1882-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 379] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 456793 INFO (qtp663050139-3376-null-1235) [n:127.0.0.1:46399_ c:unloadcollection s: r: x: t:null-1235] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=unloadcollection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:42863_&wt=javabin&version=2} status=0 QTime=1262 2> 456813 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 456830 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 456845 INFO (zkCallback-1993-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager zkClient has connected 2> 456846 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 456846 WARN (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 456853 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5) 2> 456862 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42247/solr ready 2> 456862 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractFullDistribZkTestBase Created commonCloudSolrClient with updatesToLeaders=true and parallelUpdates=false 2> 456898 INFO (OverseerCollectionConfigSetProcessor-72273000262598660-127.0.0.1:37255_-n_0000000000) [n: c: s: r: x: t:] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000012 doesn't exist. Requestor may have disconnected from ZooKeeper 2> 456910 INFO (OverseerThreadFactory-1846-thread-5) [n: c:unloadcollection s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:46467_ for creating new replica of shard shard1 for collection unloadcollection 2> 456913 INFO (OverseerThreadFactory-1846-thread-5) [n: c:unloadcollection s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command. 2> 456929 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2> "core":"unloadcollection_shard1_replica2", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "collection":"unloadcollection", 2> "shard":"shard1", 2> "state":"down", 2> "type":"NRT", 2> "operation":"addreplica"} 2> 457045 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 388] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 457045 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 388] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 457056 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c: s: r: x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&name=unloadcollection_shard1_replica2&action=CREATE&collection=unloadcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT 2> 457098 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.11.1 2> 457112 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.s.IndexSchema Schema name=test 2> 457182 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 391] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 457268 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id 2> 457406 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.CoreContainer Creating SolrCore 'unloadcollection_shard1_replica2' using configuration from configset conf1, trusted=true 2> 457411 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.SolrCore Opening new SolrCore at [/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-2-001/cores/unloadcollection_shard1_replica2], dataDir=[/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-2-001/cores/unloadcollection_shard1_replica2/data/] 2> 457430 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.45309530795817154] 2> 457447 WARN (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}} 2> 457868 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2> 457872 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2> 457874 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.CommitTracker Hard AutoCommit: disabled 2> 457874 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.CommitTracker Soft AutoCommit: disabled 2> 457944 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.27249031949539704] 2> 458029 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 2> 458036 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 2> 458052 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2> 458083 INFO (searcherExecutor-1997-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 458094 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.ZkShardTerms Successful update of terms at /collections/unloadcollection/terms/shard1 to Terms{values={core_node2=0, core_node3=0}, version=1} for registerTerm 2> 458102 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/unloadcollection/leaders/shard1 2> 458128 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.ZkController Core needs to recover:unloadcollection_shard1_replica2 2> 458130 INFO (updateExecutor-1902-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.DefaultSolrCoreState Running recovery 2> 458131 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true 2> 458132 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy startupVersions is empty 2> 458169 INFO (qtp969411185-3327-null-1238) [n:127.0.0.1:46467_ c: s: r: x: t:null-1238] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&name=unloadcollection_shard1_replica2&action=CREATE&collection=unloadcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1113 2> 458176 INFO (qtp372927392-3303-null-1238) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1238] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} hits=0 status=0 QTime=5 2> 458176 INFO (qtp372927392-3303-null-1238) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1238] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=6 2> 458179 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[unloadcollection_shard1_replica2] 2> 458181 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} 2> 458181 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Publishing state of core [unloadcollection_shard1_replica2] as recovering, leader is [http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/] and I am [http://127.0.0.1:46467/unloadcollection_shard1_replica2/] 2> 458187 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:42863]; [WaitForState: action=PREPRECOVERY&core=unloadcollection_shard1_replica_n1&nodeName=127.0.0.1:46467_&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true] 2> 458196 INFO (qtp372927392-3298-null-1238) [n:127.0.0.1:42863_ c: s: r: x:unloadcollection_shard1_replica_n1 t:null-1238] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true 2> 458196 INFO (qtp663050139-3373-null-1237) [n:127.0.0.1:46399_ c:unloadcollection s: r: x: t:null-1237] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46467_&name=unloadcollection_shard1_replica2&action=ADDREPLICA&collection=unloadcollection&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1321 2> 458207 INFO (qtp372927392-3298-null-1238) [n:127.0.0.1:42863_ c: s: r: x: t:null-1238] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=unloadcollection, shard=shard1, thisCore=unloadcollection_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{ 2> "core":"unloadcollection_shard1_replica2", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 458209 INFO (qtp372927392-3298-null-1238) [n:127.0.0.1:42863_ c: s: r: x: t:null-1238] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=unloadcollection, shard=shard1, thisCore=unloadcollection_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{ 2> "core":"unloadcollection_shard1_replica2", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 458210 INFO (qtp372927392-3298-null-1238) [n:127.0.0.1:42863_ c: s: r: x: t:null-1238] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=unloadcollection, shard=shard1, thisCore=unloadcollection_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{ 2> "core":"unloadcollection_shard1_replica2", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 458210 INFO (qtp372927392-3298-null-1238) [n:127.0.0.1:42863_ c: s: r: x: t:null-1238] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=unloadcollection, shard=shard1, thisCore=unloadcollection_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{ 2> "core":"unloadcollection_shard1_replica2", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"down", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 458214 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection:unloadcollection failOnTimeout:true timeout:330SECONDS 2> 458300 INFO (zkCallback-1863-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 403] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 458300 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 403] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 458300 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 403] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 458304 INFO (watches-1884-thread-1) [n:127.0.0.1:42863_ c: s: r: x: t:] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=unloadcollection, shard=shard1, thisCore=unloadcollection_shard1_replica_n1, leaderDoesNotNeedRecovery=false, isLeader=true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:46467_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{ 2> "core":"unloadcollection_shard1_replica2", 2> "node_name":"127.0.0.1:46467_", 2> "base_url":"http://127.0.0.1:46467", 2> "state":"recovering", 2> "type":"NRT", 2> "force_set_state":"false"} 2> 458305 INFO (qtp372927392-3298-null-1238) [n:127.0.0.1:42863_ c: s: r: x: t:null-1238] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:46467_&onlyIfLeaderActive=true&core=unloadcollection_shard1_replica_n1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=113 2> 458807 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/] - recoveringAfterStartup=[true] 2> 458811 WARN (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.PeerSyncWithLeader no frame of reference to tell if we've missed updates 2> 458812 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy PeerSync Recovery was not successful - trying replication. 2> 458812 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Starting Replication Recovery. 2> 458812 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Attempting to replicate from core [unloadcollection_shard1_replica_n1] on node [http://127.0.0.1:42863]. 2> 458867 INFO (qtp969411185-3330-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.p.DistributedUpdateProcessor Ignoring commit while not ACTIVE - state: BUFFERING replay: false 2> 458868 INFO (qtp969411185-3330-null-1238) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=false&commit=true&softCommit=false&distrib.from=http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 8 2> 458870 INFO (qtp372927392-3299-null-1238) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1238] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 52 2> 458879 INFO (qtp372927392-3300-null-1238) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1238] o.a.s.c.S.Request webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=2 2> 458882 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.h.IndexFetcher Leader's generation: 1 2> 458882 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.h.IndexFetcher Leader's version: 0 2> 458882 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.h.IndexFetcher Follower's generation: 1 2> 458883 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.h.IndexFetcher Follower's version: 0 2> 458883 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy No replay needed. 2> 458891 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Replication Recovery was successful. 2> 458891 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Registering as Active after recovery. 2> 458896 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[true] msTimeTaken=764.0 2> 458897 INFO (recoveryExecutor-1905-thread-1-processing-unloadcollection_shard1_replica2 null-1238 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1238] o.a.s.c.RecoveryStrategy Finished recovery process. recoveringAfterStartup=true msTimeTaken=764.0 2> 458912 INFO (OverseerCollectionConfigSetProcessor-72273000262598660-127.0.0.1:37255_-n_0000000000) [n: c: s: r: x: t:] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000014 doesn't exist. Requestor may have disconnected from ZooKeeper 2> 459009 INFO (zkCallback-1863-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 408] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 459009 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 408] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 459009 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 408] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 459014 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection:unloadcollection 2> 459070 INFO (qtp372927392-3302-null-1239) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1239] o.a.s.c.ZkShardTerms Successful update of terms at /collections/unloadcollection/terms/shard1 to Terms{values={core_node2=1, core_node3=1}, version=2} for ensureHighestTermsAreNotZero 2> 459101 INFO (qtp969411185-3331-null-1239) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1239] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/&wt=javabin&version=2}{add=[6 (1824423588615159808)]} 0 18 2> 459110 INFO (qtp372927392-3302-null-1239) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1239] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={wt=javabin&version=2}{add=[6 (1824423588615159808)]} 0 76 2> 459136 INFO (qtp969411185-3326-null-1240) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1240] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/&wt=javabin&version=2}{add=[7 (1824423588699045888)]} 0 8 2> 459144 INFO (qtp372927392-3303-null-1240) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1240] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={wt=javabin&version=2}{add=[7 (1824423588699045888)]} 0 30 2> 459161 INFO (qtp969411185-3327-null-1241) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1241] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/&wt=javabin&version=2}{add=[8 (1824423588734697472)]} 0 3 2> 459163 INFO (qtp372927392-3298-null-1241) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1241] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={wt=javabin&version=2}{add=[8 (1824423588734697472)]} 0 15 2> 459286 INFO (searcherExecutor-1997-thread-1-processing-unloadcollection_shard1_replica2 null-1242 core_node3 127.0.0.1:46467_ unloadcollection shard1) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1242] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 459286 INFO (searcherExecutor-1986-thread-1-processing-unloadcollection_shard1_replica_n1 null-1242 core_node2 127.0.0.1:42863_ unloadcollection shard1) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1242] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 459289 INFO (qtp969411185-3328-null-1242) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:null-1242] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:42863/unloadcollection_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 112 2> 459291 INFO (qtp372927392-3299-null-1242) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1242] o.a.s.u.p.LogUpdateProcessorFactory webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 123 2> 459344 INFO (OverseerThreadFactory-1846-thread-5) [n: c:unloadcollection s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:46399_ for creating new replica of shard shard1 for collection unloadcollection 2> 459347 INFO (OverseerThreadFactory-1846-thread-5) [n: c:unloadcollection s:shard1 r: x: t:] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command. 2> 459361 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.o.SliceMutator createReplica() { 2> "core":"unloadcollection_shard1_replica3", 2> "node_name":"127.0.0.1:46399_", 2> "base_url":"http://127.0.0.1:46399", 2> "collection":"unloadcollection", 2> "shard":"shard1", 2> "state":"down", 2> "type":"NRT", 2> "operation":"addreplica"} 2> 459477 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 415] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 459478 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 415] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 459478 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 415] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 459490 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c: s: r: x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&name=unloadcollection_shard1_replica3&action=CREATE&collection=unloadcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT 2> 459537 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.11.1 2> 459553 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.s.IndexSchema Schema name=test 2> 459618 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 418] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 459618 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 418] for collection [unloadcollection] has occurred - updating... (live nodes size: [5]) 2> 459736 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id 2> 460042 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.CoreContainer Creating SolrCore 'unloadcollection_shard1_replica3' using configuration from configset conf1, trusted=true 2> 460065 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.SolrCore Opening new SolrCore at [/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-4-001/cores/unloadcollection_shard1_replica3], dataDir=[/build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001/shard-4-001/cores/unloadcollection_shard1_replica3/data/] 2> 460115 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.45309530795817154] 2> 460155 WARN (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}} 2> 475158 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2> 475179 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 2> 475184 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.u.CommitTracker Hard AutoCommit: disabled 2> 475185 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.u.CommitTracker Soft AutoCommit: disabled 2> 475109 ERROR (OverseerThreadFactory-1846-thread-5) [n: c:unloadcollection s:shard1 r: x: t:] o.a.s.c.a.c.CollectionHandlingUtils Error from shard: http://127.0.0.1:46399 2> => org.apache.solr.client.solrj.SolrServerException: Total timeout 15000 ms elapsed 2> at org.apache.solr.client.solrj.impl.Http2SolrClient$1.onFailure(Http2SolrClient.java:507) 2> org.apache.solr.client.solrj.SolrServerException: Total timeout 15000 ms elapsed 2> at org.apache.solr.client.solrj.impl.Http2SolrClient$1.onFailure(Http2SolrClient.java:507) ~[solr-solrj-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.eclipse.jetty.client.ResponseNotifier.notifyFailure(ResponseNotifier.java:192) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.ResponseNotifier.notifyFailure(ResponseNotifier.java:184) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpReceiver.abort(HttpReceiver.java:559) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpChannel.abortResponse(HttpChannel.java:154) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpChannel.abort(HttpChannel.java:147) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpExchange.abort(HttpExchange.java:273) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpConversation.abort(HttpConversation.java:159) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpRequest.abort(HttpRequest.java:925) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpConnection$RequestTimeouts.onExpired(HttpConnection.java:342) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpConnection$RequestTimeouts.onExpired(HttpConnection.java:322) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.CyclicTimeouts.onTimeoutExpired(CyclicTimeouts.java:110) ~[jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.CyclicTimeouts$Timeouts.onTimeoutExpired(CyclicTimeouts.java:197) ~[jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.CyclicTimeout$Wakeup.run(CyclicTimeout.java:294) ~[jetty-io-10.0.22.jar:10.0.22] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] 2> at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] 2> at java.base/java.lang.Thread.run(Thread.java:829) [?:?] 2> Caused by: java.util.concurrent.TimeoutException: Total timeout 15000 ms elapsed 2> ... 11 more 2> 475219 ERROR (OverseerThreadFactory-1846-thread-5) [n: c:unloadcollection s:shard1 r: x: t:] o.a.s.c.a.c.CollectionHandlingUtils Collection unloadcollection, operation addreplica failed 2> => org.apache.solr.common.SolrException: ADDREPLICA failed to create replica 2> at org.apache.solr.cloud.api.collections.CollectionHandlingUtils$ShardRequestTracker.processResponses(CollectionHandlingUtils.java:686) 2> org.apache.solr.common.SolrException: ADDREPLICA failed to create replica 2> at org.apache.solr.cloud.api.collections.CollectionHandlingUtils$ShardRequestTracker.processResponses(CollectionHandlingUtils.java:686) ~[main/:?] 2> at org.apache.solr.cloud.api.collections.CollectionHandlingUtils$ShardRequestTracker.processResponses(CollectionHandlingUtils.java:665) ~[main/:?] 2> at org.apache.solr.cloud.api.collections.AddReplicaCmd.lambda$addReplica$1(AddReplicaCmd.java:200) ~[main/:?] 2> at org.apache.solr.cloud.api.collections.AddReplicaCmd.addReplica(AddReplicaCmd.java:233) ~[main/:?] 2> at org.apache.solr.cloud.api.collections.AddReplicaCmd.call(AddReplicaCmd.java:85) ~[main/:?] 2> at org.apache.solr.cloud.api.collections.CollApiCmds$TraceAwareCommand.call(CollApiCmds.java:225) ~[main/:?] 2> at org.apache.solr.cloud.api.collections.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:130) [main/:?] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:564) [main/:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380) [solr-solrj-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] 2> at java.base/java.lang.Thread.run(Thread.java:829) [?:?] 2> Caused by: org.apache.solr.client.solrj.SolrServerException: Total timeout 15000 ms elapsed 2> at org.apache.solr.client.solrj.impl.Http2SolrClient$1.onFailure(Http2SolrClient.java:507) ~[solr-solrj-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.eclipse.jetty.client.ResponseNotifier.notifyFailure(ResponseNotifier.java:192) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.ResponseNotifier.notifyFailure(ResponseNotifier.java:184) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpReceiver.abort(HttpReceiver.java:559) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpChannel.abortResponse(HttpChannel.java:154) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpChannel.abort(HttpChannel.java:147) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpExchange.abort(HttpExchange.java:273) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpConversation.abort(HttpConversation.java:159) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpRequest.abort(HttpRequest.java:925) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpConnection$RequestTimeouts.onExpired(HttpConnection.java:342) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpConnection$RequestTimeouts.onExpired(HttpConnection.java:322) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.CyclicTimeouts.onTimeoutExpired(CyclicTimeouts.java:110) ~[jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.CyclicTimeouts$Timeouts.onTimeoutExpired(CyclicTimeouts.java:197) ~[jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.CyclicTimeout$Wakeup.run(CyclicTimeout.java:294) ~[jetty-io-10.0.22.jar:10.0.22] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] 2> at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?] 2> ... 3 more 2> Caused by: java.util.concurrent.TimeoutException: Total timeout 15000 ms elapsed 2> at org.eclipse.jetty.client.HttpConnection$RequestTimeouts.onExpired(HttpConnection.java:342) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.client.HttpConnection$RequestTimeouts.onExpired(HttpConnection.java:322) ~[jetty-client-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.CyclicTimeouts.onTimeoutExpired(CyclicTimeouts.java:110) ~[jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.CyclicTimeouts$Timeouts.onTimeoutExpired(CyclicTimeouts.java:197) ~[jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.CyclicTimeout$Wakeup.run(CyclicTimeout.java:294) ~[jetty-io-10.0.22.jar:10.0.22] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] 2> at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?] 2> ... 3 more 2> 475274 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022208E12, noCFSRatio=0.27249031949539704] 2> 475343 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 2> 475334 ERROR (qtp663050139-3372-null-1243) [n:127.0.0.1:46399_ c:unloadcollection s: r: x: t:null-1243] o.a.s.h.RequestHandlerBase Server exception 2> => org.apache.solr.common.SolrException: ADDREPLICA failed to create replica 2> at org.apache.solr.client.solrj.SolrResponse.getException(SolrResponse.java:56) 2> org.apache.solr.common.SolrException: ADDREPLICA failed to create replica 2> at org.apache.solr.client.solrj.SolrResponse.getException(SolrResponse.java:56) ~[solr-solrj-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.handler.admin.api.AdminAPIBase.submitRemoteMessageAndHandleResponse(AdminAPIBase.java:141) ~[main/:?] 2> at org.apache.solr.handler.admin.api.CreateReplica.createReplica(CreateReplica.java:95) ~[main/:?] 2> at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.lambda$static$22(CollectionsHandler.java:952) ~[main/:?] 2> at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.execute(CollectionsHandler.java:1264) ~[main/:?] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:321) ~[main/:?] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:299) ~[main/:?] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:228) [main/:?] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:940) [main/:?] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:894) [main/:?] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:555) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.dispatch(SolrDispatchFilter.java:241) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.lambda$doFilterRetry$0(SolrDispatchFilter.java:198) [main/:?] 2> at org.apache.solr.servlet.ServletUtils.traceHttpRequestExecution2(ServletUtils.java:227) [main/:?] 2> at org.apache.solr.servlet.ServletUtils.rateLimitRequest(ServletUtils.java:197) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilterRetry(SolrDispatchFilter.java:192) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:181) [main/:?] 2> at javax.servlet.http.HttpFilter.doFilter(HttpFilter.java:97) [jetty-servlet-api-4.0.6.jar:?] 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.apache.solr.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:184) [solr-test-framework-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1580) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1384) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1553) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1306) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:301) [jetty-rewrite-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:822) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.Server.handle(Server.java:563) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1598) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:753) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:501) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:287) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314) [jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100) [jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53) [jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149) [jetty-util-10.0.22.jar:10.0.22] 2> at java.base/java.lang.Thread.run(Thread.java:829) [?:?] 2> 475358 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 2> 475361 INFO (qtp663050139-3372-null-1243) [n:127.0.0.1:46399_ c:unloadcollection s: r: x: t:null-1243] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46399_&name=unloadcollection_shard1_replica3&action=ADDREPLICA&collection=unloadcollection&shard=shard1&type=NRT&wt=javabin&version=2} status=500 QTime=16057 2> 475367 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms 2> 475367 ERROR (qtp663050139-3372-null-1243) [n:127.0.0.1:46399_ c:unloadcollection s: r: x: t:null-1243] o.a.s.s.HttpSolrCall 500 Exception 2> => org.apache.solr.common.SolrException: ADDREPLICA failed to create replica 2> at org.apache.solr.client.solrj.SolrResponse.getException(SolrResponse.java:56) 2> org.apache.solr.common.SolrException: ADDREPLICA failed to create replica 2> at org.apache.solr.client.solrj.SolrResponse.getException(SolrResponse.java:56) ~[solr-solrj-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.handler.admin.api.AdminAPIBase.submitRemoteMessageAndHandleResponse(AdminAPIBase.java:141) ~[main/:?] 2> at org.apache.solr.handler.admin.api.CreateReplica.createReplica(CreateReplica.java:95) ~[main/:?] 2> at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.lambda$static$22(CollectionsHandler.java:952) ~[main/:?] 2> at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.execute(CollectionsHandler.java:1264) ~[main/:?] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:321) ~[main/:?] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:299) ~[main/:?] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:228) ~[main/:?] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:940) [main/:?] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:894) [main/:?] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:555) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.dispatch(SolrDispatchFilter.java:241) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.lambda$doFilterRetry$0(SolrDispatchFilter.java:198) [main/:?] 2> at org.apache.solr.servlet.ServletUtils.traceHttpRequestExecution2(ServletUtils.java:227) [main/:?] 2> at org.apache.solr.servlet.ServletUtils.rateLimitRequest(ServletUtils.java:197) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilterRetry(SolrDispatchFilter.java:192) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:181) [main/:?] 2> at javax.servlet.http.HttpFilter.doFilter(HttpFilter.java:97) [jetty-servlet-api-4.0.6.jar:?] 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.apache.solr.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:184) [solr-test-framework-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:202) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1635) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:527) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1580) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1384) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1553) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1306) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:301) [jetty-rewrite-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:822) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.Server.handle(Server.java:563) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1598) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:753) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:501) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:287) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314) [jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100) [jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53) [jetty-io-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149) [jetty-util-10.0.22.jar:10.0.22] 2> at java.base/java.lang.Thread.run(Thread.java:829) [?:?] 2> 475399 INFO (searcherExecutor-2003-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms 2> 475423 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.ZkShardTerms Successful update of terms at /collections/unloadcollection/terms/shard1 to Terms{values={core_node2=1, core_node3=1, core_node4=0}, version=3} for registerTerm 2> 475434 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/unloadcollection/leaders/shard1 2> 475434 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.SolrTestCaseJ4 ###Ending test 2> 475479 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.ZkController Core needs to recover:unloadcollection_shard1_replica3 2> 475481 INFO (updateExecutor-1924-thread-3-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.u.DefaultSolrCoreState Running recovery 2> 475483 INFO (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true 2> 475484 INFO (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.RecoveryStrategy startupVersions is empty 2> 475518 INFO (qtp663050139-3375-null-1244) [n:127.0.0.1:46399_ c: s: r: x: t:null-1244] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&name=unloadcollection_shard1_replica3&action=CREATE&collection=unloadcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=16030 2> 475589 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.e.j.s.Server Stopped Server@c3ccffd{STOPPING}[10.0.22,sto=0] 2> 475595 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.e.j.s.Server Stopped Server@2e61ca9c{STOPPING}[10.0.22,sto=0] 2> 475595 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.e.j.s.Server Stopped Server@712ec6a7{STOPPING}[10.0.22,sto=0] 2> 475599 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.e.j.s.Server Stopped Server@621a0d35{STOPPING}[10.0.22,sto=0] 2> 475603 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.e.j.s.Server Stopped Server@5241f34b{STOPPING}[10.0.22,sto=0] 2> 475607 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Stopped ServerConnector@617b86b1{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0} 2> 475606 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Stopped ServerConnector@3df78990{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0} 2> 475606 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Stopped ServerConnector@411ff717{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0} 2> 475608 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Stopped ServerConnector@1205fdbf{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0} 2> 475609 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Stopped ServerConnector@23bac7b3{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0} 2> 475615 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1789926044 2> 475615 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.a.s.c.CoreContainer Shutting down CoreContainer instance=123523151 2> 475615 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1804689881 2> 475615 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.a.s.c.CoreContainer Shutting down CoreContainer instance=477450666 2> 475617 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42863_ 2> 475617 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:46467_ 2> 475617 WARN (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.a.s.c.RecoveryStrategy Stopping recovery for core=[unloadcollection_shard1_replica3] coreNodeName=[core_node4] 2> 475618 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:46399_ 2> 475618 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38065_ 2> 475621 INFO (qtp372927392-3299-null-1244) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1244] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} hits=3 status=0 QTime=68 2> 475622 INFO (qtp372927392-3299-null-1244) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:null-1244] o.a.s.c.S.Request webapp= path=/admin/ping params={wt=javabin&version=2} status=0 QTime=74 2> 475623 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish this node as DOWN... 2> 475623 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish this node as DOWN... 2> 475623 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish node=127.0.0.1:46399_ as DOWN 2> 475623 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish node=127.0.0.1:42863_ as DOWN 2> 475624 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish this node as DOWN... 2> 475624 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish node=127.0.0.1:38065_ as DOWN 2> 475625 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish this node as DOWN... 2> 475636 INFO (zkCallback-1948-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (1) 2> 475636 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish node=127.0.0.1:46467_ as DOWN 2> 475636 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (1) 2> 475637 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (1) 2> 475641 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (1) 2> 475641 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (1) 2> 475652 ERROR (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.RecoveryStrategy Failed to connect leader http://127.0.0.1:42863 on recovery, try again 2> 475669 INFO (coreCloseExecutor-2018-thread-1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:] o.a.s.c.SolrCore CLOSING SolrCore org.apache.solr.core.SolrCore@6c1a4c6a collection1_shard1_replica_n3 2> 475670 INFO (coreCloseExecutor-2018-thread-1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n3 tag=SolrCore@6c1a4c6a 2> 475671 INFO (coreCloseExecutor-2018-thread-2) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:] o.a.s.c.SolrCore CLOSING SolrCore org.apache.solr.core.SolrCore@9aa5cb8 unloadcollection_shard1_replica_n1 2> 475680 INFO (coreCloseExecutor-2019-thread-1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:] o.a.s.c.SolrCore CLOSING SolrCore org.apache.solr.core.SolrCore@3577043b collection1_shard1_replica_n5 2> 475680 INFO (coreCloseExecutor-2020-thread-1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:] o.a.s.c.SolrCore CLOSING SolrCore org.apache.solr.core.SolrCore@47c361ac collection1_shard1_replica_n7 2> 475683 INFO (coreCloseExecutor-2019-thread-2) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:] o.a.s.c.SolrCore CLOSING SolrCore org.apache.solr.core.SolrCore@4cea4884 unloadcollection_shard1_replica2 2> 475684 INFO (coreCloseExecutor-2019-thread-1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n5 tag=SolrCore@3577043b 2> 475684 INFO (coreCloseExecutor-2020-thread-1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n7 tag=SolrCore@47c361ac 2> 475684 INFO (coreCloseExecutor-2021-thread-1) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:] o.a.s.c.SolrCore CLOSING SolrCore org.apache.solr.core.SolrCore@53600731 collection1_shard1_replica_n1 2> 475685 INFO (coreCloseExecutor-2021-thread-1) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n1 tag=SolrCore@53600731 2> 475693 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 439] for collection [collection1] has occurred - updating... (live nodes size: [1]) 2> 475694 INFO (zkCallback-1948-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 439] for collection [collection1] has occurred - updating... (live nodes size: [1]) 2> 475693 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 439] for collection [collection1] has occurred - updating... (live nodes size: [1]) 2> 475694 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 439] for collection [collection1] has occurred - updating... (live nodes size: [1]) 2> 475700 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 440] for collection [unloadcollection] has occurred - updating... (live nodes size: [1]) 2> 475700 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 440] for collection [unloadcollection] has occurred - updating... (live nodes size: [1]) 2> 475700 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 440] for collection [unloadcollection] has occurred - updating... (live nodes size: [1]) 2> 475760 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.a.s.c.CoreContainer Shutting down CoreContainer instance=932802344 2> 475761 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37255_ 2> 475764 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish this node as DOWN... 2> 475765 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.a.s.c.ZkController Publish node=127.0.0.1:37255_ as DOWN 2> 475785 INFO (zkCallback-1948-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) 2> 475785 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) 2> 475785 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) 2> 475786 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) 2> 475786 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) 2> 475806 INFO (coreCloseExecutor-2024-thread-1) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:] o.a.s.c.SolrCore CLOSING SolrCore org.apache.solr.core.SolrCore@433fb343 control_collection_shard1_replica_n1 2> 475806 INFO (coreCloseExecutor-2024-thread-1) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.control_collection.shard1.replica_n1 tag=SolrCore@433fb343 2> 475913 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 444] for collection [collection1] has occurred - updating... (live nodes size: [0]) 2> 475913 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 444] for collection [collection1] has occurred - updating... (live nodes size: [0]) 2> 475913 INFO (zkCallback-1948-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 444] for collection [collection1] has occurred - updating... (live nodes size: [0]) 2> 475913 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json zxid: 444] for collection [collection1] has occurred - updating... (live nodes size: [0]) 2> 475919 INFO (zkCallback-1882-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 445] for collection [unloadcollection] has occurred - updating... (live nodes size: [0]) 2> 475919 INFO (zkCallback-1909-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 445] for collection [unloadcollection] has occurred - updating... (live nodes size: [0]) 2> 475919 INFO (zkCallback-1931-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/unloadcollection/state.json zxid: 445] for collection [unloadcollection] has occurred - updating... (live nodes size: [0]) 2> 475925 INFO (zkCallback-1840-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json zxid: 446] for collection [control_collection] has occurred - updating... (live nodes size: [0]) 2> 476002 INFO (coreCloseExecutor-2021-thread-1) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader tag=SolrCore@53600731 2> 476010 INFO (coreCloseExecutor-2021-thread-1) [n:127.0.0.1:46399_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1 t:] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary). 2> 476023 INFO (coreCloseExecutor-2018-thread-1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader tag=SolrCore@6c1a4c6a 2> 476023 INFO (coreCloseExecutor-2018-thread-2) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.unloadcollection.shard1.replica_n1 tag=SolrCore@9aa5cb8 2> 476030 INFO (coreCloseExecutor-2018-thread-1) [n:127.0.0.1:42863_ c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n3 t:] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary). 2> 476046 INFO (coreCloseExecutor-2020-thread-1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader tag=SolrCore@47c361ac 2> 476047 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null 2> 476051 INFO (coreCloseExecutor-2020-thread-1) [n:127.0.0.1:38065_ c:collection1 s:shard1 r:core_node8 x:collection1_shard1_replica_n7 t:] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary). 2> 476078 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null 2> 476083 INFO (coreCloseExecutor-2019-thread-1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader tag=SolrCore@3577043b 2> 476084 INFO (coreCloseExecutor-2019-thread-2) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.unloadcollection.shard1.replica2 tag=SolrCore@4cea4884 2> 476093 INFO (coreCloseExecutor-2019-thread-1) [n:127.0.0.1:46467_ c:collection1 s:shard1 r:core_node6 x:collection1_shard1_replica_n5 t:] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary). 2> 476153 INFO (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.RecoveryStrategy RecoveryStrategy has been closed 2> 476153 INFO (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[false] msTimeTaken=669.0 2> 476153 INFO (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.RecoveryStrategy Finished recovery process. recoveringAfterStartup=true msTimeTaken=669.0 2> 476154 INFO (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.SolrCore CLOSING SolrCore org.apache.solr.core.SolrCore@4cf22802 unloadcollection_shard1_replica3 2> 476210 INFO (coreCloseExecutor-2024-thread-1) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.control_collection.shard1.leader tag=SolrCore@433fb343 2> 476222 INFO (coreCloseExecutor-2024-thread-1) [n:127.0.0.1:37255_ c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 t:] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary). 2> 476245 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null 2> 476279 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null 2> 476303 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null 2> 476308 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null 2> 476350 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null 2> 476350 INFO (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.unloadcollection.shard1.replica3 tag=SolrCore@4cf22802 2> 476368 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null 2> 476369 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null 2> 476377 INFO (closeThreadPool-2025-thread-1) [n: c: s: r: x: t:] o.a.s.c.Overseer Overseer (id=72273000262598660-127.0.0.1:37255_-n_0000000000) closing 2> 476380 INFO (OverseerStateUpdate-72273000262598660-127.0.0.1:37255_-n_0000000000) [n:127.0.0.1:37255_ c: s: r: x: t:] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37255_ 2> 476410 INFO (closeThreadPool-2025-thread-2) [n: c: s: r: x: t:] o.a.s.c.Overseer Overseer (id=72273000262598660-127.0.0.1:37255_-n_0000000000) closing 2> 476417 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null 2> 476417 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null 2> 476419 INFO (coreCloseExecutor-2018-thread-2) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.unloadcollection.shard1.leader tag=SolrCore@9aa5cb8 2> 476432 INFO (coreCloseExecutor-2018-thread-2) [n:127.0.0.1:42863_ c:unloadcollection s:shard1 r:core_node2 x:unloadcollection_shard1_replica_n1 t:] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary). 2> 476457 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null 2> 476470 INFO (coreCloseExecutor-2019-thread-2) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.unloadcollection.shard1.leader tag=SolrCore@4cea4884 2> 476482 INFO (coreCloseExecutor-2019-thread-2) [n:127.0.0.1:46467_ c:unloadcollection s:shard1 r:core_node3 x:unloadcollection_shard1_replica2 t:] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary). 2> 476495 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null 2> 476499 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null 2> 476511 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null 2> 476512 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null 2> 476514 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.a.s.c.Overseer Overseer (id=72273000262598660-127.0.0.1:37255_-n_0000000000) closing 2> 476531 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null 2> 476534 INFO (closeThreadPool-2009-thread-2) [n: c: s: r: x: t:] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1a1312b9{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,STOPPED} 2> 476539 INFO (closeThreadPool-2009-thread-6) [n: c: s: r: x: t:] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3f290ef8{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,STOPPED} 2> 476566 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null 2> 476567 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null 2> 476621 INFO (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.unloadcollection.shard1.leader tag=SolrCore@4cf22802 2> 476621 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null 2> 476632 WARN (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.c.RecoveryStrategy Stopping recovery for core=[unloadcollection_shard1_replica3] coreNodeName=[core_node4] 2> 476633 INFO (recoveryExecutor-1927-thread-1-processing-unloadcollection_shard1_replica3 null-1244 core_node4 127.0.0.1:46399_ unloadcollection shard1) [n:127.0.0.1:46399_ c:unloadcollection s:shard1 r:core_node4 x:unloadcollection_shard1_replica3 t:null-1244] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary). 2> 476707 INFO (closeThreadPool-2009-thread-5) [n: c: s: r: x: t:] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@70792755{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,STOPPED} 2> 476725 INFO (closeThreadPool-2009-thread-1) [n: c: s: r: x: t:] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3d73659c{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,STOPPED} 2> 476751 INFO (closeThreadPool-2009-thread-3) [n: c: s: r: x: t:] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5a1a041e{/,file:///build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-cwd/,STOPPED} 2> 476761 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-32 after mutting 0 log messages 2> 476764 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-33 for ERROR logs matching regex: ignore_exception 2> 476768 INFO (TEST-UnloadDistributedZkTest.test-seed#[E3003B68FEA969F8]) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer Shutting down ZkTestServer. 2> 476992 WARN (ZkTestServer Run Thread) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer Watch limit violations: 2> Maximum concurrent create/delete watches above limit: 2> 2> 14 /solr/collections/collection1/terms/shard1 2> 11 /solr/collections/unloadcollection/terms/shard1 2> 8 /solr/clusterprops.json 2> 8 /solr/aliases.json 2> 5 /solr/packages.json 2> 5 /solr/security.json 2> 5 /solr/configs/conf1 2> 4 /solr/collections/collection1/collectionprops.json 2> 2 /solr/collections/unloadcollection/collectionprops.json 2> 2 /solr/collections/control_collection/terms/shard1 2> 2> Maximum concurrent data watches above limit: 2> 2> 54 /solr/collections/collection1/state.json 2> 34 /solr/collections/unloadcollection/state.json 2> 8 /solr/collections/control_collection/state.json 2> 2 /solr/collections/collection1/leader_elect/shard1/election/72273000262598672-core_node2-n_0000000000 2> 2> Maximum concurrent children watches above limit: 2> 2> 78 /solr/overseer/queue 2> 37 /solr/live_nodes 2> 27 /solr/overseer/collection-queue-work 2> 14 /solr/collections 2> 10 /solr/collections/collection1/state.json 2> 9 /solr/collections/unloadcollection/state.json 2> 3 /solr/collections/control_collection/state.json 2> > org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46399: ADDREPLICA failed to create replica > at __randomizedtesting.SeedInfo.seed([E3003B68FEA969F8:6B5404B250550400]:0) > at app//org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:729) > at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:264) > at app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:243) > at app//org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:574) > at app//org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:511) > at app//org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:475) > at app//org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1200) > at app//org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:898) > at app//org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:826) > at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:279) > at app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:295) > at app//org.apache.solr.cloud.AbstractUnloadDistributedZkTestBase.testCoreUnloadAndLeaders(AbstractUnloadDistributedZkTestBase.java:270) > at app//org.apache.solr.cloud.AbstractUnloadDistributedZkTestBase.test(AbstractUnloadDistributedZkTestBase.java:78) > at java.base@11.0.26/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at java.base@11.0.26/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at java.base@11.0.26/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base@11.0.26/java.lang.reflect.Method.invoke(Method.java:566) > at app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) > at app//com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) > at app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) > at app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) > at app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1154) > at app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1125) > at app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) > at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) > at app//org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) > at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at app//org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) > at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) > at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) > at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) > at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) > at app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) > at app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) > at app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) > at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) > at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) > at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at app//org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at app//org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) > at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at app//org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) > at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) > at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) > at java.base@11.0.26/java.lang.Thread.run(Thread.java:829) 2> NOTE: reproduce with: gradlew test --tests UnloadDistributedZkTest.test -Dtests.seed=E3003B68FEA969F8 -Dtests.locale=es-CU -Dtests.timezone=PRC -Dtests.asserts=true -Dtests.file.encoding=UTF-8 2> 477071 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-33 after mutting 0 log messages 2> 477071 INFO (SUITE-UnloadDistributedZkTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-34 for ERROR logs matching regex: ignore_exception 2> NOTE: leaving temporary files on disk at: /build/solr/src/solr-9.8.0/solr/core/build/tmp/tests-tmp/org.apache.solr.cloud.UnloadDistributedZkTest_E3003B68FEA969F8-001 2> NOTE: test params are: codec=DummyCompressingStoredFieldsData(storedFieldsFormat=Lucene90CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=9978, maxDocsPerChunk=1003, blockShift=22), termVectorsFormat=Lucene90CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=9978, maxDocsPerChunk=1003, blockSize=22)), sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=es-CU, timezone=PRC 2> NOTE: Linux 6.1.80-2-sophgo-11457-g83ab3eda46e6 riscv64/Arch Linux 11.0.26 (64-bit)/cpus=1,threads=2,free=255676648,total=435683328 2> NOTE: All tests run in this JVM: [HelloWorldSolrCloudTestCase, TestDocumentBuilder, ProtectedTermFilterFactoryTest, HealthcheckToolTest, TestEmbeddedSolrServerSchemaAPI, ChaosMonkeySafeLeaderWithPullReplicasTest, ConnectionManagerTest, DistribJoinFromCollectionTest, LeaderElectionIntegrationTest, NestedShardedAtomicUpdateTest, PackageManagerCLITest, RestartWhileUpdatingTest, SyncSliceTest, TestClusterProperties, TestExclusionRuleCollectionAccess, TestPullReplicaErrorHandling, TestSizeLimitedDistributedMap, UnloadDistributedZkTest] WARNING: Test org.apache.solr.TestRandomFaceting wrote 13,733,957 bytes of output. > Task :solr:solrj:test :solr:solrj:test (SUCCESS): 1240 test(s), 40 skipped > Task :solr:solrj-zookeeper:test :solr:solrj-zookeeper:test (SUCCESS): 19 test(s) > Task :solr:modules:extraction:test :solr:modules:extraction:test (SUCCESS): 20 test(s), 3 skipped > Task :solr:modules:analytics:wipeTaskTemp > Task :solr:modules:hdfs:testClasses > Task :solr:modules:hdfs:test > Task :solr:solrj-zookeeper:wipeTaskTemp > Task :solr:modules:jaegertracer-configurator:testClasses > Task :solr:test-framework:test :solr:test-framework:test (SUCCESS): 18 test(s) > Task :solr:solr-ref-guide:wipeTaskTemp > Task :solr:modules:jwt-auth:classes UP-TO-DATE > Task :solr:modules:jaegertracer-configurator:test > Task :solr:modules:jwt-auth:compileTestJava > Task :solr:cross-dc-manager:wipeTaskTemp > Task :solr:modules:langid:classes UP-TO-DATE > Task :solr:modules:langid:compileTestJava > Task :solr:modules:analysis-extras:test :solr:modules:analysis-extras:test (SUCCESS): 31 test(s) > Task :solr:modules:analysis-extras:wipeTaskTemp > Task :solr:modules:llm:compileJava UP-TO-DATE > Task :solr:modules:llm:classes UP-TO-DATE > Task :solr:modules:llm:compileTestJava Note: /build/solr/src/solr-9.8.0/solr/modules/llm/src/test/org/apache/solr/llm/TestLlmBase.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:extraction:wipeTaskTemp > Task :solr:modules:ltr:compileJava UP-TO-DATE > Task :solr:modules:ltr:classes UP-TO-DATE > Task :solr:modules:ltr:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:ltr:testClasses > Task :solr:modules:ltr:test > Task :solr:core:test WARNING: Test org.apache.solr.schema.TestCloudSchemaless wrote 12,712,196 bytes of output. > Task :solr:solrj-streaming:wipeTaskTemp > Task :solr:test-framework:wipeTaskTemp > Task :solr:modules:langid:testClasses > Task :solr:modules:jwt-auth:compileTestJava Note: /build/solr/src/solr-9.8.0/solr/modules/jwt-auth/src/test/org/apache/solr/security/jwt/JWTAuthPluginIntegrationTest.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:opentelemetry:compileJava > Task :solr:modules:s3-repository:compileJava > Task :solr:modules:langid:test > Task :solr:modules:hadoop-auth:test :solr:modules:hadoop-auth:test (SUCCESS): 54 test(s), 1 skipped > Task :solr:modules:opentelemetry:compileJava UP-TO-DATE > Task :solr:modules:opentelemetry:classes UP-TO-DATE > Task :solr:modules:s3-repository:compileJava UP-TO-DATE > Task :solr:modules:s3-repository:classes UP-TO-DATE > Task :solr:modules:jwt-auth:testClasses > Task :solr:modules:llm:testClasses > Task :solr:modules:hadoop-auth:wipeTaskTemp > Task :solr:modules:scripting:compileJava UP-TO-DATE > Task :solr:modules:scripting:classes UP-TO-DATE > Task :solr:modules:scripting:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:opentelemetry:compileTestJava > Task :solr:modules:s3-repository:compileTestJava > Task :solr:modules:jwt-auth:test > Task :solr:modules:llm:test > Task :solr:modules:jaegertracer-configurator:test :solr:modules:jaegertracer-configurator:test (SUCCESS): 1 test(s) > Task :solr:modules:jaegertracer-configurator:wipeTaskTemp > Task :solr:modules:langid:test :solr:modules:langid:test (SUCCESS): 49 test(s) > Task :solr:solrj:wipeTaskTemp > Task :solr:modules:langid:wipeTaskTemp > Task :solr:modules:opentelemetry:testClasses > Task :solr:modules:scripting:testClasses > Task :solr:modules:sql:compileTestJava Note: /build/solr/src/solr-9.8.0/solr/modules/sql/src/test/org/apache/solr/handler/sql/TestSQLHandlerNonCloud.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:core:test WARNING: Test org.apache.solr.search.TestRandomCollapseQParserPlugin wrote 11,621,069 bytes of output. > Task :solr:modules:s3-repository:testClasses > Task :solr:modules:opentelemetry:test > Task :solr:modules:scripting:test > Task :solr:modules:ltr:test :solr:modules:ltr:test (SUCCESS): 209 test(s) > Task :solr:modules:s3-repository:test > Task :solr:modules:gcs-repository:test :solr:modules:gcs-repository:test (SUCCESS): 22 test(s), 1 skipped > Task :solr:modules:gcs-repository:wipeTaskTemp > Task :solr:modules:ltr:wipeTaskTemp > Task :solr:modules:sql:testClasses > Task :solr:modules:sql:test > Task :solr:modules:opentelemetry:test :solr:modules:opentelemetry:test (SUCCESS): 5 test(s) > Task :solr:modules:opentelemetry:wipeTaskTemp > Task :solr:modules:scripting:test :solr:modules:scripting:test (SUCCESS): 22 test(s), 1 skipped > Task :solr:modules:scripting:wipeTaskTemp > Task :solr:modules:llm:test :solr:modules:llm:test (SUCCESS): 33 test(s) > Task :solr:modules:jwt-auth:test :solr:modules:jwt-auth:test (SUCCESS): 63 test(s) > Task :solr:modules:llm:wipeTaskTemp > Task :solr:modules:jwt-auth:wipeTaskTemp > Task :solr:modules:s3-repository:test S3IncrementalBackupTest > testRestoreToOriginalCollection FAILED java.lang.AssertionError: expected: but was: at __randomizedtesting.SeedInfo.seed([E3003B68FEA969F8:D6F4D03315755FA6]:0) at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.failNotEquals(Assert.java:835) at org.junit.Assert.assertEquals(Assert.java:120) at org.junit.Assert.assertEquals(Assert.java:146) at org.apache.solr.cloud.api.collections.AbstractIncrementalBackupTest.testRestoreToOriginalCollection(AbstractIncrementalBackupTest.java:215) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) at com.adobe.testing.s3mock.junit4.S3MockRule$1.evaluate(S3MockRule.java:66) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) at java.base/java.lang.Thread.run(Thread.java:829) S3IncrementalBackupTest > testSkipConfigset FAILED java.lang.AssertionError: Configset shouldn't be part of the backup but found: s3:/mytestbackuptestbackuprestoretooriginal/backuprestore_testbackuprestoretooriginal/zk_backup_0/ s3:/mytestbackuptestbackuprestoretooriginal/backuprestore_testbackuprestoretooriginal/zk_backup_0/configs/ s3:/mytestbackuptestbackuprestoretooriginal/backuprestore_testbackuprestoretooriginal/zk_backup_0/configs/conf1/ s3:/mytestbackuptestskipconfigset/ s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/ s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/ s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/index/ s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/shard_backup_metadata/ s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/ s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/ s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/zk_backup_0/ at __randomizedtesting.SeedInfo.seed([E3003B68FEA969F8:E8F9A46166EB3FEF]:0) at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.junit.Assert.assertFalse(Assert.java:65) at org.apache.solr.cloud.api.collections.AbstractIncrementalBackupTest.testSkipConfigset(AbstractIncrementalBackupTest.java:378) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) at com.adobe.testing.s3mock.junit4.S3MockRule$1.evaluate(S3MockRule.java:66) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) at java.base/java.lang.Thread.run(Thread.java:829) org.apache.solr.s3.S3IncrementalBackupTest > test suite's output saved to /build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/test-results/test/outputs/OUTPUT-org.apache.solr.s3.S3IncrementalBackupTest.txt, copied below: 2> 37874 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.Server jetty-10.0.22; built: 2024-06-27T16:03:51.502Z; git: 5c8471e852d377fd726ad9b1692c35ffc5febb09; jvm 11.0.26+4 2> 38461 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.h.C.application Initializing Spring embedded WebApplicationContext 2> 42047 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.s.DefaultSessionIdManager Session workerName=node0 2> 42165 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.s.b.w.e.j.JettyEmbeddedWebAppContext@7ce5fd57{application,/,[file:///build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/tmp/tests-tmp/jetty-docbase.0.11805860284012450550/],AVAILABLE} 2> 42180 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.Server Started Server@24ab2359{STARTING}[10.0.22,sto=0] @42396ms 2> 48194 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.h.C.application Initializing Spring DispatcherServlet 'dispatcherServlet' 2> 49368 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.u.s.SslContextFactory x509=X509@1bcd0bd8(selfsigned,h=[localhost, adobe s3mock],a=[],w=[]) for Server@37a774e1[provider=null,keyStore=jar:file:/build/.gradle/caches/modules-2/files-2.1/com.adobe.testing/s3mock/2.17.0/e5857753b28d06f6728f6200f94e5be299c8631c/s3mock-2.17.0.jar!/s3mock.jks,trustStore=null] 2> 49834 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Started SslValidatingServerConnector@4ceeaf92{SSL, (ssl, http/1.1)}{0.0.0.0:42665} 2> 49846 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@310b2403{HTTP/1.1, (http/1.1)}{0.0.0.0:37215} 2> 51112 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer TEST_PATH() does not exist - solrj test? 2> 51158 ERROR (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer ZkTestServer requires the 'stat' command, temporarily manipulating your whitelist 2> 53754 WARN (ZkTestServer Run Thread) [n: c: s: r: x: t:] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. 2> 54272 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55020 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55126 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55158 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55161 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55198 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55547 INFO (jetty-launcher-8-thread-2) [n: c: s: r: x: t:] o.e.j.s.Server jetty-10.0.22; built: 2024-06-27T16:03:51.502Z; git: 5c8471e852d377fd726ad9b1692c35ffc5febb09; jvm 11.0.26+4 2> 55549 INFO (jetty-launcher-8-thread-1) [n: c: s: r: x: t:] o.e.j.s.Server jetty-10.0.22; built: 2024-06-27T16:03:51.502Z; git: 5c8471e852d377fd726ad9b1692c35ffc5febb09; jvm 11.0.26+4 2> 55593 INFO (jetty-launcher-8-thread-1) [n: c: s: r: x: t:] o.e.j.s.s.DefaultSessionIdManager Session workerName=node0 2> 55594 INFO (jetty-launcher-8-thread-2) [n: c: s: r: x: t:] o.e.j.s.s.DefaultSessionIdManager Session workerName=node0 2> 55653 ERROR (jetty-launcher-8-thread-1) [n: c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. 2> 55653 ERROR (jetty-launcher-8-thread-2) [n: c: s: r: x: t:] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. 2> 55790 WARN (jetty-launcher-8-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55790 WARN (jetty-launcher-8-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55829 WARN (jetty-launcher-8-thread-1) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55835 WARN (jetty-launcher-8-thread-2) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 55852 WARN (jetty-launcher-8-thread-1) [n: c: s: r: x: t:] o.a.s.D.solrxml-zookeeper Loading solr.xml from zookeeper is deprecated. See reference guide for details. 2> 62865 WARN (jetty-launcher-8-thread-1) [n:127.0.0.1:40549_solr c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2> 62865 WARN (jetty-launcher-8-thread-2) [n:127.0.0.1:44123_solr c: s: r: x: t:] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html 2> 63566 WARN (jetty-launcher-8-thread-1) [n:127.0.0.1:40549_solr c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2> 63953 WARN (jetty-launcher-8-thread-2) [n:127.0.0.1:44123_solr c: s: r: x: t:] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2> 66215 WARN (jetty-launcher-8-thread-1) [n:127.0.0.1:40549_solr c: s: r: x: t:] o.a.s.m.r.j.JmxMetricsReporter Unable to register gauge 2> => javax.management.InstanceNotFoundException: solr:dom1=node,category=CONTAINER,name=zkClient 2> at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083) 2> javax.management.InstanceNotFoundException: solr:dom1=node,category=CONTAINER,name=zkClient 2> at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083) ~[?:?] 2> at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:423) ~[?:?] 2> at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:411) ~[?:?] 2> at java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) ~[?:?] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:545) ~[solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:587) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.lambda$start$0(JmxMetricsReporter.java:766) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at java.base/java.util.HashMap.forEach(HashMap.java:1337) [?:?] 2> at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:755) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:117) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:68) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:1087) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:998) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.core.CoreContainer.loadInternal(CoreContainer.java:955) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.core.CoreContainer.load(CoreContainer.java:784) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.servlet.CoreContainerProvider.createCoreContainer(CoreContainerProvider.java:408) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.servlet.CoreContainerProvider.init(CoreContainerProvider.java:231) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.servlet.CoreContainerProvider.contextInitialized(CoreContainerProvider.java:108) [solr-core-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.embedded.JettySolrRunner$1.contextInitialized(JettySolrRunner.java:397) [solr-test-framework-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1049) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:624) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:984) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:740) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:392) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:901) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:306) [jetty-servlet-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:221) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:171) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.Server.start(Server.java:470) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114) [jetty-util-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:89) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.server.Server.doStart(Server.java:415) [jetty-server-10.0.22.jar:10.0.22] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:93) [jetty-util-10.0.22.jar:10.0.22] 2> at org.apache.solr.embedded.JettySolrRunner.retryOnPortBindFailure(JettySolrRunner.java:585) [solr-test-framework-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.embedded.JettySolrRunner.start(JettySolrRunner.java:531) [solr-test-framework-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.embedded.JettySolrRunner.start(JettySolrRunner.java:502) [solr-test-framework-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:571) [solr-test-framework-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:377) [solr-test-framework-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:380) [solr-solrj-9.8.0.jar:9.8.0 (not a git checkout) - builduser] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] 2> at java.base/java.lang.Thread.run(Thread.java:829) [?:?] 2> 68846 WARN (jetty-launcher-8-thread-2) [n:127.0.0.1:44123_solr c: s: r: x: t:] o.g.j.m.i.MessagingBinders A class jakarta.activation.DataSource for a default provider MessageBodyWriter was not found. The provider is not available. 2> 73481 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:40549_solr c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@539f60dc{/solr,file:///build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/tmp/tests-cwd/,AVAILABLE} 2> 73481 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44123_solr c: s: r: x: t:] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4f8cfff8{/solr,file:///build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/tmp/tests-cwd/,AVAILABLE} 2> 73492 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44123_solr c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@18ac93e0{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:44123} 2> 73492 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:40549_solr c: s: r: x: t:] o.e.j.s.AbstractConnector Started ServerConnector@59c72279{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:40549} 2> 73500 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:40549_solr c: s: r: x: t:] o.e.j.s.Server Started Server@679bdbd8{STARTING}[10.0.22,sto=0] @73716ms 2> 73500 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44123_solr c: s: r: x: t:] o.e.j.s.Server Started Server@4b87fb0c{STARTING}[10.0.22,sto=0] @73716ms 2> 73534 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 73581 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 73611 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes 2> 73639 WARN (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes > java.lang.AssertionError: expected: but was: > at __randomizedtesting.SeedInfo.seed([E3003B68FEA969F8:D6F4D03315755FA6]:0) > at org.junit.Assert.fail(Assert.java:89) > at org.junit.Assert.failNotEquals(Assert.java:835) > at org.junit.Assert.assertEquals(Assert.java:120) > at org.junit.Assert.assertEquals(Assert.java:146) > at org.apache.solr.cloud.api.collections.AbstractIncrementalBackupTest.testRestoreToOriginalCollection(AbstractIncrementalBackupTest.java:215) > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) > at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) > at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) > at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) > at com.adobe.testing.s3mock.junit4.S3MockRule$1.evaluate(S3MockRule.java:66) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) > at java.base/java.lang.Thread.run(Thread.java:829) 2> NOTE: reproduce with: gradlew test --tests S3IncrementalBackupTest.testRestoreToOriginalCollection -Dtests.seed=E3003B68FEA969F8 -Dtests.locale=sbp -Dtests.timezone=Chile/Continental -Dtests.asserts=true -Dtests.file.encoding=UTF-8 > java.lang.AssertionError: Configset shouldn't be part of the backup but found: > s3:/mytestbackuptestbackuprestoretooriginal/backuprestore_testbackuprestoretooriginal/zk_backup_0/ > s3:/mytestbackuptestbackuprestoretooriginal/backuprestore_testbackuprestoretooriginal/zk_backup_0/configs/ > s3:/mytestbackuptestbackuprestoretooriginal/backuprestore_testbackuprestoretooriginal/zk_backup_0/configs/conf1/ > s3:/mytestbackuptestskipconfigset/ > s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/ > s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/ > s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/index/ > s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/shard_backup_metadata/ > s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/ > s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/ > s3:/mytestbackuptestskipconfigset/backuprestore_testskipconfigset/zk_backup_0/ > at __randomizedtesting.SeedInfo.seed([E3003B68FEA969F8:E8F9A46166EB3FEF]:0) > at org.junit.Assert.fail(Assert.java:89) > at org.junit.Assert.assertTrue(Assert.java:42) > at org.junit.Assert.assertFalse(Assert.java:65) > at org.apache.solr.cloud.api.collections.AbstractIncrementalBackupTest.testSkipConfigset(AbstractIncrementalBackupTest.java:378) > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) > at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) > at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) > at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) > at com.adobe.testing.s3mock.junit4.S3MockRule$1.evaluate(S3MockRule.java:66) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) > at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) > at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) > at java.base/java.lang.Thread.run(Thread.java:829) 2> NOTE: reproduce with: gradlew test --tests S3IncrementalBackupTest.testSkipConfigset -Dtests.seed=E3003B68FEA969F8 -Dtests.locale=sbp -Dtests.timezone=Chile/Continental -Dtests.asserts=true -Dtests.file.encoding=UTF-8 2> 161099 WARN (OverseerThreadFactory-45-thread-5) [n: c:backuprestore_testbackupincsimple_restore s: r: x: t:] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (backuprestore_testbackupincsimple_restore) without cores. 2> 167585 INFO (jetty-closer-120-thread-2) [n: c: s: r: x: t:] o.e.j.s.Server Stopped Server@4b87fb0c{STOPPING}[10.0.22,sto=0] 2> 167585 INFO (jetty-closer-120-thread-1) [n: c: s: r: x: t:] o.e.j.s.Server Stopped Server@679bdbd8{STOPPING}[10.0.22,sto=0] 2> 167603 INFO (jetty-closer-120-thread-2) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Stopped ServerConnector@18ac93e0{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0} 2> 167603 INFO (jetty-closer-120-thread-1) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Stopped ServerConnector@59c72279{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0} 2> 169524 INFO (jetty-closer-120-thread-2) [n: c: s: r: x: t:] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4f8cfff8{/solr,file:///build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/tmp/tests-cwd/,STOPPED} 2> 169672 INFO (jetty-closer-120-thread-1) [n: c: s: r: x: t:] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@539f60dc{/solr,file:///build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/tmp/tests-cwd/,STOPPED} 2> 169923 WARN (ZkTestServer Run Thread) [n: c: s: r: x: t:] o.a.s.c.ZkTestServer Watch limit violations: 2> Maximum concurrent create/delete watches above limit: 2> 2> 8 /solr/collections/backuprestore_testbackuprestoretooriginal/terms/shard1 2> 7 /solr/collections/backuprestore_testbackuprestoretooriginal/terms/shard2 2> 3 /solr/collections/backuprestore_testskipconfigset/terms/shard1 2> 3 /solr/collections/backuprestore_testskipconfigset/terms/shard2 2> 3 /solr/clusterprops.json 2> 3 /solr/collections/backuprestore_testbackupincsimple_restore/terms/shard2 2> 3 /solr/aliases.json 2> 3 /solr/collections/backuprestore_testbackupincsimple_restore/terms/shard1 2> 3 /solr/collections/backuprestore_testbackupincsimple/terms/shard2 2> 3 /solr/collections/backuprestore_testbackupincsimple/terms/shard1 2> 2 /solr/packages.json 2> 2 /solr/security.json 2> 2 /solr/collections/backuprestore_testbackupincsimple/collectionprops.json 2> 2 /solr/collections/backuprestore_testskipconfigset/collectionprops.json 2> 2 /solr/configs/conf1 2> 2 /solr/collections/backuprestore_testbackuprestoretooriginal/collectionprops.json 2> 2> Maximum concurrent data watches above limit: 2> 2> 19 /solr/collections/backuprestore_testbackupincsimple_restore/state.json 2> 15 /solr/collections/backuprestore_testbackuprestoretooriginal/state.json 2> 13 /solr/collections/backuprestore_testbackupincsimple/state.json 2> 13 /solr/collections/backuprestore_testskipconfigset/state.json 2> 2> Maximum concurrent children watches above limit: 2> 2> 67 /solr/overseer/queue 2> 21 /solr/overseer/collection-queue-work 2> 15 /solr/collections 2> 11 /solr/live_nodes 2> 5 /solr/collections/backuprestore_testbackuprestoretooriginal/state.json 2> 5 /solr/collections/backuprestore_testbackupincsimple_restore/state.json 2> 5 /solr/collections/backuprestore_testbackupincsimple/state.json 2> 5 /solr/collections/backuprestore_testskipconfigset/state.json 2> 2> 170049 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.Server Stopped Server@24ab2359{STOPPING}[10.0.22,sto=0] 2> 170052 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Stopped SslValidatingServerConnector@4ceeaf92{SSL, (ssl, http/1.1)}{0.0.0.0:0} 2> 170057 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.AbstractConnector Stopped ServerConnector@310b2403{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2> 170063 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.h.C.application Destroying Spring FrameworkServlet 'dispatcherServlet' 2> 170065 INFO (SUITE-S3IncrementalBackupTest-seed#[E3003B68FEA969F8]-worker) [n: c: s: r: x: t:] o.e.j.s.h.ContextHandler Stopped o.s.b.w.e.j.JettyEmbeddedWebAppContext@7ce5fd57{application,/,[file:///build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/tmp/tests-tmp/jetty-docbase.0.11805860284012450550/],STOPPED} 2> NOTE: leaving temporary files on disk at: /build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/tmp/tests-tmp/org.apache.solr.s3.S3IncrementalBackupTest_E3003B68FEA969F8-001 2> NOTE: test params are: codec=DeflateWithPresetCompressingStoredFieldsData(storedFieldsFormat=Lucene90CompressingStoredFieldsFormat(compressionMode=BEST_COMPRESSION, chunkSize=30461, maxDocsPerChunk=4, blockShift=22), termVectorsFormat=Lucene90CompressingTermVectorsFormat(compressionMode=BEST_COMPRESSION, chunkSize=30461, maxDocsPerChunk=4, blockSize=22)), sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=sbp, timezone=Chile/Continental 2> NOTE: Linux 6.1.80-2-sophgo-11457-g83ab3eda46e6 riscv64/Arch Linux 11.0.26 (64-bit)/cpus=1,threads=2,free=221605536,total=529006592 2> NOTE: All tests run in this JVM: [S3IncrementalBackupTest] > Task :solr:modules:sql:test :solr:modules:sql:test (SUCCESS): 33 test(s) > Task :solr:modules:sql:wipeTaskTemp > Task :solr:modules:s3-repository:test FAILED :solr:modules:s3-repository:test (FAILURE): 52 test(s), 2 failure(s), 1 skipped 52 tests completed, 2 failed, 1 skipped > Task :solr:modules:s3-repository:wipeTaskTemp > Task :solr:core:test WARNING: Test org.apache.solr.search.facet.TestCloudJSONFacetSKG wrote 25,088,960 bytes of output. > Task :solr:modules:hdfs:test :solr:modules:hdfs:test (SUCCESS): 104 test(s), 45 skipped > Task :solr:modules:hdfs:wipeTaskTemp > Task :solr:core:test WARNING: Test org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv wrote 14,549,582 bytes of output. :solr:core:test (FAILURE): 5180 test(s), 1 failure(s), 216 skipped 5180 tests completed, 1 failed, 216 skipped > Task :solr:core:test FAILED > Task :solr:core:wipeTaskTemp ERROR: The following test(s) have failed: - org.apache.solr.s3.S3IncrementalBackupTest.testRestoreToOriginalCollection (:solr:modules:s3-repository) Test history: https://ge.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.s3.S3IncrementalBackupTest&tests.test=testRestoreToOriginalCollection http://fucit.org/solr-jenkins-reports/history-trend-of-recent-failures.html#series/org.apache.solr.s3.S3IncrementalBackupTest.testRestoreToOriginalCollection Test output: /build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/test-results/test/outputs/OUTPUT-org.apache.solr.s3.S3IncrementalBackupTest.txt Reproduce with: ./gradlew :solr:modules:s3-repository:test --tests "org.apache.solr.s3.S3IncrementalBackupTest.testRestoreToOriginalCollection" -Ptests.jvms=12 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" -Ptests.seed=E3003B68FEA969F8 -Ptests.file.encoding=ISO-8859-1 - org.apache.solr.s3.S3IncrementalBackupTest.testSkipConfigset (:solr:modules:s3-repository) Test history: https://ge.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.s3.S3IncrementalBackupTest&tests.test=testSkipConfigset http://fucit.org/solr-jenkins-reports/history-trend-of-recent-failures.html#series/org.apache.solr.s3.S3IncrementalBackupTest.testSkipConfigset Test output: /build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/test-results/test/outputs/OUTPUT-org.apache.solr.s3.S3IncrementalBackupTest.txt Reproduce with: ./gradlew :solr:modules:s3-repository:test --tests "org.apache.solr.s3.S3IncrementalBackupTest.testSkipConfigset" -Ptests.jvms=12 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" -Ptests.seed=E3003B68FEA969F8 -Ptests.file.encoding=ISO-8859-1 - org.apache.solr.cloud.UnloadDistributedZkTest.test (:solr:core) Test history: https://ge.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.cloud.UnloadDistributedZkTest&tests.test=test http://fucit.org/solr-jenkins-reports/history-trend-of-recent-failures.html#series/org.apache.solr.cloud.UnloadDistributedZkTest.test Test output: /build/solr/src/solr-9.8.0/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.UnloadDistributedZkTest.txt Reproduce with: ./gradlew :solr:core:test --tests "org.apache.solr.cloud.UnloadDistributedZkTest.test" -Ptests.jvms=12 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" -Ptests.seed=E3003B68FEA969F8 -Ptests.file.encoding=ISO-8859-1 FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':solr:modules:s3-repository:test'. > There were failing tests. See the results at: file:///build/solr/src/solr-9.8.0/solr/modules/s3-repository/build/test-results/test/ ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':solr:core:test'. > There were failing tests. See the results at: file:///build/solr/src/solr-9.8.0/solr/core/build/test-results/test/ ============================================================================== BUILD FAILED in 1h 6m 34s 167 actionable tasks: 123 executed, 44 up-to-date ==> ERROR: A failure occurred in check().  Aborting... ==> ERROR: Build failed, check /var/lib/archbuild/extra-riscv64/felix-0/build [?25h[?25h[?25hreceiving incremental file list solr-9.8.0-1-riscv64-build.log solr-9.8.0-1-riscv64-check.log solr-9.8.0-1-riscv64-prepare.log sent 81 bytes received 38,453 bytes 77,068.00 bytes/sec total size is 371,845 speedup is 9.65