==> Building on PP ==> Attempt to run pkgver()... ==> Making package: mimir 2.4.0-1 (Thu 01 Dec 2022 10:22:39 PM EET) ==> Checking runtime dependencies... ==> Checking buildtime dependencies... ==> Retrieving sources...  -> Updating mimir git repo...  -> Found systemd.service  -> Found sysusers.conf  -> Found tmpfiles.conf  -> Found config.yaml ==> Validating source files with b2sums... ==> Extracting sources...  -> Creating working copy of mimir git repo... ==> Starting prepare()... ==> Starting pkgver()... ==> Sources are ready. ==> Checking for remote environment... ==> Syncing package to remote host... sending incremental file list created directory packages/mimir ./ PKGBUILD 2,381 100% 0.00kB/s 0:00:00 2,381 100% 0.00kB/s 0:00:00 (xfr#1, to-chk=5/7) config.yaml 38 100% 37.11kB/s 0:00:00 38 100% 37.11kB/s 0:00:00 (xfr#2, to-chk=4/7) mimir-2.4.0-1.log 1,328 100% 1.27MB/s 0:00:00 1,328 100% 1.27MB/s 0:00:00 (xfr#3, to-chk=3/7) systemd.service 1,011 100% 987.30kB/s 0:00:00 1,011 100% 987.30kB/s 0:00:00 (xfr#4, to-chk=2/7) sysusers.conf 45 100% 43.95kB/s 0:00:00 45 100% 43.95kB/s 0:00:00 (xfr#5, to-chk=1/7) tmpfiles.conf 34 100% 33.20kB/s 0:00:00 34 100% 33.20kB/s 0:00:00 (xfr#6, to-chk=0/7) sent 2,788 bytes received 170 bytes 1,972.00 bytes/sec total size is 4,558 speedup is 1.54 ==> Patching arch to riscv64... ==> Running extra-riscv64-build -- -d /home/felix/packages/riscv64-pkg-cache:/var/cache/pacman/pkg -l felix0 on remote host... [?25l:: Synchronizing package databases... core downloading... extra downloading... community downloading... :: Starting full system upgrade... there is nothing to do [?25h==> Building in chroot for [extra] (riscv64)... ==> Synchronizing chroot copy [/var/lib/archbuild/extra-riscv64/root] -> [felix0]...done ==> Making package: mimir 2.4.0-1 (Thu Dec 1 20:23:53 2022) ==> Retrieving sources...  -> Cloning mimir git repo... Cloning into bare repository '/home/felix/packages/mimir/mimir'... remote: Enumerating objects: 192691, done. remote: Counting objects: 0% (1/2276) remote: Counting objects: 1% (23/2276) remote: Counting objects: 2% (46/2276) remote: Counting objects: 3% (69/2276) remote: Counting objects: 4% (92/2276) remote: Counting objects: 5% (114/2276) remote: Counting objects: 6% (137/2276) remote: Counting objects: 7% (160/2276) remote: Counting objects: 8% (183/2276) remote: Counting objects: 9% (205/2276) remote: Counting objects: 10% (228/2276) remote: Counting objects: 11% (251/2276) remote: Counting objects: 12% (274/2276) remote: Counting objects: 13% (296/2276) remote: Counting objects: 14% (319/2276) remote: Counting objects: 15% (342/2276) remote: Counting objects: 16% (365/2276) remote: Counting objects: 17% (387/2276) remote: Counting objects: 18% (410/2276) remote: Counting objects: 19% (433/2276) remote: Counting objects: 20% (456/2276) remote: Counting objects: 21% (478/2276) remote: Counting objects: 22% (501/2276) remote: Counting objects: 23% (524/2276) remote: Counting objects: 24% (547/2276) remote: Counting objects: 25% (569/2276) remote: Counting objects: 26% (592/2276) remote: Counting objects: 27% (615/2276) remote: Counting objects: 28% (638/2276) remote: Counting objects: 29% (661/2276) remote: Counting objects: 30% (683/2276) remote: Counting objects: 31% (706/2276) remote: Counting objects: 32% (729/2276) remote: Counting objects: 33% (752/2276) remote: Counting objects: 34% (774/2276) remote: Counting objects: 35% (797/2276) remote: Counting objects: 36% (820/2276) remote: Counting objects: 37% (843/2276) remote: Counting objects: 38% (865/2276) remote: Counting objects: 39% (888/2276) remote: Counting objects: 40% (911/2276) remote: Counting objects: 41% (934/2276) remote: Counting objects: 42% (956/2276) remote: Counting objects: 43% (979/2276) remote: Counting objects: 44% (1002/2276) remote: Counting objects: 45% (1025/2276) remote: Counting objects: 46% (1047/2276) remote: Counting objects: 47% (1070/2276) remote: Counting objects: 48% (1093/2276) remote: Counting objects: 49% (1116/2276) remote: Counting objects: 50% (1138/2276) remote: Counting objects: 51% (1161/2276) remote: Counting objects: 52% (1184/2276) remote: Counting objects: 53% (1207/2276) remote: Counting objects: 54% (1230/2276) remote: Counting objects: 55% (1252/2276) remote: Counting objects: 56% (1275/2276) remote: Counting objects: 57% (1298/2276) remote: Counting objects: 58% (1321/2276) remote: Counting objects: 59% (1343/2276) remote: Counting objects: 60% (1366/2276) remote: Counting objects: 61% (1389/2276) remote: Counting objects: 62% (1412/2276) remote: Counting objects: 63% (1434/2276) remote: Counting objects: 64% (1457/2276) remote: Counting objects: 65% (1480/2276) remote: Counting objects: 66% (1503/2276) remote: Counting objects: 67% (1525/2276) remote: Counting objects: 68% (1548/2276) remote: Counting objects: 69% (1571/2276) remote: Counting objects: 70% (1594/2276) remote: Counting objects: 71% (1616/2276) remote: Counting objects: 72% (1639/2276) remote: Counting objects: 73% (1662/2276) remote: Counting objects: 74% (1685/2276) remote: Counting objects: 75% (1707/2276) remote: Counting objects: 76% (1730/2276) remote: Counting objects: 77% (1753/2276) remote: Counting objects: 78% (1776/2276) remote: Counting objects: 79% (1799/2276) remote: Counting objects: 80% (1821/2276) remote: Counting objects: 81% (1844/2276) remote: Counting objects: 82% (1867/2276) remote: Counting objects: 83% (1890/2276) remote: Counting objects: 84% (1912/2276) remote: Counting objects: 85% (1935/2276) remote: Counting objects: 86% (1958/2276) remote: Counting objects: 87% (1981/2276) remote: Counting objects: 88% (2003/2276) remote: Counting objects: 89% (2026/2276) remote: Counting objects: 90% (2049/2276) remote: Counting objects: 91% (2072/2276) remote: Counting objects: 92% (2094/2276) remote: Counting objects: 93% (2117/2276) remote: Counting objects: 94% (2140/2276) remote: Counting objects: 95% (2163/2276) remote: Counting objects: 96% (2185/2276) remote: Counting objects: 97% (2208/2276) remote: Counting objects: 98% (2231/2276) remote: Counting objects: 99% (2254/2276) remote: Counting objects: 100% (2276/2276) remote: Counting objects: 100% (2276/2276), done. remote: Compressing objects: 0% (1/783) remote: Compressing objects: 1% (8/783) remote: Compressing objects: 2% (16/783) remote: Compressing objects: 3% (24/783) remote: Compressing objects: 4% (32/783) remote: Compressing objects: 5% (40/783) remote: Compressing objects: 6% (47/783) remote: Compressing objects: 7% (55/783) remote: Compressing objects: 8% (63/783) remote: Compressing objects: 9% (71/783) remote: Compressing objects: 10% (79/783) remote: Compressing objects: 11% (87/783) remote: Compressing objects: 12% (94/783) remote: Compressing objects: 13% (102/783) remote: Compressing objects: 14% (110/783) remote: Compressing objects: 15% (118/783) remote: Compressing objects: 16% (126/783) remote: Compressing objects: 17% (134/783) remote: Compressing objects: 18% (141/783) remote: Compressing objects: 19% (149/783) remote: Compressing objects: 20% (157/783) remote: Compressing objects: 21% (165/783) remote: Compressing objects: 22% (173/783) remote: Compressing objects: 23% (181/783) remote: Compressing objects: 24% (188/783) remote: Compressing objects: 25% (196/783) remote: Compressing objects: 26% (204/783) remote: Compressing objects: 27% (212/783) remote: Compressing objects: 28% (220/783) remote: Compressing objects: 29% (228/783) remote: Compressing objects: 30% (235/783) remote: Compressing objects: 31% (243/783) remote: Compressing objects: 32% (251/783) remote: Compressing objects: 33% (259/783) remote: Compressing objects: 34% (267/783) remote: Compressing objects: 35% (275/783) remote: Compressing objects: 36% (282/783) remote: Compressing objects: 37% (290/783) remote: Compressing objects: 38% (298/783) remote: Compressing objects: 39% (306/783) remote: Compressing objects: 40% (314/783) remote: Compressing objects: 41% (322/783) remote: Compressing objects: 42% (329/783) remote: Compressing objects: 43% (337/783) remote: Compressing objects: 44% (345/783) remote: Compressing objects: 45% (353/783) remote: Compressing objects: 46% (361/783) remote: Compressing objects: 47% (369/783) remote: Compressing objects: 48% (376/783) remote: Compressing objects: 49% (384/783) remote: Compressing objects: 50% (392/783) remote: Compressing objects: 51% (400/783) remote: Compressing objects: 52% (408/783) remote: Compressing objects: 53% (415/783) remote: Compressing objects: 54% (423/783) remote: Compressing objects: 55% (431/783) remote: Compressing objects: 56% (439/783) remote: Compressing objects: 57% (447/783) remote: Compressing objects: 58% (455/783) remote: Compressing objects: 59% (462/783) remote: Compressing objects: 60% (470/783) remote: Compressing objects: 61% (478/783) remote: Compressing objects: 62% (486/783) remote: Compressing objects: 63% (494/783) remote: Compressing objects: 64% (502/783) remote: Compressing objects: 65% (509/783) remote: Compressing objects: 66% (517/783) remote: Compressing objects: 67% (525/783) remote: Compressing objects: 68% (533/783) remote: Compressing objects: 69% (541/783) remote: Compressing objects: 70% (549/783) remote: Compressing objects: 71% (556/783) remote: Compressing objects: 72% (564/783) remote: Compressing objects: 73% (572/783) remote: Compressing objects: 74% (580/783) remote: Compressing objects: 75% (588/783) remote: Compressing objects: 76% (596/783) remote: Compressing objects: 77% (603/783) remote: Compressing objects: 78% (611/783) remote: Compressing objects: 79% (619/783) remote: Compressing objects: 80% (627/783) remote: Compressing objects: 81% (635/783) remote: Compressing objects: 82% (643/783) remote: Compressing objects: 83% (650/783) remote: Compressing objects: 84% (658/783) remote: Compressing objects: 85% (666/783) remote: Compressing objects: 86% (674/783) remote: Compressing objects: 87% (682/783) remote: Compressing objects: 88% (690/783) remote: Compressing objects: 89% (697/783) remote: Compressing objects: 90% (705/783) remote: Compressing objects: 91% (713/783) remote: Compressing objects: 92% (721/783) remote: Compressing objects: 93% (729/783) remote: Compressing objects: 94% (737/783) remote: Compressing objects: 95% (744/783) remote: Compressing objects: 96% (752/783) remote: Compressing objects: 97% (760/783) remote: Compressing objects: 98% (768/783) remote: Compressing objects: 99% (776/783) remote: Compressing objects: 100% (783/783) remote: Compressing objects: 100% (783/783), done. Receiving objects: 0% (1/192691) Receiving objects: 1% (1927/192691) Receiving objects: 2% (3854/192691) Receiving objects: 3% (5781/192691), 2.37 MiB | 4.73 MiB/s Receiving objects: 4% (7708/192691), 2.37 MiB | 4.73 MiB/s Receiving objects: 4% (8849/192691), 2.37 MiB | 4.73 MiB/s Receiving objects: 5% (9635/192691), 4.57 MiB | 4.56 MiB/s Receiving objects: 6% (11562/192691), 7.30 MiB | 4.86 MiB/s Receiving objects: 6% (12137/192691), 7.30 MiB | 4.86 MiB/s Receiving objects: 7% (13489/192691), 9.84 MiB | 4.92 MiB/s Receiving objects: 7% (14437/192691), 12.10 MiB | 4.84 MiB/s Receiving objects: 8% (15416/192691), 13.61 MiB | 4.53 MiB/s Receiving objects: 9% (17343/192691), 15.95 MiB | 4.55 MiB/s Receiving objects: 9% (18385/192691), 15.95 MiB | 4.55 MiB/s Receiving objects: 10% (19270/192691), 18.25 MiB | 4.56 MiB/s Receiving objects: 11% (21197/192691), 20.82 MiB | 4.62 MiB/s Receiving objects: 11% (21646/192691), 20.82 MiB | 4.62 MiB/s Receiving objects: 12% (23123/192691), 25.21 MiB | 4.59 MiB/s Receiving objects: 12% (24446/192691), 27.53 MiB | 4.49 MiB/s Receiving objects: 13% (25050/192691), 27.53 MiB | 4.49 MiB/s Receiving objects: 14% (26977/192691), 30.32 MiB | 4.55 MiB/s Receiving objects: 14% (27539/192691), 30.32 MiB | 4.55 MiB/s Receiving objects: 15% (28904/192691), 33.04 MiB | 4.65 MiB/s Receiving objects: 16% (30831/192691), 35.84 MiB | 4.94 MiB/s Receiving objects: 16% (32062/192691), 38.28 MiB | 4.96 MiB/s Receiving objects: 17% (32758/192691), 40.68 MiB | 4.98 MiB/s Receiving objects: 17% (34553/192691), 40.68 MiB | 4.98 MiB/s Receiving objects: 18% (34685/192691), 43.07 MiB | 4.94 MiB/s Receiving objects: 19% (36612/192691), 43.07 MiB | 4.94 MiB/s Receiving objects: 20% (38539/192691), 43.07 MiB | 4.94 MiB/s Receiving objects: 21% (40466/192691), 45.40 MiB | 5.00 MiB/s Receiving objects: 21% (42199/192691), 45.40 MiB | 5.00 MiB/s Receiving objects: 22% (42393/192691), 45.40 MiB | 5.00 MiB/s Receiving objects: 23% (44319/192691), 48.19 MiB | 5.10 MiB/s Receiving objects: 24% (46246/192691), 50.78 MiB | 5.17 MiB/s Receiving objects: 24% (47062/192691), 50.78 MiB | 5.17 MiB/s Receiving objects: 25% (48173/192691), 52.65 MiB | 4.96 MiB/s Receiving objects: 26% (50100/192691), 52.65 MiB | 4.96 MiB/s Receiving objects: 27% (52027/192691), 54.54 MiB | 4.78 MiB/s Receiving objects: 28% (53954/192691), 54.54 MiB | 4.78 MiB/s Receiving objects: 28% (54163/192691), 54.54 MiB | 4.78 MiB/s Receiving objects: 29% (55881/192691), 58.31 MiB | 4.45 MiB/s Receiving objects: 29% (57749/192691), 58.31 MiB | 4.45 MiB/s Receiving objects: 30% (57808/192691), 58.31 MiB | 4.45 MiB/s Receiving objects: 31% (59735/192691), 62.06 MiB | 4.22 MiB/s Receiving objects: 32% (61662/192691), 62.06 MiB | 4.22 MiB/s Receiving objects: 33% (63589/192691), 62.06 MiB | 4.22 MiB/s Receiving objects: 33% (65147/192691), 62.06 MiB | 4.22 MiB/s Receiving objects: 34% (65515/192691), 63.88 MiB | 4.10 MiB/s Receiving objects: 35% (67442/192691), 63.88 MiB | 4.10 MiB/s Receiving objects: 36% (69369/192691), 63.88 MiB | 4.10 MiB/s Receiving objects: 37% (71296/192691), 65.73 MiB | 3.90 MiB/s Receiving objects: 37% (73007/192691), 65.73 MiB | 3.90 MiB/s Receiving objects: 38% (73223/192691), 65.73 MiB | 3.90 MiB/s Receiving objects: 39% (75150/192691), 67.75 MiB | 3.77 MiB/s Receiving objects: 40% (77077/192691), 67.75 MiB | 3.77 MiB/s Receiving objects: 41% (79004/192691), 70.55 MiB | 3.97 MiB/s Receiving objects: 41% (80630/192691), 70.55 MiB | 3.97 MiB/s Receiving objects: 42% (80931/192691), 73.14 MiB | 4.13 MiB/s Receiving objects: 43% (82858/192691), 73.14 MiB | 4.13 MiB/s Receiving objects: 44% (84785/192691), 75.09 MiB | 4.14 MiB/s Receiving objects: 44% (86055/192691), 75.09 MiB | 4.14 MiB/s Receiving objects: 45% (86711/192691), 76.96 MiB | 4.13 MiB/s Receiving objects: 46% (88638/192691), 78.93 MiB | 4.14 MiB/s Receiving objects: 46% (89294/192691), 80.95 MiB | 4.17 MiB/s Receiving objects: 46% (89294/192691), 84.88 MiB | 4.23 MiB/s Receiving objects: 46% (89294/192691), 88.99 MiB | 4.07 MiB/s Receiving objects: 46% (89294/192691), 94.31 MiB | 4.25 MiB/s Receiving objects: 47% (90565/192691), 96.91 MiB | 4.42 MiB/s Receiving objects: 48% (92492/192691), 96.91 MiB | 4.42 MiB/s Receiving objects: 48% (93355/192691), 96.91 MiB | 4.42 MiB/s Receiving objects: 49% (94419/192691), 96.91 MiB | 4.42 MiB/s Receiving objects: 50% (96346/192691), 99.46 MiB | 4.56 MiB/s Receiving objects: 51% (98273/192691), 99.46 MiB | 4.56 MiB/s Receiving objects: 52% (100200/192691), 99.46 MiB | 4.56 MiB/s Receiving objects: 53% (102127/192691), 102.28 MiB | 4.74 MiB/s Receiving objects: 54% (104054/192691), 102.28 MiB | 4.74 MiB/s Receiving objects: 54% (105156/192691), 102.28 MiB | 4.74 MiB/s Receiving objects: 55% (105981/192691), 105.10 MiB | 4.91 MiB/s Receiving objects: 56% (107907/192691), 105.10 MiB | 4.91 MiB/s Receiving objects: 57% (109834/192691), 105.10 MiB | 4.91 MiB/s Receiving objects: 58% (111761/192691), 107.94 MiB | 5.12 MiB/s Receiving objects: 58% (112032/192691), 107.94 MiB | 5.12 MiB/s Receiving objects: 59% (113688/192691), 110.46 MiB | 5.25 MiB/s Receiving objects: 60% (115615/192691), 110.46 MiB | 5.25 MiB/s Receiving objects: 61% (117542/192691), 112.95 MiB | 5.32 MiB/s Receiving objects: 62% (119469/192691), 112.95 MiB | 5.32 MiB/s Receiving objects: 63% (121396/192691), 112.95 MiB | 5.32 MiB/s Receiving objects: 63% (122593/192691), 112.95 MiB | 5.32 MiB/s Receiving objects: 64% (123323/192691), 115.20 MiB | 5.21 MiB/s Receiving objects: 65% (125250/192691), 115.20 MiB | 5.21 MiB/s Receiving objects: 66% (127177/192691), 117.62 MiB | 5.17 MiB/s Receiving objects: 67% (129103/192691), 117.62 MiB | 5.17 MiB/s Receiving objects: 67% (129932/192691), 117.62 MiB | 5.17 MiB/s Receiving objects: 68% (131030/192691), 120.14 MiB | 5.15 MiB/s Receiving objects: 69% (132957/192691), 120.14 MiB | 5.15 MiB/s Receiving objects: 69% (134883/192691), 124.60 MiB | 4.95 MiB/s Receiving objects: 70% (134884/192691), 124.60 MiB | 4.95 MiB/s Receiving objects: 71% (136811/192691), 126.93 MiB | 4.84 MiB/s Receiving objects: 71% (137807/192691), 126.93 MiB | 4.84 MiB/s Receiving objects: 72% (138738/192691), 129.48 MiB | 4.78 MiB/s Receiving objects: 73% (140665/192691), 129.48 MiB | 4.78 MiB/s Receiving objects: 74% (142592/192691), 129.48 MiB | 4.78 MiB/s Receiving objects: 75% (144519/192691), 131.76 MiB | 4.73 MiB/s Receiving objects: 76% (146446/192691), 131.76 MiB | 4.73 MiB/s Receiving objects: 76% (146943/192691), 131.76 MiB | 4.73 MiB/s Receiving objects: 77% (148373/192691), 134.04 MiB | 4.69 MiB/s Receiving objects: 78% (150299/192691), 134.04 MiB | 4.69 MiB/s Receiving objects: 79% (152226/192691), 134.04 MiB | 4.69 MiB/s Receiving objects: 80% (154153/192691), 134.04 MiB | 4.69 MiB/s Receiving objects: 81% (156080/192691), 134.04 MiB | 4.69 MiB/s Receiving objects: 82% (158007/192691), 134.04 MiB | 4.69 MiB/s Receiving objects: 83% (159934/192691), 136.85 MiB | 4.81 MiB/s Receiving objects: 84% (161861/192691), 136.85 MiB | 4.81 MiB/s Receiving objects: 85% (163788/192691), 136.85 MiB | 4.81 MiB/s Receiving objects: 86% (165715/192691), 136.85 MiB | 4.81 MiB/s Receiving objects: 87% (167642/192691), 136.85 MiB | 4.81 MiB/s Receiving objects: 88% (169569/192691), 136.85 MiB | 4.81 MiB/s Receiving objects: 88% (170770/192691), 136.85 MiB | 4.81 MiB/s Receiving objects: 89% (171495/192691), 136.85 MiB | 4.81 MiB/s Receiving objects: 90% (173422/192691), 136.85 MiB | 4.81 MiB/s Receiving objects: 91% (175349/192691), 139.56 MiB | 4.88 MiB/s Receiving objects: 92% (177276/192691), 139.56 MiB | 4.88 MiB/s Receiving objects: 93% (179203/192691), 142.41 MiB | 4.95 MiB/s Receiving objects: 93% (179520/192691), 142.41 MiB | 4.95 MiB/s Receiving objects: 94% (181130/192691), 142.41 MiB | 4.95 MiB/s Receiving objects: 95% (183057/192691), 142.41 MiB | 4.95 MiB/s Receiving objects: 96% (184984/192691), 145.12 MiB | 5.07 MiB/s Receiving objects: 97% (186911/192691), 145.12 MiB | 5.07 MiB/s Receiving objects: 98% (188838/192691), 145.12 MiB | 5.07 MiB/s Receiving objects: 98% (190037/192691), 150.39 MiB | 5.21 MiB/s Receiving objects: 98% (190037/192691), 155.43 MiB | 5.26 MiB/s Receiving objects: 98% (190037/192691), 160.59 MiB | 5.27 MiB/s Receiving objects: 98% (190037/192691), 166.23 MiB | 5.29 MiB/s Receiving objects: 98% (190037/192691), 171.48 MiB | 5.27 MiB/s Receiving objects: 98% (190038/192691), 176.43 MiB | 5.23 MiB/s Receiving objects: 98% (190038/192691), 181.51 MiB | 5.30 MiB/s Receiving objects: 98% (190038/192691), 186.55 MiB | 5.15 MiB/s Receiving objects: 98% (190038/192691), 191.42 MiB | 4.97 MiB/s Receiving objects: 98% (190038/192691), 197.15 MiB | 5.07 MiB/s Receiving objects: 99% (190765/192691), 199.84 MiB | 5.20 MiB/s Receiving objects: 99% (192653/192691), 199.84 MiB | 5.20 MiB/s remote: Total 192691 (delta 1540), reused 2051 (delta 1441), pack-reused 190415 Receiving objects: 100% (192691/192691), 199.84 MiB | 5.20 MiB/s Receiving objects: 100% (192691/192691), 201.53 MiB | 4.79 MiB/s, done. Resolving deltas: 0% (0/133192) Resolving deltas: 1% (1332/133192) Resolving deltas: 1% (1559/133192) Resolving deltas: 1% (2243/133192) Resolving deltas: 2% (2664/133192) Resolving deltas: 2% (3390/133192) Resolving deltas: 3% (3996/133192) Resolving deltas: 3% (4608/133192) Resolving deltas: 4% (5328/133192) Resolving deltas: 5% (6660/133192) Resolving deltas: 5% (7750/133192) Resolving deltas: 6% (7992/133192) Resolving deltas: 7% (9324/133192) Resolving deltas: 8% (10656/133192) Resolving deltas: 8% (11637/133192) Resolving deltas: 9% (11988/133192) Resolving deltas: 10% (13321/133192) Resolving deltas: 11% (14653/133192) Resolving deltas: 12% (15984/133192) Resolving deltas: 13% (17316/133192) Resolving deltas: 14% (18647/133192) Resolving deltas: 14% (18719/133192) Resolving deltas: 15% (19979/133192) Resolving deltas: 16% (21312/133192) Resolving deltas: 17% (22643/133192) Resolving deltas: 17% (23112/133192) Resolving deltas: 18% (23977/133192) Resolving deltas: 19% (25307/133192) Resolving deltas: 20% (26639/133192) Resolving deltas: 21% (27971/133192) Resolving deltas: 21% (28067/133192) Resolving deltas: 22% (29303/133192) Resolving deltas: 23% (30635/133192) Resolving deltas: 24% (31967/133192) Resolving deltas: 25% (33299/133192) Resolving deltas: 26% (34630/133192) Resolving deltas: 26% (34806/133192) Resolving deltas: 27% (35962/133192) Resolving deltas: 28% (37294/133192) Resolving deltas: 29% (38626/133192) Resolving deltas: 30% (39958/133192) Resolving deltas: 30% (40627/133192) Resolving deltas: 31% (41290/133192) Resolving deltas: 32% (42622/133192) Resolving deltas: 33% (43954/133192) Resolving deltas: 34% (45286/133192) Resolving deltas: 34% (46412/133192) Resolving deltas: 35% (46618/133192) Resolving deltas: 36% (47950/133192) Resolving deltas: 37% (49282/133192) Resolving deltas: 37% (50434/133192) Resolving deltas: 38% (50613/133192) Resolving deltas: 39% (51945/133192) Resolving deltas: 40% (53277/133192) Resolving deltas: 41% (54609/133192) Resolving deltas: 42% (55941/133192) Resolving deltas: 43% (57273/133192) Resolving deltas: 44% (58605/133192) Resolving deltas: 45% (59938/133192) Resolving deltas: 45% (59980/133192) Resolving deltas: 46% (61269/133192) Resolving deltas: 47% (62601/133192) Resolving deltas: 48% (63933/133192) Resolving deltas: 49% (65265/133192) Resolving deltas: 50% (66596/133192) Resolving deltas: 51% (67928/133192) Resolving deltas: 52% (69261/133192) Resolving deltas: 52% (69862/133192) Resolving deltas: 53% (70592/133192) Resolving deltas: 54% (71924/133192) Resolving deltas: 55% (73256/133192) Resolving deltas: 56% (74588/133192) Resolving deltas: 57% (75920/133192) Resolving deltas: 58% (77252/133192) Resolving deltas: 59% (78584/133192) Resolving deltas: 59% (78764/133192) Resolving deltas: 60% (79916/133192) Resolving deltas: 61% (81248/133192) Resolving deltas: 62% (82580/133192) Resolving deltas: 63% (83911/133192) Resolving deltas: 64% (85243/133192) Resolving deltas: 65% (86575/133192) Resolving deltas: 65% (87782/133192) Resolving deltas: 66% (87907/133192) Resolving deltas: 67% (89239/133192) Resolving deltas: 68% (90571/133192) Resolving deltas: 69% (91903/133192) Resolving deltas: 70% (93235/133192) Resolving deltas: 70% (94450/133192) Resolving deltas: 71% (94567/133192) Resolving deltas: 72% (95900/133192) Resolving deltas: 73% (97231/133192) Resolving deltas: 74% (98563/133192) Resolving deltas: 75% (99895/133192) Resolving deltas: 76% (101226/133192) Resolving deltas: 76% (101286/133192) Resolving deltas: 77% (102558/133192) Resolving deltas: 78% (103890/133192) Resolving deltas: 79% (105222/133192) Resolving deltas: 80% (106554/133192) Resolving deltas: 80% (107393/133192) Resolving deltas: 81% (107886/133192) Resolving deltas: 82% (109218/133192) Resolving deltas: 82% (110400/133192) Resolving deltas: 83% (110550/133192) Resolving deltas: 84% (111882/133192) Resolving deltas: 85% (113214/133192) Resolving deltas: 86% (114546/133192) Resolving deltas: 87% (115878/133192) Resolving deltas: 88% (117209/133192) Resolving deltas: 89% (118541/133192) Resolving deltas: 89% (119030/133192) Resolving deltas: 90% (119873/133192) Resolving deltas: 91% (121205/133192) Resolving deltas: 92% (122538/133192) Resolving deltas: 93% (123869/133192) Resolving deltas: 94% (125201/133192) Resolving deltas: 95% (126533/133192) Resolving deltas: 95% (127479/133192) Resolving deltas: 96% (127865/133192) Resolving deltas: 97% (129197/133192) Resolving deltas: 98% (130529/133192) Resolving deltas: 99% (131861/133192) Resolving deltas: 100% (133192/133192) Resolving deltas: 100% (133192/133192), done.  -> Found systemd.service  -> Found sysusers.conf  -> Found tmpfiles.conf  -> Found config.yaml ==> Validating source files with b2sums... mimir ... Skipped systemd.service ... Passed sysusers.conf ... Passed tmpfiles.conf ... Passed config.yaml ... Passed ==> Making package: mimir 2.4.0-1 (Thu Dec 1 20:25:58 2022) ==> Checking runtime dependencies... ==> Checking buildtime dependencies... ==> Installing missing dependencies... [?25lresolving dependencies... looking for conflicting packages... Package (5) New Version Net Change extra/perl-error 0.17029-4 0.04 MiB extra/perl-mailtools 2.21-6 0.11 MiB extra/perl-timedate 2.33-4 0.08 MiB extra/git 2.38.1-2 32.84 MiB community/go 2:1.19.3-1 434.45 MiB Total Installed Size: 467.52 MiB :: Proceed with installation? [Y/n] checking keyring... checking package integrity... loading package files... checking for file conflicts... :: Processing package changes... installing perl-error... installing perl-timedate... installing perl-mailtools... installing git... Optional dependencies for git tk: gitk and git gui perl-libwww: git svn perl-term-readkey: git svn and interactive.singlekey setting perl-io-socket-ssl: git send-email TLS support perl-authen-sasl: git send-email TLS support perl-mediawiki-api: git mediawiki support perl-datetime-format-iso8601: git mediawiki support perl-lwp-protocol-https: git mediawiki https support perl-cgi: gitweb (web interface) support python: git svn & git p4 subversion: git svn org.freedesktop.secrets: keyring credential helper libsecret: libsecret credential helper [installed] installing go... :: Running post-transaction hooks... (1/1) Warn about old perl modules [?25h==> Retrieving sources...  -> Found systemd.service  -> Found sysusers.conf  -> Found tmpfiles.conf  -> Found config.yaml ==> WARNING: Skipping all source file integrity checks. ==> Extracting sources...  -> Creating working copy of mimir git repo... Cloning into 'mimir'... done. Updating files: 9% (791/8463) Updating files: 10% (847/8463) Updating files: 11% (931/8463) Updating files: 12% (1016/8463) Updating files: 13% (1101/8463) Updating files: 14% (1185/8463) Updating files: 15% (1270/8463) Updating files: 16% (1355/8463) Updating files: 17% (1439/8463) Updating files: 18% (1524/8463) Updating files: 19% (1608/8463) Updating files: 19% (1638/8463) Updating files: 20% (1693/8463) Updating files: 21% (1778/8463) Updating files: 22% (1862/8463) Updating files: 23% (1947/8463) Updating files: 24% (2032/8463) Updating files: 25% (2116/8463) Updating files: 26% (2201/8463) Updating files: 27% (2286/8463) Updating files: 28% (2370/8463) Updating files: 28% (2427/8463) Updating files: 29% (2455/8463) Updating files: 30% (2539/8463) Updating files: 31% (2624/8463) Updating files: 32% (2709/8463) Updating files: 33% (2793/8463) Updating files: 34% (2878/8463) Updating files: 35% (2963/8463) Updating files: 36% (3047/8463) Updating files: 37% (3132/8463) Updating files: 37% (3143/8463) Updating files: 38% (3216/8463) Updating files: 39% (3301/8463) Updating files: 40% (3386/8463) Updating files: 41% (3470/8463) Updating files: 42% (3555/8463) Updating files: 43% (3640/8463) Updating files: 44% (3724/8463) Updating files: 45% (3809/8463) Updating files: 46% (3893/8463) Updating files: 47% (3978/8463) Updating files: 48% (4063/8463) Updating files: 48% (4114/8463) Updating files: 49% (4147/8463) Updating files: 50% (4232/8463) Updating files: 51% (4317/8463) Updating files: 52% (4401/8463) Updating files: 53% (4486/8463) Updating files: 54% (4571/8463) Updating files: 55% (4655/8463) Updating files: 56% (4740/8463) Updating files: 57% (4824/8463) Updating files: 58% (4909/8463) Updating files: 59% (4994/8463) Updating files: 59% (5026/8463) Updating files: 60% (5078/8463) Updating files: 61% (5163/8463) Updating files: 62% (5248/8463) Updating files: 63% (5332/8463) Updating files: 64% (5417/8463) Updating files: 65% (5501/8463) Updating files: 66% (5586/8463) Updating files: 67% (5671/8463) Updating files: 68% (5755/8463) Updating files: 68% (5839/8463) Updating files: 69% (5840/8463) Updating files: 70% (5925/8463) Updating files: 71% (6009/8463) Updating files: 72% (6094/8463) Updating files: 73% (6178/8463) Updating files: 74% (6263/8463) Updating files: 75% (6348/8463) Updating files: 76% (6432/8463) Updating files: 77% (6517/8463) Updating files: 78% (6602/8463) Updating files: 79% (6686/8463) Updating files: 79% (6697/8463) Updating files: 80% (6771/8463) Updating files: 81% (6856/8463) Updating files: 82% (6940/8463) Updating files: 83% (7025/8463) Updating files: 84% (7109/8463) Updating files: 85% (7194/8463) Updating files: 86% (7279/8463) Updating files: 87% (7363/8463) Updating files: 88% (7448/8463) Updating files: 89% (7533/8463) Updating files: 90% (7617/8463) Updating files: 90% (7618/8463) Updating files: 91% (7702/8463) Updating files: 92% (7786/8463) Updating files: 93% (7871/8463) Updating files: 94% (7956/8463) Updating files: 95% (8040/8463) Updating files: 96% (8125/8463) Updating files: 97% (8210/8463) Updating files: 98% (8294/8463) Updating files: 98% (8368/8463) Updating files: 99% (8379/8463) Updating files: 100% (8463/8463) Updating files: 100% (8463/8463), done. Updating files: 35% (965/2727) Updating files: 36% (982/2727) Updating files: 37% (1009/2727) Updating files: 38% (1037/2727) Updating files: 39% (1064/2727) Updating files: 40% (1091/2727) Updating files: 41% (1119/2727) Updating files: 42% (1146/2727) Updating files: 43% (1173/2727) Updating files: 44% (1200/2727) Updating files: 45% (1228/2727) Updating files: 46% (1255/2727) Updating files: 47% (1282/2727) Updating files: 48% (1309/2727) Updating files: 49% (1337/2727) Updating files: 50% (1364/2727) Updating files: 51% (1391/2727) Updating files: 52% (1419/2727) Updating files: 53% (1446/2727) Updating files: 54% (1473/2727) Updating files: 55% (1500/2727) Updating files: 56% (1528/2727) Updating files: 57% (1555/2727) Updating files: 58% (1582/2727) Updating files: 58% (1598/2727) Updating files: 59% (1609/2727) Updating files: 60% (1637/2727) Updating files: 61% (1664/2727) Updating files: 62% (1691/2727) Updating files: 63% (1719/2727) Updating files: 64% (1746/2727) Updating files: 65% (1773/2727) Updating files: 66% (1800/2727) Updating files: 67% (1828/2727) Updating files: 68% (1855/2727) Updating files: 69% (1882/2727) Updating files: 70% (1909/2727) Updating files: 71% (1937/2727) Updating files: 72% (1964/2727) Updating files: 73% (1991/2727) Updating files: 74% (2018/2727) Updating files: 75% (2046/2727) Updating files: 76% (2073/2727) Updating files: 77% (2100/2727) Updating files: 78% (2128/2727) Updating files: 79% (2155/2727) Updating files: 80% (2182/2727) Updating files: 81% (2209/2727) Updating files: 82% (2237/2727) Updating files: 83% (2264/2727) Updating files: 83% (2287/2727) Updating files: 84% (2291/2727) Updating files: 85% (2318/2727) Updating files: 86% (2346/2727) Updating files: 87% (2373/2727) Updating files: 88% (2400/2727) Updating files: 89% (2428/2727) Updating files: 90% (2455/2727) Updating files: 91% (2482/2727) Updating files: 92% (2509/2727) Updating files: 93% (2537/2727) Updating files: 94% (2564/2727) Updating files: 95% (2591/2727) Updating files: 96% (2618/2727) Updating files: 97% (2646/2727) Updating files: 98% (2673/2727) Updating files: 99% (2700/2727) Updating files: 100% (2727/2727) Updating files: 100% (2727/2727), done. Switched to a new branch 'makepkg' ==> Starting prepare()... ==> Starting pkgver()... ==> Starting build()... all modules verified internal/unsafeheader internal/goarch internal/race internal/goos internal/goexperiment internal/cpu runtime/internal/syscall runtime/internal/atomic runtime/internal/math internal/abi runtime/internal/sys sync/atomic unicode unicode/utf8 internal/itoa encoding math/bits unicode/utf16 internal/bytealg container/list crypto/internal/subtle crypto/subtle crypto/internal/boring/sig vendor/golang.org/x/crypto/cryptobyte/asn1 internal/nettrace vendor/golang.org/x/crypto/internal/subtle google.golang.org/protobuf/internal/flags google.golang.org/protobuf/internal/set golang.org/x/sys/internal/unsafeheader github.com/dennwc/varint math google.golang.org/grpc/attributes google.golang.org/grpc/serviceconfig github.com/googleapis/gax-go/v2/internal go.opentelemetry.io/otel/sdk/instrumentation github.com/golang/groupcache/lru go.opencensus.io go.opencensus.io/trace/internal golang.org/x/xerrors/internal cloud.google.com/go/storage/internal runtime go.opencensus.io/internal/tagencoding github.com/google/go-cmp/cmp/internal/flags image/color github.com/weaveworks/common/errors github.com/uber/jaeger-client-go/internal/baggage github.com/uber/jaeger-client-go/internal/reporterstats github.com/uber/jaeger-client-go/internal/throttler github.com/aws/aws-sdk-go-v2/internal/sdkio github.com/aws/aws-sdk-go-v2 github.com/dgryski/go-rendezvous golang.org/x/net/internal/iana github.com/aws/aws-sdk-go/aws/client/metadata github.com/prometheus/prometheus/tsdb/goversion github.com/grafana/dskit/internal/math go.mongodb.org/mongo-driver/bson/bsonoptions github.com/grafana/dskit/ring/util go.mongodb.org/mongo-driver/bson/bsontype go.opentelemetry.io/collector/semconv/v1.6.1 go.opentelemetry.io/otel/metric/unit github.com/segmentio/fasthash/fnv1a go.opentelemetry.io/otel/metric/instrument go.opentelemetry.io/otel/internal github.com/aws/aws-sdk-go/internal/sdkmath github.com/prometheus/prometheus/model/value internal/reflectlite runtime/metrics sync internal/testlog internal/singleflight math/rand google.golang.org/protobuf/internal/pragma internal/sysinfo google.golang.org/grpc/internal/buffer runtime/cgo google.golang.org/grpc/internal/grpcsync github.com/aws/aws-sdk-go-v2/internal/sync/singleflight github.com/vimeo/galaxycache/singleflight github.com/aws/aws-sdk-go/internal/sync/singleflight github.com/golang/groupcache/singleflight github.com/josharian/intern errors sort github.com/go-redis/redis/v8/internal/rand github.com/vimeo/galaxycache/promoter internal/oserror path io strconv vendor/golang.org/x/net/dns/dnsmessage crypto/internal/nistec/fiat github.com/beorn7/perks/quantile container/heap syscall github.com/gogo/protobuf/sortkeys github.com/hashicorp/golang-lru/simplelru golang.org/x/text/internal/tag bytes strings hash hash/crc32 reflect crypto crypto/internal/randutil crypto/rc4 vendor/golang.org/x/text/transform hash/fnv bufio regexp/syntax net/http/internal/ascii github.com/prometheus/common/internal/bitbucket.org/ww/goautoneg github.com/grafana/regexp/syntax net/http/internal/testcert html text/tabwriter time internal/syscall/unix internal/syscall/execenv google.golang.org/grpc/encoding golang.org/x/text/transform github.com/dimchansky/utfbom cloud.google.com/go/internal/version golang.org/x/crypto/blowfish hash/adler32 regexp github.com/aws/smithy-go/transport/http/internal/io crypto/internal/nistec github.com/aws/smithy-go/io github.com/aws/aws-sdk-go-v2/internal/strings github.com/go-redis/redis/v8/internal/util github.com/go-redis/redis/v8/internal/hashtag github.com/grafana/regexp encoding/base32 github.com/aws/aws-sdk-go/internal/sdkio github.com/aws/aws-sdk-go/internal/strings github.com/aws/aws-sdk-go/internal/sdkuri github.com/hashicorp/go-immutable-radix github.com/thanos-io/thanos/pkg/strutil golang.org/x/crypto/openpgp/errors compress/bzip2 context internal/poll io/fs google.golang.org/grpc/backoff google.golang.org/grpc/internal/grpcrand google.golang.org/grpc/keepalive google.golang.org/api/internal/third_party/uritemplates google.golang.org/grpc/tap go.opentelemetry.io/otel/internal/baggage google.golang.org/grpc/internal/backoff github.com/go-logr/logr github.com/google/go-cmp/cmp/internal/diff golang.org/x/net/context github.com/jpillora/backoff github.com/aws/aws-sdk-go-v2/internal/sdk github.com/aws/smithy-go/ptr github.com/aws/aws-sdk-go-v2/internal/timeconv github.com/facette/natsort github.com/prometheus/prometheus/util/gate internal/fmtsort encoding/binary github.com/google/go-cmp/cmp/internal/function github.com/modern-go/reflect2 github.com/prometheus/prometheus/model/timestamp os github.com/vimeo/galaxycache/lru github.com/aws/aws-sdk-go/internal/sdkrand golang.org/x/sync/semaphore embed go.uber.org/zap/buffer github.com/hashicorp/errwrap github.com/cenkalti/backoff/v4 github.com/weaveworks/common/mtime go.uber.org/zap/internal/bufferpool golang.org/x/crypto/cast5 golang.org/x/crypto/openpgp/s2k image encoding/base64 crypto/cipher crypto/internal/edwards25519/field crypto/md5 encoding/pem crypto/internal/boring crypto/des fmt internal/godebug crypto/aes crypto/sha512 crypto/internal/edwards25519 crypto/hmac crypto/sha1 crypto/sha256 internal/intern path/filepath vendor/golang.org/x/crypto/chacha20 net/netip vendor/golang.org/x/crypto/internal/poly1305 vendor/golang.org/x/crypto/curve25519/internal/field vendor/golang.org/x/crypto/hkdf vendor/golang.org/x/crypto/chacha20poly1305 github.com/cespare/xxhash/v2 google.golang.org/protobuf/internal/detrand io/ioutil github.com/prometheus/procfs/internal/util golang.org/x/sys/unix google.golang.org/grpc/internal/envconfig golang.org/x/crypto/pkcs12/internal/rc2 os/exec github.com/golang/snappy os/signal golang.org/x/crypto/blake2b github.com/minio/md5-simd flag encoding/json github.com/go-logfmt/logfmt log github.com/pkg/errors compress/flate math/big encoding/hex net net/url vendor/golang.org/x/crypto/curve25519 vendor/golang.org/x/text/unicode/bidi vendor/golang.org/x/text/unicode/norm compress/gzip vendor/golang.org/x/net/http2/hpack mime mime/quotedprintable github.com/go-kit/log vendor/golang.org/x/text/secure/bidirule net/http/internal google.golang.org/protobuf/internal/errors go/token google.golang.org/protobuf/internal/version google.golang.org/protobuf/encoding/protowire github.com/prometheus/common/model github.com/go-kit/log/level google.golang.org/protobuf/reflect/protoreflect github.com/prometheus/procfs/internal/fs runtime/debug github.com/opentracing/opentracing-go/log github.com/thanos-io/thanos/pkg/errutil github.com/thanos-io/thanos/pkg/runutil crypto/rand crypto/elliptic crypto/internal/boring/bbig encoding/asn1 crypto/dsa vendor/golang.org/x/net/idna crypto/ed25519 crypto/rsa github.com/davecgh/go-spew/spew github.com/pmezard/go-difflib/difflib google.golang.org/protobuf/internal/encoding/messageset google.golang.org/protobuf/internal/strs google.golang.org/protobuf/internal/order google.golang.org/protobuf/internal/genid vendor/golang.org/x/crypto/cryptobyte crypto/x509/pkix google.golang.org/protobuf/reflect/protoregistry google.golang.org/protobuf/runtime/protoiface google.golang.org/protobuf/internal/encoding/text google.golang.org/protobuf/internal/descfmt google.golang.org/protobuf/internal/descopts github.com/prometheus/prometheus/model/labels github.com/prometheus/prometheus/tsdb/chunkenc github.com/prometheus/prometheus/tsdb/errors github.com/prometheus/prometheus/tsdb/fileutil google.golang.org/protobuf/proto go.uber.org/atomic crypto/ecdsa google.golang.org/protobuf/internal/encoding/defval gopkg.in/yaml.v3 github.com/prometheus/prometheus/model/exemplar go.uber.org/goleak/internal/stack runtime/trace github.com/prometheus/prometheus/tsdb/encoding golang.org/x/net/internal/timeseries text/template/parse go.uber.org/goleak testing google.golang.org/grpc/internal/grpclog google.golang.org/grpc/metadata google.golang.org/grpc/codes google.golang.org/grpc/grpclog golang.org/x/text/unicode/bidi google.golang.org/grpc/internal/balancerload google.golang.org/protobuf/encoding/prototext google.golang.org/protobuf/internal/filedesc google.golang.org/grpc/connectivity google.golang.org/grpc/internal/grpcutil golang.org/x/text/unicode/norm text/template golang.org/x/net/http2/hpack golang.org/x/text/secure/bidirule github.com/grpc-ecosystem/go-grpc-middleware/v2/util/metautils go.opentelemetry.io/otel/baggage go.opentelemetry.io/otel/attribute go.opentelemetry.io/otel/codes github.com/go-logr/logr/funcr os/user google.golang.org/protobuf/internal/encoding/tag go.opentelemetry.io/otel/trace golang.org/x/sync/errgroup google.golang.org/protobuf/internal/impl encoding/xml github.com/go-logr/stdr html/template database/sql/driver golang.org/x/net/idna go.opentelemetry.io/otel/bridge/opentracing/migration go.opentelemetry.io/otel/internal/trace/noop github.com/Azure/go-autorest/autorest/date github.com/mitchellh/go-homedir gopkg.in/yaml.v2 google.golang.org/protobuf/internal/encoding/json cloud.google.com/go/internal/optional go.opencensus.io/internal go.opencensus.io/trace/tracestate golang.org/x/xerrors google.golang.org/api/iterator go.opencensus.io/trace golang.org/x/oauth2/jws google.golang.org/protobuf/encoding/protojson go.opencensus.io/resource runtime/pprof go.opencensus.io/metric/metricdata go.opencensus.io/metric/metricproducer encoding/gob github.com/google/go-cmp/cmp/internal/value github.com/google/go-cmp/cmp go.opencensus.io/tag google.golang.org/grpc/internal/googlecloud go.opencensus.io/stats/internal go.opencensus.io/stats github.com/gogo/protobuf/proto github.com/grafana/dskit/services go.opencensus.io/stats/view crypto/x509 net/textproto vendor/golang.org/x/net/http/httpproxy vendor/golang.org/x/net/http/httpguts github.com/prometheus/procfs mime/multipart golang.org/x/net/http/httpguts google.golang.org/grpc/internal/syscall google.golang.org/grpc/stats log/syslog github.com/google/uuid google.golang.org/protobuf/internal/filetype github.com/sirupsen/logrus golang.org/x/crypto/bcrypt github.com/uber/jaeger-client-go/internal/spanlog google.golang.org/protobuf/runtime/protoimpl github.com/uber/jaeger-client-go/log compress/zlib crypto/tls github.com/golang-jwt/jwt/v4 google.golang.org/protobuf/types/descriptorpb google.golang.org/protobuf/types/known/timestamppb github.com/golang/protobuf/ptypes/timestamp google.golang.org/protobuf/types/known/anypb google.golang.org/protobuf/types/known/durationpb golang.org/x/crypto/pkcs12 github.com/golang/protobuf/ptypes/duration github.com/golang/protobuf/ptypes/any google.golang.org/genproto/googleapis/rpc/status google.golang.org/genproto/googleapis/rpc/code google.golang.org/genproto/googleapis/rpc/errdetails google.golang.org/genproto/googleapis/type/expr google.golang.org/protobuf/types/known/fieldmaskpb github.com/googleapis/gax-go/v2/apierror/internal/proto github.com/googleapis/enterprise-certificate-proxy/client/util google.golang.org/genproto/googleapis/type/date google.golang.org/protobuf/types/known/emptypb google.golang.org/protobuf/reflect/protodesc google.golang.org/genproto/googleapis/api/annotations google.golang.org/protobuf/types/known/wrapperspb google.golang.org/genproto/googleapis/type/datetime google.golang.org/genproto/googleapis/type/decimal google.golang.org/genproto/googleapis/type/fraction google.golang.org/genproto/googleapis/type/month github.com/golang/protobuf/ptypes/empty google.golang.org/genproto/googleapis/type/color github.com/uber/jaeger-lib/metrics golang.org/x/net/netutil internal/profile github.com/modern-go/concurrent github.com/googleapis/go-type-adapters/adapters golang.org/x/crypto/argon2 github.com/aws/aws-sdk-go-v2/internal/rand github.com/aws/smithy-go/logging github.com/aws/smithy-go/rand github.com/aws/smithy-go/middleware github.com/json-iterator/go github.com/aws/smithy-go github.com/aws/smithy-go/time github.com/golang/protobuf/proto github.com/aws/aws-sdk-go-v2/aws/ratelimit github.com/aws/aws-sdk-go-v2/feature/ec2/imds/internal/config github.com/aws/aws-sdk-go-v2/aws/protocol/restjson github.com/aws/smithy-go/document github.com/gogo/protobuf/types github.com/aws/aws-sdk-go-v2/aws/protocol/xml github.com/aws/smithy-go/encoding github.com/aws/aws-sdk-go-v2/internal/ini github.com/aws/aws-sdk-go-v2/service/sso/types github.com/aws/aws-sdk-go-v2/service/sts/types github.com/aws/smithy-go/encoding/xml archive/tar github.com/klauspost/compress/s2 net/http/httptrace google.golang.org/grpc/internal/credentials github.com/prometheus/client_model/go github.com/matttproud/golang_protobuf_extensions/pbutil net/http google.golang.org/grpc/credentials google.golang.org/grpc/encoding/proto github.com/golang/protobuf/ptypes github.com/prometheus/client_golang/prometheus/internal google.golang.org/grpc/resolver google.golang.org/grpc/credentials/insecure google.golang.org/grpc/internal google.golang.org/grpc/binarylog/grpc_binarylog_v1 google.golang.org/grpc/internal/status google.golang.org/grpc/balancer google.golang.org/grpc/internal/channelz google.golang.org/grpc/balancer/grpclb/state google.golang.org/grpc/status google.golang.org/grpc/balancer/base google.golang.org/grpc/internal/serviceconfig google.golang.org/grpc/internal/resolver/dns google.golang.org/grpc/internal/resolver google.golang.org/grpc/balancer/roundrobin google.golang.org/grpc/internal/binarylog google.golang.org/grpc/internal/resolver/passthrough google.golang.org/grpc/internal/transport/networktype google.golang.org/grpc/internal/metadata google.golang.org/grpc/peer google.golang.org/grpc/internal/resolver/unix google.golang.org/grpc/credentials/alts/internal github.com/weaveworks/common/grpc github.com/uber/jaeger-client-go/thrift google.golang.org/grpc/credentials/alts/internal/conn github.com/minio/minio-go/v7/pkg/s3utils github.com/klauspost/cpuid/v2 gopkg.in/ini.v1 github.com/minio/minio-go/v7/pkg/lifecycle github.com/minio/minio-go/v7/pkg/set github.com/rs/xid github.com/minio/minio-go/v7/pkg/notification github.com/minio/minio-go/v7/pkg/replication github.com/minio/minio-go/v7/pkg/sse github.com/minio/minio-go/v7/pkg/tags github.com/stretchr/objx github.com/minio/sha256-simd github.com/gogo/googleapis/google/rpc github.com/alecthomas/units github.com/bradfitz/gomemcache/memcache github.com/cespare/xxhash github.com/go-redis/redis/v8/internal github.com/go-redis/redis/v8/internal/hscan github.com/go-redis/redis/v8/internal/proto github.com/thanos-io/thanos/pkg/discovery/dns/godns golang.org/x/net/bpf golang.org/x/net/internal/socket github.com/go-redis/redis/v8/internal/pool github.com/alecthomas/template/parse go/scanner github.com/go-redis/redis/v8 github.com/uber/jaeger-client-go/thrift-gen/jaeger github.com/uber/jaeger-client-go/thrift-gen/sampling github.com/uber/jaeger-client-go/thrift-gen/zipkincore github.com/uber/jaeger-client-go/thrift-gen/baggage golang.org/x/net/ipv4 github.com/gogo/status golang.org/x/net/ipv6 github.com/alecthomas/template go/ast go/doc/comment github.com/uber/jaeger-client-go/thrift-gen/agent internal/lazyregexp github.com/thanos-io/thanos/pkg/store/cache/cachekey github.com/vimeo/galaxycache/consistenthash github.com/gogo/protobuf/protoc-gen-gogo/descriptor github.com/grafana/dskit/backoff github.com/vimeo/galaxycache github.com/miekg/dns github.com/grafana/dskit/grpcencoding/snappy golang.org/x/time/rate google.golang.org/grpc/encoding/gzip github.com/prometheus/prometheus/model/textparse go/doc github.com/edsrzf/mmap-go github.com/prometheus/prometheus/util/strutil github.com/oklog/ulid github.com/aws/aws-sdk-go/aws/awserr github.com/aws/aws-sdk-go/internal/ini github.com/aws/aws-sdk-go/internal/shareddefaults gopkg.in/alecthomas/kingpin.v2 github.com/aws/aws-sdk-go/aws/endpoints github.com/jmespath/go-jmespath expvar github.com/prometheus/common/expfmt github.com/opentracing/opentracing-go net/http/httptest golang.org/x/net/trace github.com/stretchr/testify/assert golang.org/x/net/http2 github.com/prometheus/client_golang/prometheus github.com/prometheus/client_golang/prometheus/testutil/promlint net/http/httputil github.com/opentracing/opentracing-go/ext go.opentelemetry.io/otel/propagation go.opentelemetry.io/contrib/propagators/ot go.opentelemetry.io/otel/internal/global go.opentelemetry.io/otel/semconv/internal github.com/stretchr/testify/require go.opentelemetry.io/otel go.opentelemetry.io/otel/sdk/internal/env go.opentelemetry.io/otel/bridge/opentracing go.opentelemetry.io/otel/sdk/internal github.com/prometheus/client_golang/prometheus/promauto github.com/prometheus/prometheus/tsdb/chunks github.com/grafana/dskit/flagext github.com/prometheus/client_golang/prometheus/testutil github.com/prometheus/prometheus/util/testutil go.opentelemetry.io/otel/semconv/v1.10.0 github.com/mattn/go-ieproxy github.com/Azure/go-autorest/logger github.com/Azure/azure-pipeline-go/pipeline github.com/prometheus/prometheus/tsdb/tsdbutil github.com/Azure/go-autorest/tracing google.golang.org/grpc/internal/transport net/http/cookiejar github.com/thanos-io/thanos/pkg/exthttp github.com/prometheus/prometheus/storage github.com/Azure/azure-storage-blob-go/azblob go.opentelemetry.io/otel/sdk/resource cloud.google.com/go/compute/metadata github.com/Azure/go-autorest/autorest/adal google.golang.org/api/googleapi go.opentelemetry.io/otel/sdk/trace github.com/googleapis/gax-go/v2/apierror github.com/prometheus/prometheus/tsdb/hashcache github.com/Azure/go-autorest/autorest github.com/prometheus/prometheus/tsdb/index github.com/Azure/go-autorest/autorest/azure/cli cloud.google.com/go/internal/trace golang.org/x/net/context/ctxhttp github.com/thanos-io/thanos/pkg/tracing/migration google.golang.org/grpc golang.org/x/oauth2/internal go.opencensus.io/trace/propagation github.com/Azure/go-autorest/autorest/azure golang.org/x/oauth2 go.opencensus.io/plugin/ocgrpc github.com/thanos-io/thanos/pkg/testutil golang.org/x/oauth2/authhandler golang.org/x/oauth2/google/internal/externalaccount golang.org/x/oauth2/jwt google.golang.org/api/internal/impersonate net/rpc go.opencensus.io/plugin/ochttp/propagation/b3 go.opencensus.io/plugin/ochttp github.com/Azure/go-autorest/autorest/azure/auth golang.org/x/oauth2/google github.com/googleapis/enterprise-certificate-proxy/client google.golang.org/api/transport/cert google.golang.org/api/googleapi/transport google.golang.org/grpc/credentials/oauth google.golang.org/api/transport/http/internal/propagation github.com/prometheus/common/version github.com/weaveworks/promrus github.com/gorilla/mux github.com/grpc-ecosystem/go-grpc-middleware/v2 github.com/grpc-ecosystem/go-grpc-middleware/v2/interceptors github.com/googleapis/gax-go/v2 google.golang.org/genproto/googleapis/iam/v1 google.golang.org/api/internal github.com/grpc-ecosystem/go-grpc-middleware/v2/interceptors/tags cloud.google.com/go/internal google.golang.org/grpc/balancer/grpclb/grpc_lb_v1 google.golang.org/grpc/credentials/alts/internal/proto/grpc_gcp google.golang.org/grpc/credentials/alts/internal/handshaker/service google.golang.org/api/option github.com/grpc-ecosystem/go-grpc-middleware/v2/interceptors/tracing google.golang.org/api/transport/internal/dca google.golang.org/api/option/internaloption cloud.google.com/go/iam google.golang.org/grpc/balancer/grpclb google.golang.org/genproto/googleapis/storage/v2 github.com/thanos-io/thanos/pkg/tracing google.golang.org/api/internal/gensupport google.golang.org/api/transport/http github.com/weaveworks/common/logging google.golang.org/grpc/credentials/alts/internal/authinfo github.com/grpc-ecosystem/go-grpc-middleware google.golang.org/grpc/credentials/alts/internal/handshaker github.com/thanos-io/thanos/pkg/objstore github.com/opentracing-contrib/go-grpc github.com/prometheus/client_golang/prometheus/promhttp google.golang.org/grpc/credentials/alts google.golang.org/api/iamcredentials/v1 google.golang.org/api/storage/v1 github.com/weaveworks/common/user google.golang.org/grpc/credentials/google github.com/grafana/dskit/tenant github.com/mwitkow/go-conntrack github.com/thanos-io/thanos/pkg/objstore/filesystem google.golang.org/api/transport/grpc golang.org/x/oauth2/clientcredentials github.com/grafana/mimir/pkg/storage/bucket/filesystem github.com/weaveworks/common/httpgrpc github.com/sercand/kuberesolver github.com/prometheus/common/config google.golang.org/api/transport github.com/felixge/httpsnoop github.com/opentracing-contrib/go-stdlib/nethttp github.com/prometheus/exporter-toolkit/web github.com/uber/jaeger-client-go/utils github.com/uber/jaeger-lib/metrics/prometheus cloud.google.com/go/storage/internal/apiv2 github.com/uber/jaeger-client-go github.com/weaveworks/common/signals net/http/pprof github.com/minio/minio-go/v7/pkg/encrypt github.com/aws/aws-sdk-go-v2/aws github.com/aws/smithy-go/transport/http github.com/aws/smithy-go/encoding/httpbinding github.com/minio/minio-go/v7/pkg/signer github.com/thanos-io/thanos/pkg/objstore/azure golang.org/x/net/publicsuffix github.com/ncw/swift cloud.google.com/go/storage github.com/aws/aws-sdk-go-v2/aws/protocol/query github.com/aws/aws-sdk-go-v2/aws/middleware github.com/aws/aws-sdk-go-v2/credentials github.com/aws/aws-sdk-go-v2/credentials/processcreds github.com/aws/aws-sdk-go-v2/aws/defaults github.com/grafana/mimir/pkg/storage/bucket/azure github.com/aws/aws-sdk-go-v2/internal/configsources github.com/aws/aws-sdk-go-v2/aws/signer/internal/v4 github.com/aws/aws-sdk-go-v2/aws/transport/http github.com/aws/aws-sdk-go-v2/aws/retry github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 github.com/minio/minio-go/v7/pkg/credentials github.com/aws/aws-sdk-go-v2/service/sso/internal/endpoints github.com/uber/jaeger-client-go/internal/baggage/remote github.com/uber/jaeger-client-go/internal/throttler/remote github.com/uber/jaeger-client-go/rpcmetrics github.com/uber/jaeger-client-go/transport github.com/aws/aws-sdk-go-v2/feature/ec2/imds github.com/aws/aws-sdk-go-v2/credentials/endpointcreds/internal/client github.com/aws/aws-sdk-go-v2/aws/signer/v4 github.com/aws/aws-sdk-go-v2/service/sts/internal/endpoints github.com/thanos-io/thanos/pkg/objstore/swift github.com/uber/jaeger-client-go/config github.com/stretchr/testify/mock github.com/aws/aws-sdk-go-v2/credentials/endpointcreds github.com/aws/aws-sdk-go-v2/credentials/ec2rolecreds github.com/julienschmidt/httprouter github.com/grafana/mimir/pkg/storage/bucket/swift github.com/aws/aws-sdk-go-v2/service/sso github.com/minio/minio-go/v7 github.com/aws/aws-sdk-go-v2/service/internal/presigned-url github.com/weaveworks/common/tracing github.com/thanos-io/thanos/pkg/discovery/dns/miekgdns github.com/thanos-io/thanos/pkg/extprom github.com/prometheus/common/route github.com/aws/aws-sdk-go-v2/service/sts github.com/weaveworks/common/instrument github.com/grafana/dskit/spanlogger github.com/thanos-io/thanos/pkg/discovery/dns github.com/thanos-io/thanos/pkg/discovery/memcache github.com/thanos-io/thanos/pkg/gate github.com/weaveworks/common/middleware github.com/thanos-io/thanos/pkg/model github.com/vimeo/galaxycache/http github.com/gogo/protobuf/gogoproto github.com/thanos-io/thanos/pkg/cacheutil github.com/aws/aws-sdk-go-v2/credentials/ssocreds github.com/thanos-io/thanos/pkg/objstore/gcs github.com/grafana/dskit/crypto/tls github.com/prometheus/prometheus/promql/parser github.com/aws/aws-sdk-go/aws/credentials github.com/aws/aws-sdk-go/aws/awsutil github.com/weaveworks/common/httpgrpc/server github.com/grafana/mimir/pkg/storage/bucket/gcs github.com/grafana/dskit/grpcclient github.com/aws/aws-sdk-go/aws github.com/weaveworks/common/server github.com/aws/aws-sdk-go/aws/credentials/processcreds github.com/prometheus/prometheus/discovery/targetgroup github.com/prometheus/prometheus/discovery github.com/prometheus/prometheus/model/relabel github.com/aws/aws-sdk-go-v2/credentials/stscreds github.com/aws/aws-sdk-go/aws/request github.com/aws/aws-sdk-go-v2/config github.com/prometheus/prometheus/tsdb/tombstones github.com/prometheus/prometheus/util/stats github.com/thanos-io/thanos/pkg/cache github.com/grafana/mimir/pkg/util/log google.golang.org/grpc/health/grpc_health_v1 github.com/prometheus/prometheus/tsdb/record github.com/grafana/dskit/multierror github.com/grafana/dskit/runutil github.com/grafana/mimir/pkg/util github.com/grafana/mimir/pkg/util/spanlogger github.com/aws/aws-sdk-go/aws/client github.com/aws/aws-sdk-go/private/protocol github.com/aws/aws-sdk-go/aws/corehandlers github.com/aws/aws-sdk-go/aws/csm github.com/prometheus/prometheus/tsdb/wal github.com/aws/aws-sdk-go/aws/ec2metadata github.com/grafana/mimir/pkg/storage/sharding github.com/grafana/mimir/pkg/storegateway/indexheader/fileutil github.com/grafana/mimir/pkg/storegateway/indexcache github.com/aws/aws-sdk-go/private/protocol/rest github.com/aws/aws-sdk-go/private/protocol/query/queryutil github.com/aws/aws-sdk-go/private/protocol/xml/xmlutil github.com/thanos-io/thanos/pkg/objstore/s3 github.com/aws/aws-sdk-go/private/protocol/json/jsonutil github.com/aws/aws-sdk-go/aws/credentials/ec2rolecreds github.com/grafana/mimir/pkg/cache github.com/aws/aws-sdk-go/aws/signer/v4 github.com/grafana/dskit/grpcutil github.com/aws/aws-sdk-go/private/protocol/query github.com/grafana/mimir/pkg/storage/bucket/s3 github.com/grafana/dskit/kv/codec github.com/hashicorp/go-cleanhttp github.com/aws/aws-sdk-go/private/protocol/jsonrpc github.com/aws/aws-sdk-go/aws/credentials/endpointcreds github.com/mattn/go-isatty github.com/hashicorp/go-rootcerts github.com/armon/go-metrics github.com/aws/aws-sdk-go/service/sts github.com/mattn/go-colorable github.com/aws/aws-sdk-go/private/protocol/restjson github.com/grafana/mimir/pkg/storage/tsdb/bucketcache github.com/mitchellh/mapstructure github.com/grafana/mimir/pkg/storage/bucket github.com/aws/aws-sdk-go/aws/defaults github.com/fatih/color github.com/aws/aws-sdk-go/service/sso github.com/hashicorp/go-hclog go.etcd.io/etcd/api/v3/authpb go.etcd.io/etcd/api/v3/membershippb github.com/hashicorp/serf/coordinate go.etcd.io/etcd/api/v3/mvccpb github.com/aws/aws-sdk-go/service/sts/stsiface github.com/aws/aws-sdk-go/service/sso/ssoiface go.uber.org/multierr github.com/aws/aws-sdk-go/aws/credentials/ssocreds go.uber.org/zap/internal/color go.uber.org/zap/internal/exit github.com/aws/aws-sdk-go/aws/credentials/stscreds go.etcd.io/etcd/client/pkg/v3/tlsutil go.etcd.io/etcd/api/v3/v3rpc/rpctypes github.com/hashicorp/consul/api go.etcd.io/etcd/api/v3/etcdserverpb github.com/coreos/go-semver/semver go.uber.org/zap/zapcore github.com/coreos/go-systemd/v22/journal go.etcd.io/etcd/client/pkg/v3/systemd github.com/aws/aws-sdk-go/aws/session go.etcd.io/etcd/client/pkg/v3/types go.etcd.io/etcd/api/v3/version go.etcd.io/etcd/client/v3/internal/endpoint google.golang.org/grpc/resolver/manual go.etcd.io/etcd/client/v3/credentials github.com/prometheus/client_golang/prometheus/push go.etcd.io/etcd/client/v3/internal/resolver compress/lzw github.com/hashicorp/go-sockaddr github.com/google/btree github.com/hashicorp/go-msgpack/codec github.com/armon/go-metrics/prometheus github.com/hashicorp/go-multierror github.com/prometheus/common/sigv4 github.com/sean-/seed github.com/grafana/dskit/modules github.com/grafana/dskit/netutil github.com/prometheus/prometheus/config go.uber.org/zap github.com/grafana/dskit/ring/shard github.com/grafana/dskit/runtimeconfig github.com/grafana/dskit/concurrency github.com/prometheus/prometheus/tsdb github.com/prometheus/alertmanager/cluster/clusterpb github.com/prometheus/alertmanager/pkg/labels github.com/prometheus/alertmanager/timeinterval github.com/mailru/easyjson/jlexer github.com/grafana/mimir/pkg/alertmanager/alertmanagerpb github.com/grafana/mimir/pkg/alertmanager/alertspb github.com/prometheus/alertmanager/config github.com/hashicorp/memberlist github.com/grafana/dskit/kv/consul go.etcd.io/etcd/client/pkg/v3/fileutil go.etcd.io/etcd/client/pkg/v3/logutil go.uber.org/zap/zapgrpc github.com/grafana/mimir/pkg/alertmanager/alertstore/bucketclient github.com/mailru/easyjson/buffer github.com/mailru/easyjson/jwriter github.com/prometheus/alertmanager/api/metrics go.etcd.io/etcd/client/pkg/v3/transport github.com/hashicorp/golang-lru github.com/go-openapi/swag github.com/oklog/run github.com/grafana/mimir/pkg/alertmanager/alertstore/local github.com/prometheus/alertmanager/types github.com/prometheus/alertmanager/nflog/nflogpb github.com/grafana/mimir/pkg/alertmanager/alertstore github.com/prometheus/alertmanager/provider github.com/prometheus/alertmanager/store github.com/benbjohnson/clock github.com/gofrs/uuid github.com/prometheus/alertmanager/inhibit github.com/grafana/dskit/kv/memberlist github.com/prometheus/alertmanager/cluster github.com/prometheus/alertmanager/silence/silencepb github.com/shurcooL/httpfs/vfsutil golang.org/x/text/internal/language github.com/go-openapi/analysis/internal/debug github.com/shurcooL/vfsgen github.com/go-openapi/jsonpointer github.com/go-openapi/jsonreference/internal github.com/asaskevich/govalidator github.com/prometheus/alertmanager/asset github.com/go-openapi/jsonreference github.com/go-openapi/spec github.com/prometheus/alertmanager/nflog github.com/prometheus/alertmanager/silence golang.org/x/text/internal/language/compact github.com/go-openapi/errors golang.org/x/text/language go.mongodb.org/mongo-driver/bson/primitive net/mail encoding/csv github.com/go-openapi/runtime/logger github.com/prometheus/prometheus/util/teststorage github.com/thanos-io/thanos/pkg/block/metadata go.mongodb.org/mongo-driver/x/bsonx/bsoncore github.com/go-openapi/runtime/middleware/denco github.com/go-openapi/runtime/middleware/header github.com/thanos-io/thanos/pkg/block github.com/prometheus/prometheus/promql golang.org/x/text/internal github.com/docker/go-units github.com/jessevdk/go-flags golang.org/x/text/cases github.com/go-openapi/analysis/internal/flatten/normalize github.com/go-openapi/analysis/internal/flatten/operations github.com/go-openapi/analysis/internal/flatten/replace go.etcd.io/etcd/client/v3 github.com/go-openapi/analysis/internal/flatten/schutils github.com/go-openapi/analysis/internal/flatten/sortref github.com/go-openapi/runtime/flagext github.com/rs/cors github.com/prometheus/alertmanager/template github.com/grafana/mimir/pkg/util/net net/smtp go.mongodb.org/mongo-driver/bson/bsonrw github.com/grafana/mimir/pkg/storegateway/indexheader github.com/aws/aws-sdk-go/service/sns github.com/prometheus/alertmanager/notify gopkg.in/telebot.v3 github.com/prometheus/alertmanager/provider/mem github.com/prometheus/alertmanager/ui github.com/google/pprof/profile github.com/grafana/mimir/pkg/ingester/activeseries github.com/prometheus/alertmanager/dispatch github.com/prometheus/alertmanager/notify/email github.com/grafana/mimir/pkg/mimirpb github.com/prometheus/alertmanager/api/v1 github.com/prometheus/alertmanager/notify/opsgenie go.mongodb.org/mongo-driver/bson/bsoncodec github.com/grafana/dskit/kv/etcd github.com/prometheus/alertmanager/notify/pagerduty github.com/prometheus/alertmanager/notify/pushover github.com/prometheus/alertmanager/notify/slack github.com/prometheus/alertmanager/notify/telegram github.com/prometheus/alertmanager/notify/victorops github.com/prometheus/alertmanager/notify/webhook github.com/prometheus/alertmanager/notify/sns github.com/prometheus/alertmanager/notify/wechat github.com/felixge/fgprof github.com/grafana/dskit/kv github.com/grafana/mimir/pkg/ingester/client github.com/grafana/mimir/pkg/util/extract github.com/grafana/mimir/pkg/util/globalerror github.com/grafana/dskit/limiter github.com/grafana/mimir/pkg/util/validation github.com/grafana/mimir/pkg/querier/stats github.com/grafana/mimir/pkg/util/httpgrpcutil github.com/grafana/mimir/pkg/util/math github.com/prometheus/prometheus/prompb github.com/gogo/protobuf/jsonpb go.opentelemetry.io/collector/pdata/internal/data github.com/grafana/dskit/ring go.opentelemetry.io/collector/pdata/internal/data/protogen/common/v1 go.opentelemetry.io/collector/service/featuregate github.com/prometheus/prometheus/util/osutil github.com/prometheus/prometheus/util/pool github.com/prometheus/prometheus/scrape github.com/grafana/mimir/pkg/distributor/distributorpb go.opentelemetry.io/collector/pdata/internal/data/protogen/resource/v1 github.com/grafana/mimir/pkg/frontend/v1/frontendv1pb github.com/grafana/mimir/pkg/scheduler/queue go.opentelemetry.io/collector/pdata/internal/data/protogen/logs/v1 go.opentelemetry.io/collector/pdata/internal/data/protogen/metrics/v1 go.mongodb.org/mongo-driver/bson go.opentelemetry.io/collector/pdata/internal/data/protogen/trace/v1 github.com/grafana/mimir/pkg/frontend/v1 github.com/grafana/mimir/pkg/frontend/v2/frontendv2pb go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/logs/v1 github.com/go-openapi/strfmt github.com/grafana/mimir/pkg/scheduler/schedulerpb go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1 github.com/grafana/mimir/pkg/storage/chunk github.com/grafana/mimir/pkg/util/activitytracker github.com/grafana/dskit/ring/client github.com/grafana/mimir/pkg/util/servicediscovery github.com/grafana/mimir/pkg/querier/batch github.com/grafana/mimir/pkg/storage/tsdb github.com/grafana/mimir/pkg/distributor/forwarding github.com/grafana/mimir/pkg/util/limiter github.com/grafana/mimir/pkg/querier/engine github.com/grafana/mimir/pkg/querier/iterators github.com/grafana/mimir/pkg/storage/lazyquery go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/metrics/v1 go.opentelemetry.io/collector/pdata/internal/otlp github.com/grafana/mimir/pkg/scheduler/schedulerdiscovery github.com/grafana/mimir/pkg/storage/series github.com/thanos-io/thanos/pkg/store/labelpb github.com/grafana/mimir/pkg/util/gate github.com/dustin/go-humanize github.com/grafana/mimir/cmd/metaconvert github.com/grafana/mimir/pkg/storage/tsdb/bucketindex github.com/thanos-io/thanos/pkg/pool github.com/go-openapi/analysis github.com/go-openapi/runtime go.opentelemetry.io/collector/pdata/internal github.com/thanos-io/thanos/pkg/store/storepb/prompb github.com/grafana/mimir/pkg/util/chunkcompat github.com/grafana/mimir/pkg/frontend/v2 github.com/prometheus/prometheus/template github.com/go-openapi/runtime/security github.com/grafana/mimir/pkg/compactor github.com/grafana/mimir/pkg/util/listblocks github.com/prometheus/prometheus/model/rulefmt github.com/prometheus/prometheus/util/logging github.com/go-openapi/loads go.opentelemetry.io/otel/metric/instrument/asyncfloat64 go.opentelemetry.io/otel/metric/instrument/asyncint64 github.com/prometheus/prometheus/rules go.opentelemetry.io/otel/metric/instrument/syncfloat64 github.com/thanos-io/thanos/pkg/store/storepb go.opentelemetry.io/otel/metric/instrument/syncint64 github.com/go-openapi/runtime/middleware/untyped github.com/go-openapi/validate go.opentelemetry.io/otel/metric go.opentelemetry.io/otel/metric/internal/global github.com/grafana/mimir/pkg/ruler/rulespb go.opentelemetry.io/otel/metric/global go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp github.com/grafana/mimir/pkg/util/version github.com/grafana/mimir/pkg/ruler/rulestore/local github.com/prometheus/prometheus/storage/remote github.com/grafana/mimir/pkg/ruler/rulestore github.com/prometheus/client_golang/api github.com/grafana/mimir/pkg/ruler/rulestore/bucketclient github.com/prometheus/client_golang/api/prometheus/v1 github.com/prometheus/prometheus/discovery/refresh github.com/spf13/afero/mem github.com/grafana/mimir/pkg/storegateway/storegatewaypb go.opentelemetry.io/collector/pdata/plog go.opentelemetry.io/collector/pdata/pmetric go.opentelemetry.io/collector/pdata/ptrace go.opentelemetry.io/collector/pdata/pcommon github.com/go-openapi/runtime/middleware github.com/prometheus/alertmanager/api/v2/models github.com/thanos-io/thanos/pkg/store/hintspb go.opentelemetry.io/collector/pdata/pmetric/pmetricotlp github.com/spf13/afero go.opentelemetry.io/collector/consumer/consumererror github.com/grafana/mimir/pkg/scheduler github.com/grafana/mimir/pkg/storegateway github.com/prometheus/prometheus/notifier github.com/open-telemetry/opentelemetry-collector-contrib/pkg/translator/prometheusremotewrite github.com/prometheus/prometheus/util/httputil github.com/prometheus/prometheus/web/api/v1 github.com/prometheus/alertmanager/api/v2/restapi/operations/alert github.com/prometheus/alertmanager/api/v2/restapi/operations/alertgroup github.com/prometheus/alertmanager/api/v2/restapi/operations/general github.com/prometheus/alertmanager/api/v2/restapi/operations/receiver github.com/prometheus/alertmanager/api/v2/restapi/operations/silence github.com/grafana/mimir/pkg/util/push github.com/grafana/mimir/pkg/util/gziphandler github.com/thanos-io/thanos/pkg/shipper github.com/grafana/mimir/pkg/api/error github.com/grafana/mimir/pkg/frontend/querymiddleware/astmapper github.com/grafana/mimir/pkg/frontend/transport github.com/prometheus/alertmanager/api/v2/restapi/operations github.com/grafana/mimir/pkg/distributor github.com/grafana/mimir/pkg/usagestats github.com/grafana/mimir/pkg/util/instrumentation github.com/grafana/mimir/pkg/querier/worker github.com/grafana/mimir/pkg/frontend/querymiddleware github.com/grafana/mimir/pkg/util/fs github.com/prometheus/alertmanager/api/v2/restapi github.com/grafana/mimir/pkg/util/noauth github.com/grafana/mimir/pkg/ingester github.com/grafana/mimir/pkg/util/process github.com/grafana/mimir/pkg/util/fieldcategory github.com/grafana/mimir/pkg/querier github.com/grafana/mimir/pkg/util/usage github.com/prometheus/alertmanager/api/v2 github.com/grafana/mimir/pkg/continuoustest database/sql github.com/grafana/mimir/pkg/alertmanager/merger github.com/prometheus/alertmanager/api github.com/rainycape/unidecode github.com/grafana/mimir/pkg/mimirtool/minisdk github.com/gosimple/slug github.com/grafana-tools/sdk github.com/grafana/mimir/pkg/mimirtool/rules/rwrulefmt github.com/grafana/mimir/pkg/alertmanager github.com/grafana/mimir/pkg/mimirtool/analyze github.com/prometheus/client_golang/prometheus/collectors github.com/grafana/mimir/pkg/mimirtool/backfill github.com/grafana/mimir/pkg/frontend github.com/grafana/mimir/cmd/mimir-continuous-test github.com/grafana/mimir/pkg/mimirtool/client github.com/grafana/mimir/pkg/flusher github.com/grafana/mimir/pkg/ruler github.com/grafana/mimir/pkg/querier/tenantfederation github.com/dlclark/regexp2/syntax github.com/mitchellh/colorstring github.com/google/go-querystring/query github.com/grafana/mimir/pkg/mimirtool/rules golang.org/x/crypto/openpgp/armor golang.org/x/crypto/openpgp/elgamal image/internal/imageutil github.com/grafana/mimir/tools/querytee image/jpeg github.com/grafana/mimir/cmd/query-tee golang.org/x/crypto/openpgp/packet github.com/dlclark/regexp2 github.com/grafana/mimir/pkg/api golang.org/x/crypto/openpgp github.com/alecthomas/chroma github.com/google/go-github/v32/github github.com/grafana/mimir/pkg/mimir github.com/alecthomas/chroma/formatters/html github.com/alecthomas/chroma/formatters/svg github.com/alecthomas/chroma/lexers/internal github.com/alecthomas/chroma/lexers/a github.com/alecthomas/chroma/lexers/b github.com/alecthomas/chroma/formatters github.com/alecthomas/chroma/lexers/p github.com/alecthomas/chroma/lexers/j github.com/alecthomas/chroma/lexers/e github.com/alecthomas/chroma/lexers/d github.com/alecthomas/chroma/lexers/f github.com/grafana/mimir/cmd/mimir github.com/grafana/mimir/tools/doc-generator/parse github.com/alecthomas/chroma/lexers/c github.com/alecthomas/chroma/lexers/i github.com/grafana/mimir/pkg/mimirtool/config github.com/alecthomas/chroma/lexers/k github.com/alecthomas/chroma/lexers/l github.com/alecthomas/chroma/lexers/n github.com/alecthomas/chroma/lexers/o github.com/alecthomas/chroma/lexers/q github.com/alecthomas/chroma/lexers/h github.com/alecthomas/chroma/lexers/r github.com/alecthomas/chroma/lexers/t github.com/alecthomas/chroma/lexers/v github.com/alecthomas/chroma/lexers/w github.com/alecthomas/chroma/lexers/x github.com/alecthomas/chroma/lexers/y github.com/alecthomas/chroma/lexers/z github.com/alecthomas/chroma/styles github.com/grafana/mimir/pkg/mimirtool/version github.com/alecthomas/chroma/lexers/circular github.com/alecthomas/chroma/lexers/g github.com/alecthomas/chroma/lexers/m github.com/alecthomas/chroma/lexers/s github.com/alecthomas/chroma/lexers github.com/alecthomas/chroma/quick github.com/grafana/mimir/pkg/mimirtool/printer github.com/grafana/mimir/pkg/mimirtool/commands github.com/grafana/mimir/cmd/mimirtool ==> Starting check()... === RUN TestConvertTenantBlocks --- PASS: TestConvertTenantBlocks (0.06s) === RUN TestConvertTenantBlocksDryMode --- PASS: TestConvertTenantBlocksDryMode (0.04s) PASS ok github.com/grafana/mimir/cmd/metaconvert 1.417s === RUN TestFlagParsing === RUN TestFlagParsing/common_yaml_overridden_by_a_common_flag_and_specific_flag === RUN TestFlagParsing/config === RUN TestFlagParsing/help === RUN TestFlagParsing/user_visible_module_listing === RUN TestFlagParsing/user_visible_module_listing_flag_take_precedence_over_target_flag === RUN TestFlagParsing/root_level_configuration_option_specified_as_an_empty_node_in_YAML_does_not_set_entire_config_to_zero_value === RUN TestFlagParsing/version === RUN TestFlagParsing/common_yaml_inheritance_with_common_config_in_the_last_place === RUN TestFlagParsing/default_values === RUN TestFlagParsing/help-all === RUN TestFlagParsing/config_with_expand-env === RUN TestFlagParsing/common_yaml_inheritance_with_common_config_in_the_first_place === RUN TestFlagParsing/common_yaml_sets_a_value_but_specific_config_reverts_it_back === RUN TestFlagParsing/unknown_flag === RUN TestFlagParsing/new_flag,_with_config === RUN TestFlagParsing/config_with_arguments_override === RUN TestFlagParsing/common_yaml_unmarshaling_is_strict === RUN TestFlagParsing/help-short === RUN TestFlagParsing/common_flag_inheritance --- PASS: TestFlagParsing (4.47s) --- PASS: TestFlagParsing/common_yaml_overridden_by_a_common_flag_and_specific_flag (0.61s) --- PASS: TestFlagParsing/config (0.31s) --- PASS: TestFlagParsing/help (0.25s) --- PASS: TestFlagParsing/user_visible_module_listing (0.23s) --- PASS: TestFlagParsing/user_visible_module_listing_flag_take_precedence_over_target_flag (0.10s) --- PASS: TestFlagParsing/root_level_configuration_option_specified_as_an_empty_node_in_YAML_does_not_set_entire_config_to_zero_value (0.42s) --- PASS: TestFlagParsing/version (0.05s) --- PASS: TestFlagParsing/common_yaml_inheritance_with_common_config_in_the_last_place (0.30s) --- PASS: TestFlagParsing/default_values (0.14s) --- PASS: TestFlagParsing/help-all (0.38s) --- PASS: TestFlagParsing/config_with_expand-env (0.14s) --- PASS: TestFlagParsing/common_yaml_inheritance_with_common_config_in_the_first_place (0.14s) --- PASS: TestFlagParsing/common_yaml_sets_a_value_but_specific_config_reverts_it_back (0.28s) --- PASS: TestFlagParsing/unknown_flag (0.21s) --- PASS: TestFlagParsing/new_flag,_with_config (0.16s) --- PASS: TestFlagParsing/config_with_arguments_override (0.13s) --- PASS: TestFlagParsing/common_yaml_unmarshaling_is_strict (0.17s) --- PASS: TestFlagParsing/help-short (0.19s) --- PASS: TestFlagParsing/common_flag_inheritance (0.23s) === RUN TestHelp === RUN TestHelp/basic === RUN TestHelp/all --- PASS: TestHelp (0.42s) --- PASS: TestHelp/basic (0.08s) --- PASS: TestHelp/all (0.33s) === RUN TestExpandEnvironmentVariables === RUN TestExpandEnvironmentVariables/x$y === RUN TestExpandEnvironmentVariables/x${y} === RUN TestExpandEnvironmentVariables/x$Y === RUN TestExpandEnvironmentVariables/x${Y} === RUN TestExpandEnvironmentVariables/x${Z:D} === RUN TestExpandEnvironmentVariables/x${Z:A_B_C_D} === RUN TestExpandEnvironmentVariables/x${Z:} === RUN TestExpandEnvironmentVariables/x$y:D --- PASS: TestExpandEnvironmentVariables (0.01s) --- PASS: TestExpandEnvironmentVariables/x$y (0.00s) --- PASS: TestExpandEnvironmentVariables/x${y} (0.00s) --- PASS: TestExpandEnvironmentVariables/x$Y (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Y} (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Z:D} (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Z:A_B_C_D} (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Z:} (0.00s) --- PASS: TestExpandEnvironmentVariables/x$y:D (0.00s) === RUN TestParseConfigFileParameter === RUN TestParseConfigFileParameter/#00 === RUN TestParseConfigFileParameter/--foo === RUN TestParseConfigFileParameter/-f_-a === RUN TestParseConfigFileParameter/--config.file=foo === RUN TestParseConfigFileParameter/--config.file_foo === RUN TestParseConfigFileParameter/--config.file=foo_--config.expand-env === RUN TestParseConfigFileParameter/--config.expand-env_--config.file=foo === RUN TestParseConfigFileParameter/--opt1_--config.file=foo === RUN TestParseConfigFileParameter/--opt1_--config.file_foo === RUN TestParseConfigFileParameter/--opt1_--config.file=foo_--config.expand-env === RUN TestParseConfigFileParameter/--opt1_--config.expand-env_--config.file=foo === RUN TestParseConfigFileParameter/--config.file=foo_--opt1 === RUN TestParseConfigFileParameter/--config.file_foo_--opt1 === RUN TestParseConfigFileParameter/--config.file=foo_--config.expand-env_--opt1 === RUN TestParseConfigFileParameter/--config.expand-env_--config.file=foo_--opt1 === RUN TestParseConfigFileParameter/--config.file=foo_--opt1_--config.expand-env === RUN TestParseConfigFileParameter/--config.expand-env_--opt1_--config.file=foo --- PASS: TestParseConfigFileParameter (0.02s) --- PASS: TestParseConfigFileParameter/#00 (0.00s) --- PASS: TestParseConfigFileParameter/--foo (0.00s) --- PASS: TestParseConfigFileParameter/-f_-a (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--config.file_foo (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--config.expand-env (0.00s) --- PASS: TestParseConfigFileParameter/--config.expand-env_--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.file_foo (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.file=foo_--config.expand-env (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.expand-env_--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.file_foo_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--config.expand-env_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.expand-env_--config.file=foo_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--opt1_--config.expand-env (0.00s) --- PASS: TestParseConfigFileParameter/--config.expand-env_--opt1_--config.file=foo (0.00s) === RUN TestFieldCategoryOverridesNotStale --- PASS: TestFieldCategoryOverridesNotStale (0.09s) PASS ok github.com/grafana/mimir/cmd/mimir 9.607s ? github.com/grafana/mimir/cmd/mimir-continuous-test [no test files] ? github.com/grafana/mimir/cmd/mimirtool [no test files] === RUN TestMimirReadRoutes --- PASS: TestMimirReadRoutes (0.00s) PASS ok github.com/grafana/mimir/cmd/query-tee 0.772s ? github.com/grafana/mimir/integration [no test files] ? github.com/grafana/mimir/integration/ca [no test files] ? github.com/grafana/mimir/integration/e2emimir [no test files] === RUN TestResolveConfigs === RUN TestResolveConfigs/ResolveConfigs_annotates_values_that_match_defaults === RUN TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_cli_arguments === RUN TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_mounted_ConfigMaps === RUN TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_mounted_Secrets --- PASS: TestResolveConfigs (1.21s) --- PASS: TestResolveConfigs/ResolveConfigs_annotates_values_that_match_defaults (0.37s) --- PASS: TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_cli_arguments (0.23s) --- PASS: TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_mounted_ConfigMaps (0.32s) --- PASS: TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_mounted_Secrets (0.28s) PASS ok github.com/grafana/mimir/operations/compare-helm-with-jsonnet/plugins/resolve-config 3.051s === RUN TestMultitenantAlertmanager_GetStatusHandler --- PASS: TestMultitenantAlertmanager_GetStatusHandler (0.39s) === RUN TestAlertmanagerMetricsStore --- PASS: TestAlertmanagerMetricsStore (0.07s) === RUN TestAlertmanagerMetricsRemoval --- PASS: TestAlertmanagerMetricsRemoval (0.04s) === RUN TestIsHealthyForAlertmanagerOperations === PAUSE TestIsHealthyForAlertmanagerOperations === RUN TestDispatcherGroupLimits === RUN TestDispatcherGroupLimits/low_limit === RUN TestDispatcherGroupLimits/no_limit === RUN TestDispatcherGroupLimits/high_limit --- PASS: TestDispatcherGroupLimits (0.62s) --- PASS: TestDispatcherGroupLimits/low_limit (0.46s) --- PASS: TestDispatcherGroupLimits/no_limit (0.10s) --- PASS: TestDispatcherGroupLimits/high_limit (0.06s) === RUN TestDispatcherLoggerInsightKey --- PASS: TestDispatcherLoggerInsightKey (0.08s) === RUN TestAlertsLimiterWithNoLimits --- PASS: TestAlertsLimiterWithNoLimits (0.00s) === RUN TestAlertsLimiterWithCountLimit --- PASS: TestAlertsLimiterWithCountLimit (0.00s) === RUN TestAlertsLimiterWithSizeLimit --- PASS: TestAlertsLimiterWithSizeLimit (0.00s) === RUN TestAlertsLimiterWithSizeLimitAndAnnotationUpdate --- PASS: TestAlertsLimiterWithSizeLimitAndAnnotationUpdate (0.00s) === RUN TestAMConfigValidationAPI === RUN TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_contains_no_receivers === RUN TestAMConfigValidationAPI/Should_pass_if_the_alertmanager_config_is_valid === RUN TestAMConfigValidationAPI/Should_return_error_if_the_config_is_empty_due_to_wrong_indentation === RUN TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_is_empty_due_to_wrong_key === RUN TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_an_absolute_path === RUN TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_a_relative_path === RUN TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_is_not_a_valid_filename === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_/ === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_with_repeated_separators_/// === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_an_absolute_path === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_a_relative_path === RUN TestAMConfigValidationAPI/Should_pass_if_the_referenced_template_is_valid_filename === RUN TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_password_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_bearer_token_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_credentials_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_client_secret_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_proxy_url_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_TLS_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_password_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_bearer_token_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_credentials_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_client_secret_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_proxy_url_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_slack_api_url_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_Slack_api_url_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_opsgenie_api_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_OpsGenie_api_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_VictorOps_api_key_file_is_set === RUN TestAMConfigValidationAPI/should_return_error_if_template_is_wrong === RUN TestAMConfigValidationAPI/config_too_big === RUN TestAMConfigValidationAPI/config_size_OK === RUN TestAMConfigValidationAPI/templates_limit_reached === RUN TestAMConfigValidationAPI/templates_limit_not_reached === RUN TestAMConfigValidationAPI/template_size_limit_reached === RUN TestAMConfigValidationAPI/template_size_limit_ok --- PASS: TestAMConfigValidationAPI (0.33s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_contains_no_receivers (0.03s) --- PASS: TestAMConfigValidationAPI/Should_pass_if_the_alertmanager_config_is_valid (0.05s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_config_is_empty_due_to_wrong_indentation (0.01s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_is_empty_due_to_wrong_key (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_an_absolute_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_a_relative_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_is_not_a_valid_filename (0.01s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_/ (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_with_repeated_separators_/// (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_an_absolute_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_a_relative_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_pass_if_the_referenced_template_is_valid_filename (0.04s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_password_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_bearer_token_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_credentials_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_client_secret_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_proxy_url_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_TLS_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_password_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_bearer_token_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_credentials_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_client_secret_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_proxy_url_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_slack_api_url_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_Slack_api_url_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_opsgenie_api_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_OpsGenie_api_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_VictorOps_api_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/should_return_error_if_template_is_wrong (0.05s) --- PASS: TestAMConfigValidationAPI/config_too_big (0.00s) --- PASS: TestAMConfigValidationAPI/config_size_OK (0.03s) --- PASS: TestAMConfigValidationAPI/templates_limit_reached (0.00s) --- PASS: TestAMConfigValidationAPI/templates_limit_not_reached (0.03s) --- PASS: TestAMConfigValidationAPI/template_size_limit_reached (0.00s) --- PASS: TestAMConfigValidationAPI/template_size_limit_ok (0.03s) === RUN TestMultitenantAlertmanager_DeleteUserConfig --- PASS: TestMultitenantAlertmanager_DeleteUserConfig (0.02s) === RUN TestAMConfigListUserConfig --- PASS: TestAMConfigListUserConfig (0.46s) === RUN TestValidateAlertmanagerConfig === RUN TestValidateAlertmanagerConfig/*TLSConfig === RUN TestValidateAlertmanagerConfig/*GlobalConfig.SMTPAuthPasswordFile === RUN TestValidateAlertmanagerConfig/EmailConfig.AuthPasswordFile === RUN TestValidateAlertmanagerConfig/map_containing_*HTTPClientConfig === RUN TestValidateAlertmanagerConfig/map_containing_TLSConfig_as_nested_child === RUN TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child === RUN TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child_within_a_slice === RUN TestValidateAlertmanagerConfig/*HTTPClientConfig === RUN TestValidateAlertmanagerConfig/HTTPClientConfig === RUN TestValidateAlertmanagerConfig/TLSConfig === RUN TestValidateAlertmanagerConfig/GlobalConfig.SMTPAuthPasswordFile === RUN TestValidateAlertmanagerConfig/*EmailConfig.AuthPasswordFile === RUN TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_direct_child --- PASS: TestValidateAlertmanagerConfig (0.01s) --- PASS: TestValidateAlertmanagerConfig/*TLSConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/*GlobalConfig.SMTPAuthPasswordFile (0.00s) --- PASS: TestValidateAlertmanagerConfig/EmailConfig.AuthPasswordFile (0.00s) --- PASS: TestValidateAlertmanagerConfig/map_containing_*HTTPClientConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/map_containing_TLSConfig_as_nested_child (0.00s) --- PASS: TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child (0.00s) --- PASS: TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child_within_a_slice (0.00s) --- PASS: TestValidateAlertmanagerConfig/*HTTPClientConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/HTTPClientConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/TLSConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/GlobalConfig.SMTPAuthPasswordFile (0.00s) --- PASS: TestValidateAlertmanagerConfig/*EmailConfig.AuthPasswordFile (0.00s) --- PASS: TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_direct_child (0.00s) === RUN TestDistributor_DistributeRequest === RUN TestDistributor_DistributeRequest/Write_/alerts,_Simple_AM_request,_all_AM_healthy === RUN TestDistributor_DistributeRequest/Write_/alerts,_no_healthy_Alertmanagers === RUN TestDistributor_DistributeRequest/Write_/alerts,_1_healthy_Alertmanager_out_of_3 === RUN TestDistributor_DistributeRequest/Write_/alerts,_3_healthy_Alertmanagers_out_of_5 === RUN TestDistributor_DistributeRequest/Read_/v1/alerts_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/alerts_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/alerts/groups_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Write_/alerts/groups_not_supported === RUN TestDistributor_DistributeRequest/Read_/v1/silences_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/silences_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Write_/silences_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Read_/v1/silence/id_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/silence/id_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Write_/silence/id_not_supported === RUN TestDistributor_DistributeRequest/Delete_/silence/id_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Read_/status_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Write_/status_not_supported === RUN TestDistributor_DistributeRequest/Read_/some/place/arbitrary_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Read_/receivers_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Write_/receivers_not_supported --- PASS: TestDistributor_DistributeRequest (0.27s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_Simple_AM_request,_all_AM_healthy (0.01s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_no_healthy_Alertmanagers (0.03s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_1_healthy_Alertmanager_out_of_3 (0.01s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_3_healthy_Alertmanagers_out_of_5 (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v1/alerts_is_sent_to_3_AMs (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/alerts_is_sent_to_3_AMs (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/alerts/groups_is_sent_to_3_AMs (0.02s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts/groups_not_supported (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/v1/silences_is_sent_to_3_AMs (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/silences_is_sent_to_3_AMs (0.02s) --- PASS: TestDistributor_DistributeRequest/Write_/silences_is_sent_to_only_1_AM (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v1/silence/id_is_sent_to_3_AMs (0.02s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/silence/id_is_sent_to_3_AMs (0.01s) --- PASS: TestDistributor_DistributeRequest/Write_/silence/id_not_supported (0.01s) --- PASS: TestDistributor_DistributeRequest/Delete_/silence/id_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/status_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/status_not_supported (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/some/place/arbitrary_is_sent_to_only_1_AM (0.02s) --- PASS: TestDistributor_DistributeRequest/Read_/receivers_is_sent_to_only_1_AM (0.02s) --- PASS: TestDistributor_DistributeRequest/Write_/receivers_not_supported (0.01s) === RUN TestMultitenantAlertmanagerConfig_Validate === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_zone_aware_is_enabled_but_zone_is_not_set === RUN TestMultitenantAlertmanagerConfig_Validate/should_pass_if_the_URL_just_contains_the_path_with_the_leading_/ === RUN TestMultitenantAlertmanagerConfig_Validate/should_pass_with_default_config === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_with_empty_external_URL === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_has_no_hostname === RUN TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_external_URL_does_not_end_with_/ === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_has_no_scheme === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_the_URL_just_contains_the_hostname_(because_it_can't_be_disambiguated_with_a_path) === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_0 === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_negative === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_ends_with_/ --- PASS: TestMultitenantAlertmanagerConfig_Validate (0.07s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_zone_aware_is_enabled_but_zone_is_not_set (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_pass_if_the_URL_just_contains_the_path_with_the_leading_/ (0.01s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_pass_with_default_config (0.01s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_with_empty_external_URL (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_has_no_hostname (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_external_URL_does_not_end_with_/ (0.01s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_has_no_scheme (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_the_URL_just_contains_the_hostname_(because_it_can't_be_disambiguated_with_a_path) (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_0 (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_negative (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_ends_with_/ (0.00s) === RUN TestMultitenantAlertmanager_loadAndSyncConfigs --- PASS: TestMultitenantAlertmanager_loadAndSyncConfigs (0.76s) === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=slack integration=slack[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://www.google.com\": http: server gave HTTP response to HTTPS client" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=telegram integration=telegram[0] msg="Notify attempt failed, will retry later" attempts=1 err="telebot: unexpected end of JSON input" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=sns msg="SNS message successfully published" message_id=null sequencenumber=null level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=sns integration=sns[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=error component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="wechat/wechat[0]: notify retry canceled due to unrecoverable error after 1 attempts: EOF" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=opsgenie integration=opsgenie[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=pagerduty integration=pagerduty[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=wechat integration=wechat[0] msg="Notify attempt failed, will retry later" attempts=1 err="Get \"\": dial tcp 127.0.0.1:38543: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://www.google.com\": proxyconnect tcp: dial tcp 127.0.0.1:40581: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"http://127.0.0.1:35727\": dial tcp 127.0.0.1:35727: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=pagerduty integration=pagerduty[0] msg="Notify attempt failed, will retry later" attempts=1 err="failed to post message to PagerDuty: Post \"http://127.0.0.1:45741\": dial tcp 127.0.0.1:45741: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=sns integration=sns[0] msg="Notify attempt failed, will retry later" attempts=1 err="RequestError: send request failed\ncaused by: Post \"http://127.0.0.1:41441/\": dial tcp 127.0.0.1:41441: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=telegram integration=telegram[0] msg="Notify attempt failed, will retry later" attempts=1 err="telebot: Post \"http://127.0.0.1:34417/botxxx/sendMessage\": dial tcp 127.0.0.1:34417: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=opsgenie integration=opsgenie[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"http://127.0.0.1:39403/v2/alerts\": dial tcp 127.0.0.1:39403: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true multitenant_test.go:603: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=slack integration=slack[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:33985: blocked address" --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled (0.01s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false (0.47s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false (0.51s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false (0.58s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false (0.30s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false (0.43s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false (0.54s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false (0.36s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false (0.30s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true (3.41s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true (3.42s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true (3.44s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true (3.45s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true (3.35s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true (3.86s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true (3.24s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true (3.29s) === RUN TestMultitenantAlertmanager_deleteUnusedLocalUserState --- PASS: TestMultitenantAlertmanager_deleteUnusedLocalUserState (0.54s) === RUN TestMultitenantAlertmanager_zoneAwareSharding level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-1 ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-2 ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-3 ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=3 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user1 addr=127.0.0.1-3:0 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user2 level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user2 addr=127.0.0.1-3:0 level=debug component=MultiTenantAlertmanager msg="setting config" user=user3 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user3 level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user3 addr=127.0.0.1-3:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-3:0 user=user3 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-3: no such host\"" level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-3:0 user=user2 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-3: no such host\"" level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-3:0 user=user1 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-3: no such host\"" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=3 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user1 addr=127.0.0.1-1:0 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user2 level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user2 addr=127.0.0.1-1:0 level=debug component=MultiTenantAlertmanager msg="setting config" user=user3 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user3 level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user3 addr=127.0.0.1-1:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-1:0 user=user1 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-1: no such host\"" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="no state for user in storage; proceeding" level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-1:0 user=user3 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-1: no such host\"" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="no state for user in storage; proceeding" level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-1:0 user=user2 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-1: no such host\"" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="no state for user in storage; proceeding" level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Running maintenance" level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Maintenance done" duration=1.0456ms size=0 level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Maintenance done" duration=5.806599ms size=0 level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Maintenance done" duration=2.9217ms size=0 level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Maintenance done" duration=1.0974ms size=0 level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Maintenance done" duration=798.499µs size=0 level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Maintenance done" duration=962.2µs size=0 level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Maintenance done" duration=794µs size=0 level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Maintenance done" duration=1.0928ms size=0 level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Maintenance done" duration=802.4µs size=0 level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Maintenance done" duration=14.717098ms size=0 level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Maintenance done" duration=1.3358ms size=0 level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Maintenance done" duration=1.6802ms size=0 --- PASS: TestMultitenantAlertmanager_zoneAwareSharding (1.16s) === RUN TestMultitenantAlertmanager_deleteUnusedRemoteUserState level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-1 ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-2 ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=2 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="no state for user in storage; proceeding" level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user2 level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=debug component=MultiTenantAlertmanager user=user1 msg="persisting state" user=user1 level=debug component=MultiTenantAlertmanager user=user2 msg="persisting state" user=user2 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=2 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=info component=MultiTenantAlertmanager msg="deactivating per-tenant alertmanager" user=user1 level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Maintenance done" duration=1.2148ms size=0 level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Maintenance done" duration=1.0279ms size=0 level=info component=MultiTenantAlertmanager msg="deactivated per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager msg="deleted local directory for user" dir=/tmp/TestMultitenantAlertmanager_deleteUnusedRemoteUserState3310624875/001/user1 user=user1 level=info component=MultiTenantAlertmanager msg="deleted remote state for user" user=user1 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Maintenance done" duration=850.8µs size=0 level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Maintenance done" duration=1.044899ms size=0 --- PASS: TestMultitenantAlertmanager_deleteUnusedRemoteUserState (0.89s) === RUN TestMultitenantAlertmanager_ServeHTTP --- PASS: TestMultitenantAlertmanager_ServeHTTP (0.23s) === RUN TestMultitenantAlertmanager_ServeHTTPWithFallbackConfig --- PASS: TestMultitenantAlertmanager_ServeHTTPWithFallbackConfig (0.57s) === RUN TestMultitenantAlertmanager_ServeHTTPBeforeSyncFailsIfConfigExists --- PASS: TestMultitenantAlertmanager_ServeHTTPBeforeSyncFailsIfConfigExists (0.24s) === RUN TestMultitenantAlertmanager_InitialSync === RUN TestMultitenantAlertmanager_InitialSync/with_no_instance_in_the_ring === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_PENDING_state_and_no_tokens === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_JOINING_state_and_some_tokens === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_ACTIVE_state_and_all_tokens === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_LEAVING_state_and_all_tokens --- PASS: TestMultitenantAlertmanager_InitialSync (1.70s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_no_instance_in_the_ring (0.36s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_PENDING_state_and_no_tokens (0.38s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_JOINING_state_and_some_tokens (0.17s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_ACTIVE_state_and_all_tokens (0.41s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_LEAVING_state_and_all_tokens (0.37s) === RUN TestMultitenantAlertmanager_PerTenantSharding === RUN TestMultitenantAlertmanager_PerTenantSharding/1_instance,_RF_=_1 === RUN TestMultitenantAlertmanager_PerTenantSharding/2_instances,_RF_=_1 === RUN TestMultitenantAlertmanager_PerTenantSharding/3_instances,_RF_=_2 === RUN TestMultitenantAlertmanager_PerTenantSharding/5_instances,_RF_=_3 --- PASS: TestMultitenantAlertmanager_PerTenantSharding (10.00s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/1_instance,_RF_=_1 (1.17s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/2_instances,_RF_=_1 (1.80s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/3_instances,_RF_=_2 (2.42s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/5_instances,_RF_=_3 (4.61s) === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_added_to_the_ring === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_removed_from_the_ring === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_instance_changes_state === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_healthy_instance_becomes_unhealthy === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_unhealthy_instance_becomes_healthy === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_updates_the_heartbeat === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges (2.47s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_added_to_the_ring (0.42s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_removed_from_the_ring (0.27s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_instance_changes_state (0.39s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_healthy_instance_becomes_unhealthy (0.47s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_unhealthy_instance_becomes_healthy (0.47s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_updates_the_heartbeat (0.30s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state (0.15s) === RUN TestMultitenantAlertmanager_RingLifecyclerShouldAutoForgetUnhealthyInstances --- PASS: TestMultitenantAlertmanager_RingLifecyclerShouldAutoForgetUnhealthyInstances (0.46s) === RUN TestMultitenantAlertmanager_InitialSyncFailure --- PASS: TestMultitenantAlertmanager_InitialSyncFailure (0.20s) === RUN TestAlertmanager_ReplicasPosition --- PASS: TestAlertmanager_ReplicasPosition (0.91s) === RUN TestAlertmanager_StateReplication === RUN TestAlertmanager_StateReplication/RF_=_1,_1_instance === RUN TestAlertmanager_StateReplication/RF_=_2,_2_instances === RUN TestAlertmanager_StateReplication/RF_=_3,_10_instance --- PASS: TestAlertmanager_StateReplication (13.68s) --- PASS: TestAlertmanager_StateReplication/RF_=_1,_1_instance (1.65s) --- PASS: TestAlertmanager_StateReplication/RF_=_2,_2_instances (2.55s) --- PASS: TestAlertmanager_StateReplication/RF_=_3,_10_instance (9.49s) === RUN TestAlertmanager_StateReplication_InitialSyncFromPeers === RUN TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_2 === RUN TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_3 --- PASS: TestAlertmanager_StateReplication_InitialSyncFromPeers (2.09s) --- PASS: TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_2 (0.86s) --- PASS: TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_3 (1.23s) === RUN TestSafeTemplateFilepath === RUN TestSafeTemplateFilepath/escaping_template_name_that_has_prefix_of_dir_(tmp_is_prefix_of_tmpfile) === RUN TestSafeTemplateFilepath/empty_template_name === RUN TestSafeTemplateFilepath/dot_template_name === RUN TestSafeTemplateFilepath/should_succeed_if_the_provided_template_is_a_filename === RUN TestSafeTemplateFilepath/template_name_starting_with_/ === RUN TestSafeTemplateFilepath/root_dir === RUN TestSafeTemplateFilepath/root_dir_2 === RUN TestSafeTemplateFilepath/should_fail_if_the_provided_template_is_escaping_the_dir --- PASS: TestSafeTemplateFilepath (0.00s) --- PASS: TestSafeTemplateFilepath/escaping_template_name_that_has_prefix_of_dir_(tmp_is_prefix_of_tmpfile) (0.00s) --- PASS: TestSafeTemplateFilepath/empty_template_name (0.00s) --- PASS: TestSafeTemplateFilepath/dot_template_name (0.00s) --- PASS: TestSafeTemplateFilepath/should_succeed_if_the_provided_template_is_a_filename (0.00s) --- PASS: TestSafeTemplateFilepath/template_name_starting_with_/ (0.00s) --- PASS: TestSafeTemplateFilepath/root_dir (0.00s) --- PASS: TestSafeTemplateFilepath/root_dir_2 (0.00s) --- PASS: TestSafeTemplateFilepath/should_fail_if_the_provided_template_is_escaping_the_dir (0.00s) === RUN TestStoreTemplateFile --- PASS: TestStoreTemplateFile (0.02s) === RUN TestMultitenantAlertmanager_verifyRateLimitedEmailConfig --- PASS: TestMultitenantAlertmanager_verifyRateLimitedEmailConfig (0.29s) === RUN TestRateLimitedNotifier --- PASS: TestRateLimitedNotifier (1.00s) === RUN TestStatePersister_Position0ShouldWrite --- PASS: TestStatePersister_Position0ShouldWrite (6.02s) === RUN TestStatePersister_Position1ShouldNotWrite --- PASS: TestStatePersister_Position1ShouldNotWrite (5.00s) === RUN TestStateReplication === RUN TestStateReplication/with_a_replication_factor_of_<=_1,_state_is_not_replicated_but_loaded_from_storage. === RUN TestStateReplication/with_a_replication_factor_of_>_1,_state_is_broadcasted_for_replication. --- PASS: TestStateReplication (0.25s) --- PASS: TestStateReplication/with_a_replication_factor_of_<=_1,_state_is_not_replicated_but_loaded_from_storage. (0.13s) --- PASS: TestStateReplication/with_a_replication_factor_of_>_1,_state_is_broadcasted_for_replication. (0.11s) === RUN TestStateReplication_Settle === RUN TestStateReplication_Settle/with_a_replication_factor_of_<=_1,_no_state_can_be_read_from_peers. === RUN TestStateReplication_Settle/with_a_replication_factor_of_>_1,_state_is_read_from_all_peers. === RUN TestStateReplication_Settle/with_full_state_having_no_parts,_nothing_is_merged. === RUN TestStateReplication_Settle/with_an_unknown_key,_parts_in_the_same_state_are_merged. === RUN TestStateReplication_Settle/with_an_unknown_key,_parts_in_other_states_are_merged. === RUN TestStateReplication_Settle/when_reading_from_replicas_fails,_state_is_read_from_storage. === RUN TestStateReplication_Settle/when_reading_from_replicas_and_from_storage_fails,_still_become_ready. === RUN TestStateReplication_Settle/when_user_not_found_in_all_replicas_and_storage,_read_not_counted_as_failure_and_still_become_ready. === RUN TestStateReplication_Settle/when_reading_the_full_state_takes_too_long,_hit_timeout_but_become_ready. --- PASS: TestStateReplication_Settle (1.05s) --- PASS: TestStateReplication_Settle/with_a_replication_factor_of_<=_1,_no_state_can_be_read_from_peers. (0.01s) --- PASS: TestStateReplication_Settle/with_a_replication_factor_of_>_1,_state_is_read_from_all_peers. (0.01s) --- PASS: TestStateReplication_Settle/with_full_state_having_no_parts,_nothing_is_merged. (0.00s) --- PASS: TestStateReplication_Settle/with_an_unknown_key,_parts_in_the_same_state_are_merged. (0.00s) --- PASS: TestStateReplication_Settle/with_an_unknown_key,_parts_in_other_states_are_merged. (0.00s) --- PASS: TestStateReplication_Settle/when_reading_from_replicas_fails,_state_is_read_from_storage. (0.00s) --- PASS: TestStateReplication_Settle/when_reading_from_replicas_and_from_storage_fails,_still_become_ready. (0.00s) --- PASS: TestStateReplication_Settle/when_user_not_found_in_all_replicas_and_storage,_read_not_counted_as_failure_and_still_become_ready. (0.00s) --- PASS: TestStateReplication_Settle/when_reading_the_full_state_takes_too_long,_hit_timeout_but_become_ready. (1.00s) === RUN TestStateReplication_GetFullState === RUN TestStateReplication_GetFullState/no_keys === RUN TestStateReplication_GetFullState/zero_length_data === RUN TestStateReplication_GetFullState/keys_with_data --- PASS: TestStateReplication_GetFullState (0.00s) --- PASS: TestStateReplication_GetFullState/no_keys (0.00s) --- PASS: TestStateReplication_GetFullState/zero_length_data (0.00s) --- PASS: TestStateReplication_GetFullState/keys_with_data (0.00s) === CONT TestIsHealthyForAlertmanagerOperations === RUN TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/JOINING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/PENDING_instance_with_last_keepalive_newer_than_timeout --- PASS: TestIsHealthyForAlertmanagerOperations (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/JOINING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/PENDING_instance_with_last_keepalive_newer_than_timeout (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager 59.156s ? github.com/grafana/mimir/pkg/alertmanager/alertmanagerpb [no test files] ? github.com/grafana/mimir/pkg/alertmanager/alertspb [no test files] === RUN TestAlertStore_ListAllUsers --- PASS: TestAlertStore_ListAllUsers (0.00s) === RUN TestAlertStore_SetAndGetAlertConfig --- PASS: TestAlertStore_SetAndGetAlertConfig (0.00s) === RUN TestStore_GetAlertConfigs --- PASS: TestStore_GetAlertConfigs (0.01s) === RUN TestAlertStore_DeleteAlertConfig --- PASS: TestAlertStore_DeleteAlertConfig (0.00s) === RUN TestBucketAlertStore_GetSetDeleteFullState --- PASS: TestBucketAlertStore_GetSetDeleteFullState (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager/alertstore 1.536s testing: warning: no tests to run PASS ok github.com/grafana/mimir/pkg/alertmanager/alertstore/bucketclient 1.403s [no tests to run] === RUN TestStore_ListAllUsers --- PASS: TestStore_ListAllUsers (0.05s) === RUN TestStore_GetAlertConfig --- PASS: TestStore_GetAlertConfig (0.02s) === RUN TestStore_GetAlertConfigs --- PASS: TestStore_GetAlertConfigs (0.01s) === RUN TestStore_FullState --- PASS: TestStore_FullState (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager/alertstore/local 0.913s === RUN TestV1Alerts --- PASS: TestV1Alerts (0.09s) === RUN TestMergeV1Alerts === RUN TestMergeV1Alerts/no_alerts,_should_return_an_empty_list === RUN TestMergeV1Alerts/one_alert,_should_return_the_alert === RUN TestMergeV1Alerts/two_alerts,_should_return_two_alerts === RUN TestMergeV1Alerts/three_alerts,_should_return_three_alerts === RUN TestMergeV1Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order === RUN TestMergeV1Alerts/two_identical_alerts,_should_return_one_alert === RUN TestMergeV1Alerts/two_identical_alerts_plus_another,_should_return_two_alerts === RUN TestMergeV1Alerts/two_duplicates_out_of_sync_alerts,_should_return_first_seen_alert === RUN TestMergeV1Alerts/two_duplicates_plus_others,_should_return_first_seen_alert_and_others --- PASS: TestMergeV1Alerts (0.01s) --- PASS: TestMergeV1Alerts/no_alerts,_should_return_an_empty_list (0.00s) --- PASS: TestMergeV1Alerts/one_alert,_should_return_the_alert (0.00s) --- PASS: TestMergeV1Alerts/two_alerts,_should_return_two_alerts (0.00s) --- PASS: TestMergeV1Alerts/three_alerts,_should_return_three_alerts (0.00s) --- PASS: TestMergeV1Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order (0.00s) --- PASS: TestMergeV1Alerts/two_identical_alerts,_should_return_one_alert (0.00s) --- PASS: TestMergeV1Alerts/two_identical_alerts_plus_another,_should_return_two_alerts (0.00s) --- PASS: TestMergeV1Alerts/two_duplicates_out_of_sync_alerts,_should_return_first_seen_alert (0.00s) --- PASS: TestMergeV1Alerts/two_duplicates_plus_others,_should_return_first_seen_alert_and_others (0.00s) === RUN TestV1SilenceID_ReturnsNewestSilence --- PASS: TestV1SilenceID_ReturnsNewestSilence (0.01s) === RUN TestV1SilenceID_InvalidDifferentIDs --- PASS: TestV1SilenceID_InvalidDifferentIDs (0.00s) === RUN TestV1Silences --- PASS: TestV1Silences (0.00s) === RUN TestV2AlertGroups --- PASS: TestV2AlertGroups (0.01s) === RUN TestMergeV2AlertGroups === RUN TestMergeV2AlertGroups/no_groups,_should_return_no_groups === RUN TestMergeV2AlertGroups/one_group_with_one_alert,_should_return_one_group === RUN TestMergeV2AlertGroups/two_groups_with_different_labels,_should_return_two_groups === RUN TestMergeV2AlertGroups/two_groups_with_different_receiver,_should_return_two_groups === RUN TestMergeV2AlertGroups/two_identical_groups_with_different_alerts,_should_return_one_group_with_two_alerts === RUN TestMergeV2AlertGroups/two_identical_groups_with_identical_alerts,_should_return_one_group_with_one_alert === RUN TestMergeV2AlertGroups/two_identical_groups_with_diverged_alerts,_should_return_one_group_with_the_newer_alert === RUN TestMergeV2AlertGroups/two_sets_of_identical_groups_with_single_alerts,_should_merge_all_into_two_groups_ === RUN TestMergeV2AlertGroups/many_unordered_groups,_should_return_groups_ordered_by_labels_then_receiver --- PASS: TestMergeV2AlertGroups (0.02s) --- PASS: TestMergeV2AlertGroups/no_groups,_should_return_no_groups (0.00s) --- PASS: TestMergeV2AlertGroups/one_group_with_one_alert,_should_return_one_group (0.00s) --- PASS: TestMergeV2AlertGroups/two_groups_with_different_labels,_should_return_two_groups (0.00s) --- PASS: TestMergeV2AlertGroups/two_groups_with_different_receiver,_should_return_two_groups (0.00s) --- PASS: TestMergeV2AlertGroups/two_identical_groups_with_different_alerts,_should_return_one_group_with_two_alerts (0.00s) --- PASS: TestMergeV2AlertGroups/two_identical_groups_with_identical_alerts,_should_return_one_group_with_one_alert (0.00s) --- PASS: TestMergeV2AlertGroups/two_identical_groups_with_diverged_alerts,_should_return_one_group_with_the_newer_alert (0.00s) --- PASS: TestMergeV2AlertGroups/two_sets_of_identical_groups_with_single_alerts,_should_merge_all_into_two_groups_ (0.00s) --- PASS: TestMergeV2AlertGroups/many_unordered_groups,_should_return_groups_ordered_by_labels_then_receiver (0.00s) === RUN TestV2Alerts --- PASS: TestV2Alerts (0.00s) === RUN TestMergeV2Alerts === RUN TestMergeV2Alerts/no_alerts,_should_return_an_empty_list === RUN TestMergeV2Alerts/one_alert,_should_return_the_alert === RUN TestMergeV2Alerts/two_alerts,_should_return_two_alerts === RUN TestMergeV2Alerts/three_alerts,_should_return_three_alerts === RUN TestMergeV2Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order === RUN TestMergeV2Alerts/two_identical_alerts,_should_return_one_alert === RUN TestMergeV2Alerts/two_identical_alerts_plus_another,_should_return_two_alerts === RUN TestMergeV2Alerts/two_duplicates_out_of_sync_alerts,_should_return_newer_alert === RUN TestMergeV2Alerts/two_duplicates_out_of_sync_alerts_(newer_first),_should_return_newer_alert === RUN TestMergeV2Alerts/two_duplicates_plus_others,_should_return_newer_alert_and_others --- PASS: TestMergeV2Alerts (0.01s) --- PASS: TestMergeV2Alerts/no_alerts,_should_return_an_empty_list (0.00s) --- PASS: TestMergeV2Alerts/one_alert,_should_return_the_alert (0.00s) --- PASS: TestMergeV2Alerts/two_alerts,_should_return_two_alerts (0.00s) --- PASS: TestMergeV2Alerts/three_alerts,_should_return_three_alerts (0.00s) --- PASS: TestMergeV2Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order (0.00s) --- PASS: TestMergeV2Alerts/two_identical_alerts,_should_return_one_alert (0.00s) --- PASS: TestMergeV2Alerts/two_identical_alerts_plus_another,_should_return_two_alerts (0.00s) --- PASS: TestMergeV2Alerts/two_duplicates_out_of_sync_alerts,_should_return_newer_alert (0.00s) --- PASS: TestMergeV2Alerts/two_duplicates_out_of_sync_alerts_(newer_first),_should_return_newer_alert (0.00s) --- PASS: TestMergeV2Alerts/two_duplicates_plus_others,_should_return_newer_alert_and_others (0.00s) === RUN TestV2SilenceId_ReturnsNewestSilence --- PASS: TestV2SilenceId_ReturnsNewestSilence (0.00s) === RUN TestV2SilenceID_InvalidDifferentIDs --- PASS: TestV2SilenceID_InvalidDifferentIDs (0.00s) === RUN TestV2Silences --- PASS: TestV2Silences (0.00s) === RUN TestMergeV2Silences === RUN TestMergeV2Silences/no_silences,_should_return_an_empty_list === RUN TestMergeV2Silences/one_silence,_should_return_the_silence === RUN TestMergeV2Silences/two_silences,_should_return_two_silences === RUN TestMergeV2Silences/three_silences,_should_return_three_silences === RUN TestMergeV2Silences/three_active_silences_out_of_order,_should_return_three_silences_in_expiry_order === RUN TestMergeV2Silences/two_identical_silences,_should_return_one_silence === RUN TestMergeV2Silences/two_identical_silences_plus_another,_should_return_two_silences === RUN TestMergeV2Silences/two_duplicates_out_of_sync_silences,_should_return_newer_silence === RUN TestMergeV2Silences/two_duplicates_out_of_sync_silences_(newer_first),_should_return_newer_silence === RUN TestMergeV2Silences/two_duplicates_plus_others,_should_return_newer_silence_and_others --- PASS: TestMergeV2Silences (0.01s) --- PASS: TestMergeV2Silences/no_silences,_should_return_an_empty_list (0.00s) --- PASS: TestMergeV2Silences/one_silence,_should_return_the_silence (0.00s) --- PASS: TestMergeV2Silences/two_silences,_should_return_two_silences (0.00s) --- PASS: TestMergeV2Silences/three_silences,_should_return_three_silences (0.00s) --- PASS: TestMergeV2Silences/three_active_silences_out_of_order,_should_return_three_silences_in_expiry_order (0.00s) --- PASS: TestMergeV2Silences/two_identical_silences,_should_return_one_silence (0.00s) --- PASS: TestMergeV2Silences/two_identical_silences_plus_another,_should_return_two_silences (0.00s) --- PASS: TestMergeV2Silences/two_duplicates_out_of_sync_silences,_should_return_newer_silence (0.00s) --- PASS: TestMergeV2Silences/two_duplicates_out_of_sync_silences_(newer_first),_should_return_newer_silence (0.00s) --- PASS: TestMergeV2Silences/two_duplicates_plus_others,_should_return_newer_silence_and_others (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager/merger 1.417s === RUN TestNewApiWithoutSourceIPExtractor --- PASS: TestNewApiWithoutSourceIPExtractor (0.02s) === RUN TestNewApiWithSourceIPExtractor --- PASS: TestNewApiWithSourceIPExtractor (0.00s) === RUN TestNewApiWithInvalidSourceIPExtractor --- PASS: TestNewApiWithInvalidSourceIPExtractor (0.00s) === RUN TestApiGzip === RUN TestApiGzip/happy_case_gzip === RUN TestApiGzip/gzip_with_priority_header === RUN TestApiGzip/gzip_because_any_is_accepted === RUN TestApiGzip/no_gzip_because_no_header === RUN TestApiGzip/no_gzip_because_not_accepted === RUN TestApiGzip/no_gzip_because_small_payload === RUN TestApiGzip/forced_gzip_with_small_payload === RUN TestApiGzip/gzip_disabled_endpoint === RUN TestApiGzip/compressed_with_gzip --- PASS: TestApiGzip (0.24s) --- PASS: TestApiGzip/happy_case_gzip (0.05s) --- PASS: TestApiGzip/gzip_with_priority_header (0.04s) --- PASS: TestApiGzip/gzip_because_any_is_accepted (0.02s) --- PASS: TestApiGzip/no_gzip_because_no_header (0.02s) --- PASS: TestApiGzip/no_gzip_because_not_accepted (0.01s) --- PASS: TestApiGzip/no_gzip_because_small_payload (0.01s) --- PASS: TestApiGzip/forced_gzip_with_small_payload (0.01s) --- PASS: TestApiGzip/gzip_disabled_endpoint (0.00s) --- PASS: TestApiGzip/compressed_with_gzip (0.00s) === RUN TestIndexHandlerPrefix --- PASS: TestIndexHandlerPrefix (0.03s) === RUN TestIndexPageContent --- PASS: TestIndexPageContent (0.00s) === RUN TestConfigDiffHandler === RUN TestConfigDiffHandler/no_config_parameters_overridden === RUN TestConfigDiffHandler/slice_changed === RUN TestConfigDiffHandler/string_in_nested_struct_changed === RUN TestConfigDiffHandler/bool_in_nested_struct_changed === RUN TestConfigDiffHandler/test_invalid_input --- PASS: TestConfigDiffHandler (0.07s) --- PASS: TestConfigDiffHandler/no_config_parameters_overridden (0.04s) --- PASS: TestConfigDiffHandler/slice_changed (0.00s) --- PASS: TestConfigDiffHandler/string_in_nested_struct_changed (0.00s) --- PASS: TestConfigDiffHandler/bool_in_nested_struct_changed (0.00s) --- PASS: TestConfigDiffHandler/test_invalid_input (0.00s) === RUN TestConfigOverrideHandler --- PASS: TestConfigOverrideHandler (0.00s) PASS ok github.com/grafana/mimir/pkg/api 2.462s ? github.com/grafana/mimir/pkg/api/error [no test files] === RUN TestCompressionConfig_Validate === RUN TestCompressionConfig_Validate/should_pass_with_default_config === RUN TestCompressionConfig_Validate/should_pass_with_snappy_compression === RUN TestCompressionConfig_Validate/should_fail_with_unsupported_compression --- PASS: TestCompressionConfig_Validate (0.01s) --- PASS: TestCompressionConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestCompressionConfig_Validate/should_pass_with_snappy_compression (0.00s) --- PASS: TestCompressionConfig_Validate/should_fail_with_unsupported_compression (0.00s) === RUN TestSnappyCache === RUN TestSnappyCache/Fetch()_should_return_empty_results_if_no_key_has_been_found === RUN TestSnappyCache/Fetch()_should_return_previously_set_keys === RUN TestSnappyCache/Fetch()_should_skip_entries_failing_to_decode --- PASS: TestSnappyCache (0.01s) --- PASS: TestSnappyCache/Fetch()_should_return_empty_results_if_no_key_has_been_found (0.00s) --- PASS: TestSnappyCache/Fetch()_should_return_previously_set_keys (0.00s) --- PASS: TestSnappyCache/Fetch()_should_skip_entries_failing_to_decode (0.00s) === RUN TestLRUCache_StoreFetch --- PASS: TestLRUCache_StoreFetch (0.02s) === RUN TestLRUCache_Evictions --- PASS: TestLRUCache_Evictions (0.00s) === RUN TestMemcachedIndexCacheConfig_GetAddresses === RUN TestMemcachedIndexCacheConfig_GetAddresses/two_addresses === RUN TestMemcachedIndexCacheConfig_GetAddresses/no_addresses === RUN TestMemcachedIndexCacheConfig_GetAddresses/one_address --- PASS: TestMemcachedIndexCacheConfig_GetAddresses (0.00s) --- PASS: TestMemcachedIndexCacheConfig_GetAddresses/two_addresses (0.00s) --- PASS: TestMemcachedIndexCacheConfig_GetAddresses/no_addresses (0.00s) --- PASS: TestMemcachedIndexCacheConfig_GetAddresses/one_address (0.00s) === RUN TestVersioned === RUN TestVersioned/happy_case:_can_store_and_retrieve === RUN TestVersioned/different_versions_use_different_datasets --- PASS: TestVersioned (0.00s) --- PASS: TestVersioned/happy_case:_can_store_and_retrieve (0.00s) --- PASS: TestVersioned/different_versions_use_different_datasets (0.00s) PASS ok github.com/grafana/mimir/pkg/cache 0.733s === RUN TestMultitenantCompactor_HandleBlockUpload_Create === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_tenant_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_body block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/malformed_body block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_file_path block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_file_size block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_minTime block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_maxTime block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/maxTime_before_minTime block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/block_before_retention_period block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_version block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_==_0 block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_<_0 block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_compactor_shard_ID_label block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/failure_checking_for_complete_block block_upload_test.go:555: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/complete_block_already_exists block_upload_test.go:555: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/failure_uploading_meta_file block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/block_upload_disabled === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_empty_compactor_shard_ID_label block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_without_compactor_shard_ID_label block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_different_block_ID_in_meta_file block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_both_in-flight_meta_file_and_complete_meta_file_exist_in_object_storage === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_request_when_in-flight_meta_file_exists_in_object_storage === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_same_in-flight_meta_file_exists_in_object_storage === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_different_in-flight_meta_file_exists_in_object_storage --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create (0.29s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_tenant_ID (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_body (0.03s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/malformed_body (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_file_path (0.02s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_file_size (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_minTime (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_maxTime (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/maxTime_before_minTime (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/block_before_retention_period (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_version (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_==_0 (0.02s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_<_0 (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_compactor_shard_ID_label (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/failure_checking_for_complete_block (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/complete_block_already_exists (0.02s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/failure_uploading_meta_file (0.03s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/block_upload_disabled (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request (0.03s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_empty_compactor_shard_ID_label (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_without_compactor_shard_ID_label (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_different_block_ID_in_meta_file (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_both_in-flight_meta_file_and_complete_meta_file_exist_in_object_storage (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_request_when_in-flight_meta_file_exists_in_object_storage (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_same_in-flight_meta_file_exists_in_object_storage (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_different_in-flight_meta_file_exists_in_object_storage (0.00s) === RUN TestMultitenantCompactor_UploadBlockFile === RUN TestMultitenantCompactor_UploadBlockFile/without_tenant_ID === RUN TestMultitenantCompactor_UploadBlockFile/without_block_ID === RUN TestMultitenantCompactor_UploadBlockFile/invalid_block_ID === RUN TestMultitenantCompactor_UploadBlockFile/without_path === RUN TestMultitenantCompactor_UploadBlockFile/invalid_path === RUN TestMultitenantCompactor_UploadBlockFile/empty_file === RUN TestMultitenantCompactor_UploadBlockFile/attempt_block_metadata_file === RUN TestMultitenantCompactor_UploadBlockFile/attempt_in-flight_block_metadata_file === RUN TestMultitenantCompactor_UploadBlockFile/block_upload_disabled === RUN TestMultitenantCompactor_UploadBlockFile/complete_block_already_exists block_upload_test.go:967: PASS: Exists(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/failure_checking_for_complete_block block_upload_test.go:967: PASS: Exists(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/failure_checking_for_in-flight_meta_file block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/missing_in-flight_meta_file block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/file_upload_fails block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_UploadBlockFile/invalid_file_size block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Get(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/unexpected_file block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Get(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/valid_request block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_UploadBlockFile/multiple_sequential_uploads_of_same_file --- PASS: TestMultitenantCompactor_UploadBlockFile (0.12s) --- PASS: TestMultitenantCompactor_UploadBlockFile/without_tenant_ID (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/without_block_ID (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/invalid_block_ID (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/without_path (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/invalid_path (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/empty_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/attempt_block_metadata_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/attempt_in-flight_block_metadata_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/block_upload_disabled (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/complete_block_already_exists (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/failure_checking_for_complete_block (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/failure_checking_for_in-flight_meta_file (0.01s) --- PASS: TestMultitenantCompactor_UploadBlockFile/missing_in-flight_meta_file (0.01s) --- PASS: TestMultitenantCompactor_UploadBlockFile/file_upload_fails (0.02s) --- PASS: TestMultitenantCompactor_UploadBlockFile/invalid_file_size (0.01s) --- PASS: TestMultitenantCompactor_UploadBlockFile/unexpected_file (0.04s) --- PASS: TestMultitenantCompactor_UploadBlockFile/valid_request (0.02s) --- PASS: TestMultitenantCompactor_UploadBlockFile/multiple_sequential_uploads_of_same_file (0.00s) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/without_tenant_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/without_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/invalid_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/block_upload_disabled === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/complete_block_already_exists block_upload_test.go:1264: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/checking_for_complete_block_fails block_upload_test.go:1264: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/missing_in-flight_meta_file block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/downloading_in-flight_meta_file_fails block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/corrupt_in-flight_meta_file block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/uploading_meta_file_fails block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/removing_in-flight_meta_file_fails block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Upload(string,string,string) block_upload_test.go:1264: PASS: Delete(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/valid_request block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Upload(string,string,string) block_upload_test.go:1264: PASS: Delete(string,string) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete (0.10s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/without_tenant_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/without_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/invalid_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/block_upload_disabled (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/complete_block_already_exists (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/checking_for_complete_block_fails (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/missing_in-flight_meta_file (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/downloading_in-flight_meta_file_fails (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/corrupt_in-flight_meta_file (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/uploading_meta_file_fails (0.02s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/removing_in-flight_meta_file_fails (0.02s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/valid_request (0.02s) === RUN TestMultitenantCompactor_GetBlockUploadStateHandler === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/validation_failed === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/stale_validation_file === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/block_doesn't_exist === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/complete_block === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/upload_in_progress === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/validating --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler (0.01s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/validation_failed (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/stale_validation_file (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/block_doesn't_exist (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/complete_block (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/upload_in_progress (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/validating (0.00s) === RUN TestBlocksCleaner === RUN TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s === PAUSE TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s === RUN TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s === PAUSE TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s === RUN TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s === PAUSE TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s === RUN TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s === PAUSE TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s === CONT TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s --- PASS: TestBlocksCleaner (0.00s) --- PASS: TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s (24.80s) --- PASS: TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s (26.76s) --- PASS: TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s (26.86s) --- PASS: TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s (28.56s) === RUN TestBlocksCleaner_ShouldContinueOnBlockDeletionFailure --- PASS: TestBlocksCleaner_ShouldContinueOnBlockDeletionFailure (14.86s) === RUN TestBlocksCleaner_ShouldRebuildBucketIndexOnCorruptedOne --- PASS: TestBlocksCleaner_ShouldRebuildBucketIndexOnCorruptedOne (12.14s) === RUN TestBlocksCleaner_ShouldRemoveMetricsForTenantsNotBelongingAnymoreToTheShard --- PASS: TestBlocksCleaner_ShouldRemoveMetricsForTenantsNotBelongingAnymoreToTheShard (19.72s) === RUN TestBlocksCleaner_ShouldNotCleanupUserThatDoesntBelongToShardAnymore --- PASS: TestBlocksCleaner_ShouldNotCleanupUserThatDoesntBelongToShardAnymore (7.81s) === RUN TestBlocksCleaner_ListBlocksOutsideRetentionPeriod --- PASS: TestBlocksCleaner_ListBlocksOutsideRetentionPeriod (11.14s) === RUN TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 18.605798ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 10.364399ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 9h0m0s logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 10.397699ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 6.9239ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level info component cleaner user user-1 msg applied retention: marking block for deletion block 01GK7Q21VQVYKB09TE9EY91W90 maxTime 1669898801000 logger.go:22: level info component cleaner user user-1 msg block has been marked for deletion block 01GK7Q21VQVYKB09TE9EY91W90 logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 17.212398ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 6.953399ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 9.829999ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 12.953698ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GK7Q21VQVYKB09TE9EY91W90/meta.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GK7Q21VQVYKB09TE9EY91W90/chunks/000001 bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GK7Q21VQVYKB09TE9EY91W90/index bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GK7Q21VQVYKB09TE9EY91W90/tombstones bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GK7Q21VQVYKB09TE9EY91W90/deletion-mark.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level info component cleaner user user-1 msg deleted block marked for deletion block 01GK7Q21VQVYKB09TE9EY91W90 logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 50.260694ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 4.9074ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 18.485798ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-2 msg applying retention retention 5h0m0s logger.go:22: level info component cleaner user user-2 msg applied retention: marking block for deletion block 01GK7Q28274JSX897QKVQQK24Q maxTime 1669898808000 logger.go:22: level info component cleaner user user-2 msg block has been marked for deletion block 01GK7Q28274JSX897QKVQQK24Q logger.go:22: level info component cleaner user user-2 msg applied retention: marking block for deletion block 01GK7Q2A1TS0JBG4XFAP2DB0EZ maxTime 1669906010000 logger.go:22: level info component cleaner user user-2 msg block has been marked for deletion block 01GK7Q2A1TS0JBG4XFAP2DB0EZ logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q28274JSX897QKVQQK24Q/meta.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q28274JSX897QKVQQK24Q/chunks/000001 bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q28274JSX897QKVQQK24Q/index bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q28274JSX897QKVQQK24Q/tombstones bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q28274JSX897QKVQQK24Q/deletion-mark.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level info component cleaner user user-2 msg deleted block marked for deletion block 01GK7Q28274JSX897QKVQQK24Q logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q2A1TS0JBG4XFAP2DB0EZ/meta.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q2A1TS0JBG4XFAP2DB0EZ/chunks/000001 bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q2A1TS0JBG4XFAP2DB0EZ/index bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q2A1TS0JBG4XFAP2DB0EZ/tombstones bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GK7Q2A1TS0JBG4XFAP2DB0EZ/deletion-mark.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2338630432/001 logger.go:22: level info component cleaner user user-2 msg deleted block marked for deletion block 01GK7Q2A1TS0JBG4XFAP2DB0EZ logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 90.717589ms --- PASS: TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod (11.15s) === RUN TestBlocksCleaner_ShouldRemovePartialBlocksOutsideDelayPeriod logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level warn component cleaner user user-1 msg skipped partial block when updating bucket index block 01GK7Q2CRFQFQ6VWAJPJPGDWMM logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 9.380099ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level warn component cleaner user user-1 msg skipped partial block when updating bucket index block 01GK7Q2CRFQFQ6VWAJPJPGDWMM logger.go:22: level info component cleaner user user-1 msg stale partial block found: marking block for deletion block 01GK7Q2CRFQFQ6VWAJPJPGDWMM last modified 2022-12-01 20:46:56.111500441 +0000 UTC logger.go:22: level info component cleaner user user-1 msg block has been marked for deletion block 01GK7Q2CRFQFQ6VWAJPJPGDWMM logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 45.241795ms --- PASS: TestBlocksCleaner_ShouldRemovePartialBlocksOutsideDelayPeriod (5.89s) === RUN TestBlocksCleaner_ShouldNotRemovePartialBlocksInsideDelayPeriod logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level warn component cleaner user user-1 msg skipped partial block when updating bucket index block 01GK7Q2JEJ0K56TW2NGRQS6N1F logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 10.427298ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level error component cleaner user user-2 msg skipped block with corrupted meta.json when updating bucket index block 01GK7Q2MEZ0D4S32J8FTXRC6QZ err unmarshal block meta file 01GK7Q2MEZ0D4S32J8FTXRC6QZ/meta.json: invalid character 'c' looking for beginning of value: meta.json corrupted logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 6.021899ms --- PASS: TestBlocksCleaner_ShouldNotRemovePartialBlocksInsideDelayPeriod (4.15s) === RUN TestBlocksCleaner_ShouldNotRemovePartialBlocksIfConfiguredDelayIsInvalid --- PASS: TestBlocksCleaner_ShouldNotRemovePartialBlocksIfConfiguredDelayIsInvalid (2.09s) === RUN TestFindMostRecentModifiedTimeForBlock --- PASS: TestFindMostRecentModifiedTimeForBlock (2.89s) === RUN TestSyncer_GarbageCollect_e2e === PAUSE TestSyncer_GarbageCollect_e2e === RUN TestGroupCompactE2E === PAUSE TestGroupCompactE2E === RUN TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly === PAUSE TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly === RUN TestGroupKey === RUN TestGroupKey/#00 === RUN TestGroupKey/#01 === RUN TestGroupKey/#02 === RUN TestGroupKey/#03 --- PASS: TestGroupKey (0.00s) --- PASS: TestGroupKey/#00 (0.00s) --- PASS: TestGroupKey/#01 (0.00s) --- PASS: TestGroupKey/#02 (0.00s) --- PASS: TestGroupKey/#03 (0.00s) === RUN TestGroupMaxMinTime --- PASS: TestGroupMaxMinTime (0.00s) === RUN TestFilterOwnJobs === RUN TestFilterOwnJobs/should_return_all_planned_jobs_if_the_compactor_instance_owns_all_of_them === RUN TestFilterOwnJobs/should_return_no_jobs_if_the_compactor_instance_owns_none_of_them === RUN TestFilterOwnJobs/should_return_some_jobs_if_the_compactor_instance_owns_some_of_them --- PASS: TestFilterOwnJobs (0.00s) --- PASS: TestFilterOwnJobs/should_return_all_planned_jobs_if_the_compactor_instance_owns_all_of_them (0.00s) --- PASS: TestFilterOwnJobs/should_return_no_jobs_if_the_compactor_instance_owns_none_of_them (0.00s) --- PASS: TestFilterOwnJobs/should_return_some_jobs_if_the_compactor_instance_owns_some_of_them (0.00s) === RUN TestNoCompactionMarkFilter === RUN TestNoCompactionMarkFilter/filter_with_no_deletion_of_blocks_marked_for_no-compaction === RUN TestNoCompactionMarkFilter/filter_with_deletion_enabled === RUN TestNoCompactionMarkFilter/filter_with_deletion_enabled,_but_canceled_context === RUN TestNoCompactionMarkFilter/filtering_block_with_wrong_marker_version --- PASS: TestNoCompactionMarkFilter (0.03s) --- PASS: TestNoCompactionMarkFilter/filter_with_no_deletion_of_blocks_marked_for_no-compaction (0.01s) --- PASS: TestNoCompactionMarkFilter/filter_with_deletion_enabled (0.02s) --- PASS: TestNoCompactionMarkFilter/filter_with_deletion_enabled,_but_canceled_context (0.00s) --- PASS: TestNoCompactionMarkFilter/filtering_block_with_wrong_marker_version (0.00s) === RUN TestConvertCompactionResultToForEachJobs --- PASS: TestConvertCompactionResultToForEachJobs (0.00s) === RUN TestRingConfig_DefaultConfigToLifecyclerConfig --- PASS: TestRingConfig_DefaultConfigToLifecyclerConfig (0.02s) === RUN TestRingConfig_CustomConfigToLifecyclerConfig --- PASS: TestRingConfig_CustomConfigToLifecyclerConfig (0.01s) === RUN TestConfig_ShouldSupportYamlConfig --- PASS: TestConfig_ShouldSupportYamlConfig (0.01s) === RUN TestConfig_ShouldSupportCliFlags --- PASS: TestConfig_ShouldSupportCliFlags (0.02s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_with_the_default_config === RUN TestConfig_Validate/should_pass_with_only_1_block_range_period === RUN TestConfig_Validate/should_fail_with_non_divisible_block_range_periods === RUN TestConfig_Validate/should_fail_on_unknown_compaction_jobs_order === RUN TestConfig_Validate/should_fail_on_invalid_value_of_max-opening-blocks-concurrency === RUN TestConfig_Validate/should_fail_on_invalid_value_of_max-closing-blocks-concurrency === RUN TestConfig_Validate/should_fail_on_invalid_value_of_symbols-flushers-concurrency --- PASS: TestConfig_Validate (0.06s) --- PASS: TestConfig_Validate/should_pass_with_the_default_config (0.01s) --- PASS: TestConfig_Validate/should_pass_with_only_1_block_range_period (0.00s) --- PASS: TestConfig_Validate/should_fail_with_non_divisible_block_range_periods (0.00s) --- PASS: TestConfig_Validate/should_fail_on_unknown_compaction_jobs_order (0.03s) --- PASS: TestConfig_Validate/should_fail_on_invalid_value_of_max-opening-blocks-concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_value_of_max-closing-blocks-concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_value_of_symbols-flushers-concurrency (0.00s) === RUN TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks === PAUSE TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks === RUN TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket === PAUSE TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket === RUN TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant === PAUSE TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant === RUN TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction === PAUSE TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction === RUN TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime === PAUSE TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime === RUN TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion === PAUSE TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion === RUN TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction === PAUSE TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction === RUN TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion === PAUSE TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion === RUN TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning === PAUSE TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning === RUN TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning === PAUSE TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning === RUN TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning === PAUSE TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning === RUN TestMultitenantCompactor_DeleteLocalSyncFiles --- PASS: TestMultitenantCompactor_DeleteLocalSyncFiles (6.86s) === RUN TestMultitenantCompactor_ShouldFailCompactionOnTimeout === PAUSE TestMultitenantCompactor_ShouldFailCompactionOnTimeout === RUN TestOwnUser === RUN TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size === PAUSE TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size === RUN TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes === PAUSE TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes === RUN TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size === PAUSE TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size === CONT TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size === CONT TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size === CONT TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes --- PASS: TestOwnUser (0.00s) --- PASS: TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size (2.91s) --- PASS: TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes (3.07s) --- PASS: TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size (3.24s) === RUN TestMultitenantCompactor_OutOfOrderCompaction --- PASS: TestMultitenantCompactor_OutOfOrderCompaction (8.84s) === RUN TestSortJobsBySmallestRangeOldestBlocksFirst === RUN TestSortJobsBySmallestRangeOldestBlocksFirst/should_do_nothing_on_empty_input === RUN TestSortJobsBySmallestRangeOldestBlocksFirst/should_sort_jobs_by_smallest_range,_oldest_blocks_first === RUN TestSortJobsBySmallestRangeOldestBlocksFirst/split_jobs_are_always_sorted_first --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst (0.01s) --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst/should_do_nothing_on_empty_input (0.00s) --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst/should_sort_jobs_by_smallest_range,_oldest_blocks_first (0.00s) --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst/split_jobs_are_always_sorted_first (0.00s) === RUN TestSortJobsByNewestBlocksFirst === RUN TestSortJobsByNewestBlocksFirst/should_do_nothing_on_empty_input job_sorting_test.go:126: sorted jobs: === RUN TestSortJobsByNewestBlocksFirst/should_sort_jobs_by_newest_blocks_first job_sorting_test.go:126: sorted jobs: job_sorting_test.go:128: - (minTime: 40 maxTime: 80) job_sorting_test.go:128: - (minTime: 10 maxTime: 30) job_sorting_test.go:128: - (minTime: 10 maxTime: 20) === RUN TestSortJobsByNewestBlocksFirst/should_give_precedence_to_smaller_time_ranges_in_case_of_multiple_jobs_with_the_same_max_time job_sorting_test.go:126: sorted jobs: job_sorting_test.go:128: - (minTime: 30 maxTime: 40) job_sorting_test.go:128: - (minTime: 10 maxTime: 40) === RUN TestSortJobsByNewestBlocksFirst/should_give_precedence_to_newest_blocks_over_smaller_time_ranges job_sorting_test.go:126: sorted jobs: job_sorting_test.go:128: - (minTime: 10 maxTime: 40) job_sorting_test.go:128: - (minTime: 10 maxTime: 30) job_sorting_test.go:128: - (minTime: 10 maxTime: 20) --- PASS: TestSortJobsByNewestBlocksFirst (0.01s) --- PASS: TestSortJobsByNewestBlocksFirst/should_do_nothing_on_empty_input (0.00s) --- PASS: TestSortJobsByNewestBlocksFirst/should_sort_jobs_by_newest_blocks_first (0.01s) --- PASS: TestSortJobsByNewestBlocksFirst/should_give_precedence_to_smaller_time_ranges_in_case_of_multiple_jobs_with_the_same_max_time (0.00s) --- PASS: TestSortJobsByNewestBlocksFirst/should_give_precedence_to_newest_blocks_over_smaller_time_ranges (0.00s) === RUN TestLabelRemoverFilter === RUN TestLabelRemoverFilter/should_remove_configured_labels === RUN TestLabelRemoverFilter/should_remove_configured_labels_2 --- PASS: TestLabelRemoverFilter (0.01s) --- PASS: TestLabelRemoverFilter/should_remove_configured_labels (0.00s) --- PASS: TestLabelRemoverFilter/should_remove_configured_labels_2 (0.00s) === RUN TestShardAwareDeduplicateFilter_Filter === RUN TestShardAwareDeduplicateFilter_Filter/blocks_with_same_sources_and_different_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_single_shard === RUN TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_two_shards === RUN TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards === RUN TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level === RUN TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level,_with_various_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_same_sources === RUN TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_overlapping_sources === RUN TestShardAwareDeduplicateFilter_Filter/4_non_compacted_blocks_and_compacted_block_of_level_2_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/3_compacted_blocks_of_level_2_and_one_compacted_block_of_level_3_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length === RUN TestShardAwareDeduplicateFilter_Filter/block_with_invalid_shardID_cannot_'include'_its_source_blocks === RUN TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split_into_two,_one_shard_missing === RUN TestShardAwareDeduplicateFilter_Filter/compacted_block_without_sources_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length_and_different_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/when_invalid_shard_IDs_present,_no_deduplication_happens_for_source_blocks === RUN TestShardAwareDeduplicateFilter_Filter/3_non_compacted_blocks_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_equal_length === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources_and_different_resolutions --- PASS: TestShardAwareDeduplicateFilter_Filter (0.07s) --- PASS: TestShardAwareDeduplicateFilter_Filter/blocks_with_same_sources_and_different_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_single_shard (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_two_shards (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level,_with_various_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_same_sources (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_overlapping_sources (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/4_non_compacted_blocks_and_compacted_block_of_level_2_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/3_compacted_blocks_of_level_2_and_one_compacted_block_of_level_3_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/block_with_invalid_shardID_cannot_'include'_its_source_blocks (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split_into_two,_one_shard_missing (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_block_without_sources_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length_and_different_resolutions (0.01s) --- PASS: TestShardAwareDeduplicateFilter_Filter/when_invalid_shard_IDs_present,_no_deduplication_happens_for_source_blocks (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/3_non_compacted_blocks_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_equal_length (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources_and_different_resolutions (0.00s) === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=18.124497ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=27.201197ms duration_ms=27 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GK7Q3EBA7KHZJ8FDN0V4C7G3 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GK7Q3JW3KMH8VTH4VE0WR6MD (min time: 1970-01-01 00:01:00 +0000 UTC, max time: 1970-01-01 00:07:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q3EBA7KHZJ8FDN0V4C7G3 (min time: 0, max time: 300000) 01GK7Q3JW3KMH8VTH4VE0WR6MD (min time: 60000, max time: 420000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q3JW3KMH8VTH4VE0WR6MD/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q3EBA7KHZJ8FDN0V4C7G3/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q3EBA7KHZJ8FDN0V4C7G3 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q3JW3KMH8VTH4VE0WR6MD]" duration=22.527297ms duration_ms=22 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=420000 ulid=01GK7Q3VF7GK28ZD8SF24HV9V7 sources="[01GK7Q3JW3KMH8VTH4VE0WR6MD 01GK7Q3EBA7KHZJ8FDN0V4C7G3]" duration=4.700131528s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=420000 ulid=01GK7Q3VF7VDAZRFSHNAX0ZCGE sources="[01GK7Q3JW3KMH8VTH4VE0WR6MD 01GK7Q3EBA7KHZJ8FDN0V4C7G3]" duration=4.701461628s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q3VF7GK28ZD8SF24HV9V7 01GK7Q3VF7VDAZRFSHNAX0ZCGE]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q3EBA7KHZJ8FDN0V4C7G3 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q3JW3KMH8VTH4VE0WR6MD]" duration=4.703066328s duration_ms=4703 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q3VF7VDAZRFSHNAX0ZCGE/chunks/000001 dst=01GK7Q3VF7VDAZRFSHNAX0ZCGE/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q3VF7VDAZRFSHNAX0ZCGE/index dst=01GK7Q3VF7VDAZRFSHNAX0ZCGE/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q3VF7GK28ZD8SF24HV9V7/chunks/000001 dst=01GK7Q3VF7GK28ZD8SF24HV9V7/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q3VF7GK28ZD8SF24HV9V7/index dst=01GK7Q3VF7GK28ZD8SF24HV9V7/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2039494360/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q3VF7GK28ZD8SF24HV9V7 duration=12.430499ms duration_ms=12 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q3VF7VDAZRFSHNAX0ZCGE duration=9.543099ms duration_ms=9 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=34.147995ms duration_ms=34 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q3EBA7KHZJ8FDN0V4C7G3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q3EBA7KHZJ8FDN0V4C7G3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q3JW3KMH8VTH4VE0WR6MD level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q3JW3KMH8VTH4VE0WR6MD level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="compaction job succeeded" duration=4.787455618s duration_ms=4787 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=18.625498ms duration_ms=18 cached=5 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=56.585093ms duration_ms=56 cached=5 returned=3 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=14.919199ms duration_ms=14 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GK7Q40EKFP3EKHFEXQ8GHBCV (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GK7Q43888TMGMKVX8NWPA116 (min time: 1970-01-01 00:05:00 +0000 UTC, max time: 1970-01-01 00:10:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=42.832194ms level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q40EKFP3EKHFEXQ8GHBCV (min time: 0, max time: 300000) 01GK7Q43888TMGMKVX8NWPA116 (min time: 300000, max time: 600000)]" level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q43888TMGMKVX8NWPA116/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q40EKFP3EKHFEXQ8GHBCV/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q40EKFP3EKHFEXQ8GHBCV /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q43888TMGMKVX8NWPA116]" duration=62.512393ms duration_ms=62 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GK7Q4A4XME4RSZHBMZD1ZH12 sources="[01GK7Q40EKFP3EKHFEXQ8GHBCV 01GK7Q43888TMGMKVX8NWPA116]" duration=5.102661179s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GK7Q4A4XTX4K1XPDBKSYMWRQ sources="[01GK7Q40EKFP3EKHFEXQ8GHBCV 01GK7Q43888TMGMKVX8NWPA116]" duration=5.104453779s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q4A4XME4RSZHBMZD1ZH12 01GK7Q4A4XTX4K1XPDBKSYMWRQ]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q40EKFP3EKHFEXQ8GHBCV /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q43888TMGMKVX8NWPA116]" duration=5.105452379s duration_ms=5105 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q4A4XTX4K1XPDBKSYMWRQ/chunks/000001 dst=01GK7Q4A4XTX4K1XPDBKSYMWRQ/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q4A4XME4RSZHBMZD1ZH12/chunks/000001 dst=01GK7Q4A4XME4RSZHBMZD1ZH12/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q4A4XTX4K1XPDBKSYMWRQ/index dst=01GK7Q4A4XTX4K1XPDBKSYMWRQ/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q4A4XME4RSZHBMZD1ZH12/index dst=01GK7Q4A4XME4RSZHBMZD1ZH12/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split1558814985/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q4A4XTX4K1XPDBKSYMWRQ duration=46.655894ms duration_ms=46 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q4A4XME4RSZHBMZD1ZH12 duration=56.684093ms duration_ms=56 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=88.99319ms duration_ms=88 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q40EKFP3EKHFEXQ8GHBCV level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q40EKFP3EKHFEXQ8GHBCV level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q43888TMGMKVX8NWPA116 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q43888TMGMKVX8NWPA116 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction job succeeded" duration=5.357118148s duration_ms=5357 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=56.338993ms duration_ms=56 cached=5 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=92.433289ms duration_ms=92 cached=5 returned=3 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/smaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=63.719592ms duration_ms=63 cached=10 returned=10 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 1_of_2, blocks: 01GK7Q4Y941EQA1FJSV3MVB0VD (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GK7Q53MF7XM4GDWQC3R897RN (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=92.576088ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 2_of_2, blocks: 01GK7Q50XYWKJ4DGVK9AMDGAXN (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GK7Q564PB7XKXCYNHX438FV0 (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 job="stage: split, range start: 28800000, range end: 36000000, shard: 1_of_1, blocks: 01GK7Q590BAJHEYMFH44T9JF3N (min time: 1970-01-01 08:00:00 +0000 UTC, max time: 1970-01-01 10:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 job="stage: split, range start: 50400000, range end: 57600000, shard: 1_of_1, blocks: 01GK7Q5B90DGGH27N2VE9JPG9Q (min time: 1970-01-01 14:00:00 +0000 UTC, max time: 1970-01-01 16:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GK7Q4R5NZD55CXW48V8EDM8X (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GK7Q4VSMXHCEK7SANEHD765E (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q4VSMXHCEK7SANEHD765E (min time: 7200000, max time: 14400000) 01GK7Q4R5NZD55CXW48V8EDM8X (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q4R5NZD55CXW48V8EDM8X/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q4VSMXHCEK7SANEHD765E/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q4VSMXHCEK7SANEHD765E /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q4R5NZD55CXW48V8EDM8X]" duration=23.303097ms duration_ms=23 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GK7Q5DPM8NNYNYS9TW6T1G7Z sources="[01GK7Q4VSMXHCEK7SANEHD765E 01GK7Q4R5NZD55CXW48V8EDM8X]" duration=3.337624193s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GK7Q5DPMTB3K5HVV3DTRCAWV sources="[01GK7Q4VSMXHCEK7SANEHD765E 01GK7Q4R5NZD55CXW48V8EDM8X]" duration=3.337895893s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q5DPM8NNYNYS9TW6T1G7Z 01GK7Q5DPMTB3K5HVV3DTRCAWV]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q4VSMXHCEK7SANEHD765E /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q4R5NZD55CXW48V8EDM8X]" duration=3.338541193s duration_ms=3338 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q5DPMTB3K5HVV3DTRCAWV/chunks/000001 dst=01GK7Q5DPMTB3K5HVV3DTRCAWV/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q5DPM8NNYNYS9TW6T1G7Z/chunks/000001 dst=01GK7Q5DPM8NNYNYS9TW6T1G7Z/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q5DPMTB3K5HVV3DTRCAWV/index dst=01GK7Q5DPMTB3K5HVV3DTRCAWV/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q5DPM8NNYNYS9TW6T1G7Z/index dst=01GK7Q5DPM8NNYNYS9TW6T1G7Z/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q5DPMTB3K5HVV3DTRCAWV duration=12.875498ms duration_ms=12 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q5DPM8NNYNYS9TW6T1G7Z duration=29.897497ms duration_ms=29 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=37.426396ms duration_ms=37 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q4VSMXHCEK7SANEHD765E level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q4VSMXHCEK7SANEHD765E level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q4R5NZD55CXW48V8EDM8X level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q4R5NZD55CXW48V8EDM8X level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=3.414817884s duration_ms=3414 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=1 plan="[01GK7Q590BAJHEYMFH44T9JF3N (min time: 28800000, max time: 36000000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q590BAJHEYMFH44T9JF3N/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=1 plan=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GK7Q590BAJHEYMFH44T9JF3N] duration=16.437798ms duration_ms=16 level=info component=compactor msg="compact blocks" count=1 mint=28800000 maxt=36000000 ulid=01GK7Q5H12XFA1J6CC89RJT2M2 sources=[01GK7Q590BAJHEYMFH44T9JF3N] duration=3.347981393s shard=1_of_2 level=info component=compactor msg="compact blocks" count=1 mint=28800000 maxt=36000000 ulid=01GK7Q5H12MA04YE25QMX4WRN6 sources=[01GK7Q590BAJHEYMFH44T9JF3N] duration=3.348272793s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q5H12XFA1J6CC89RJT2M2 01GK7Q5H12MA04YE25QMX4WRN6]" blocks=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GK7Q590BAJHEYMFH44T9JF3N] duration=3.349062593s duration_ms=3349 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GK7Q5H12MA04YE25QMX4WRN6/chunks/000001 dst=01GK7Q5H12MA04YE25QMX4WRN6/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GK7Q5H12XFA1J6CC89RJT2M2/chunks/000001 dst=01GK7Q5H12XFA1J6CC89RJT2M2/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GK7Q5H12MA04YE25QMX4WRN6/index dst=01GK7Q5H12MA04YE25QMX4WRN6/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GK7Q5H12XFA1J6CC89RJT2M2/index dst=01GK7Q5H12XFA1J6CC89RJT2M2/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q5H12MA04YE25QMX4WRN6 duration=9.377099ms duration_ms=9 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q5H12XFA1J6CC89RJT2M2 duration=9.670999ms duration_ms=9 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=16.499898ms duration_ms=16 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q590BAJHEYMFH44T9JF3N level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q590BAJHEYMFH44T9JF3N level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="compaction job succeeded" duration=3.391221887s duration_ms=3391 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=1 plan="[01GK7Q5B90DGGH27N2VE9JPG9Q (min time: 50400000, max time: 57600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q5B90DGGH27N2VE9JPG9Q/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=1 plan=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GK7Q5B90DGGH27N2VE9JPG9Q] duration=33.001796ms duration_ms=33 level=info component=compactor msg="compact blocks" count=1 mint=50400000 maxt=57600000 ulid=01GK7Q5MBSB85QR2DC33C28V49 sources=[01GK7Q5B90DGGH27N2VE9JPG9Q] duration=4.791799717s shard=1_of_2 level=info component=compactor msg="compact blocks" count=1 mint=50400000 maxt=57600000 ulid=01GK7Q5MBS74KDC8J7F3T91SCR sources=[01GK7Q5B90DGGH27N2VE9JPG9Q] duration=4.792114217s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q5MBSB85QR2DC33C28V49 01GK7Q5MBS74KDC8J7F3T91SCR]" blocks=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GK7Q5B90DGGH27N2VE9JPG9Q] duration=4.792984117s duration_ms=4792 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GK7Q5MBS74KDC8J7F3T91SCR/chunks/000001 dst=01GK7Q5MBS74KDC8J7F3T91SCR/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GK7Q5MBS74KDC8J7F3T91SCR/index dst=01GK7Q5MBS74KDC8J7F3T91SCR/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q5MBS74KDC8J7F3T91SCR duration=10.844299ms duration_ms=10 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GK7Q5MBSB85QR2DC33C28V49/chunks/000001 dst=01GK7Q5MBSB85QR2DC33C28V49/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GK7Q5MBSB85QR2DC33C28V49/index dst=01GK7Q5MBSB85QR2DC33C28V49/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q5MBSB85QR2DC33C28V49 duration=17.048198ms duration_ms=17 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=31.022696ms duration_ms=31 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q5B90DGGH27N2VE9JPG9Q level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q5B90DGGH27N2VE9JPG9Q level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction job succeeded" duration=4.865274708s duration_ms=4865 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q4Y941EQA1FJSV3MVB0VD (min time: 14400000, max time: 21600000) 01GK7Q53MF7XM4GDWQC3R897RN (min time: 21600000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q53MF7XM4GDWQC3R897RN/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q4Y941EQA1FJSV3MVB0VD/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q4Y941EQA1FJSV3MVB0VD /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q53MF7XM4GDWQC3R897RN]" duration=55.095294ms duration_ms=55 level=info component=compactor msg="Found overlapping blocks during compaction" split_merge_compactor_test.go:640: expected , got Diff: --- metric output does not match expectation; want +++ got: @@ -2,3 +2,3 @@ # TYPE cortex_compactor_runs_completed_total counter -cortex_compactor_runs_completed_total 1 +cortex_compactor_runs_completed_total 0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor level=error component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job failed" duration=3.489894176s duration_ms=3489 err="compact blocks [/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q4Y941EQA1FJSV3MVB0VD /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q53MF7XM4GDWQC3R897RN]: populate block: writing block: closing index writer: context canceled" level=error component=compactor msg="failed to compact user blocks" user=user-1 err="compaction: group 0@17241709254077376921-merge-1_of_2-14400000-28800000: compact blocks [/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q4Y941EQA1FJSV3MVB0VD /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges2026820068/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q53MF7XM4GDWQC3R897RN]: populate block: writing block: closing index writer: context canceled" === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/should_correctly_handle_empty_blocks_generated_in_the_splitting_stage level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=8.800799ms duration_ms=8 cached=1 returned=1 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GK7Q5WPMPJ0YA3RD4QVZNK4F (min time: 1970-01-01 03:59:59.999 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=1 plan="[01GK7Q5WPMPJ0YA3RD4QVZNK4F (min time: 14399999, max time: 14400000)]" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=7.114399ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q5WPMPJ0YA3RD4QVZNK4F/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=1 plan=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3802532974/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q5WPMPJ0YA3RD4QVZNK4F] duration=25.477597ms duration_ms=25 level=info component=compactor msg="compact blocks" count=1 mint=14399999 maxt=14400000 ulid=01GK7Q5Z3HHB4DMW7SGF8VA5A9 sources=[01GK7Q5WPMPJ0YA3RD4QVZNK4F] duration=2.30137862s shard=1_of_2 level=info component=compactor msg="compact blocks resulted in empty block" count=1 sources=[01GK7Q5WPMPJ0YA3RD4QVZNK4F] duration=2.30166092s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q5Z3HHB4DMW7SGF8VA5A9 00000000000000000000000000]" blocks=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3802532974/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q5WPMPJ0YA3RD4QVZNK4F] duration=2.30216982s duration_ms=2302 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction produced an empty block" shard_id=2_of_2 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3802532974/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q5Z3HHB4DMW7SGF8VA5A9/chunks/000001 dst=01GK7Q5Z3HHB4DMW7SGF8VA5A9/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3802532974/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3802532974/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q5Z3HHB4DMW7SGF8VA5A9/index dst=01GK7Q5Z3HHB4DMW7SGF8VA5A9/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3802532974/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q5Z3HHB4DMW7SGF8VA5A9 duration=15.461698ms duration_ms=15 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=25.303197ms duration_ms=25 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q5WPMPJ0YA3RD4QVZNK4F level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q5WPMPJ0YA3RD4QVZNK4F level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=2.364540812s duration_ms=2364 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=15.606498ms duration_ms=15 cached=2 returned=1 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=17.954298ms duration_ms=17 cached=2 returned=1 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0 level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=43.707195ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=53.151694ms duration_ms=53 cached=10 returned=10 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 1_of_2, blocks: 01GK7Q6ADY5KCX8PJ4256HT2QJ (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GK7Q6ECK333WQ2SSG8JADFCK (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 2_of_2, blocks: 01GK7Q6CCZZ6KDTRAKY5KBH7PA (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GK7Q6GFD5ZYY6S2XP7K2NMF2 (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge--28800000-57600000 job="stage: merge, range start: 28800000, range end: 57600000, shard: , blocks: 01GK7Q6JJV296NV10HQD9NFY1G (min time: 1970-01-01 08:00:00 +0000 UTC, max time: 1970-01-01 10:00:00 +0000 UTC),01GK7Q6MVGRV44M0YDTNQTKBSB (min time: 1970-01-01 14:00:00 +0000 UTC, max time: 1970-01-01 16:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge--7200000-14400000 job="stage: merge, range start: 7200000, range end: 14400000, shard: , blocks: 01GK7Q660PBE190T0AFS5S28DM (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GK7Q68AHSAG0KK0QXZA41N0N (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q660PBE190T0AFS5S28DM (min time: 7200000, max time: 14400000) 01GK7Q68AHSAG0KK0QXZA41N0N (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q68AHSAG0KK0QXZA41N0N/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q660PBE190T0AFS5S28DM/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--7200000-14400000/01GK7Q660PBE190T0AFS5S28DM /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--7200000-14400000/01GK7Q68AHSAG0KK0QXZA41N0N]" duration=45.138494ms duration_ms=45 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GK7Q6QZS6CPK9DY1F3Y0VGSX sources="[01GK7Q660PBE190T0AFS5S28DM 01GK7Q68AHSAG0KK0QXZA41N0N]" duration=2.001613457s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new=[01GK7Q6QZS6CPK9DY1F3Y0VGSX] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--7200000-14400000/01GK7Q660PBE190T0AFS5S28DM /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--7200000-14400000/01GK7Q68AHSAG0KK0QXZA41N0N]" duration=2.003648956s duration_ms=2003 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--7200000-14400000/01GK7Q6QZS6CPK9DY1F3Y0VGSX/chunks/000001" dst=01GK7Q6QZS6CPK9DY1F3Y0VGSX/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--7200000-14400000/01GK7Q6QZS6CPK9DY1F3Y0VGSX/index" dst=01GK7Q6QZS6CPK9DY1F3Y0VGSX/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q6QZS6CPK9DY1F3Y0VGSX duration=13.221299ms duration_ms=13 external_labels={} level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=21.208098ms duration_ms=21 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q660PBE190T0AFS5S28DM level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q660PBE190T0AFS5S28DM level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q68AHSAG0KK0QXZA41N0N level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q68AHSAG0KK0QXZA41N0N level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=2.091467846s duration_ms=2091 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q6ADY5KCX8PJ4256HT2QJ (min time: 14400000, max time: 21600000) 01GK7Q6ECK333WQ2SSG8JADFCK (min time: 21600000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q6ADY5KCX8PJ4256HT2QJ/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q6ECK333WQ2SSG8JADFCK/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q6ADY5KCX8PJ4256HT2QJ /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q6ECK333WQ2SSG8JADFCK]" duration=22.907497ms duration_ms=22 level=info component=compactor msg="compact blocks" count=2 mint=14400000 maxt=28800000 ulid=01GK7Q6T0M6SD13XM1C1RB15BY sources="[01GK7Q6ADY5KCX8PJ4256HT2QJ 01GK7Q6ECK333WQ2SSG8JADFCK]" duration=2.499405596s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GK7Q6T0M6SD13XM1C1RB15BY] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q6ADY5KCX8PJ4256HT2QJ /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q6ECK333WQ2SSG8JADFCK]" duration=2.500749695s duration_ms=2500 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q6T0M6SD13XM1C1RB15BY/chunks/000001" dst=01GK7Q6T0M6SD13XM1C1RB15BY/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GK7Q6T0M6SD13XM1C1RB15BY/index" dst=01GK7Q6T0M6SD13XM1C1RB15BY/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q6T0M6SD13XM1C1RB15BY duration=12.653199ms duration_ms=12 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=21.656898ms duration_ms=21 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q6ADY5KCX8PJ4256HT2QJ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q6ADY5KCX8PJ4256HT2QJ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q6ECK333WQ2SSG8JADFCK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q6ECK333WQ2SSG8JADFCK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job succeeded" duration=2.567337688s duration_ms=2567 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q6CCZZ6KDTRAKY5KBH7PA (min time: 14400000, max time: 21600000) 01GK7Q6GFD5ZYY6S2XP7K2NMF2 (min time: 21600000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q6GFD5ZYY6S2XP7K2NMF2/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q6CCZZ6KDTRAKY5KBH7PA/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GK7Q6CCZZ6KDTRAKY5KBH7PA /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GK7Q6GFD5ZYY6S2XP7K2NMF2]" duration=21.736197ms duration_ms=21 level=info component=compactor msg="compact blocks" count=2 mint=14400000 maxt=28800000 ulid=01GK7Q6WH2JC5HMHAHXWXYZYQJ sources="[01GK7Q6CCZZ6KDTRAKY5KBH7PA 01GK7Q6GFD5ZYY6S2XP7K2NMF2]" duration=1.960533361s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GK7Q6WH2JC5HMHAHXWXYZYQJ] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GK7Q6CCZZ6KDTRAKY5KBH7PA /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GK7Q6GFD5ZYY6S2XP7K2NMF2]" duration=1.961557261s duration_ms=1961 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GK7Q6WH2JC5HMHAHXWXYZYQJ/chunks/000001" dst=01GK7Q6WH2JC5HMHAHXWXYZYQJ/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GK7Q6WH2JC5HMHAHXWXYZYQJ/index" dst=01GK7Q6WH2JC5HMHAHXWXYZYQJ/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q6WH2JC5HMHAHXWXYZYQJ duration=9.600199ms duration_ms=9 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=16.350498ms duration_ms=16 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q6CCZZ6KDTRAKY5KBH7PA level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q6CCZZ6KDTRAKY5KBH7PA level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q6GFD5ZYY6S2XP7K2NMF2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q6GFD5ZYY6S2XP7K2NMF2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job succeeded" duration=2.015854055s duration_ms=2015 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q6JJV296NV10HQD9NFY1G (min time: 28800000, max time: 36000000) 01GK7Q6MVGRV44M0YDTNQTKBSB (min time: 50400000, max time: 57600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q6JJV296NV10HQD9NFY1G/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q6MVGRV44M0YDTNQTKBSB/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--28800000-57600000/01GK7Q6JJV296NV10HQD9NFY1G /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--28800000-57600000/01GK7Q6MVGRV44M0YDTNQTKBSB]" duration=17.856998ms duration_ms=17 level=info component=compactor msg="compact blocks" count=2 mint=28800000 maxt=57600000 ulid=01GK7Q6YGAPNXFJRBRNA8WAXN6 sources="[01GK7Q6JJV296NV10HQD9NFY1G 01GK7Q6MVGRV44M0YDTNQTKBSB]" duration=2.30534732s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compacted blocks" new=[01GK7Q6YGAPNXFJRBRNA8WAXN6] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--28800000-57600000/01GK7Q6JJV296NV10HQD9NFY1G /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--28800000-57600000/01GK7Q6MVGRV44M0YDTNQTKBSB]" duration=2.30629502s duration_ms=2306 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--28800000-57600000/01GK7Q6YGAPNXFJRBRNA8WAXN6/chunks/000001" dst=01GK7Q6YGAPNXFJRBRNA8WAXN6/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge--28800000-57600000/01GK7Q6YGAPNXFJRBRNA8WAXN6/index" dst=01GK7Q6YGAPNXFJRBRNA8WAXN6/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q6YGAPNXFJRBRNA8WAXN6 duration=35.649596ms duration_ms=35 external_labels={} level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=46.940994ms duration_ms=46 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q6JJV296NV10HQD9NFY1G level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q6JJV296NV10HQD9NFY1G level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q6MVGRV44M0YDTNQTKBSB level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q6MVGRV44M0YDTNQTKBSB level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction job succeeded" duration=2.402531708s duration_ms=2402 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=59.697993ms duration_ms=59 cached=14 returned=6 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 job="stage: merge, range start: 0, range end: 28800000, shard: 1_of_2, blocks: 01GK7Q61P8BBCC9SMF48HMG651 (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC),01GK7Q6T0M6SD13XM1C1RB15BY (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 job="stage: merge, range start: 0, range end: 28800000, shard: 2_of_2, blocks: 01GK7Q647588T8VH2DSFC1YF0A (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC),01GK7Q6WH2JC5HMHAHXWXYZYQJ (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q61P8BBCC9SMF48HMG651 (min time: 1, max time: 7200000) 01GK7Q6T0M6SD13XM1C1RB15BY (min time: 14400000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q6T0M6SD13XM1C1RB15BY/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q61P8BBCC9SMF48HMG651/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GK7Q61P8BBCC9SMF48HMG651 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GK7Q6T0M6SD13XM1C1RB15BY]" duration=31.832696ms duration_ms=31 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=1 maxt=28800000 ulid=01GK7Q70XH8BKTZ9F5P20QWSGJ sources="[01GK7Q6T0M6SD13XM1C1RB15BY 01GK7Q61P8BBCC9SMF48HMG651]" duration=1.849758275s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GK7Q70XH8BKTZ9F5P20QWSGJ] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GK7Q61P8BBCC9SMF48HMG651 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GK7Q6T0M6SD13XM1C1RB15BY]" duration=1.850424675s duration_ms=1850 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GK7Q70XH8BKTZ9F5P20QWSGJ/chunks/000001" dst=01GK7Q70XH8BKTZ9F5P20QWSGJ/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GK7Q70XH8BKTZ9F5P20QWSGJ/index" dst=01GK7Q70XH8BKTZ9F5P20QWSGJ/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q70XH8BKTZ9F5P20QWSGJ duration=17.303298ms duration_ms=17 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=31.807696ms duration_ms=31 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q61P8BBCC9SMF48HMG651 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q61P8BBCC9SMF48HMG651 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q6T0M6SD13XM1C1RB15BY level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q6T0M6SD13XM1C1RB15BY level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job succeeded" duration=1.926214466s duration_ms=1926 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q647588T8VH2DSFC1YF0A (min time: 1, max time: 7200000) 01GK7Q6WH2JC5HMHAHXWXYZYQJ (min time: 14400000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q6WH2JC5HMHAHXWXYZYQJ/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q647588T8VH2DSFC1YF0A/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GK7Q647588T8VH2DSFC1YF0A /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GK7Q6WH2JC5HMHAHXWXYZYQJ]" duration=18.760198ms duration_ms=18 level=info component=compactor msg="compact blocks" count=2 mint=1 maxt=28800000 ulid=01GK7Q72SCM5J7SZT7KCX6DB5W sources="[01GK7Q647588T8VH2DSFC1YF0A 01GK7Q6WH2JC5HMHAHXWXYZYQJ]" duration=1.818839778s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GK7Q72SCM5J7SZT7KCX6DB5W] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GK7Q647588T8VH2DSFC1YF0A /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GK7Q6WH2JC5HMHAHXWXYZYQJ]" duration=1.819792978s duration_ms=1819 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GK7Q72SCM5J7SZT7KCX6DB5W/chunks/000001" dst=01GK7Q72SCM5J7SZT7KCX6DB5W/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GK7Q72SCM5J7SZT7KCX6DB5W/index" dst=01GK7Q72SCM5J7SZT7KCX6DB5W/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0475796438/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q72SCM5J7SZT7KCX6DB5W duration=9.115798ms duration_ms=9 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=15.398798ms duration_ms=15 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q647588T8VH2DSFC1YF0A level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q647588T8VH2DSFC1YF0A level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q6WH2JC5HMHAHXWXYZYQJ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q6WH2JC5HMHAHXWXYZYQJ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job succeeded" duration=1.865469873s duration_ms=1865 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=41.848395ms duration_ms=41 cached=16 returned=4 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=93.690189ms duration_ms=93 cached=16 returned=4 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=25.753097ms duration_ms=25 cached=2 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GK7Q75026DYHWE2S3873P8HK (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GK7Q770FVCC39VB8RJW2BJHK (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q770FVCC39VB8RJW2BJHK (min time: 7200000, max time: 14400000) 01GK7Q75026DYHWE2S3873P8HK (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q75026DYHWE2S3873P8HK/meta.json level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=61.315292ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q770FVCC39VB8RJW2BJHK/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q770FVCC39VB8RJW2BJHK /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q75026DYHWE2S3873P8HK]" duration=41.341095ms duration_ms=41 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GK7Q79GGH21N6GB9XZP0GCNW sources="[01GK7Q75026DYHWE2S3873P8HK 01GK7Q770FVCC39VB8RJW2BJHK]" duration=3.190391412s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GK7Q79GGD46PDWBDWY0P6AV9 sources="[01GK7Q75026DYHWE2S3873P8HK 01GK7Q770FVCC39VB8RJW2BJHK]" duration=3.191035512s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q79GGH21N6GB9XZP0GCNW 01GK7Q79GGD46PDWBDWY0P6AV9]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q770FVCC39VB8RJW2BJHK /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q75026DYHWE2S3873P8HK]" duration=3.191917612s duration_ms=3191 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q79GGH21N6GB9XZP0GCNW/chunks/000001 dst=01GK7Q79GGH21N6GB9XZP0GCNW/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q79GGD46PDWBDWY0P6AV9/chunks/000001 dst=01GK7Q79GGD46PDWBDWY0P6AV9/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q79GGH21N6GB9XZP0GCNW/index dst=01GK7Q79GGH21N6GB9XZP0GCNW/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q79GGD46PDWBDWY0P6AV9/index dst=01GK7Q79GGD46PDWBDWY0P6AV9/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split3574655920/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q79GGH21N6GB9XZP0GCNW duration=13.409798ms duration_ms=13 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q79GGD46PDWBDWY0P6AV9 duration=12.654798ms duration_ms=12 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=33.757995ms duration_ms=33 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q770FVCC39VB8RJW2BJHK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q770FVCC39VB8RJW2BJHK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q75026DYHWE2S3873P8HK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q75026DYHWE2S3873P8HK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=3.298705499s duration_ms=3298 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=20.958998ms duration_ms=20 cached=4 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=23.991397ms duration_ms=23 cached=4 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=11.897099ms duration_ms=11 cached=2 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GK7Q7CZD8617DEZ76Z4Q03M3 (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GK7Q7F4ACWVFTEXFHWCTKMVC (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q7F4ACWVFTEXFHWCTKMVC (min time: 7200000, max time: 14400000) 01GK7Q7CZD8617DEZ76Z4Q03M3 (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q7CZD8617DEZ76Z4Q03M3/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q7F4ACWVFTEXFHWCTKMVC/meta.json level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=50.633794ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q7F4ACWVFTEXFHWCTKMVC /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q7CZD8617DEZ76Z4Q03M3]" duration=36.614696ms duration_ms=36 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GK7Q7HZK0PHXT7ZQXSQD4TEQ sources="[01GK7Q7CZD8617DEZ76Z4Q03M3 01GK7Q7F4ACWVFTEXFHWCTKMVC]" duration=2.856955652s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GK7Q7HZK93AM7KCHVEC791JQ sources="[01GK7Q7CZD8617DEZ76Z4Q03M3 01GK7Q7F4ACWVFTEXFHWCTKMVC]" duration=2.857249652s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q7HZK0PHXT7ZQXSQD4TEQ 01GK7Q7HZK93AM7KCHVEC791JQ]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q7F4ACWVFTEXFHWCTKMVC /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q7CZD8617DEZ76Z4Q03M3]" duration=2.87204255s duration_ms=2872 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q7HZK93AM7KCHVEC791JQ/chunks/000001 dst=01GK7Q7HZK93AM7KCHVEC791JQ/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q7HZK93AM7KCHVEC791JQ/index dst=01GK7Q7HZK93AM7KCHVEC791JQ/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q7HZK93AM7KCHVEC791JQ duration=10.158499ms duration_ms=10 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q7HZK0PHXT7ZQXSQD4TEQ/chunks/000001 dst=01GK7Q7HZK0PHXT7ZQXSQD4TEQ/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GK7Q7HZK0PHXT7ZQXSQD4TEQ/index dst=01GK7Q7HZK0PHXT7ZQXSQD4TEQ/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split1960616533/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q7HZK0PHXT7ZQXSQD4TEQ duration=22.739797ms duration_ms=22 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=32.823596ms duration_ms=32 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q7F4ACWVFTEXFHWCTKMVC level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q7F4ACWVFTEXFHWCTKMVC level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q7CZD8617DEZ76Z4Q03M3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q7CZD8617DEZ76Z4Q03M3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=2.95520204s duration_ms=2955 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=15.249398ms duration_ms=15 cached=4 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=45.671495ms duration_ms=45 cached=4 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=9.893499ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=14.853698ms duration_ms=14 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GK7Q7N44FFGK77MQG66K9Z5D (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GK7Q7R1E7BK3FVAVWS09KFZ3 (min time: 1970-01-01 00:07:00 +0000 UTC, max time: 1970-01-01 00:10:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q7N44FFGK77MQG66K9Z5D (min time: 0, max time: 300000) 01GK7Q7R1E7BK3FVAVWS09KFZ3 (min time: 420000, max time: 600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q7R1E7BK3FVAVWS09KFZ3/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q7N44FFGK77MQG66K9Z5D/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q7N44FFGK77MQG66K9Z5D /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q7R1E7BK3FVAVWS09KFZ3]" duration=38.230096ms duration_ms=38 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GK7Q7X4J8F2VKVW38EY4YTQ3 sources="[01GK7Q7N44FFGK77MQG66K9Z5D 01GK7Q7R1E7BK3FVAVWS09KFZ3]" duration=4.173433992s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GK7Q7X4JK8C6Z1YX5MDA4HXX sources="[01GK7Q7N44FFGK77MQG66K9Z5D 01GK7Q7R1E7BK3FVAVWS09KFZ3]" duration=4.173713092s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q7X4J8F2VKVW38EY4YTQ3 01GK7Q7X4JK8C6Z1YX5MDA4HXX]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q7N44FFGK77MQG66K9Z5D /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q7R1E7BK3FVAVWS09KFZ3]" duration=4.174846792s duration_ms=4174 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q7X4JK8C6Z1YX5MDA4HXX/chunks/000001 dst=01GK7Q7X4JK8C6Z1YX5MDA4HXX/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q7X4JK8C6Z1YX5MDA4HXX/index dst=01GK7Q7X4JK8C6Z1YX5MDA4HXX/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q7X4J8F2VKVW38EY4YTQ3/chunks/000001 dst=01GK7Q7X4J8F2VKVW38EY4YTQ3/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q7X4JK8C6Z1YX5MDA4HXX duration=11.297399ms duration_ms=11 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q7X4J8F2VKVW38EY4YTQ3/index dst=01GK7Q7X4J8F2VKVW38EY4YTQ3/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split32364646/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q7X4J8F2VKVW38EY4YTQ3 duration=12.128198ms duration_ms=12 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=20.230497ms duration_ms=20 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q7N44FFGK77MQG66K9Z5D level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q7N44FFGK77MQG66K9Z5D level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q7R1E7BK3FVAVWS09KFZ3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q7R1E7BK3FVAVWS09KFZ3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction job succeeded" duration=4.251232082s duration_ms=4251 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=35.811996ms duration_ms=35 cached=5 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=51.367694ms duration_ms=51 cached=5 returned=3 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=11.280399ms duration_ms=11 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GK7Q81FY0A87CF2FR83FWBT8 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GK7Q844G224WDYYX1TC7S3NH (min time: 1970-01-01 00:01:00 +0000 UTC, max time: 1970-01-01 00:07:00 +0000 UTC),01GK7Q86EVQJW74YYZZ59BP1AF (min time: 1970-01-01 01:00:00 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=15.628498ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=3 plan="[01GK7Q81FY0A87CF2FR83FWBT8 (min time: 0, max time: 300000) 01GK7Q844G224WDYYX1TC7S3NH (min time: 60000, max time: 420000) 01GK7Q86EVQJW74YYZZ59BP1AF (min time: 3600000, max time: 7200000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q86EVQJW74YYZZ59BP1AF/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q844G224WDYYX1TC7S3NH/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q81FY0A87CF2FR83FWBT8/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=3 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q81FY0A87CF2FR83FWBT8 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q844G224WDYYX1TC7S3NH /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q86EVQJW74YYZZ59BP1AF]" duration=49.893694ms duration_ms=49 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GK7Q88WGDVJD1NDDWEJTRA18 sources="[01GK7Q844G224WDYYX1TC7S3NH 01GK7Q86EVQJW74YYZZ59BP1AF 01GK7Q81FY0A87CF2FR83FWBT8]" duration=3.220405008s shard=1_of_2 level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GK7Q88WG8472VA163TKK5D0S sources="[01GK7Q844G224WDYYX1TC7S3NH 01GK7Q86EVQJW74YYZZ59BP1AF 01GK7Q81FY0A87CF2FR83FWBT8]" duration=3.220944708s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q88WGDVJD1NDDWEJTRA18 01GK7Q88WG8472VA163TKK5D0S]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q81FY0A87CF2FR83FWBT8 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q844G224WDYYX1TC7S3NH /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q86EVQJW74YYZZ59BP1AF]" duration=3.221716508s duration_ms=3221 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q88WG8472VA163TKK5D0S/chunks/000001 dst=01GK7Q88WG8472VA163TKK5D0S/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q88WG8472VA163TKK5D0S/index dst=01GK7Q88WG8472VA163TKK5D0S/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q88WG8472VA163TKK5D0S duration=16.007998ms duration_ms=16 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q88WGDVJD1NDDWEJTRA18/chunks/000001 dst=01GK7Q88WGDVJD1NDDWEJTRA18/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q88WGDVJD1NDDWEJTRA18/index dst=01GK7Q88WGDVJD1NDDWEJTRA18/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together575316363/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q88WGDVJD1NDDWEJTRA18 duration=13.219998ms duration_ms=13 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=33.710896ms duration_ms=33 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q81FY0A87CF2FR83FWBT8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q81FY0A87CF2FR83FWBT8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q844G224WDYYX1TC7S3NH level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q844G224WDYYX1TC7S3NH level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q86EVQJW74YYZZ59BP1AF level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q86EVQJW74YYZZ59BP1AF level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction job succeeded" duration=3.327198295s duration_ms=3327 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=21.986697ms duration_ms=21 cached=5 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=37.802495ms duration_ms=37 cached=5 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=info component=compactor msg="ring doesn't exist in KV store yet" level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=32.963596ms level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=28.384197ms duration_ms=28 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GK7Q8CDJEMNAGBEC3BE2F664 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GK7Q8F38FHJCPYJG5C05AEM3 (min time: 1970-01-01 00:01:00 +0000 UTC, max time: 1970-01-01 00:07:00 +0000 UTC),01GK7Q8H20HJKY0214VFP6DKPK (min time: 1970-01-01 01:00:00 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC)" level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=3 plan="[01GK7Q8CDJEMNAGBEC3BE2F664 (min time: 0, max time: 300000) 01GK7Q8F38FHJCPYJG5C05AEM3 (min time: 60000, max time: 420000) 01GK7Q8H20HJKY0214VFP6DKPK (min time: 3600000, max time: 7200000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q8CDJEMNAGBEC3BE2F664/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q8F38FHJCPYJG5C05AEM3/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q8H20HJKY0214VFP6DKPK/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=3 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8CDJEMNAGBEC3BE2F664 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8F38FHJCPYJG5C05AEM3 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8H20HJKY0214VFP6DKPK]" duration=37.358296ms duration_ms=37 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GK7Q8KFV9V23KZQA4P76EMC1 sources="[01GK7Q8H20HJKY0214VFP6DKPK 01GK7Q8F38FHJCPYJG5C05AEM3 01GK7Q8CDJEMNAGBEC3BE2F664]" duration=3.69520215s shard=1_of_2 level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GK7Q8KFVRJ4DVAG2HZCPN6N0 sources="[01GK7Q8H20HJKY0214VFP6DKPK 01GK7Q8F38FHJCPYJG5C05AEM3 01GK7Q8CDJEMNAGBEC3BE2F664]" duration=3.69583525s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compacted blocks" new="[01GK7Q8KFV9V23KZQA4P76EMC1 01GK7Q8KFVRJ4DVAG2HZCPN6N0]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8CDJEMNAGBEC3BE2F664 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8F38FHJCPYJG5C05AEM3 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8H20HJKY0214VFP6DKPK]" duration=3.69699425s duration_ms=3696 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8KFVRJ4DVAG2HZCPN6N0/chunks/000001 dst=01GK7Q8KFVRJ4DVAG2HZCPN6N0/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8KFV9V23KZQA4P76EMC1/chunks/000001 dst=01GK7Q8KFV9V23KZQA4P76EMC1/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8KFV9V23KZQA4P76EMC1/index dst=01GK7Q8KFV9V23KZQA4P76EMC1/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q8KFV9V23KZQA4P76EMC1 duration=12.583498ms duration_ms=12 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GK7Q8KFVRJ4DVAG2HZCPN6N0/index dst=01GK7Q8KFVRJ4DVAG2HZCPN6N0/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together233576972/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q8KFVRJ4DVAG2HZCPN6N0 duration=31.992196ms duration_ms=31 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=40.295295ms duration_ms=40 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q8CDJEMNAGBEC3BE2F664 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q8CDJEMNAGBEC3BE2F664 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q8F38FHJCPYJG5C05AEM3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q8F38FHJCPYJG5C05AEM3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q8H20HJKY0214VFP6DKPK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q8H20HJKY0214VFP6DKPK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction job succeeded" duration=3.812250136s duration_ms=3812 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=75.37139ms duration_ms=75 cached=5 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=52.278493ms duration_ms=52 cached=5 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_if_configured_shards_=_0 level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=21.702097ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=30.378196ms duration_ms=30 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge--0-7200000 job="stage: merge, range start: 0, range end: 7200000, shard: , blocks: 01GK7Q8QKW9P9HG67AZZ013Q44 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GK7Q8SNVC62HBSW1B63Q9HRQ (min time: 1970-01-01 00:05:00 +0000 UTC, max time: 1970-01-01 00:10:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q8QKW9P9HG67AZZ013Q44 (min time: 0, max time: 300000) 01GK7Q8SNVC62HBSW1B63Q9HRQ (min time: 300000, max time: 600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q8QKW9P9HG67AZZ013Q44/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q8SNVC62HBSW1B63Q9HRQ/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_04157785506/001/compact/0@17241709254077376921-merge--0-7200000/01GK7Q8QKW9P9HG67AZZ013Q44 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_04157785506/001/compact/0@17241709254077376921-merge--0-7200000/01GK7Q8SNVC62HBSW1B63Q9HRQ]" duration=14.353398ms duration_ms=14 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GK7Q8Y8TVTG5S25Q71PF8DYK sources="[01GK7Q8QKW9P9HG67AZZ013Q44 01GK7Q8SNVC62HBSW1B63Q9HRQ]" duration=2.122864642s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compacted blocks" new=[01GK7Q8Y8TVTG5S25Q71PF8DYK] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_04157785506/001/compact/0@17241709254077376921-merge--0-7200000/01GK7Q8QKW9P9HG67AZZ013Q44 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_04157785506/001/compact/0@17241709254077376921-merge--0-7200000/01GK7Q8SNVC62HBSW1B63Q9HRQ]" duration=2.124482141s duration_ms=2124 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_04157785506/001/compact/0@17241709254077376921-merge--0-7200000/01GK7Q8Y8TVTG5S25Q71PF8DYK/chunks/000001" dst=01GK7Q8Y8TVTG5S25Q71PF8DYK/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_04157785506/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_04157785506/001/compact/0@17241709254077376921-merge--0-7200000/01GK7Q8Y8TVTG5S25Q71PF8DYK/index" dst=01GK7Q8Y8TVTG5S25Q71PF8DYK/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_04157785506/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GK7Q8Y8TVTG5S25Q71PF8DYK duration=8.792399ms duration_ms=8 external_labels={} level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=16.519098ms duration_ms=16 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q8QKW9P9HG67AZZ013Q44 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q8QKW9P9HG67AZZ013Q44 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q8SNVC62HBSW1B63Q9HRQ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q8SNVC62HBSW1B63Q9HRQ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction job succeeded" duration=2.168915836s duration_ms=2168 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=43.021495ms duration_ms=43 cached=4 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=31.885896ms duration_ms=31 cached=4 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor --- FAIL: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor (182.74s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split (18.59s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split (15.82s) --- FAIL: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/smaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges (45.99s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/should_correctly_handle_empty_blocks_generated_in_the_splitting_stage (5.03s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0 (36.17s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split (8.18s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split (8.34s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split (12.67s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together (11.16s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together (11.47s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_if_configured_shards_=_0 (9.30s) === RUN TestPlanCompaction === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_two_split_groups split_merge_grouper_test.go:515: got 4 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_2, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 2_of_2, blocks: 00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_2, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 2_of_2, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/input_blocks_can_be_compacted_on_a_mix_of_1st_and_2nd_ranges,_guaranteeing_no_overlaps_and_giving_preference_to_smaller_ranges split_merge_grouper_test.go:515: got 3 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 20, range end: 40, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000050000000000000000 (min time: 1970-01-01 00:00:00.03 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 70, range end: 80, shard: 1_of_1, blocks: 00000000080000000000000000 (min time: 1970-01-01 00:00:00.07 +0000 UTC, max time: 1970-01-01 00:00:00.08 +0000 UTC),00000000090000000000000000 (min time: 1970-01-01 00:00:00.075 +0000 UTC, max time: 1970-01-01 00:00:00.08 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.007 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/input_blocks_have_already_been_compacted_with_the_largest_range split_merge_grouper_test.go:515: got 0 jobs: === RUN TestPlanCompaction/a_block_with_time_range_larger_then_the_largest_compaction_range_should_NOT_be_considered_for_compaction split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 80, range end: 120, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC),00000000050000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC) === RUN TestPlanCompaction/a_range_containing_the_most_recent_block_shouldn't_be_prematurely_compacted_if_doesn't_cover_the_full_range split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000000000000000000000 (min time: 1970-01-01 00:00:00.005 +0000 UTC, max time: 1970-01-01 00:00:00.008 +0000 UTC),00000000000000000000000000 (min time: 1970-01-01 00:00:00.007 +0000 UTC, max time: 1970-01-01 00:00:00.009 +0000 UTC) === RUN TestPlanCompaction/no_input_blocks split_merge_grouper_test.go:515: got 0 jobs: === RUN TestPlanCompaction/should_split_a_single_block_if_<_smallest_compaction_range split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_within_the_same_time_range split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_not_split_non-split_blocks_if_they're_>_smallest_compaction_range_(do_not_split_historical_blocks_after_enabling_splitting) split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 20, shard: 1_of_2, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 20, shard: 2_of_2, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/input_blocks_match_the_largest_range_but_can_be_compacted_because_overlapping split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 80, range end: 120, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC) === RUN TestPlanCompaction/should_not_merge_blocks_within_the_same_time_range_but_with_different_external_labels split_merge_grouper_test.go:515: got 3 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_NOT_split_a_single_block_if_==_smallest_compaction_range_but_configured_shards_=_0 split_merge_grouper_test.go:515: got 0 jobs: === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_single_split_group split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_split_blocks_that_can_be_compacted_on_the_2nd_range_only split_merge_grouper_test.go:515: got 3 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 20, shard: 1_of_2, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 20, shard: 2_of_2, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 20, range end: 40, shard: 1_of_2, blocks: 00000000050000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000060000000000000000 (min time: 1970-01-01 00:00:00.03 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) === RUN TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_BE_considered_for_2nd_level_compaction split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 40, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000030000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) === RUN TestPlanCompaction/should_split_a_single_block_if_==_smallest_compaction_range split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_but_NOT_split_multiple_1st_level_blocks_in_different_time_ranges_if_configured_shards_=_0 split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 10, shard: , blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 10, range end: 20, shard: , blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_be_NOT_considered_for_1st_level_splitting split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 20, range end: 40, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.03 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) --- PASS: TestPlanCompaction (0.07s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_two_split_groups (0.00s) --- PASS: TestPlanCompaction/input_blocks_can_be_compacted_on_a_mix_of_1st_and_2nd_ranges,_guaranteeing_no_overlaps_and_giving_preference_to_smaller_ranges (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges (0.00s) --- PASS: TestPlanCompaction/input_blocks_have_already_been_compacted_with_the_largest_range (0.00s) --- PASS: TestPlanCompaction/a_block_with_time_range_larger_then_the_largest_compaction_range_should_NOT_be_considered_for_compaction (0.00s) --- PASS: TestPlanCompaction/a_range_containing_the_most_recent_block_shouldn't_be_prematurely_compacted_if_doesn't_cover_the_full_range (0.00s) --- PASS: TestPlanCompaction/no_input_blocks (0.00s) --- PASS: TestPlanCompaction/should_split_a_single_block_if_<_smallest_compaction_range (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_within_the_same_time_range (0.00s) --- PASS: TestPlanCompaction/should_not_split_non-split_blocks_if_they're_>_smallest_compaction_range_(do_not_split_historical_blocks_after_enabling_splitting) (0.00s) --- PASS: TestPlanCompaction/input_blocks_match_the_largest_range_but_can_be_compacted_because_overlapping (0.00s) --- PASS: TestPlanCompaction/should_not_merge_blocks_within_the_same_time_range_but_with_different_external_labels (0.00s) --- PASS: TestPlanCompaction/should_NOT_split_a_single_block_if_==_smallest_compaction_range_but_configured_shards_=_0 (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_single_split_group (0.00s) --- PASS: TestPlanCompaction/should_merge_split_blocks_that_can_be_compacted_on_the_2nd_range_only (0.00s) --- PASS: TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_BE_considered_for_2nd_level_compaction (0.00s) --- PASS: TestPlanCompaction/should_split_a_single_block_if_==_smallest_compaction_range (0.00s) --- PASS: TestPlanCompaction/should_merge_but_NOT_split_multiple_1st_level_blocks_in_different_time_ranges_if_configured_shards_=_0 (0.00s) --- PASS: TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_be_NOT_considered_for_1st_level_splitting (0.00s) === RUN TestPlanSplitting === RUN TestPlanSplitting/should_return_nil_if_the_input_group_contains_no_non-sharded_blocks === RUN TestPlanSplitting/should_return_a_split_job_if_the_input_group_contains_1_non-sharded_block === RUN TestPlanSplitting/should_splitGroups_split_jobs_if_the_input_group_contains_multiple_non-sharded_blocks === RUN TestPlanSplitting/should_return_nil_if_the_input_group_is_empty --- PASS: TestPlanSplitting (0.00s) --- PASS: TestPlanSplitting/should_return_nil_if_the_input_group_contains_no_non-sharded_blocks (0.00s) --- PASS: TestPlanSplitting/should_return_a_split_job_if_the_input_group_contains_1_non-sharded_block (0.00s) --- PASS: TestPlanSplitting/should_splitGroups_split_jobs_if_the_input_group_contains_multiple_non-sharded_blocks (0.00s) --- PASS: TestPlanSplitting/should_return_nil_if_the_input_group_is_empty (0.00s) === RUN TestGroupBlocksByShardID === RUN TestGroupBlocksByShardID/no_input_blocks === RUN TestGroupBlocksByShardID/only_1_block_in_input_with_shard_ID === RUN TestGroupBlocksByShardID/only_1_block_in_input_without_shard_ID === RUN TestGroupBlocksByShardID/multiple_blocks_per_shard_ID --- PASS: TestGroupBlocksByShardID (0.01s) --- PASS: TestGroupBlocksByShardID/no_input_blocks (0.00s) --- PASS: TestGroupBlocksByShardID/only_1_block_in_input_with_shard_ID (0.00s) --- PASS: TestGroupBlocksByShardID/only_1_block_in_input_without_shard_ID (0.00s) --- PASS: TestGroupBlocksByShardID/multiple_blocks_per_shard_ID (0.00s) === RUN TestGroupBlocksByRange === RUN TestGroupBlocksByRange/a_block_with_time_range_larger_then_the_range_should_be_excluded === RUN TestGroupBlocksByRange/blocks_with_different_time_ranges_but_all_fitting_within_the_input_range === RUN TestGroupBlocksByRange/no_input_blocks === RUN TestGroupBlocksByRange/only_1_block_in_input === RUN TestGroupBlocksByRange/only_1_block_per_range === RUN TestGroupBlocksByRange/multiple_blocks_per_range --- PASS: TestGroupBlocksByRange (0.00s) --- PASS: TestGroupBlocksByRange/a_block_with_time_range_larger_then_the_range_should_be_excluded (0.00s) --- PASS: TestGroupBlocksByRange/blocks_with_different_time_ranges_but_all_fitting_within_the_input_range (0.00s) --- PASS: TestGroupBlocksByRange/no_input_blocks (0.00s) --- PASS: TestGroupBlocksByRange/only_1_block_in_input (0.00s) --- PASS: TestGroupBlocksByRange/only_1_block_per_range (0.00s) --- PASS: TestGroupBlocksByRange/multiple_blocks_per_range (0.00s) === RUN TestJob_conflicts === RUN TestJob_conflicts/should_NOT_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_but_different_shard === RUN TestJob_conflicts/should_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_and_different_shard_but_at_a_different_stage === RUN TestJob_conflicts/should_conflict_between_split_and_merge_jobs_with_overlapping_time_ranges === RUN TestJob_conflicts/should_NOT_conflict_between_split_and_merge_jobs_with_non-overlapping_time_ranges === RUN TestJob_conflicts/should_conflict_if_jobs_compact_different_blocks_but_with_overlapping_time_ranges_and_same_shard === RUN TestJob_conflicts/should_NOT_conflict_if_jobs_compact_different_blocks_with_non-overlapping_time_ranges_and_same_shard --- PASS: TestJob_conflicts (0.01s) --- PASS: TestJob_conflicts/should_NOT_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_but_different_shard (0.00s) --- PASS: TestJob_conflicts/should_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_and_different_shard_but_at_a_different_stage (0.00s) --- PASS: TestJob_conflicts/should_conflict_between_split_and_merge_jobs_with_overlapping_time_ranges (0.00s) --- PASS: TestJob_conflicts/should_NOT_conflict_between_split_and_merge_jobs_with_non-overlapping_time_ranges (0.00s) --- PASS: TestJob_conflicts/should_conflict_if_jobs_compact_different_blocks_but_with_overlapping_time_ranges_and_same_shard (0.00s) --- PASS: TestJob_conflicts/should_NOT_conflict_if_jobs_compact_different_blocks_with_non-overlapping_time_ranges_and_same_shard (0.00s) === RUN TestBlocksGroup_overlaps --- PASS: TestBlocksGroup_overlaps (0.00s) === RUN TestBlocksGroup_getNonShardedBlocks --- PASS: TestBlocksGroup_getNonShardedBlocks (0.00s) === RUN TestSplitAndMergePlanner_Plan === RUN TestSplitAndMergePlanner_Plan/a_source_block_is_larger_then_the_largest_range === RUN TestSplitAndMergePlanner_Plan/source_blocks_are_smaller_then_the_largest_range_but_compacted_block_is_larger === RUN TestSplitAndMergePlanner_Plan/source_blocks_and_compacted_block_are_smaller_then_the_largest_range_but_misaligned === RUN TestSplitAndMergePlanner_Plan/blocks_fit_within_the_largest_range === RUN TestSplitAndMergePlanner_Plan/no_blocks --- PASS: TestSplitAndMergePlanner_Plan (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/a_source_block_is_larger_then_the_largest_range (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/source_blocks_are_smaller_then_the_largest_range_but_compacted_block_is_larger (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/source_blocks_and_compacted_block_are_smaller_then_the_largest_range_but_misaligned (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/blocks_fit_within_the_largest_range (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/no_blocks (0.00s) === RUN TestSyncerMetrics --- PASS: TestSyncerMetrics (0.01s) === RUN TestDeleteTenant --- PASS: TestDeleteTenant (0.22s) === RUN TestDeleteTenantStatus === RUN TestDeleteTenantStatus/empty === RUN TestDeleteTenantStatus/no_user_objects === RUN TestDeleteTenantStatus/non-block_files === RUN TestDeleteTenantStatus/block_files --- PASS: TestDeleteTenantStatus (0.86s) --- PASS: TestDeleteTenantStatus/empty (0.21s) --- PASS: TestDeleteTenantStatus/no_user_objects (0.23s) --- PASS: TestDeleteTenantStatus/non-block_files (0.22s) --- PASS: TestDeleteTenantStatus/block_files (0.20s) === CONT TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion === CONT TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket === CONT TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant === CONT TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning === CONT TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction === CONT TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning === CONT TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime === CONT TestSyncer_GarbageCollect_e2e === RUN TestSyncer_GarbageCollect_e2e/inmem create 00000000000000000000000000 create 00000000010000000000000000 create 00000000020000000000000000 create 00000000030000000000000000 create 00000000040000000000000000 create 00000000050000000000000000 create 00000000060000000000000000 create 00000000070000000000000000 create 00000000080000000000000000 create 00000000090000000000000000 create 00000000340000000000000000 create 00000000680000000000000000 create 000000009C0000000000000000 create 00000000CG0000000000000000 create 00000000FM0000000000000000 === RUN TestSyncer_GarbageCollect_e2e/filesystem === PAUSE TestSyncer_GarbageCollect_e2e/filesystem === CONT TestMultitenantCompactor_ShouldFailCompactionOnTimeout --- PASS: TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket (0.21s) === CONT TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion --- PASS: TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning (0.36s) === CONT TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning --- PASS: TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion (0.40s) === CONT TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly === RUN TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/inmem create 00000000000000000000000000 create 00000000010000000000000000 create 00000000340000000000000000 level=debug msg="deleted file" file=00000000000000000000000000/meta.json bucket=inmem level=debug msg="deleted file" file=00000000000000000000000000/deletion-mark.json bucket=inmem level=debug msg="deleted file" file=00000000010000000000000000/meta.json bucket=inmem level=debug msg="deleted file" file=00000000010000000000000000/deletion-mark.json bucket=inmem === RUN TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem === PAUSE TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem === CONT TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks --- PASS: TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction (0.51s) === CONT TestGroupCompactE2E === RUN TestGroupCompactE2E/inmem level=info msg="start sync of metas" level=info msg="start of GC" level=info msg="start of compactions" level=info msg="compaction iterations done" --- PASS: TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion (0.38s) === CONT TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction --- PASS: TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks (0.22s) === CONT TestSyncer_GarbageCollect_e2e/filesystem create 00000000000000000000000000 create 00000000010000000000000000 create 00000000020000000000000000 create 00000000030000000000000000 create 00000000040000000000000000 create 00000000050000000000000000 create 00000000060000000000000000 create 00000000070000000000000000 create 00000000080000000000000000 create 00000000090000000000000000 create 00000000340000000000000000 create 00000000680000000000000000 create 000000009C0000000000000000 create 00000000CG0000000000000000 create 00000000FM0000000000000000 --- PASS: TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant (0.79s) === CONT TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem create 00000000000000000000000000 create 00000000010000000000000000 --- PASS: TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction (0.22s) create 00000000340000000000000000 level=debug msg="deleted file" file=00000000000000000000000000/meta.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem2252807785/001" level=debug msg="deleted file" file=00000000000000000000000000/deletion-mark.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem2252807785/001" level=debug msg="deleted file" file=00000000010000000000000000/meta.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem2252807785/001" level=debug msg="deleted file" file=00000000010000000000000000/deletion-mark.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem2252807785/001" --- PASS: TestSyncer_GarbageCollect_e2e (0.02s) --- PASS: TestSyncer_GarbageCollect_e2e/inmem (0.02s) --- PASS: TestSyncer_GarbageCollect_e2e/filesystem (0.20s) --- PASS: TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly (0.01s) --- PASS: TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/inmem (0.01s) --- PASS: TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem (0.07s) --- PASS: TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning (0.51s) --- PASS: TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime (1.45s) --- PASS: TestMultitenantCompactor_ShouldFailCompactionOnTimeout (5.04s) level=info msg="start sync of metas" level=info msg="start of GC" level=debug msg="grouper found a compactable blocks group" groupKey=124@14251579150387240703-merge--0-1000 job="stage: merge, range start: 0, range end: 1000, shard: , blocks: 01GK7Q929EDG321RJHQ65DJMZP (min time: 1970-01-01 00:00:00.5 +0000 UTC, max time: 1970-01-01 00:00:01 +0000 UTC),01GK7Q9K691JYHMTC525A2812X (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.499 +0000 UTC)" level=debug msg="grouper found a compactable blocks group" groupKey=124@8084862141041806226-merge--0-3000 job="stage: merge, range start: 0, range end: 3000, shard: , blocks: 01GK7Q9CWYWYD1NNHVZAWG58X6 (min time: 1970-01-01 00:00:02 +0000 UTC, max time: 1970-01-01 00:00:03 +0000 UTC),01GK7Q9ESWEXNNFMJQFP1S8PKG (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:01 +0000 UTC)" level=info msg="start of compactions" level=info groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q9K691JYHMTC525A2812X (min time: 0, max time: 499) 01GK7Q929EDG321RJHQ65DJMZP (min time: 500, max time: 1000)]" level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GK7Q9ESWEXNNFMJQFP1S8PKG (min time: 0, max time: 1000) 01GK7Q9CWYWYD1NNHVZAWG58X6 (min time: 2000, max time: 3000)]" level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q9ESWEXNNFMJQFP1S8PKG/meta.json level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q9CWYWYD1NNHVZAWG58X6/meta.json level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestGroupCompactE2Einmem2551452237/001/124@8084862141041806226-merge--0-3000/01GK7Q9ESWEXNNFMJQFP1S8PKG /tmp/TestGroupCompactE2Einmem2551452237/001/124@8084862141041806226-merge--0-3000/01GK7Q9CWYWYD1NNHVZAWG58X6]" duration=9.661499ms duration_ms=9 level=debug groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q9K691JYHMTC525A2812X/meta.json level=debug groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q929EDG321RJHQ65DJMZP/meta.json level=debug groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="found out of order series" labels="{lbl1=\"1\"}" level=error groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="compaction job failed" duration=26.961397ms duration_ms=26 err="blocks with out-of-order chunks are dropped from compaction: /tmp/TestGroupCompactE2Einmem2551452237/001/124@14251579150387240703-merge--0-1000/01GK7Q9K691JYHMTC525A2812X: 1/1 series have an average of 1.000 out-of-order chunks: 0.000 of these are exact duplicates (in terms of data and time range)" level=info msg="block has been marked for no compaction" block=01GK7Q9K691JYHMTC525A2812X --- PASS: TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning (20.47s) level=info msg="compact blocks" count=2 mint=0 maxt=3000 ulid=01GK7Q9N8CJ5R9K8T663QNV0M2 sources="[01GK7Q9ESWEXNNFMJQFP1S8PKG 01GK7Q9CWYWYD1NNHVZAWG58X6]" duration=2.845281754s shard=1_of_1 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compacted blocks" new=[01GK7Q9N8CJ5R9K8T663QNV0M2] blocks="[/tmp/TestGroupCompactE2Einmem2551452237/001/124@8084862141041806226-merge--0-3000/01GK7Q9ESWEXNNFMJQFP1S8PKG /tmp/TestGroupCompactE2Einmem2551452237/001/124@8084862141041806226-merge--0-3000/01GK7Q9CWYWYD1NNHVZAWG58X6]" duration=2.860287951s duration_ms=2860 level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Einmem2551452237/001/124@8084862141041806226-merge--0-3000/01GK7Q9N8CJ5R9K8T663QNV0M2/chunks/000001 dst=01GK7Q9N8CJ5R9K8T663QNV0M2/chunks/000001 bucket=inmem level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Einmem2551452237/001/124@8084862141041806226-merge--0-3000/01GK7Q9N8CJ5R9K8T663QNV0M2/index dst=01GK7Q9N8CJ5R9K8T663QNV0M2/index bucket=inmem level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded block" result_block=01GK7Q9N8CJ5R9K8T663QNV0M2 duration=6.526199ms duration_ms=6 external_labels="{e1=\"1\"}" level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=20.357998ms duration_ms=20 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q9ESWEXNNFMJQFP1S8PKG level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q9ESWEXNNFMJQFP1S8PKG level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q9CWYWYD1NNHVZAWG58X6 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q9CWYWYD1NNHVZAWG58X6 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction job succeeded" duration=2.903364047s duration_ms=2903 level=info msg="start sync of metas" level=info msg="start of GC" level=debug msg="grouper found a compactable blocks group" groupKey=124@14251579150387240703-merge--0-3000 job="stage: merge, range start: 0, range end: 3000, shard: , blocks: 01GK7Q929EDG321RJHQ65DJMZP (min time: 1970-01-01 00:00:00.5 +0000 UTC, max time: 1970-01-01 00:00:01 +0000 UTC),01GK7Q94E4SWYAX2D7XHHADQ1M (min time: 1970-01-01 00:00:02 +0000 UTC, max time: 1970-01-01 00:00:03 +0000 UTC),01GK7Q962AYNT6CD20NP39V8AB (min time: 1970-01-01 00:00:01 +0000 UTC, max time: 1970-01-01 00:00:02 +0000 UTC)" level=info msg="start of compactions" level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=3 plan="[01GK7Q929EDG321RJHQ65DJMZP (min time: 500, max time: 1000) 01GK7Q962AYNT6CD20NP39V8AB (min time: 1000, max time: 2000) 01GK7Q94E4SWYAX2D7XHHADQ1M (min time: 2000, max time: 3000)]" level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q94E4SWYAX2D7XHHADQ1M/meta.json level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q962AYNT6CD20NP39V8AB/meta.json level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GK7Q929EDG321RJHQ65DJMZP/meta.json level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=3 plan="[/tmp/TestGroupCompactE2Einmem2551452237/001/124@14251579150387240703-merge--0-3000/01GK7Q929EDG321RJHQ65DJMZP /tmp/TestGroupCompactE2Einmem2551452237/001/124@14251579150387240703-merge--0-3000/01GK7Q962AYNT6CD20NP39V8AB /tmp/TestGroupCompactE2Einmem2551452237/001/124@14251579150387240703-merge--0-3000/01GK7Q94E4SWYAX2D7XHHADQ1M]" duration=12.560999ms duration_ms=12 level=info msg="compact blocks" count=3 mint=500 maxt=3000 ulid=01GK7Q9R347920S9PCWAZYJ0HV sources="[01GK7Q929EDG321RJHQ65DJMZP 01GK7Q962AYNT6CD20NP39V8AB 01GK7Q94E4SWYAX2D7XHHADQ1M]" duration=2.360792913s shard=1_of_1 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compacted blocks" new=[01GK7Q9R347920S9PCWAZYJ0HV] blocks="[/tmp/TestGroupCompactE2Einmem2551452237/001/124@14251579150387240703-merge--0-3000/01GK7Q929EDG321RJHQ65DJMZP /tmp/TestGroupCompactE2Einmem2551452237/001/124@14251579150387240703-merge--0-3000/01GK7Q962AYNT6CD20NP39V8AB /tmp/TestGroupCompactE2Einmem2551452237/001/124@14251579150387240703-merge--0-3000/01GK7Q94E4SWYAX2D7XHHADQ1M]" duration=2.362038312s duration_ms=2362 level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Einmem2551452237/001/124@14251579150387240703-merge--0-3000/01GK7Q9R347920S9PCWAZYJ0HV/chunks/000001 dst=01GK7Q9R347920S9PCWAZYJ0HV/chunks/000001 bucket=inmem level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Einmem2551452237/001/124@14251579150387240703-merge--0-3000/01GK7Q9R347920S9PCWAZYJ0HV/index dst=01GK7Q9R347920S9PCWAZYJ0HV/index bucket=inmem level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded block" result_block=01GK7Q9R347920S9PCWAZYJ0HV duration=5.280299ms duration_ms=5 external_labels="{e1=\"1/weird\"}" level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=10.332699ms duration_ms=10 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q929EDG321RJHQ65DJMZP level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q929EDG321RJHQ65DJMZP level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q962AYNT6CD20NP39V8AB level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q962AYNT6CD20NP39V8AB level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GK7Q94E4SWYAX2D7XHHADQ1M level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GK7Q94E4SWYAX2D7XHHADQ1M level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction job succeeded" duration=2.395690708s duration_ms=2395 level=info msg="start sync of metas" level=info msg="start of GC" level=info msg="start of compactions" level=info msg="compaction iterations done" === RUN TestGroupCompactE2E/filesystem === PAUSE TestGroupCompactE2E/filesystem === CONT TestGroupCompactE2E/filesystem level=info msg="start sync of metas" level=info msg="start of GC" level=info msg="start of compactions" level=info msg="compaction iterations done" bucket_compactor_e2e_test.go:476: Error Trace: /build/mimir/src/mimir/pkg/compactor/bucket_compactor_e2e_test.go:476 /build/mimir/src/mimir/pkg/compactor/bucket_compactor_e2e_test.go:457 /build/mimir/src/mimir/pkg/compactor/bucket_compactor_e2e_test.go:270 /build/mimir/src/mimir/pkg/compactor/bucket_compactor_e2e_test.go:605 Error: Received unexpected error: write block: 2 errors: populate block: writing block: add series: context deadline exceeded; context deadline exceeded Test: TestGroupCompactE2E/filesystem --- FAIL: TestGroupCompactE2E (24.76s) --- PASS: TestGroupCompactE2E/inmem (24.76s) --- FAIL: TestGroupCompactE2E/filesystem (21.31s) FAIL FAIL github.com/grafana/mimir/pkg/compactor 372.650s === RUN TestClient_WriteSeries === RUN TestClient_WriteSeries/write_series_in_a_single_batch === RUN TestClient_WriteSeries/write_series_in_multiple_batches === RUN TestClient_WriteSeries/request_failed_with_4xx_error === RUN TestClient_WriteSeries/request_failed_with_5xx_error --- PASS: TestClient_WriteSeries (0.15s) --- PASS: TestClient_WriteSeries/write_series_in_a_single_batch (0.06s) --- PASS: TestClient_WriteSeries/write_series_in_multiple_batches (0.02s) --- PASS: TestClient_WriteSeries/request_failed_with_4xx_error (0.02s) --- PASS: TestClient_WriteSeries/request_failed_with_5xx_error (0.00s) === RUN TestClient_QueryRange === RUN TestClient_QueryRange/results_cache_not_explicitly_disabled === RUN TestClient_QueryRange/results_cache_disabled --- PASS: TestClient_QueryRange (0.05s) --- PASS: TestClient_QueryRange/results_cache_not_explicitly_disabled (0.04s) --- PASS: TestClient_QueryRange/results_cache_disabled (0.01s) === RUN TestClient_Query === RUN TestClient_Query/results_cache_not_explicitly_disabled === RUN TestClient_Query/results_cache_disabled --- PASS: TestClient_Query (0.01s) --- PASS: TestClient_Query/results_cache_not_explicitly_disabled (0.01s) --- PASS: TestClient_Query/results_cache_disabled (0.00s) === RUN TestManager_PeriodicRun --- PASS: TestManager_PeriodicRun (0.05s) === RUN TestManager_SmokeTest === RUN TestManager_SmokeTest/successful_smoke_test === RUN TestManager_SmokeTest/failed_smoke_test --- PASS: TestManager_SmokeTest (0.00s) --- PASS: TestManager_SmokeTest/successful_smoke_test (0.00s) --- PASS: TestManager_SmokeTest/failed_smoke_test (0.00s) === RUN TestAlignTimestampToInterval --- PASS: TestAlignTimestampToInterval (0.00s) === RUN TestGetQueryStep === RUN TestGetQueryStep/should_return_write_interval_if_expected_number_of_samples_is_<_1000 === RUN TestGetQueryStep/should_align_step_to_write_interval_and_guarantee_no_more_than_1000_samples --- PASS: TestGetQueryStep (0.00s) --- PASS: TestGetQueryStep/should_return_write_interval_if_expected_number_of_samples_is_<_1000 (0.00s) --- PASS: TestGetQueryStep/should_align_step_to_write_interval_and_guarantee_no_more_than_1000_samples (0.00s) === RUN TestVerifySineWaveSamplesSum === RUN TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(1_series) === RUN TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(multiple_series) === RUN TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_series === RUN TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_sample === RUN TestVerifySineWaveSamplesSum/should_return_error_if_the_2nd_last_sample_has_an_unexpected_timestamp --- PASS: TestVerifySineWaveSamplesSum (0.01s) --- PASS: TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(1_series) (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(multiple_series) (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_series (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_sample (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_error_if_the_2nd_last_sample_has_an_unexpected_timestamp (0.00s) === RUN TestMinTime --- PASS: TestMinTime (0.00s) === RUN TestMaxTime --- PASS: TestMaxTime (0.00s) === RUN TestRandTime --- PASS: TestRandTime (0.01s) === RUN TestWriteReadSeriesTest_Run === RUN TestWriteReadSeriesTest_Run/should_write_series_with_current_timestamp_if_it's_already_aligned_to_write_interval === RUN TestWriteReadSeriesTest_Run/should_write_series_with_timestamp_aligned_to_write_interval === RUN TestWriteReadSeriesTest_Run/should_write_series_from_last_written_timestamp_until_now === RUN TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_network_error === RUN TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_5xx_error === RUN TestWriteReadSeriesTest_Run/should_keep_remote_writing_next_intervals_on_4xx_error === RUN TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_no_failure_if_results_match === RUN TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_failure_if_results_don't_match --- PASS: TestWriteReadSeriesTest_Run (4.27s) --- PASS: TestWriteReadSeriesTest_Run/should_write_series_with_current_timestamp_if_it's_already_aligned_to_write_interval (0.07s) --- PASS: TestWriteReadSeriesTest_Run/should_write_series_with_timestamp_aligned_to_write_interval (0.04s) --- PASS: TestWriteReadSeriesTest_Run/should_write_series_from_last_written_timestamp_until_now (2.06s) --- PASS: TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_network_error (0.01s) --- PASS: TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_5xx_error (0.00s) --- PASS: TestWriteReadSeriesTest_Run/should_keep_remote_writing_next_intervals_on_4xx_error (2.01s) --- PASS: TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_no_failure_if_results_match (0.02s) --- PASS: TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_failure_if_results_don't_match (0.06s) === RUN TestWriteReadSeriesTest_Init === RUN TestWriteReadSeriesTest_Init/no_previously_written_samples_found === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-2h,_-1m] === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m] === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m]_but_last_data_point_of_previous_24h_period_is_missing === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-24h,_-1m] === RUN TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_>_24h === RUN TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_<_24h === RUN TestWriteReadSeriesTest_Init/the_most_recent_previously_written_data_point_is_older_than_1h_ago === RUN TestWriteReadSeriesTest_Init/the_first_query_fails === RUN TestWriteReadSeriesTest_Init/a_subsequent_query_fails === RUN TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_last_24h_period === RUN TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_previous_24h_period === RUN TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_exactly_at_the_beginning_of_this_24h_period --- PASS: TestWriteReadSeriesTest_Init (0.18s) --- PASS: TestWriteReadSeriesTest_Init/no_previously_written_samples_found (0.00s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-2h,_-1m] (0.00s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m] (0.04s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m]_but_last_data_point_of_previous_24h_period_is_missing (0.01s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-24h,_-1m] (0.04s) --- PASS: TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_>_24h (0.02s) --- PASS: TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_<_24h (0.00s) --- PASS: TestWriteReadSeriesTest_Init/the_most_recent_previously_written_data_point_is_older_than_1h_ago (0.00s) --- PASS: TestWriteReadSeriesTest_Init/the_first_query_fails (0.00s) --- PASS: TestWriteReadSeriesTest_Init/a_subsequent_query_fails (0.01s) --- PASS: TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_last_24h_period (0.00s) --- PASS: TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_previous_24h_period (0.01s) --- PASS: TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_exactly_at_the_beginning_of_this_24h_period (0.02s) === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_has_not_been_set_yet === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_is_older_than_max_age === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_=_max_query_time === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_1h === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_2h === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/max_query_time_is_older_than_24h_but_more_recent_than_max_query_age === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h_but_max_query_age_is_only_10m --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges (0.01s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_has_not_been_set_yet (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_is_older_than_max_age (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_=_max_query_time (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_1h (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_2h (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/max_query_time_is_older_than_24h_but_more_recent_than_max_query_age (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h_but_max_query_age_is_only_10m (0.00s) PASS ok github.com/grafana/mimir/pkg/continuoustest 5.496s === RUN TestConfig_Validate === RUN TestConfig_Validate/should_fail_if_the_default_shard_size_is_negative === RUN TestConfig_Validate/should_pass_if_the_default_shard_size_>=_0 === RUN TestConfig_Validate/default_config_should_pass --- PASS: TestConfig_Validate (0.04s) --- PASS: TestConfig_Validate/should_fail_if_the_default_shard_size_is_negative (0.02s) --- PASS: TestConfig_Validate/should_pass_if_the_default_shard_size_>=_0 (0.01s) --- PASS: TestConfig_Validate/default_config_should_pass (0.00s) === RUN TestDistributor_Push === RUN TestDistributor_Push/A_push_to_1_happy_ingesters_should_fail === RUN TestDistributor_Push/A_push_to_ingesters_with_a_current_sample_should_report_the_correct_metrics_with_no_metadata === RUN TestDistributor_Push/A_push_to_ingesters_without_samples_should_report_the_correct_metrics === RUN TestDistributor_Push/A_push_of_no_samples_shouldn't_block_or_return_error,_even_if_ingesters_are_sad === RUN TestDistributor_Push/A_push_to_3_happy_ingesters_should_succeed === RUN TestDistributor_Push/A_push_to_2_happy_ingesters_should_succeed === RUN TestDistributor_Push/A_push_to_0_happy_ingesters_should_fail === RUN TestDistributor_Push/A_push_exceeding_burst_size_should_fail === RUN TestDistributor_Push/A_push_to_ingesters_with_an_old_sample_should_report_the_correct_metrics_with_no_metadata --- PASS: TestDistributor_Push (1.40s) --- PASS: TestDistributor_Push/A_push_to_1_happy_ingesters_should_fail (0.22s) --- PASS: TestDistributor_Push/A_push_to_ingesters_with_a_current_sample_should_report_the_correct_metrics_with_no_metadata (0.21s) --- PASS: TestDistributor_Push/A_push_to_ingesters_without_samples_should_report_the_correct_metrics (0.13s) --- PASS: TestDistributor_Push/A_push_of_no_samples_shouldn't_block_or_return_error,_even_if_ingesters_are_sad (0.17s) --- PASS: TestDistributor_Push/A_push_to_3_happy_ingesters_should_succeed (0.14s) --- PASS: TestDistributor_Push/A_push_to_2_happy_ingesters_should_succeed (0.14s) --- PASS: TestDistributor_Push/A_push_to_0_happy_ingesters_should_fail (0.13s) --- PASS: TestDistributor_Push/A_push_exceeding_burst_size_should_fail (0.13s) --- PASS: TestDistributor_Push/A_push_to_ingesters_with_an_old_sample_should_report_the_correct_metrics_with_no_metadata (0.12s) === RUN TestDistributor_ContextCanceledRequest --- PASS: TestDistributor_ContextCanceledRequest (0.17s) === RUN TestDistributor_MetricsCleanup --- PASS: TestDistributor_MetricsCleanup (0.13s) === RUN TestDistributor_PushRequestRateLimiter === RUN TestDistributor_PushRequestRateLimiter/request_burst_should_set_to_each_distributor === RUN TestDistributor_PushRequestRateLimiter/request_limit_should_be_evenly_shared_across_distributors === RUN TestDistributor_PushRequestRateLimiter/request_limit_is_disabled_when_set_to_0 --- PASS: TestDistributor_PushRequestRateLimiter (0.39s) --- PASS: TestDistributor_PushRequestRateLimiter/request_burst_should_set_to_each_distributor (0.14s) --- PASS: TestDistributor_PushRequestRateLimiter/request_limit_should_be_evenly_shared_across_distributors (0.12s) --- PASS: TestDistributor_PushRequestRateLimiter/request_limit_is_disabled_when_set_to_0 (0.13s) === RUN TestDistributor_PushIngestionRateLimiter === RUN TestDistributor_PushIngestionRateLimiter/evenly_share_the_ingestion_limit_across_distributors === RUN TestDistributor_PushIngestionRateLimiter/for_each_distributor,_set_an_ingestion_burst_limit. --- PASS: TestDistributor_PushIngestionRateLimiter (0.28s) --- PASS: TestDistributor_PushIngestionRateLimiter/evenly_share_the_ingestion_limit_across_distributors (0.15s) --- PASS: TestDistributor_PushIngestionRateLimiter/for_each_distributor,_set_an_ingestion_burst_limit. (0.14s) === RUN TestDistributor_PushInstanceLimits === RUN TestDistributor_PushInstanceLimits/below_ingestion_rate_limit === RUN TestDistributor_PushInstanceLimits/hits_rate_limit_on_first_request,_but_second_request_can_proceed === RUN TestDistributor_PushInstanceLimits/below_rate_limit_on_first_request,_but_hits_the_rate_limit_afterwards === RUN TestDistributor_PushInstanceLimits/below_inflight_size_limit === RUN TestDistributor_PushInstanceLimits/hits_inflight_size_limit === RUN TestDistributor_PushInstanceLimits/no_limits_limit === RUN TestDistributor_PushInstanceLimits/below_inflight_limit === RUN TestDistributor_PushInstanceLimits/hits_inflight_limit --- PASS: TestDistributor_PushInstanceLimits (1.47s) --- PASS: TestDistributor_PushInstanceLimits/below_ingestion_rate_limit (0.21s) --- PASS: TestDistributor_PushInstanceLimits/hits_rate_limit_on_first_request,_but_second_request_can_proceed (0.15s) --- PASS: TestDistributor_PushInstanceLimits/below_rate_limit_on_first_request,_but_hits_the_rate_limit_afterwards (0.42s) --- PASS: TestDistributor_PushInstanceLimits/below_inflight_size_limit (0.13s) --- PASS: TestDistributor_PushInstanceLimits/hits_inflight_size_limit (0.15s) --- PASS: TestDistributor_PushInstanceLimits/no_limits_limit (0.13s) --- PASS: TestDistributor_PushInstanceLimits/below_inflight_limit (0.13s) --- PASS: TestDistributor_PushInstanceLimits/hits_inflight_limit (0.14s) === RUN TestDistributor_PushHAInstances === RUN TestDistributor_PushHAInstances/0 === RUN TestDistributor_PushHAInstances/1 === RUN TestDistributor_PushHAInstances/2 === RUN TestDistributor_PushHAInstances/3 --- PASS: TestDistributor_PushHAInstances (4.28s) --- PASS: TestDistributor_PushHAInstances/0 (2.01s) --- PASS: TestDistributor_PushHAInstances/1 (2.01s) --- PASS: TestDistributor_PushHAInstances/2 (0.12s) --- PASS: TestDistributor_PushHAInstances/3 (0.13s) === RUN TestDistributor_PushQuery === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) --- PASS: TestDistributor_PushQuery (0.22s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) (0.21s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) (0.15s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) (0.23s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) (0.16s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) (0.20s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) (0.21s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) (0.22s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) (0.23s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) (0.19s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) (0.23s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) (0.18s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) (0.15s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) (0.11s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) (0.15s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) (0.15s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) (0.15s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) (0.12s) === RUN TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunksPerQueryLimitIsReached --- PASS: TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunksPerQueryLimitIsReached (0.12s) === RUN TestDistributor_QueryStream_ShouldReturnErrorIfMaxSeriesPerQueryLimitIsReached --- PASS: TestDistributor_QueryStream_ShouldReturnErrorIfMaxSeriesPerQueryLimitIsReached (0.15s) === RUN TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunkBytesPerQueryLimitIsReached --- PASS: TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunkBytesPerQueryLimitIsReached (0.12s) === RUN TestDistributor_Push_LabelRemoval --- PASS: TestDistributor_Push_LabelRemoval (0.37s) === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1 === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_label_due_to_config === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_HA_replica_label === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_2_with_value_1 === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_2 --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime (0.64s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1 (0.13s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_label_due_to_config (0.12s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_HA_replica_label (0.13s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_2_with_value_1 (0.13s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_2 (0.13s) === RUN TestDistributor_Push_LabelNameValidation === RUN TestDistributor_Push_LabelNameValidation/label_name_validation_is_on_by_default === RUN TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_config === RUN TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_WriteRequest_parameter --- PASS: TestDistributor_Push_LabelNameValidation (0.77s) --- PASS: TestDistributor_Push_LabelNameValidation/label_name_validation_is_on_by_default (0.35s) --- PASS: TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_config (0.25s) --- PASS: TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_WriteRequest_parameter (0.17s) === RUN TestDistributor_Push_ExemplarValidation === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_empty_series_label_name === RUN TestDistributor_Push_ExemplarValidation/valid_exemplar === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_labels === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_timestamp === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_long_labelset === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_many_series_labels === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_duplicate_series_labels --- PASS: TestDistributor_Push_ExemplarValidation (0.96s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_empty_series_label_name (0.19s) --- PASS: TestDistributor_Push_ExemplarValidation/valid_exemplar (0.13s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_labels (0.12s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_timestamp (0.14s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_long_labelset (0.12s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_many_series_labels (0.12s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_duplicate_series_labels (0.14s) === RUN TestDistributor_ExemplarValidation === RUN TestDistributor_ExemplarValidation/one_old,_one_new,_same_series === RUN TestDistributor_ExemplarValidation/disable_exemplars === RUN TestDistributor_ExemplarValidation/valid_exemplars === RUN TestDistributor_ExemplarValidation/one_old,_one_new,_separate_series === RUN TestDistributor_ExemplarValidation/multi_exemplars --- PASS: TestDistributor_ExemplarValidation (0.64s) --- PASS: TestDistributor_ExemplarValidation/one_old,_one_new,_same_series (0.14s) --- PASS: TestDistributor_ExemplarValidation/disable_exemplars (0.14s) --- PASS: TestDistributor_ExemplarValidation/valid_exemplars (0.12s) --- PASS: TestDistributor_ExemplarValidation/one_old,_one_new,_separate_series (0.13s) --- PASS: TestDistributor_ExemplarValidation/multi_exemplars (0.11s) === RUN TestSlowQueries === RUN TestSlowQueries/0 === RUN TestSlowQueries/1 === RUN TestSlowQueries/2 === RUN TestSlowQueries/3 --- PASS: TestSlowQueries (0.92s) --- PASS: TestSlowQueries/0 (0.22s) --- PASS: TestSlowQueries/1 (0.24s) --- PASS: TestSlowQueries/2 (0.22s) --- PASS: TestSlowQueries/3 (0.24s) === RUN TestDistributor_MetricsForLabelMatchers === RUN TestDistributor_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match === RUN TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher === RUN TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers === RUN TestDistributor_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide === RUN TestDistributor_MetricsForLabelMatchers/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_shard_size_is_set --- PASS: TestDistributor_MetricsForLabelMatchers (0.68s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match (0.14s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher (0.13s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers (0.14s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide (0.13s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_shard_size_is_set (0.14s) === RUN TestDistributor_LabelNames === RUN TestDistributor_LabelNames/should_return_an_empty_response_if_no_metric_match === RUN TestDistributor_LabelNames/should_filter_metrics_by_single_matcher === RUN TestDistributor_LabelNames/should_filter_metrics_by_multiple_matchers === RUN TestDistributor_LabelNames/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled --- PASS: TestDistributor_LabelNames (0.56s) --- PASS: TestDistributor_LabelNames/should_return_an_empty_response_if_no_metric_match (0.18s) --- PASS: TestDistributor_LabelNames/should_filter_metrics_by_single_matcher (0.13s) --- PASS: TestDistributor_LabelNames/should_filter_metrics_by_multiple_matchers (0.12s) --- PASS: TestDistributor_LabelNames/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled (0.13s) === RUN TestDistributor_MetricsMetadata === RUN TestDistributor_MetricsMetadata/should_query_all_ingesters_if_shuffle_sharding_is_enabled_but_shard_size_is_0 === RUN TestDistributor_MetricsMetadata/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled --- PASS: TestDistributor_MetricsMetadata (0.26s) --- PASS: TestDistributor_MetricsMetadata/should_query_all_ingesters_if_shuffle_sharding_is_enabled_but_shard_size_is_0 (0.14s) --- PASS: TestDistributor_MetricsMetadata/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled (0.12s) === RUN TestDistributor_LabelNamesAndValuesLimitTest === RUN TestDistributor_LabelNamesAndValuesLimitTest/expected_error_if_sizeLimit_is_reached === RUN TestDistributor_LabelNamesAndValuesLimitTest/expected_no_error_if_sizeLimit_is_not_reached --- PASS: TestDistributor_LabelNamesAndValuesLimitTest (0.27s) --- PASS: TestDistributor_LabelNamesAndValuesLimitTest/expected_error_if_sizeLimit_is_reached (0.13s) --- PASS: TestDistributor_LabelNamesAndValuesLimitTest/expected_no_error_if_sizeLimit_is_not_reached (0.13s) === RUN TestDistributor_LabelNamesAndValues === RUN TestDistributor_LabelNamesAndValues/should_group_values_of_labels_by_label_name_and_return_only_distinct_label_values === RUN TestDistributor_LabelNamesAndValues/should_return_the_results_if_zone_awareness_is_enabled_and_only_2_zones_return_the_results --- PASS: TestDistributor_LabelNamesAndValues (0.26s) --- PASS: TestDistributor_LabelNamesAndValues/should_group_values_of_labels_by_label_name_and_return_only_distinct_label_values (0.13s) --- PASS: TestDistributor_LabelNamesAndValues/should_return_the_results_if_zone_awareness_is_enabled_and_only_2_zones_return_the_results (0.13s) === RUN TestDistributor_LabelValuesCardinality_ExpectedAllIngestersResponsesToBeCompleted --- PASS: TestDistributor_LabelValuesCardinality_ExpectedAllIngestersResponsesToBeCompleted (5.81s) === RUN TestDistributor_LabelNamesAndValues_ExpectedAllPossibleLabelNamesAndValuesToBeReturned --- PASS: TestDistributor_LabelNamesAndValues_ExpectedAllPossibleLabelNamesAndValuesToBeReturned (7.61s) === RUN TestDistributor_IngestionIsControlledByForwarder === RUN TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_only_samples === RUN TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_only_samples === RUN TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_metadata === RUN TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_metadata === RUN TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_exemplars === RUN TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_exemplars --- PASS: TestDistributor_IngestionIsControlledByForwarder (0.87s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_only_samples (0.15s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_only_samples (0.21s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_metadata (0.12s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_metadata (0.13s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_exemplars (0.13s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_exemplars (0.13s) === RUN TestDistributor_LabelValuesCardinality === RUN TestDistributor_LabelValuesCardinality/should_return_an_empty_map_if_no_label_names === RUN TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_a_single_label_name === RUN TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_all_the_label_names --- PASS: TestDistributor_LabelValuesCardinality (0.38s) --- PASS: TestDistributor_LabelValuesCardinality/should_return_an_empty_map_if_no_label_names (0.13s) --- PASS: TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_a_single_label_name (0.13s) --- PASS: TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_all_the_label_names (0.12s) === RUN TestDistributor_LabelValuesCardinalityLimit === RUN TestDistributor_LabelValuesCardinalityLimit/should_return_a_httpgrpc_error_if_the_maximum_number_of_label_names_per_request_is_reached === RUN TestDistributor_LabelValuesCardinalityLimit/should_succeed_if_the_maximum_number_of_label_names_per_request_is_not_reached --- PASS: TestDistributor_LabelValuesCardinalityLimit (0.25s) --- PASS: TestDistributor_LabelValuesCardinalityLimit/should_return_a_httpgrpc_error_if_the_maximum_number_of_label_names_per_request_is_reached (0.13s) --- PASS: TestDistributor_LabelValuesCardinalityLimit/should_succeed_if_the_maximum_number_of_label_names_per_request_is_not_reached (0.11s) === RUN TestDistributor_LabelValuesCardinality_Concurrency === RUN TestDistributor_LabelValuesCardinality_Concurrency/should_fail_with_an_error_if_at_least_one_ingester's_LabelValuesCardinality_and/or_UserStats_operations_fails --- PASS: TestDistributor_LabelValuesCardinality_Concurrency (0.13s) --- PASS: TestDistributor_LabelValuesCardinality_Concurrency/should_fail_with_an_error_if_at_least_one_ingester's_LabelValuesCardinality_and/or_UserStats_operations_fails (0.13s) === RUN TestHaDedupeMiddleware === RUN TestHaDedupeMiddleware/no_changes_on_empty_request === RUN TestHaDedupeMiddleware/no_changes_if_accept_HA_samples_is_false === RUN TestHaDedupeMiddleware/remove_replica_label_with_HA_tracker_disabled === RUN TestHaDedupeMiddleware/do_nothing_without_user_in_context,_don't_even_call_next === RUN TestHaDedupeMiddleware/perform_HA_deduplication === RUN TestHaDedupeMiddleware/exceed_max_ha_clusters_limit --- PASS: TestHaDedupeMiddleware (4.45s) --- PASS: TestHaDedupeMiddleware/no_changes_on_empty_request (2.01s) --- PASS: TestHaDedupeMiddleware/no_changes_if_accept_HA_samples_is_false (1.02s) --- PASS: TestHaDedupeMiddleware/remove_replica_label_with_HA_tracker_disabled (0.13s) --- PASS: TestHaDedupeMiddleware/do_nothing_without_user_in_context,_don't_even_call_next (1.02s) --- PASS: TestHaDedupeMiddleware/perform_HA_deduplication (0.15s) --- PASS: TestHaDedupeMiddleware/exceed_max_ha_clusters_limit (0.13s) === RUN TestInstanceLimitsBeforeHaDedupe --- PASS: TestInstanceLimitsBeforeHaDedupe (0.14s) === RUN TestRelabelMiddleware === RUN TestRelabelMiddleware/do_nothing === RUN TestRelabelMiddleware/no_user_in_context === RUN TestRelabelMiddleware/apply_a_relabel_rule === RUN TestRelabelMiddleware/drop_two_out_of_three_labels === RUN TestRelabelMiddleware/drop_entire_series_if_they_have_no_labels --- PASS: TestRelabelMiddleware (0.66s) --- PASS: TestRelabelMiddleware/do_nothing (0.15s) --- PASS: TestRelabelMiddleware/no_user_in_context (0.13s) --- PASS: TestRelabelMiddleware/apply_a_relabel_rule (0.12s) --- PASS: TestRelabelMiddleware/drop_two_out_of_three_labels (0.14s) --- PASS: TestRelabelMiddleware/drop_entire_series_if_they_have_no_labels (0.13s) === RUN TestHaDedupeAndRelabelBeforeForwarding --- PASS: TestHaDedupeAndRelabelBeforeForwarding (0.12s) === RUN TestDistributorValidation === RUN TestDistributorValidation/0 === RUN TestDistributorValidation/1 === RUN TestDistributorValidation/2 === RUN TestDistributorValidation/3 === RUN TestDistributorValidation/4 === RUN TestDistributorValidation/5 --- PASS: TestDistributorValidation (0.75s) --- PASS: TestDistributorValidation/0 (0.12s) --- PASS: TestDistributorValidation/1 (0.13s) --- PASS: TestDistributorValidation/2 (0.13s) --- PASS: TestDistributorValidation/3 (0.13s) --- PASS: TestDistributorValidation/4 (0.12s) --- PASS: TestDistributorValidation/5 (0.13s) === RUN TestRemoveReplicaLabel --- PASS: TestRemoveReplicaLabel (0.00s) === RUN TestShardByAllLabelsReturnsWrongResultsForUnsortedLabels --- PASS: TestShardByAllLabelsReturnsWrongResultsForUnsortedLabels (0.00s) === RUN TestSortLabels --- PASS: TestSortLabels (0.00s) === RUN TestDistributor_Push_Relabel --- PASS: TestDistributor_Push_Relabel (0.28s) === RUN TestDistributor_MetricsWithRequestModifications === RUN TestDistributor_MetricsWithRequestModifications/No_modifications === RUN TestDistributor_MetricsWithRequestModifications/Drop_samples_via_relabel_rules === RUN TestDistributor_MetricsWithRequestModifications/Drop_samples_via_drop_label_rule === RUN TestDistributor_MetricsWithRequestModifications/Drop_requests_via_ha-dedupe === RUN TestDistributor_MetricsWithRequestModifications/Some_samples_get_forwarded === RUN TestDistributor_MetricsWithRequestModifications/Drop_examplars_via_limit === RUN TestDistributor_MetricsWithRequestModifications/Drop_half_of_samples_via_label_value_length_limit === RUN TestDistributor_MetricsWithRequestModifications/Drop_metadata_via_label_value_length_limit,_except_help --- PASS: TestDistributor_MetricsWithRequestModifications (2.51s) --- PASS: TestDistributor_MetricsWithRequestModifications/No_modifications (0.13s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_samples_via_relabel_rules (0.21s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_samples_via_drop_label_rule (0.14s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_requests_via_ha-dedupe (0.12s) --- PASS: TestDistributor_MetricsWithRequestModifications/Some_samples_get_forwarded (0.19s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_examplars_via_limit (0.16s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_half_of_samples_via_label_value_length_limit (0.15s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_metadata_via_label_value_length_limit,_except_help (0.14s) === RUN TestHATrackerConfig_Validate === PAUSE TestHATrackerConfig_Validate === RUN TestWatchPrefixAssignment --- PASS: TestWatchPrefixAssignment (0.00s) === RUN TestCheckReplicaOverwriteTimeout --- PASS: TestCheckReplicaOverwriteTimeout (1.00s) === RUN TestCheckReplicaMultiCluster --- PASS: TestCheckReplicaMultiCluster (1.00s) === RUN TestCheckReplicaMultiClusterTimeout --- PASS: TestCheckReplicaMultiClusterTimeout (1.00s) === RUN TestCheckReplicaUpdateTimeout --- PASS: TestCheckReplicaUpdateTimeout (2.00s) === RUN TestCheckReplicaMultiUser --- PASS: TestCheckReplicaMultiUser (1.00s) === RUN TestCheckReplicaUpdateTimeoutJitter === PAUSE TestCheckReplicaUpdateTimeoutJitter === RUN TestFindHALabels --- PASS: TestFindHALabels (0.00s) === RUN TestHATrackerConfig_ShouldCustomizePrefixDefaultValue --- PASS: TestHATrackerConfig_ShouldCustomizePrefixDefaultValue (0.00s) === RUN TestHAClustersLimit --- PASS: TestHAClustersLimit (0.06s) === RUN TestTooManyClustersError --- PASS: TestTooManyClustersError (0.00s) === RUN TestReplicasNotMatchError --- PASS: TestReplicasNotMatchError (0.00s) === RUN TestHATracker_MetricsCleanup --- PASS: TestHATracker_MetricsCleanup (0.00s) === RUN TestCheckReplicaCleanup --- PASS: TestCheckReplicaCleanup (2.01s) === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_and_active === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_not_all_instances_active === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_all_instances_active === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_but_timeout_disabled_all_instances_active --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_and_active (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_not_all_instances_active (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_all_instances_active (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_but_timeout_disabled_all_instances_active (0.00s) === RUN TestMergeSamplesIntoFirstDuplicates --- PASS: TestMergeSamplesIntoFirstDuplicates (0.00s) === RUN TestMergeSamplesIntoFirst --- PASS: TestMergeSamplesIntoFirst (0.00s) === RUN TestMergeSamplesIntoFirstNilA --- PASS: TestMergeSamplesIntoFirstNilA (0.00s) === RUN TestMergeSamplesIntoFirstNilB --- PASS: TestMergeSamplesIntoFirstNilB (0.00s) === RUN TestMergeExemplars === RUN TestMergeExemplars/test0 === RUN TestMergeExemplars/test1 === RUN TestMergeExemplars/test2 === RUN TestMergeExemplars/test3 === RUN TestMergeExemplars/test4 === RUN TestMergeExemplars/test5 === RUN TestMergeExemplars/test6 --- PASS: TestMergeExemplars (0.01s) --- PASS: TestMergeExemplars/test0 (0.00s) --- PASS: TestMergeExemplars/test1 (0.00s) --- PASS: TestMergeExemplars/test2 (0.00s) --- PASS: TestMergeExemplars/test3 (0.00s) --- PASS: TestMergeExemplars/test4 (0.00s) --- PASS: TestMergeExemplars/test5 (0.00s) --- PASS: TestMergeExemplars/test6 (0.00s) === RUN TestIngestionRateStrategy === RUN TestIngestionRateStrategy/rate_limiter_should_share_the_limit_across_the_number_of_distributors === RUN TestIngestionRateStrategy/infinite_rate_limiter_should_return_unlimited_settings --- PASS: TestIngestionRateStrategy (0.01s) --- PASS: TestIngestionRateStrategy/rate_limiter_should_share_the_limit_across_the_number_of_distributors (0.01s) --- PASS: TestIngestionRateStrategy/infinite_rate_limiter_should_return_unlimited_settings (0.00s) === CONT TestHATrackerConfig_Validate === RUN TestHATrackerConfig_Validate/should_pass_with_default_config === RUN TestHATrackerConfig_Validate/should_fail_if_max_update_timeout_jitter_is_negative === RUN TestHATrackerConfig_Validate/should_fail_if_failover_timeout_is_<_update_timeout_+_jitter_+_1_sec === CONT TestCheckReplicaUpdateTimeoutJitter === RUN TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(with_jitter) === RUN TestHATrackerConfig_Validate/should_pass_if_failover_timeout_is_>=_update_timeout_+_jitter_+_1_sec === RUN TestHATrackerConfig_Validate/should_fail_if_KV_backend_is_set_to_memberlist === RUN TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(with_jitter) --- PASS: TestHATrackerConfig_Validate (0.01s) --- PASS: TestHATrackerConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestHATrackerConfig_Validate/should_fail_if_max_update_timeout_jitter_is_negative (0.00s) --- PASS: TestHATrackerConfig_Validate/should_fail_if_failover_timeout_is_<_update_timeout_+_jitter_+_1_sec (0.00s) --- PASS: TestHATrackerConfig_Validate/should_pass_if_failover_timeout_is_>=_update_timeout_+_jitter_+_1_sec (0.00s) --- PASS: TestHATrackerConfig_Validate/should_fail_if_KV_backend_is_set_to_memberlist (0.00s) === RUN TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(without_jitter) === RUN TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(without_jitter) --- PASS: TestCheckReplicaUpdateTimeoutJitter (2.01s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(with_jitter) (0.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(with_jitter) (1.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(without_jitter) (0.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(without_jitter) (1.00s) PASS ok github.com/grafana/mimir/pkg/distributor 58.497s ? github.com/grafana/mimir/pkg/distributor/distributorpb [no test files] === RUN TestForwardingSamplesSuccessfullyToSingleTarget --- PASS: TestForwardingSamplesSuccessfullyToSingleTarget (0.11s) === RUN TestForwardingOmitOldSamples === RUN TestForwardingOmitOldSamples/drop_nothing === RUN TestForwardingOmitOldSamples/drop_some_of_the_samples === RUN TestForwardingOmitOldSamples/split_one_sample_slice_in_the_middle === RUN TestForwardingOmitOldSamples/drop_all_of_the_samples --- PASS: TestForwardingOmitOldSamples (0.06s) --- PASS: TestForwardingOmitOldSamples/drop_nothing (0.02s) --- PASS: TestForwardingOmitOldSamples/drop_some_of_the_samples (0.03s) --- PASS: TestForwardingOmitOldSamples/split_one_sample_slice_in_the_middle (0.01s) --- PASS: TestForwardingOmitOldSamples/drop_all_of_the_samples (0.00s) === RUN TestForwardingEnsureThatPooledObjectsGetReturned === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_one_metric_and_don't_ingest_them === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_one_metric_and_ingest_them === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_and_don't_ingest_them === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_to_and_ingest_them === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_to_and_ingest_half_of_them_(1) === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_and_ingest_half_of_them_(2) === RUN TestForwardingEnsureThatPooledObjectsGetReturned/don't_forward_samples,_just_ingest_them --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned (0.08s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_one_metric_and_don't_ingest_them (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_one_metric_and_ingest_them (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_and_don't_ingest_them (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_to_and_ingest_them (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_to_and_ingest_half_of_them_(1) (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_and_ingest_half_of_them_(2) (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/don't_forward_samples,_just_ingest_them (0.00s) === RUN TestDropSamplesBefore === RUN TestDropSamplesBefore/no_samples === RUN TestDropSamplesBefore/all_samples_before_cutoff === RUN TestDropSamplesBefore/all_samples_after_cutoff === RUN TestDropSamplesBefore/cut_some_samples_off === RUN TestDropSamplesBefore/unsorted_sample_slice --- PASS: TestDropSamplesBefore (0.00s) --- PASS: TestDropSamplesBefore/no_samples (0.00s) --- PASS: TestDropSamplesBefore/all_samples_before_cutoff (0.00s) --- PASS: TestDropSamplesBefore/all_samples_after_cutoff (0.00s) --- PASS: TestDropSamplesBefore/cut_some_samples_off (0.00s) --- PASS: TestDropSamplesBefore/unsorted_sample_slice (0.00s) === RUN TestForwardingToHTTPGrpcTarget --- PASS: TestForwardingToHTTPGrpcTarget (0.13s) === RUN TestUsingPools --- PASS: TestUsingPools (0.00s) PASS ok github.com/grafana/mimir/pkg/distributor/forwarding 2.073s ? github.com/grafana/mimir/pkg/flusher [no test files] === RUN TestFrontend_RequestHostHeaderWhenDownstreamURLIsConfigured --- PASS: TestFrontend_RequestHostHeaderWhenDownstreamURLIsConfigured (0.23s) === RUN TestFrontend_LogsSlowQueriesFormValues --- PASS: TestFrontend_LogsSlowQueriesFormValues (0.09s) === RUN TestFrontend_ReturnsRequestBodyTooLargeError --- PASS: TestFrontend_ReturnsRequestBodyTooLargeError (0.07s) PASS ok github.com/grafana/mimir/pkg/frontend 1.977s === RUN TestRequest === RUN TestRequest/0 === RUN TestRequest/1 === RUN TestRequest/2 === RUN TestRequest/3 === RUN TestRequest/4 === RUN TestRequest/5 === RUN TestRequest/6 === RUN TestRequest/7 --- PASS: TestRequest (0.18s) --- PASS: TestRequest/0 (0.02s) --- PASS: TestRequest/1 (0.00s) --- PASS: TestRequest/2 (0.13s) --- PASS: TestRequest/3 (0.00s) --- PASS: TestRequest/4 (0.00s) --- PASS: TestRequest/5 (0.00s) --- PASS: TestRequest/6 (0.00s) --- PASS: TestRequest/7 (0.00s) === RUN TestDecodeFailedResponse === RUN TestDecodeFailedResponse/internal_error === RUN TestDecodeFailedResponse/too_many_requests === RUN TestDecodeFailedResponse/too_large_entry --- PASS: TestDecodeFailedResponse (0.03s) --- PASS: TestDecodeFailedResponse/internal_error (0.02s) --- PASS: TestDecodeFailedResponse/too_many_requests (0.00s) --- PASS: TestDecodeFailedResponse/too_large_entry (0.00s) === RUN TestResponseRoundtrip === RUN TestResponseRoundtrip/successful_string_response === RUN TestResponseRoundtrip/successful_scalar_response === RUN TestResponseRoundtrip/successful_instant_response === RUN TestResponseRoundtrip/successful_range_response === RUN TestResponseRoundtrip/successful_empty_matrix_response === RUN TestResponseRoundtrip/error_response --- PASS: TestResponseRoundtrip (0.12s) --- PASS: TestResponseRoundtrip/successful_string_response (0.05s) --- PASS: TestResponseRoundtrip/successful_scalar_response (0.02s) --- PASS: TestResponseRoundtrip/successful_instant_response (0.01s) --- PASS: TestResponseRoundtrip/successful_range_response (0.02s) --- PASS: TestResponseRoundtrip/successful_empty_matrix_response (0.00s) --- PASS: TestResponseRoundtrip/error_response (0.00s) === RUN TestMergeAPIResponses === RUN TestMergeAPIResponses/No_responses_shouldn't_panic_and_return_a_non-null_result_and_result_type. === RUN TestMergeAPIResponses/A_single_empty_response_shouldn't_panic. === RUN TestMergeAPIResponses/Multiple_empty_responses_shouldn't_panic. === RUN TestMergeAPIResponses/Basic_merging_of_two_responses. === RUN TestMergeAPIResponses/Merging_of_responses_when_labels_are_in_different_order. === RUN TestMergeAPIResponses/Merging_of_samples_where_there_is_single_overlap. === RUN TestMergeAPIResponses/Merging_of_samples_where_there_is_multiple_partial_overlaps. === RUN TestMergeAPIResponses/Merging_of_samples_where_there_is_complete_overlap. === RUN TestMergeAPIResponses/shouldn't_merge_unsuccessful_responses === RUN TestMergeAPIResponses/shouldn't_merge_nil_data === RUN TestMergeAPIResponses/shouldn't_merge_non-matrix_data --- PASS: TestMergeAPIResponses (0.02s) --- PASS: TestMergeAPIResponses/No_responses_shouldn't_panic_and_return_a_non-null_result_and_result_type. (0.00s) --- PASS: TestMergeAPIResponses/A_single_empty_response_shouldn't_panic. (0.00s) --- PASS: TestMergeAPIResponses/Multiple_empty_responses_shouldn't_panic. (0.00s) --- PASS: TestMergeAPIResponses/Basic_merging_of_two_responses. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_responses_when_labels_are_in_different_order. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_samples_where_there_is_single_overlap. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_samples_where_there_is_multiple_partial_overlaps. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_samples_where_there_is_complete_overlap. (0.00s) --- PASS: TestMergeAPIResponses/shouldn't_merge_unsuccessful_responses (0.00s) --- PASS: TestMergeAPIResponses/shouldn't_merge_nil_data (0.00s) --- PASS: TestMergeAPIResponses/shouldn't_merge_non-matrix_data (0.00s) === RUN Test_DecodeOptions === RUN Test_DecodeOptions/default === PAUSE Test_DecodeOptions/default === RUN Test_DecodeOptions/disable_cache === PAUSE Test_DecodeOptions/disable_cache === RUN Test_DecodeOptions/custom_sharding === PAUSE Test_DecodeOptions/custom_sharding === RUN Test_DecodeOptions/disable_sharding === PAUSE Test_DecodeOptions/disable_sharding === RUN Test_DecodeOptions/custom_instant_query_splitting === PAUSE Test_DecodeOptions/custom_instant_query_splitting === RUN Test_DecodeOptions/disable_instant_query_splitting === PAUSE Test_DecodeOptions/disable_instant_query_splitting === CONT Test_DecodeOptions/default === CONT Test_DecodeOptions/disable_sharding === CONT Test_DecodeOptions/disable_instant_query_splitting === CONT Test_DecodeOptions/custom_instant_query_splitting === CONT Test_DecodeOptions/custom_sharding === CONT Test_DecodeOptions/disable_cache --- PASS: Test_DecodeOptions (0.01s) --- PASS: Test_DecodeOptions/default (0.00s) --- PASS: Test_DecodeOptions/disable_sharding (0.00s) --- PASS: Test_DecodeOptions/disable_instant_query_splitting (0.00s) --- PASS: Test_DecodeOptions/custom_instant_query_splitting (0.00s) --- PASS: Test_DecodeOptions/custom_sharding (0.00s) --- PASS: Test_DecodeOptions/disable_cache (0.00s) === RUN TestLimitsMiddleware_MaxQueryLookback === RUN TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit === RUN TestLimitsMiddleware_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range === RUN TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_where_maxQueryLookback_is_past_the_retention_period === RUN TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_if_max_lookback_is_disabled === RUN TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range === RUN TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit --- PASS: TestLimitsMiddleware_MaxQueryLookback (0.07s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit (0.04s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_where_maxQueryLookback_is_past_the_retention_period (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_if_max_lookback_is_disabled (0.01s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit (0.00s) === RUN TestLimitsMiddleware_MaxQueryLength === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_large_time_range_close_to_the_limit,_ending_now === RUN TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_now === RUN TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_in_the_past === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_if_total_query_length_is_higher_than_query_length_limit === RUN TestLimitsMiddleware_MaxQueryLength/should_skip_validation_if_max_length_is_disabled === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_now === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_in_the_past --- PASS: TestLimitsMiddleware_MaxQueryLength (0.03s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_large_time_range_close_to_the_limit,_ending_now (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_now (0.01s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_in_the_past (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_if_total_query_length_is_higher_than_query_length_limit (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_skip_validation_if_max_length_is_disabled (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_now (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_in_the_past (0.00s) === RUN TestLimitedRoundTripper_MaxQueryParallelism --- PASS: TestLimitedRoundTripper_MaxQueryParallelism (0.27s) === RUN TestLimitedRoundTripper_MaxQueryParallelismLateScheduling --- PASS: TestLimitedRoundTripper_MaxQueryParallelismLateScheduling (0.00s) === RUN TestLimitedRoundTripper_OriginalRequestContextCancellation --- PASS: TestLimitedRoundTripper_OriginalRequestContextCancellation (0.10s) === RUN TestQueryShardingCorrectness === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation === PAUSE TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation === PAUSE TestQueryShardingCorrectness/histogram_quantile_without_aggregation === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without' === PAUSE TestQueryShardingCorrectness/sum(rate())_grouping_'without' === RUN TestQueryShardingCorrectness/vector() === PAUSE TestQueryShardingCorrectness/vector() === RUN TestQueryShardingCorrectness/stddev() === PAUSE TestQueryShardingCorrectness/stddev() === RUN TestQueryShardingCorrectness/sum(avg_over_time()) === PAUSE TestQueryShardingCorrectness/sum(avg_over_time()) === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset === PAUSE TestQueryShardingCorrectness/@_modifier_and_negative_offset === RUN TestQueryShardingCorrectness/sum_of_subquery_min === PAUSE TestQueryShardingCorrectness/sum_of_subquery_min === RUN TestQueryShardingCorrectness/@_modifier === PAUSE TestQueryShardingCorrectness/@_modifier === RUN TestQueryShardingCorrectness/@_modifier_and_offset === PAUSE TestQueryShardingCorrectness/@_modifier_and_offset === RUN TestQueryShardingCorrectness/string_literal === PAUSE TestQueryShardingCorrectness/string_literal === RUN TestQueryShardingCorrectness/sum()_offset === PAUSE TestQueryShardingCorrectness/sum()_offset === RUN TestQueryShardingCorrectness/sum(count()) === PAUSE TestQueryShardingCorrectness/sum(count()) === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar === PAUSE TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar === RUN TestQueryShardingCorrectness/stdvar() === PAUSE TestQueryShardingCorrectness/stdvar() === RUN TestQueryShardingCorrectness/avg()_grouping_'without' === PAUSE TestQueryShardingCorrectness/avg()_grouping_'without' === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1) === PAUSE TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1) === RUN TestQueryShardingCorrectness/double_subquery_deriv === PAUSE TestQueryShardingCorrectness/double_subquery_deriv === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) === PAUSE TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/sum({__name__!=""}) === PAUSE TestQueryShardingCorrectness/sum({__name__!=""}) === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping === PAUSE TestQueryShardingCorrectness/sum(rate())_no_grouping === RUN TestQueryShardingCorrectness/avg()_no_grouping === PAUSE TestQueryShardingCorrectness/avg()_no_grouping === RUN TestQueryShardingCorrectness/and === PAUSE TestQueryShardingCorrectness/and === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m])) === PAUSE TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m])) === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le === PAUSE TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le === RUN TestQueryShardingCorrectness/or === PAUSE TestQueryShardingCorrectness/or === RUN TestQueryShardingCorrectness/label_join === PAUSE TestQueryShardingCorrectness/label_join === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children === PAUSE TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""}) === PAUSE TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""}) === RUN TestQueryShardingCorrectness/sum(min_over_time()) === PAUSE TestQueryShardingCorrectness/sum(min_over_time()) === RUN TestQueryShardingCorrectness/nested_count() === PAUSE TestQueryShardingCorrectness/nested_count() === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order === PAUSE TestQueryShardingCorrectness/query_with_sort()_expects_specific_order === RUN TestQueryShardingCorrectness/0_<_bool_1 === PAUSE TestQueryShardingCorrectness/0_<_bool_1 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by' === PAUSE TestQueryShardingCorrectness/sum(rate())_grouping_'by' === RUN TestQueryShardingCorrectness/subquery_max === PAUSE TestQueryShardingCorrectness/subquery_max === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 === PAUSE TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg === PAUSE TestQueryShardingCorrectness/outer_subquery_on_top_of_avg === RUN TestQueryShardingCorrectness/sum()_no_grouping === PAUSE TestQueryShardingCorrectness/sum()_no_grouping === RUN TestQueryShardingCorrectness/count()_no_grouping === PAUSE TestQueryShardingCorrectness/count()_no_grouping === RUN TestQueryShardingCorrectness/max()_grouping_'without' === PAUSE TestQueryShardingCorrectness/max()_grouping_'without' === RUN TestQueryShardingCorrectness/avg()_grouping_'by' === PAUSE TestQueryShardingCorrectness/avg()_grouping_'by' === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) === PAUSE TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand === PAUSE TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand === RUN TestQueryShardingCorrectness/topk() === PAUSE TestQueryShardingCorrectness/topk() === RUN TestQueryShardingCorrectness/bottomk() === PAUSE TestQueryShardingCorrectness/bottomk() === RUN TestQueryShardingCorrectness/sum()_grouping_'by' === PAUSE TestQueryShardingCorrectness/sum()_grouping_'by' === RUN TestQueryShardingCorrectness/sum()_grouping_'without' === PAUSE TestQueryShardingCorrectness/sum()_grouping_'without' === RUN TestQueryShardingCorrectness/month(sum(metric_counter)) === PAUSE TestQueryShardingCorrectness/month(sum(metric_counter)) === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) === PAUSE TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/time() === PAUSE TestQueryShardingCorrectness/time() === RUN TestQueryShardingCorrectness/subquery_min === PAUSE TestQueryShardingCorrectness/subquery_min === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar === PAUSE TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) === PAUSE TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 === PAUSE TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) === PAUSE TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr === PAUSE TestQueryShardingCorrectness/subquery_min_over_time_with_aggr === RUN TestQueryShardingCorrectness/min()_grouping_'by' === PAUSE TestQueryShardingCorrectness/min()_grouping_'by' === RUN TestQueryShardingCorrectness/count()_grouping_'without' === PAUSE TestQueryShardingCorrectness/count()_grouping_'without' === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1 === PAUSE TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' === PAUSE TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' === PAUSE TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand === PAUSE TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping === PAUSE TestQueryShardingCorrectness/histogram_quantile()_no_grouping === RUN TestQueryShardingCorrectness/label_replace === PAUSE TestQueryShardingCorrectness/label_replace === RUN TestQueryShardingCorrectness/scalar(aggregation) === PAUSE TestQueryShardingCorrectness/scalar(aggregation) === RUN TestQueryShardingCorrectness/sum(max_over_time()) === PAUSE TestQueryShardingCorrectness/sum(max_over_time()) === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand === PAUSE TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant === PAUSE TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum === PAUSE TestQueryShardingCorrectness/outer_subquery_on_top_of_sum === RUN TestQueryShardingCorrectness/scalar(single_metric) === PAUSE TestQueryShardingCorrectness/scalar(single_metric) === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() === PAUSE TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/count()_grouping_'by' === PAUSE TestQueryShardingCorrectness/count()_grouping_'by' === RUN TestQueryShardingCorrectness/month()_>=_1_and_month() === PAUSE TestQueryShardingCorrectness/month()_>=_1_and_month() === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1 === PAUSE TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1 === RUN TestQueryShardingCorrectness/min()_grouping_'without' === PAUSE TestQueryShardingCorrectness/min()_grouping_'without' === RUN TestQueryShardingCorrectness/max()_no_grouping === PAUSE TestQueryShardingCorrectness/max()_no_grouping === RUN TestQueryShardingCorrectness/max()_grouping_'by' === PAUSE TestQueryShardingCorrectness/max()_grouping_'by' === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() === PAUSE TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() === RUN TestQueryShardingCorrectness/triple_subquery === PAUSE TestQueryShardingCorrectness/triple_subquery === RUN TestQueryShardingCorrectness/vector(1) === PAUSE TestQueryShardingCorrectness/vector(1) === RUN TestQueryShardingCorrectness/sum()_negative_offset === PAUSE TestQueryShardingCorrectness/sum()_negative_offset === RUN TestQueryShardingCorrectness/min()_no_grouping === PAUSE TestQueryShardingCorrectness/min()_no_grouping === CONT TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand === CONT TestQueryShardingCorrectness/histogram_quantile()_no_grouping === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/avg()_no_grouping === CONT TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum()_offset === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum(rate())_no_grouping === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum({__name__!=""}) === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/double_subquery_deriv === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1) === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/avg()_grouping_'without' === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/stdvar() === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum(count()) === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/query_with_sort()_expects_specific_order === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/avg()_grouping_'by' === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/max()_grouping_'without' === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/count()_no_grouping === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/sum()_no_grouping === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/outer_subquery_on_top_of_avg === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/subquery_max === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/sum(rate())_grouping_'by' === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/0_<_bool_1 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/month()_>=_1_and_month() === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/min()_no_grouping === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum()_negative_offset === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/vector(1) === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/triple_subquery === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/max()_grouping_'by' === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/max()_no_grouping === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/min()_grouping_'without' === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/count()_grouping_'without' === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/min()_grouping_'by' === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/subquery_min_over_time_with_aggr === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/outer_subquery_on_top_of_sum === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/count()_grouping_'by' === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/scalar(single_metric) === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/subquery_min === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/time() === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/nested_count() === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum(min_over_time()) === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""}) === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/@_modifier_and_negative_offset === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/string_literal === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/@_modifier_and_offset === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/@_modifier === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum_of_subquery_min === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum()_grouping_'by' === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/month(sum(metric_counter)) === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum()_grouping_'without' === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/bottomk() === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/topk() === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum(max_over_time()) === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/or === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/label_join === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/vector() === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum(avg_over_time()) === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/stddev() === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/scalar(aggregation) === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m])) === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/sum(rate())_grouping_'without' === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/and === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/histogram_quantile_without_aggregation === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/label_replace === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 --- PASS: TestQueryShardingCorrectness (0.83s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping (0.79s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.40s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.16s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.05s) --- PASS: TestQueryShardingCorrectness/sum()_offset (2.19s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest (0.63s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.16s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest (1.56s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.23s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.37s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.34s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand (2.28s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest (0.94s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.17s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.26s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.31s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest (1.34s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.17s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.28s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.28s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping (3.36s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (1.17s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.34s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.45s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (2.07s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.43s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.34s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.40s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.66s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping (3.58s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (1.01s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.15s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.31s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (2.57s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.69s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.43s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.42s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.46s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) (3.07s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest (1.23s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.40s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest (1.83s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.39s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.29s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.45s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.36s) --- PASS: TestQueryShardingCorrectness/stdvar() (1.60s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest (0.32s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.03s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest (1.29s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.27s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.24s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.34s) --- PASS: TestQueryShardingCorrectness/sum(count()) (2.15s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest (0.46s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.10s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.17s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest (1.69s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.23s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.38s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.41s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""}) (8.05s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest (2.66s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.50s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.73s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.56s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.58s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest (5.38s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.94s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.91s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.76s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.81s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without' (5.89s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.91s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.27s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.35s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (4.98s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.85s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.09s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.33s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.48s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without' (1.17s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.52s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.27s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (0.65s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.26s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar (6.93s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest (0.52s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest (6.40s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.80s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.73s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.82s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.64s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) (10.88s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest (1.68s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.25s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.28s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.55s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest (9.20s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (2.10s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.58s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.92s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.74s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by' (3.18s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (1.17s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.47s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.23s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.34s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (2.01s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.52s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.31s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.52s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.53s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg (0.47s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest (0.47s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.15s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping (1.77s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.54s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.17s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.08s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.12s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (1.23s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.21s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.18s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping (1.59s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.50s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (1.10s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.22s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.22s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1 (0.12s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest (0.03s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest (0.09s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month() (0.20s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest (0.08s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest (0.12s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping (0.92s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.35s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.13s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.52s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.06s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order (6.96s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest (1.92s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.41s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.56s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.29s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.45s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest (5.03s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.27s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.46s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.73s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.83s) --- PASS: TestQueryShardingCorrectness/vector(1) (0.08s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.04s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.04s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 (3.19s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest (0.75s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.23s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest (2.44s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.26s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.57s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.43s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.59s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset (1.64s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest (0.65s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.17s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest (0.99s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.19s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.31s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by' (3.04s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.54s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.15s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.10s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (2.49s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.60s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.44s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.34s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.46s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping (0.41s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.18s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.03s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.22s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.09s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by' (0.79s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.25s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.06s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.07s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (0.53s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() (2.07s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest (0.52s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest (1.50s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.28s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.30s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without' (0.99s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.34s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.07s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.15s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (0.64s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.17s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1 (1.62s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest (0.49s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.15s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest (1.13s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.16s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.18s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.31s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.27s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand (2.14s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest (0.70s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.11s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.38s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest (1.44s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.27s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.21s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.42s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' (8.18s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (2.31s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.61s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.37s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.39s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.43s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (5.87s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.57s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.76s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.66s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.91s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1 (1.15s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest (0.26s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.11s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest (0.89s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.23s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.26s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' (9.80s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (2.16s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.32s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.33s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.32s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.45s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (7.64s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.84s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.17s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.88s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.31s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by' (0.66s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.17s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.05s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (0.49s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without' (3.05s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.33s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.07s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.13s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (2.72s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.54s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.43s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.49s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.49s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series (13.94s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.91s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.14s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.38s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest (13.03s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (2.25s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (3.05s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (2.78s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (2.19s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr (2.36s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest (0.63s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.17s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.12s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest (1.73s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.39s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.33s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.26s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.46s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum (0.86s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest (0.86s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.35s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.08s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.23s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) (3.70s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest (0.82s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.26s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.26s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest (2.87s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.49s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.49s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.74s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.86s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 (3.34s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest (0.49s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.10s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.12s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest (2.86s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.57s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.55s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.65s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.64s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() (0.14s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest (0.02s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest (0.13s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.03s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric) (0.13s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest (0.06s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest (0.08s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) (0.19s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.06s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.13s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by' (2.42s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.84s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.24s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.28s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (1.57s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.20s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.21s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.45s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv (33.26s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest (4.22s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (1.08s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.55s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.81s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.96s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest (29.03s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (8.70s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (6.45s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (6.10s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (6.56s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) (1.40s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.53s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.86s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.14s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/time() (0.10s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest (0.03s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest (0.07s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.03s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series (4.19s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.44s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest (3.75s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.95s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.71s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.71s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.24s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children (2.99s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest (0.88s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.13s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.20s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.25s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.17s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest (2.11s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.60s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.56s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.40s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.26s) --- PASS: TestQueryShardingCorrectness/nested_count() (2.26s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest (0.41s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.17s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest (1.85s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.24s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.57s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.26s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.51s) --- PASS: TestQueryShardingCorrectness/subquery_max (29.00s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest (3.08s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.65s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.54s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.96s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.78s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest (25.91s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (6.70s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (6.62s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (6.23s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (5.76s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time()) (3.78s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest (0.71s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.34s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest (3.05s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.59s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.61s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.76s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.66s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset (1.47s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.16s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest (0.92s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.16s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.24s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.17s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.31s) --- PASS: TestQueryShardingCorrectness/string_literal (0.05s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest (0.05s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/triple_subquery (30.85s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest (3.81s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.76s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.81s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.78s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.93s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest (27.03s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (6.16s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (6.34s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (6.63s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (6.13s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""}) (5.60s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest (1.18s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.24s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.30s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.49s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest (4.41s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.94s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.66s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.72s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.70s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset (1.94s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest (0.61s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.11s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.15s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest (1.33s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.24s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.18s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.59s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by' (2.64s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.62s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (1.99s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.15s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.26s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.50s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.86s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le (8.52s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest (1.66s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.24s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.30s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.56s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.31s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest (6.85s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.72s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.08s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.68s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.92s) --- PASS: TestQueryShardingCorrectness/@_modifier (3.81s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest (1.61s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.25s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.24s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.35s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest (2.20s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.43s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.45s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.66s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.39s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation (49.68s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest (4.00s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.73s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.85s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.81s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.50s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest (45.68s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (8.92s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (8.49s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (8.36s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (8.93s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min (3.73s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest (0.93s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.17s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.23s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.31s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest (2.80s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.97s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.54s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.35s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.46s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter)) (1.37s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest (0.46s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.13s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.15s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest (0.91s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.21s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/bottomk() (1.17s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest (0.15s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest (1.02s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.19s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.24s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without' (2.72s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.44s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.13s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (2.27s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.33s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.54s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.56s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.61s) --- PASS: TestQueryShardingCorrectness/or (1.12s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest (0.40s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.17s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest (0.72s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.36s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time()) (3.26s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest (0.45s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.11s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest (2.81s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.55s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.60s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.55s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.72s) --- PASS: TestQueryShardingCorrectness/vector() (0.18s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest (0.09s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest (0.09s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/topk() (3.58s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest (0.09s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.03s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest (3.49s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.77s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.84s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.70s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.65s) --- PASS: TestQueryShardingCorrectness/label_join (1.69s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest (0.29s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.16s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest (1.39s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.27s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.25s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.30s) --- PASS: TestQueryShardingCorrectness/stddev() (1.43s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest (0.17s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.03s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.03s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest (1.23s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.24s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.29s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.27s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.15s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation) (1.50s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest (0.42s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.10s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest (1.08s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.22s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.21s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.32s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time()) (4.55s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest (0.59s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.26s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest (3.95s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.57s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.69s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.72s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.39s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without' (4.38s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (1.23s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.16s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.76s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (3.15s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.59s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.39s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.61s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.82s) --- PASS: TestQueryShardingCorrectness/and (2.98s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.13s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest (2.34s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.43s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.39s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.62s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.43s) --- PASS: TestQueryShardingCorrectness/label_replace (1.27s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest (0.37s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.13s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest (0.90s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.13s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/subquery_min (27.92s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest (2.28s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.23s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.49s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.42s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.90s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest (25.64s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (5.39s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (6.65s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (7.52s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (5.69s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m])) (9.14s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest (2.67s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.39s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.44s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.44s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (1.15s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest (6.47s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.68s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.86s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.74s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.55s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar (29.87s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest (1.63s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.40s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.43s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.34s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.37s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest (28.23s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (7.36s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (6.69s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (7.28s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (4.83s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation (5.15s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest (0.41s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.08s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.05s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest (4.73s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.93s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.37s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.89s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.80s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant (29.30s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest (2.04s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.50s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.43s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.45s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.47s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest (27.26s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (8.41s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (5.28s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (4.42s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (4.28s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1) (77.05s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest (4.61s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (1.17s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.76s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.94s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (1.27s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest (72.43s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (18.97s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (19.20s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (13.43s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (9.78s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand (29.42s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest (1.64s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.33s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.32s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.43s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.47s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest (27.76s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (9.35s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (4.22s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (6.61s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (3.93s) === RUN TestQueryshardingDeterminism --- PASS: TestQueryshardingDeterminism (0.71s) === RUN TestQuerySharding_FunctionCorrectness === RUN TestQuerySharding_FunctionCorrectness/(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/sum(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/count(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/sum(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/count(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/sum(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/count(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/sum(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/count(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/sum(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/count(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/sum(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/count(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) --- PASS: TestQuerySharding_FunctionCorrectness (9.71s) --- PASS: TestQuerySharding_FunctionCorrectness/(abs(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(abs(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(abs(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(abs(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(abs(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(avg_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(avg_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(avg_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(avg_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(avg_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(ceil(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(ceil(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ceil(bar1{})) (0.07s) --- PASS: TestQuerySharding_FunctionCorrectness/count(ceil(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(ceil(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(changes(bar1{}[1m])) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(changes(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(changes(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(changes(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(changes(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(count_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(count_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(count_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(count_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(count_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(days_in_month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(days_in_month(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(days_in_month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(days_in_month(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(days_in_month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(day_of_month(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(day_of_month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(day_of_month(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_month(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/(day_of_week(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(day_of_week(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_week(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(day_of_week(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_week(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(day_of_year(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(day_of_year(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_year(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(day_of_year(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_year(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/(delta(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(delta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(delta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(delta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(delta(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(deriv(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(deriv(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deriv(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(deriv(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(deriv(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(exp(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(exp(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(exp(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(exp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(exp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(floor(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(hour(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(hour(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(hour(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(hour(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(hour(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(idelta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(idelta(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(idelta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(idelta(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(idelta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(increase(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(increase(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(increase(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(increase(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(increase(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(irate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(irate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(irate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(irate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(irate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(ln(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(ln(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ln(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/count(ln(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(ln(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(log10(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(log10(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log10(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(log10(bar1{})) (0.07s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(log10(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(log2(bar1{})) (0.10s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(log2(bar1{})) (0.08s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log2(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(log2(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(log2(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(max_over_time(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(max_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(max_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(max_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(max_over_time(bar1{}[1m])) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/(min_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(min_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(min_over_time(bar1{}[1m])) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(min_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(min_over_time(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(minute(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(minute(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(minute(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(minute(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(minute(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(month(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(month(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(month(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/count(month(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(month(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(rate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(rate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(rate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(rate(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(resets(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(resets(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(resets(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(resets(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(resets(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(sort(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sort(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sort(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(sort_desc(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sort_desc(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort_desc(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sort_desc(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort_desc(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(sqrt(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sqrt(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sqrt(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sqrt(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sqrt(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(deg(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(deg(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deg(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(deg(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(deg(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(asinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(asinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asinh(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(asinh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(asinh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(rad(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(rad(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rad(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(rad(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(rad(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/(cosh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(cosh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cosh(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(cosh(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(cosh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/(atan(bar1{})) (0.08s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(atan(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atan(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/count(atan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(atan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(atanh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(atanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(atanh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(atanh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(asin(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(asin(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asin(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(asin(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(asin(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(sinh(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sinh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sinh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sinh(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sinh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/(cos(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(cos(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cos(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(cos(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(cos(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(acosh(bar1{})) (0.07s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(acosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acosh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(acosh(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(acosh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/(sin(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sin(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sin(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sin(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sin(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(tanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(tanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(tanh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(tanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(tan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(tan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tan(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(tan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(tan(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(acos(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(acos(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acos(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(acos(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(acos(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(stddev_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(stddev_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stddev_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(stddev_over_time(bar1{}[1m])) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(stddev_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(stdvar_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(stdvar_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stdvar_over_time(bar1{}[1m])) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(stdvar_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(stdvar_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sum_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sum_over_time(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(last_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(last_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(last_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(last_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(last_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(present_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(present_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(present_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(present_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(present_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.5,bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.5,bar1{}[1m])) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.5,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.99,bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.99,bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.99,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(timestamp(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(timestamp(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(timestamp(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(timestamp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(timestamp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(year(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(year(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(year(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(year(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(year(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(sgn(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sgn(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sgn(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sgn(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sgn(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(clamp(bar1{},5,10)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(clamp(bar1{},5,10)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp(bar1{},5,10)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(clamp(bar1{},5,10)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp(bar1{},5,10)) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(clamp_max(bar1{},5)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(clamp_max(bar1{},5)) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_max(bar1{},5)) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(clamp_max(bar1{},5)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_max(bar1{},5)) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/(clamp_min(bar1{},5)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(clamp_min(bar1{},5)) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_min(bar1{},5)) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(clamp_min(bar1{},5)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_min(bar1{},5)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(predict_linear(bar1{}[1m],1)) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(predict_linear(bar1{}[1m],1)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(predict_linear(bar1{}[1m],1)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(predict_linear(bar1{}[1m],1)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(predict_linear(bar1{}[1m],1)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(round(bar1{},20)) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(round(bar1{},20)) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(round(bar1{},20)) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(round(bar1{},20)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(round(bar1{},20)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(holt_winters(bar1{}[1m],0.5,0.7)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(holt_winters(bar1{}[1m],0.5,0.7)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(holt_winters(bar1{}[1m],0.5,0.7)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(label_join(bar1{},"fuzz",",","foo","bar")) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(label_join(bar1{},"fuzz",",","foo","bar")) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(label_join(bar1{},"fuzz",",","foo","bar")) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) (0.05s) === RUN TestQuerySharding_ShouldFallbackToDownstreamHandlerOnMappingFailure --- PASS: TestQuerySharding_ShouldFallbackToDownstreamHandlerOnMappingFailure (0.07s) === RUN TestQuerySharding_ShouldSkipShardingViaOption --- PASS: TestQuerySharding_ShouldSkipShardingViaOption (0.01s) === RUN TestQuerySharding_ShouldOverrideShardingSizeViaOption --- PASS: TestQuerySharding_ShouldOverrideShardingSizeViaOption (0.29s) === RUN TestQuerySharding_ShouldSupportMaxShardedQueries === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/query_sharding_is_disabled === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_1_shardable_leg === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_1_shardable_leg === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_no_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_3_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_10_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_14_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/query_is_not_shardable === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_many_shardable_legs === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_4_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_11_compactor_shards --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries (0.55s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/query_sharding_is_disabled (0.00s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_1_shardable_leg (0.04s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_1_shardable_leg (0.04s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs (0.04s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_no_compactor_shards (0.06s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_3_compactor_shards (0.05s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_10_compactor_shards (0.05s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_14_compactor_shards (0.06s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/query_is_not_shardable (0.00s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_many_shardable_legs (0.04s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_4_compactor_shards (0.07s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_11_compactor_shards (0.08s) === RUN TestQuerySharding_ShouldReturnErrorOnDownstreamHandlerFailure --- PASS: TestQuerySharding_ShouldReturnErrorOnDownstreamHandlerFailure (0.00s) === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_timeout === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_sample_limit === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_timeout === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_internal_error === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_prometheus_execution_error --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat (0.69s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_timeout (0.34s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_sample_limit (0.00s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_timeout (0.34s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_internal_error (0.01s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_prometheus_execution_error (0.00s) === RUN TestQuerySharding_EngineErrorMapping --- PASS: TestQuerySharding_EngineErrorMapping (0.10s) === RUN TestQuerySharding_WrapMultipleTime --- PASS: TestQuerySharding_WrapMultipleTime (0.00s) === RUN TestPromqlResultToSampleStreams === RUN TestPromqlResultToSampleStreams/[0] === RUN TestPromqlResultToSampleStreams/[1] === RUN TestPromqlResultToSampleStreams/[2] === RUN TestPromqlResultToSampleStreams/[3] === RUN TestPromqlResultToSampleStreams/[4] --- PASS: TestPromqlResultToSampleStreams (0.00s) --- PASS: TestPromqlResultToSampleStreams/[0] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[1] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[2] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[3] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[4] (0.00s) === RUN TestGenLabelsCorrectness --- PASS: TestGenLabelsCorrectness (0.00s) === RUN TestGenLabelsSize --- PASS: TestGenLabelsSize (0.00s) === RUN TestNewMockShardedqueryable --- PASS: TestNewMockShardedqueryable (0.00s) === RUN TestResultsCacheConfig_Validate === RUN TestResultsCacheConfig_Validate/should_fail_with_invalid_memcached_config === RUN TestResultsCacheConfig_Validate/should_fail_with_unsupported_backend === RUN TestResultsCacheConfig_Validate/should_pass_with_memcached_backend === RUN TestResultsCacheConfig_Validate/should_pass_with_default_config --- PASS: TestResultsCacheConfig_Validate (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_fail_with_invalid_memcached_config (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_fail_with_unsupported_backend (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_pass_with_memcached_backend (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_pass_with_default_config (0.00s) === RUN TestIsRequestCachable === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector_with_start()_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector_with_end()_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector_with_start()_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector_with_end()_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries_with_start()_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries_with_end()_after_maxCacheTime === RUN TestIsRequestCachable/positive_offset_on_vector_selector === RUN TestIsRequestCachable/negative_offset_on_vector_selector === RUN TestIsRequestCachable/positive_offset_on_subqueries === RUN TestIsRequestCachable/negative_offset_on_subqueries === RUN TestIsRequestCachable/request_that_is_step_aligned === RUN TestIsRequestCachable/request_that_is_NOT_step_aligned,_with_cacheStepUnaligned=false === RUN TestIsRequestCachable/request_that_is_NOT_step_aligned --- PASS: TestIsRequestCachable (0.01s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector_with_start()_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector_with_end()_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector_with_start()_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector_with_end()_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries_with_start()_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries_with_end()_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/positive_offset_on_vector_selector (0.00s) --- PASS: TestIsRequestCachable/negative_offset_on_vector_selector (0.00s) --- PASS: TestIsRequestCachable/positive_offset_on_subqueries (0.00s) --- PASS: TestIsRequestCachable/negative_offset_on_subqueries (0.00s) --- PASS: TestIsRequestCachable/request_that_is_step_aligned (0.00s) --- PASS: TestIsRequestCachable/request_that_is_NOT_step_aligned,_with_cacheStepUnaligned=false (0.00s) --- PASS: TestIsRequestCachable/request_that_is_NOT_step_aligned (0.00s) === RUN TestIsResponseCachable === RUN TestIsResponseCachable/does_not_contain_the_cacheControl_header === RUN TestIsResponseCachable/does_contain_the_cacheControl_header_which_has_the_value === RUN TestIsResponseCachable/cacheControl_header_contains_extra_values_but_still_good === RUN TestIsResponseCachable/broken_response === RUN TestIsResponseCachable/nil_headers === RUN TestIsResponseCachable/had_cacheControl_header_but_no_values --- PASS: TestIsResponseCachable (0.00s) --- PASS: TestIsResponseCachable/does_not_contain_the_cacheControl_header (0.00s) --- PASS: TestIsResponseCachable/does_contain_the_cacheControl_header_which_has_the_value (0.00s) --- PASS: TestIsResponseCachable/cacheControl_header_contains_extra_values_but_still_good (0.00s) --- PASS: TestIsResponseCachable/broken_response (0.00s) --- PASS: TestIsResponseCachable/nil_headers (0.00s) --- PASS: TestIsResponseCachable/had_cacheControl_header_but_no_values (0.00s) === RUN TestPartitionCacheExtents === RUN TestPartitionCacheExtents/Test_a_complete_hit. === RUN TestPartitionCacheExtents/Test_with_a_complete_miss. === RUN TestPartitionCacheExtents/Test_a_partial_hit. === RUN TestPartitionCacheExtents/Test_multiple_partial_hits. === RUN TestPartitionCacheExtents/Partial_hits_with_tiny_gap. === RUN TestPartitionCacheExtents/Extent_is_outside_the_range_and_the_request_has_a_single_step_(same_start_and_end). === RUN TestPartitionCacheExtents/Test_when_hit_has_a_large_step_and_only_a_single_sample_extent. === RUN TestPartitionCacheExtents/Start_time_of_all_requests_must_have_the_same_offset_into_the_step. --- PASS: TestPartitionCacheExtents (0.01s) --- PASS: TestPartitionCacheExtents/Test_a_complete_hit. (0.00s) --- PASS: TestPartitionCacheExtents/Test_with_a_complete_miss. (0.00s) --- PASS: TestPartitionCacheExtents/Test_a_partial_hit. (0.00s) --- PASS: TestPartitionCacheExtents/Test_multiple_partial_hits. (0.00s) --- PASS: TestPartitionCacheExtents/Partial_hits_with_tiny_gap. (0.00s) --- PASS: TestPartitionCacheExtents/Extent_is_outside_the_range_and_the_request_has_a_single_step_(same_start_and_end). (0.00s) --- PASS: TestPartitionCacheExtents/Test_when_hit_has_a_large_step_and_only_a_single_sample_extent. (0.00s) --- PASS: TestPartitionCacheExtents/Start_time_of_all_requests_must_have_the_same_offset_into_the_step. (0.00s) === RUN TestConstSplitter_generateCacheKey === PAUSE TestConstSplitter_generateCacheKey === RUN TestRetry === RUN TestRetry/retry_failures === RUN TestRetry/don't_retry_400s === RUN TestRetry/retry_500s === RUN TestRetry/last_error --- PASS: TestRetry (0.00s) --- PASS: TestRetry/retry_failures (0.00s) --- PASS: TestRetry/don't_retry_400s (0.00s) --- PASS: TestRetry/retry_500s (0.00s) --- PASS: TestRetry/last_error (0.00s) === RUN Test_RetryMiddlewareCancel --- PASS: Test_RetryMiddlewareCancel (0.00s) === RUN TestRangeTripperware === RUN TestRangeTripperware/0 === RUN TestRangeTripperware/1 --- PASS: TestRangeTripperware (0.11s) --- PASS: TestRangeTripperware/0 (0.03s) --- PASS: TestRangeTripperware/1 (0.03s) === RUN TestInstantTripperware === RUN TestInstantTripperware/happy_case_roundtrip === RUN TestInstantTripperware/default_time_param --- PASS: TestInstantTripperware (0.05s) --- PASS: TestInstantTripperware/happy_case_roundtrip (0.03s) --- PASS: TestInstantTripperware/default_time_param (0.01s) === RUN TestTripperware_Metrics === RUN TestTripperware_Metrics/start/end_is_aligned_to_step === RUN TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_disabled === RUN TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_enabled --- PASS: TestTripperware_Metrics (0.04s) --- PASS: TestTripperware_Metrics/start/end_is_aligned_to_step (0.02s) --- PASS: TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_disabled (0.01s) --- PASS: TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_enabled (0.01s) === RUN TestShardedQuerier_Select === RUN TestShardedQuerier_Select/errors_non_embedded_query === RUN TestShardedQuerier_Select/replaces_query === RUN TestShardedQuerier_Select/propagates_response_error === RUN TestShardedQuerier_Select/returns_SeriesSet --- PASS: TestShardedQuerier_Select (0.00s) --- PASS: TestShardedQuerier_Select/errors_non_embedded_query (0.00s) --- PASS: TestShardedQuerier_Select/replaces_query (0.00s) --- PASS: TestShardedQuerier_Select/propagates_response_error (0.00s) --- PASS: TestShardedQuerier_Select/returns_SeriesSet (0.00s) === RUN TestShardedQuerier_Select_ShouldConcurrentlyRunEmbeddedQueries --- PASS: TestShardedQuerier_Select_ShouldConcurrentlyRunEmbeddedQueries (0.00s) === RUN TestShardedQueryable_GetResponseHeaders --- PASS: TestShardedQueryable_GetResponseHeaders (0.01s) === RUN TestNewSeriesSetFromEmbeddedQueriesResults === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_add_a_stale_marker_at_the_end_even_if_if_input_samples_have_no_gaps === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_add_stale_markers_at_the_beginning_of_each_gap_and_one_at_the_end_of_the_series === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_hints_is_not_passed === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_step_==_0 --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_add_a_stale_marker_at_the_end_even_if_if_input_samples_have_no_gaps (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_add_stale_markers_at_the_beginning_of_each_gap_and_one_at_the_end_of_the_series (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_hints_is_not_passed (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_step_==_0 (0.00s) === RUN TestResponseToSamples --- PASS: TestResponseToSamples (0.00s) === RUN TestSplitAndCacheMiddleware_SplitByInterval --- PASS: TestSplitAndCacheMiddleware_SplitByInterval (0.03s) === RUN TestSplitAndCacheMiddleware_ResultsCache --- PASS: TestSplitAndCacheMiddleware_ResultsCache (0.01s) === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotLookupCacheIfStepIsNotAligned --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotLookupCacheIfStepIsNotAligned (0.01s) === RUN TestSplitAndCacheMiddleware_ResultsCache_EnabledCachingOfStepUnalignedRequest --- PASS: TestSplitAndCacheMiddleware_ResultsCache_EnabledCachingOfStepUnalignedRequest (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_not_cache_a_response_if_query_time_range_is_earlier_than_max_cache_freshness === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_cache_a_response_up_until_max_cache_freshness_time_ago --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness (0.01s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_not_cache_a_response_if_query_time_range_is_earlier_than_max_cache_freshness (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_cache_a_response_up_until_max_cache_freshness_time_ago (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy split_and_cache_test.go:617: random generator seed: 1669927622948620809 === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy (6.85s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) (12.67s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) (12.80s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) (12.71s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) (19.78s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) (7.19s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) (5.98s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) (33.21s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) (34.70s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) (8.95s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) (35.17s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) (23.02s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) (38.17s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) (19.27s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) (27.13s) === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_throw_error_if_complete-overlapped_smaller_Extent_is_erroneous === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_center-overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_replace_tiny_extents_that_are_cover_by_bigger_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_completely_overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_left-overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_right-overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_merge_fragmented_extents_if_request_fills_the_hole === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_left-extend_extent_if_request_starts_earlier_than_extent_in_cache === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_right-extend_extent_if_request_ends_later_than_extent_in_cache === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_drop_tiny_extent_that_overlaps_with_non-tiny_request_only --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases (0.02s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_throw_error_if_complete-overlapped_smaller_Extent_is_erroneous (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_center-overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_replace_tiny_extents_that_are_cover_by_bigger_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_completely_overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_left-overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_right-overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_merge_fragmented_extents_if_request_fills_the_hole (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_left-extend_extent_if_request_starts_earlier_than_extent_in_cache (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_right-extend_extent_if_request_ends_later_than_extent_in_cache (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_drop_tiny_extent_that_overlaps_with_non-tiny_request_only (0.00s) === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_but_empty_extents_on_cache_miss === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_and_some_extends_filled_up_on_partial_cache_hit === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_not_return_an_extent_if_its_key_doesn't_match_the_requested_one_(hash_collision) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents (0.00s) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_but_empty_extents_on_cache_miss (0.00s) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_and_some_extends_filled_up_on_partial_cache_hit (0.00s) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_not_return_an_extent_if_its_key_doesn't_match_the_requested_one_(hash_collision) (0.00s) === RUN TestSplitAndCacheMiddleware_WrapMultipleTimes --- PASS: TestSplitAndCacheMiddleware_WrapMultipleTimes (0.00s) === RUN TestSplitRequests_prepareDownstreamRequests === RUN TestSplitRequests_prepareDownstreamRequests/should_return_an_empty_slice_on_no_downstream_requests === RUN TestSplitRequests_prepareDownstreamRequests/should_inject_ID_and_hints_on_downstream_requests_and_return_them --- PASS: TestSplitRequests_prepareDownstreamRequests (0.00s) --- PASS: TestSplitRequests_prepareDownstreamRequests/should_return_an_empty_slice_on_no_downstream_requests (0.00s) --- PASS: TestSplitRequests_prepareDownstreamRequests/should_inject_ID_and_hints_on_downstream_requests_and_return_them (0.00s) === RUN TestSplitRequests_storeDownstreamResponses === RUN TestSplitRequests_storeDownstreamResponses/should_return_error_if_multiple_downstream_responses_have_the_same_ID === RUN TestSplitRequests_storeDownstreamResponses/should_return_error_if_extra_downstream_responses_are_requested_to_be_stored === RUN TestSplitRequests_storeDownstreamResponses/should_do_nothing_on_no_downstream_requests === RUN TestSplitRequests_storeDownstreamResponses/should_associate_downstream_responses_to_requests === RUN TestSplitRequests_storeDownstreamResponses/should_return_error_if_a_downstream_response_is_missing --- PASS: TestSplitRequests_storeDownstreamResponses (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_return_error_if_multiple_downstream_responses_have_the_same_ID (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_return_error_if_extra_downstream_responses_are_requested_to_be_stored (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_do_nothing_on_no_downstream_requests (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_associate_downstream_responses_to_requests (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_return_error_if_a_downstream_response_is_missing (0.00s) === RUN TestNextIntervalBoundary === RUN TestNextIntervalBoundary/0 === RUN TestNextIntervalBoundary/1 === RUN TestNextIntervalBoundary/2 === RUN TestNextIntervalBoundary/3 === RUN TestNextIntervalBoundary/4 === RUN TestNextIntervalBoundary/5 === RUN TestNextIntervalBoundary/6 === RUN TestNextIntervalBoundary/7 === RUN TestNextIntervalBoundary/8 === RUN TestNextIntervalBoundary/9 === RUN TestNextIntervalBoundary/10 === RUN TestNextIntervalBoundary/11 === RUN TestNextIntervalBoundary/12 === RUN TestNextIntervalBoundary/13 === RUN TestNextIntervalBoundary/14 === RUN TestNextIntervalBoundary/15 --- PASS: TestNextIntervalBoundary (0.01s) --- PASS: TestNextIntervalBoundary/0 (0.00s) --- PASS: TestNextIntervalBoundary/1 (0.00s) --- PASS: TestNextIntervalBoundary/2 (0.00s) --- PASS: TestNextIntervalBoundary/3 (0.00s) --- PASS: TestNextIntervalBoundary/4 (0.00s) --- PASS: TestNextIntervalBoundary/5 (0.00s) --- PASS: TestNextIntervalBoundary/6 (0.00s) --- PASS: TestNextIntervalBoundary/7 (0.00s) --- PASS: TestNextIntervalBoundary/8 (0.00s) --- PASS: TestNextIntervalBoundary/9 (0.00s) --- PASS: TestNextIntervalBoundary/10 (0.00s) --- PASS: TestNextIntervalBoundary/11 (0.00s) --- PASS: TestNextIntervalBoundary/12 (0.00s) --- PASS: TestNextIntervalBoundary/13 (0.00s) --- PASS: TestNextIntervalBoundary/14 (0.00s) --- PASS: TestNextIntervalBoundary/15 (0.00s) === RUN TestSplitQueryByInterval === RUN TestSplitQueryByInterval/0:_start:_0,_end:_3600000,_step:_15000 === RUN TestSplitQueryByInterval/1:_start:_0,_end:_3600000,_step:_15000 === RUN TestSplitQueryByInterval/2:_start:_0,_end:_86400000,_step:_15000 === RUN TestSplitQueryByInterval/3:_start:_0,_end:_10800000,_step:_15000 === RUN TestSplitQueryByInterval/4:_start:_0,_end:_172800000,_step:_15000 === RUN TestSplitQueryByInterval/5:_start:_0,_end:_21600000,_step:_15000 === RUN TestSplitQueryByInterval/6:_start:_10800000,_end:_259200000,_step:_15000 === RUN TestSplitQueryByInterval/7:_start:_7200000,_end:_32400000,_step:_15000 === RUN TestSplitQueryByInterval/8:_start:_1634255280000,_end:_1634256180000,_step:_300000 === RUN TestSplitQueryByInterval/9:_start:_1634255280000,_end:_1634256000000,_step:_360000 === RUN TestSplitQueryByInterval/10:_start:_1634248800000,_end:_1634508000000,_step:_86400000 === RUN TestSplitQueryByInterval/11:_start:_1634256000000,_end:_1634515200000,_step:_86400000 === RUN TestSplitQueryByInterval/12:_start:_1634335200000,_end:_1634875200000,_step:_108000000 === RUN TestSplitQueryByInterval/13:_start:_1634277600000,_end:_1634479200000,_step:_43200000 === RUN TestSplitQueryByInterval/14:_start:_1634277600000,_end:_1634493600000,_step:_43200000 === RUN TestSplitQueryByInterval/15:_start:_1634277600000,_end:_1634493600000,_step:_36000000 === RUN TestSplitQueryByInterval/16:_start:_1634277600000,_end:_1634457600000,_step:_36000000 --- PASS: TestSplitQueryByInterval (0.02s) --- PASS: TestSplitQueryByInterval/0:_start:_0,_end:_3600000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/1:_start:_0,_end:_3600000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/2:_start:_0,_end:_86400000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/3:_start:_0,_end:_10800000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/4:_start:_0,_end:_172800000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/5:_start:_0,_end:_21600000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/6:_start:_10800000,_end:_259200000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/7:_start:_7200000,_end:_32400000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/8:_start:_1634255280000,_end:_1634256180000,_step:_300000 (0.00s) --- PASS: TestSplitQueryByInterval/9:_start:_1634255280000,_end:_1634256000000,_step:_360000 (0.00s) --- PASS: TestSplitQueryByInterval/10:_start:_1634248800000,_end:_1634508000000,_step:_86400000 (0.00s) --- PASS: TestSplitQueryByInterval/11:_start:_1634256000000,_end:_1634515200000,_step:_86400000 (0.00s) --- PASS: TestSplitQueryByInterval/12:_start:_1634335200000,_end:_1634875200000,_step:_108000000 (0.00s) --- PASS: TestSplitQueryByInterval/13:_start:_1634277600000,_end:_1634479200000,_step:_43200000 (0.00s) --- PASS: TestSplitQueryByInterval/14:_start:_1634277600000,_end:_1634493600000,_step:_43200000 (0.00s) --- PASS: TestSplitQueryByInterval/15:_start:_1634277600000,_end:_1634493600000,_step:_36000000 (0.00s) --- PASS: TestSplitQueryByInterval/16:_start:_1634277600000,_end:_1634457600000,_step:_36000000 (0.00s) === RUN Test_evaluateAtModifier === RUN Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) === PAUSE Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) === RUN Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) === PAUSE Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) === RUN Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 === PAUSE Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 === RUN Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) === PAUSE Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) === RUN Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) === PAUSE Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) === CONT Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) === CONT Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) === CONT Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) === CONT Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) === CONT Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 --- PASS: Test_evaluateAtModifier (0.01s) --- PASS: Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) (0.00s) --- PASS: Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) (0.00s) --- PASS: Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 (0.00s) --- PASS: Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) (0.00s) === RUN TestSplitAndCacheMiddlewareLowerTTL --- PASS: TestSplitAndCacheMiddlewareLowerTTL (0.00s) === RUN TestInstantQuerySplittingCorrectness === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time() === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start() === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end()) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate()) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10 === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start() === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time() === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end()) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate()) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate) === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sgn === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sgn === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/delta === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_@_end()) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_only_'by'_le === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_-1m === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_min === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/exp === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/floor === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_30s === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/10_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/idelta === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time_offset_1m_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/present_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_join === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_join === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'without' === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time_@_`start`_offset_1m) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_max === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/round === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/round === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(1m)_/_rate(subquery)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort_desc === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sqrt === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_10 === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/changes === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(max(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_3m === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-2m === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/holt_winters === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/quantile_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate()_or_rate()) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/time() === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/vector(10) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ln === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(sum(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/predict_linear === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/log2 === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/irate === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_values(count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stdvar_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/deriv === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_replace === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_+_count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-30s === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(3m)_/_rate(3m)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_5m === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/increase === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time_@_start() === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(avg_over_time_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/last_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/resets === PAUSE TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/resets === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sgn === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-2m === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/deriv/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sgn/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/resets === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/resets/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/increase/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/round === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/round/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/changes/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_join === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_join/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/irate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/log2/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/exp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/time()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/idelta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/floor/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ln/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/delta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest --- PASS: TestInstantQuerySplittingCorrectness (24.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z (0.36s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable (0.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta/*querymiddleware.PrometheusInstantQueryRequest (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`) (0.37s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (0.37s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time (0.41s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.41s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear (0.46s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest (0.46s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m (0.34s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest (0.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt (0.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest (0.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m (0.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest (0.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5 (0.91s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (0.91s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate) (0.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2 (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2/*querymiddleware.PrometheusInstantQueryRequest (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())) (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m) (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time) (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor (0.87s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor/*querymiddleware.PrometheusInstantQueryRequest (0.87s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10) (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp (0.87s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp/*querymiddleware.PrometheusInstantQueryRequest (0.87s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort (0.74s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort/*querymiddleware.PrometheusInstantQueryRequest (0.73s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate/*querymiddleware.PrometheusInstantQueryRequest (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5 (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by' (0.10s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.10s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time) (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile (2.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest (2.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable (0.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.16s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start() (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable (0.23s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.23s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`) (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate (1.29s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest (1.29s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10 (0.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest (0.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without' (0.74s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.74s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by' (0.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end()) (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by' (0.80s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.80s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest (0.62s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate)) (0.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate()) (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s (0.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest (0.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate) (0.28s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.28s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by' (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time() (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time()/*querymiddleware.PrometheusInstantQueryRequest (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp (0.88s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp/*querymiddleware.PrometheusInstantQueryRequest (0.88s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round (1.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round/*querymiddleware.PrometheusInstantQueryRequest (1.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase (0.59s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase/*querymiddleware.PrometheusInstantQueryRequest (0.59s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace (0.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest (0.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time) (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate/*querymiddleware.PrometheusInstantQueryRequest (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by' (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent (0.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent/*querymiddleware.PrometheusInstantQueryRequest (0.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate) (0.17s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.17s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate) (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate) (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn/*querymiddleware.PrometheusInstantQueryRequest (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate) (0.36s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.36s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate) (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by' (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time) (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by' (0.48s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.48s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min (0.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest (0.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate)) (0.17s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.17s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln (1.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln/*querymiddleware.PrometheusInstantQueryRequest (1.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time (0.45s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.45s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join (0.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join/*querymiddleware.PrometheusInstantQueryRequest (0.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets/*querymiddleware.PrometheusInstantQueryRequest (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time (0.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m (1.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest (1.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate) (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end()) (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate()) (0.79s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest (0.79s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate) (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series (0.65s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.65s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear (0.94s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest (0.94s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate/*querymiddleware.PrometheusInstantQueryRequest (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time (1.11s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.11s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time (1.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10 (1.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest (1.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by' (0.25s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.25s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time (0.67s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.67s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time (0.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp (0.90s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp/*querymiddleware.PrometheusInstantQueryRequest (0.90s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate) (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets/*querymiddleware.PrometheusInstantQueryRequest (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate (1.04s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest (1.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes (0.70s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes/*querymiddleware.PrometheusInstantQueryRequest (0.70s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate) (0.17s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.17s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time (1.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor/*querymiddleware.PrometheusInstantQueryRequest (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate) (1.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (1.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time (0.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate) (0.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest (0.96s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by' (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.34s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta (0.82s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta/*querymiddleware.PrometheusInstantQueryRequest (0.82s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate) (0.49s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.49s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable (0.28s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.27s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable (0.25s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.25s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5 (1.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (1.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by' (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln/*querymiddleware.PrometheusInstantQueryRequest (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv/*querymiddleware.PrometheusInstantQueryRequest (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round/*querymiddleware.PrometheusInstantQueryRequest (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile (2.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest (2.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by' (0.27s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.27s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by' (0.46s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.46s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate)) (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate) (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`) (1.11s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (1.11s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time) (0.80s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.80s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`) (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by' (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time) (0.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s (1.11s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest (1.11s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join (0.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join/*querymiddleware.PrometheusInstantQueryRequest (0.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time() (0.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time()/*querymiddleware.PrometheusInstantQueryRequest (0.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without' (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m) (1.13s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest (1.13s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())) (0.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest (0.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by' (0.89s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.89s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate (1.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest (1.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate)) (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time) (1.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (1.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time (0.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10) (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2 (0.94s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2/*querymiddleware.PrometheusInstantQueryRequest (0.94s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp (0.90s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp/*querymiddleware.PrometheusInstantQueryRequest (0.90s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent (0.08s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent/*querymiddleware.PrometheusInstantQueryRequest (0.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start() (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate/*querymiddleware.PrometheusInstantQueryRequest (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time (0.60s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.60s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time) (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate) (0.17s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.17s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase (0.74s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase/*querymiddleware.PrometheusInstantQueryRequest (0.74s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta/*querymiddleware.PrometheusInstantQueryRequest (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time (0.81s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.81s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn (0.88s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn/*querymiddleware.PrometheusInstantQueryRequest (0.88s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort/*querymiddleware.PrometheusInstantQueryRequest (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5 (0.82s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (0.82s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent_over_time (0.08s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.08s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_values(count_over_time) (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stdvar_over_time (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/deriv (0.65s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/deriv/*querymiddleware.PrometheusInstantQueryRequest (0.65s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-2m (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/resets (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/resets/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sgn (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sgn/*querymiddleware.PrometheusInstantQueryRequest (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time (1.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate) (0.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/last_over_time (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(rate) (0.59s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.59s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/present_over_time (1.27s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.27s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort (1.28s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort/*querymiddleware.PrometheusInstantQueryRequest (1.28s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/increase (1.36s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/increase/*querymiddleware.PrometheusInstantQueryRequest (1.36s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'by' (1.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (1.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_5m (1.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest (1.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp (1.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp/*querymiddleware.PrometheusInstantQueryRequest (1.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_replace (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series (0.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.52s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate) (0.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(3m)_/_rate(3m)_>_0.5 (1.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (1.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev_over_time (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(max(rate)) (0.29s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.29s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate)_grouping_'by' (0.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(avg_over_time_@_`start`) (1.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (1.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-30s (1.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest (1.09s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time_@_start() (0.87s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest (0.87s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_3m (0.94s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest (0.94s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum(rate) (1.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (1.69s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate) (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/changes (0.66s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/changes/*querymiddleware.PrometheusInstantQueryRequest (0.66s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate)_grouping_'by' (0.30s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.30s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate) (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_join (0.13s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/label_join/*querymiddleware.PrometheusInstantQueryRequest (0.13s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())) (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_+_count_over_time) (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/round (1.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/round/*querymiddleware.PrometheusInstantQueryRequest (1.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_max (1.13s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest (1.13s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'without' (1.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (1.02s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time_@_`start`_offset_1m) (1.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest (1.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/irate (0.79s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/irate/*querymiddleware.PrometheusInstantQueryRequest (0.79s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/(avg_over_time) (1.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (1.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_10 (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sqrt (1.04s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest (1.04s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_@_end()) (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_grouping_'by' (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_rate (1.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest (1.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/predict_linear (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/log2 (1.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/log2/*querymiddleware.PrometheusInstantQueryRequest (1.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort_desc (0.81s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest (0.81s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable (0.29s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.29s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/vector(10) (0.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest (0.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/time() (0.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/time()/*querymiddleware.PrometheusInstantQueryRequest (0.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/exp (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/exp/*querymiddleware.PrometheusInstantQueryRequest (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(1m)_/_rate(subquery)_>_0.5 (1.08s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (1.08s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_min (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate (0.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/rate/*querymiddleware.PrometheusInstantQueryRequest (0.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate)_grouping_'by' (0.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent (0.10s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/absent/*querymiddleware.PrometheusInstantQueryRequest (0.10s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_-1m (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_only_'by'_le (0.91s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest (0.91s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time_offset_1m_@_`start`) (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/idelta (0.67s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/idelta/*querymiddleware.PrometheusInstantQueryRequest (0.67s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(avg_over_time) (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev(rate) (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate)_grouping_'by' (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/10_/_rate (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_30s (0.70s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest (0.68s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(sum(rate)) (0.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/floor (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/floor/*querymiddleware.PrometheusInstantQueryRequest (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_over_time (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate) (0.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/delta (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/delta/*querymiddleware.PrometheusInstantQueryRequest (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ln (0.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/ln/*querymiddleware.PrometheusInstantQueryRequest (0.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time (0.65s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.65s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/holt_winters (0.37s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest (0.37s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate()_or_rate()) (0.16s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest (0.16s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time (0.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate)_grouping_'by' (0.36s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/quantile_over_time (0.43s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.43s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile (2.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2022-12-01T20:47:49.733906716Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest (2.33s) === RUN TestInstantQuerySplittingHTTPOptions === RUN TestInstantQuerySplittingHTTPOptions/should_skip_instant_query_splitting_if_disabled_via_HTTP_option === RUN TestInstantQuerySplittingHTTPOptions/should_override_instant_query_splitting_interval_specified_in_HTTP_option --- PASS: TestInstantQuerySplittingHTTPOptions (0.03s) --- PASS: TestInstantQuerySplittingHTTPOptions/should_skip_instant_query_splitting_if_disabled_via_HTTP_option (0.01s) --- PASS: TestInstantQuerySplittingHTTPOptions/should_override_instant_query_splitting_interval_specified_in_HTTP_option (0.02s) === RUN TestStepAlignMiddleware === RUN TestStepAlignMiddleware/0 === RUN TestStepAlignMiddleware/1 --- PASS: TestStepAlignMiddleware (0.00s) --- PASS: TestStepAlignMiddleware/0 (0.00s) --- PASS: TestStepAlignMiddleware/1 (0.00s) === RUN TestIsRequestStepAligned === RUN TestIsRequestStepAligned/should_return_true_if_start_and_end_are_aligned_to_step === RUN TestIsRequestStepAligned/should_return_false_if_start_is_not_aligned_to_step === RUN TestIsRequestStepAligned/should_return_false_if_end_is_not_aligned_to_step === RUN TestIsRequestStepAligned/should_return_true_if_step_is_0 --- PASS: TestIsRequestStepAligned (0.01s) --- PASS: TestIsRequestStepAligned/should_return_true_if_start_and_end_are_aligned_to_step (0.00s) --- PASS: TestIsRequestStepAligned/should_return_false_if_start_is_not_aligned_to_step (0.00s) --- PASS: TestIsRequestStepAligned/should_return_false_if_end_is_not_aligned_to_step (0.00s) --- PASS: TestIsRequestStepAligned/should_return_true_if_step_is_0 (0.00s) === CONT TestConstSplitter_generateCacheKey === RUN TestConstSplitter_generateCacheKey/0_-_30m0s === RUN TestConstSplitter_generateCacheKey/<30m_-_30m0s === RUN TestConstSplitter_generateCacheKey/30m_-_30m0s === RUN TestConstSplitter_generateCacheKey/91m_-_30m0s === RUN TestConstSplitter_generateCacheKey/91m_5m_-_30m0s === RUN TestConstSplitter_generateCacheKey/0_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/<1d_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/4d_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/3d5h_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/1111m_-_1h0m0s --- PASS: TestConstSplitter_generateCacheKey (0.00s) --- PASS: TestConstSplitter_generateCacheKey/0_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/<30m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/30m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/91m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/91m_5m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/0_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/<1d_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/4d_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/3d5h_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/1111m_-_1h0m0s (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/querymiddleware 166.608s === RUN TestCloneExpr === RUN TestCloneExpr/[0] === RUN TestCloneExpr/[1] --- PASS: TestCloneExpr (0.06s) --- PASS: TestCloneExpr/[0] (0.02s) --- PASS: TestCloneExpr/[1] (0.00s) === RUN TestCloneExpr_String === RUN TestCloneExpr_String/[0] === RUN TestCloneExpr_String/[1] --- PASS: TestCloneExpr_String (0.01s) --- PASS: TestCloneExpr_String/[0] (0.00s) --- PASS: TestCloneExpr_String/[1] (0.00s) === RUN TestSharding_BinaryExpressionsDontTakeExponentialTime --- PASS: TestSharding_BinaryExpressionsDontTakeExponentialTime (0.11s) === RUN TestInstantSplitter === RUN TestInstantSplitter/avg_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/count_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/increase({app="foo"}[3m]) === RUN TestInstantSplitter/max_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/min_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/present_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/rate({app="foo"}[3m]) === RUN TestInstantSplitter/sum_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/absent(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/ceil(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/clamp(sum_over_time({app="foo"}[3m]),_1,_10) === RUN TestInstantSplitter/clamp_max(sum_over_time({app="foo"}[3m]),_10) === RUN TestInstantSplitter/clamp_min(sum_over_time({app="foo"}[3m]),_1) === RUN TestInstantSplitter/exp(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/floor(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/histogram_quantile(0.9,_sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/label_join(sum_over_time({app="foo"}[3m]),_"foo",_",",_"group_1",_"group_2",_"const") === RUN TestInstantSplitter/label_replace(sum_over_time({app="foo"}[3m]),_"foo",_"bar$1",_"group_2",_"(.*)") === RUN TestInstantSplitter/ln(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/log2(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/round(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/scalar(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sgn(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sort(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sort_desc(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sqrt(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/avg(rate({app="foo"}[3m])) === RUN TestInstantSplitter/avg_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/count(rate({app="foo"}[3m])) === RUN TestInstantSplitter/count_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/max(rate({app="foo"}[3m])) === RUN TestInstantSplitter/max_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/min(rate({app="foo"}[3m])) === RUN TestInstantSplitter/min_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/sum(rate({app="foo"}[3m])) === RUN TestInstantSplitter/sum_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/topk(10,_rate({app="foo"}[3m])) === RUN TestInstantSplitter/topk(10,_sum(rate({app="foo"}[3m]))) === RUN TestInstantSplitter/rate({app="foo"}[3m])_/_rate({app="baz"}[6m]) === RUN TestInstantSplitter/rate({app="foo"}[3m])_/_10 === RUN TestInstantSplitter/10_/_rate({app="foo"}[3m]) === RUN TestInstantSplitter/rate({app="foo"}[3m])_/_rate({app="foo"}[3m])_>_0.5 === RUN TestInstantSplitter/sum(sum_over_time({app="foo"}[3m])_+_count_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sum(sum_over_time({app="foo"}[3m])_+_count_over_time({app="foo"}[1m])) === RUN TestInstantSplitter/sum_over_time({app="foo"}[3m])_*_count_over_time({app="foo"}[1m]) === RUN TestInstantSplitter/sum(sum_over_time({app="foo"}[1m])_+_count_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sum_over_time({app="foo"}[1m])_*_count_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/(avg_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sum(avg_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/rate({app="foo"}[3m]_offset_3m) === RUN TestInstantSplitter/avg_over_time({app="foo"}[3m]_offset_5m) === RUN TestInstantSplitter/rate({app="foo"}[3m]_offset_30s) === RUN TestInstantSplitter/count_over_time({app="foo"}[3m]_offset_-3m) === RUN TestInstantSplitter/avg_over_time({app="foo"}[3m]_offset_-5m) === RUN TestInstantSplitter/count_over_time({app="foo"}[3m]_offset_-30s) === RUN TestInstantSplitter/rate({app="foo"}[3m]_@_start()) === RUN TestInstantSplitter/sum(sum_over_time({app="foo"}[3m]_@_end())) === RUN TestInstantSplitter/avg(avg_over_time({app="foo"}[3m]_@_1609746000)) === RUN TestInstantSplitter/max_over_time({app="foo"}[3m]_@_1609746000_offset_1m) === RUN TestInstantSplitter/max_over_time({app="foo"}[3m]_offset_1m_@_1609746000) === RUN TestInstantSplitter/topk(10,_histogram_quantile(0.9,_rate({app="foo"}[3m]))) === RUN TestInstantSplitter/stddev(rate(metric[3m])) === RUN TestInstantSplitter/count_values("dst",_count_over_time(metric[3m])) === RUN TestInstantSplitter/sum(max(rate({app="foo"}[3m]))) === RUN TestInstantSplitter/label_replace(sum(sum_over_time(up[1m])_+_count_over_time(up[3m])),_"dst",_"$1",_"src",_"(.*)") === RUN TestInstantSplitter/ceil(sum(sum_over_time(up[1m])_+_count_over_time(up[3m]))) --- PASS: TestInstantSplitter (0.47s) --- PASS: TestInstantSplitter/avg_over_time({app="foo"}[3m]) (0.01s) --- PASS: TestInstantSplitter/count_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/increase({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/max_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/min_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/present_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/sum_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/absent(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/ceil(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/clamp(sum_over_time({app="foo"}[3m]),_1,_10) (0.00s) --- PASS: TestInstantSplitter/clamp_max(sum_over_time({app="foo"}[3m]),_10) (0.00s) --- PASS: TestInstantSplitter/clamp_min(sum_over_time({app="foo"}[3m]),_1) (0.00s) --- PASS: TestInstantSplitter/exp(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/floor(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/histogram_quantile(0.9,_sum_over_time({app="foo"}[3m])) (0.02s) --- PASS: TestInstantSplitter/label_join(sum_over_time({app="foo"}[3m]),_"foo",_",",_"group_1",_"group_2",_"const") (0.00s) --- PASS: TestInstantSplitter/label_replace(sum_over_time({app="foo"}[3m]),_"foo",_"bar$1",_"group_2",_"(.*)") (0.00s) --- PASS: TestInstantSplitter/ln(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/log2(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/round(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/scalar(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sgn(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sort(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sort_desc(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sqrt(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/avg(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/avg_by_(bar)_(rate({app="foo"}[3m])) (0.03s) --- PASS: TestInstantSplitter/count(rate({app="foo"}[3m])) (0.03s) --- PASS: TestInstantSplitter/count_by_(bar)_(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/max(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/max_by_(bar)_(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/min(rate({app="foo"}[3m])) (0.04s) --- PASS: TestInstantSplitter/min_by_(bar)_(rate({app="foo"}[3m])) (0.01s) --- PASS: TestInstantSplitter/sum(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sum_by_(bar)_(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/topk(10,_rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/topk(10,_sum(rate({app="foo"}[3m]))) (0.00s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m])_/_rate({app="baz"}[6m]) (0.01s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m])_/_10 (0.00s) --- PASS: TestInstantSplitter/10_/_rate({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m])_/_rate({app="foo"}[3m])_>_0.5 (0.00s) --- PASS: TestInstantSplitter/sum(sum_over_time({app="foo"}[3m])_+_count_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sum(sum_over_time({app="foo"}[3m])_+_count_over_time({app="foo"}[1m])) (0.06s) --- PASS: TestInstantSplitter/sum_over_time({app="foo"}[3m])_*_count_over_time({app="foo"}[1m]) (0.00s) --- PASS: TestInstantSplitter/sum(sum_over_time({app="foo"}[1m])_+_count_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sum_over_time({app="foo"}[1m])_*_count_over_time({app="foo"}[3m]) (0.03s) --- PASS: TestInstantSplitter/(avg_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sum(avg_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m]_offset_3m) (0.00s) --- PASS: TestInstantSplitter/avg_over_time({app="foo"}[3m]_offset_5m) (0.02s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m]_offset_30s) (0.00s) --- PASS: TestInstantSplitter/count_over_time({app="foo"}[3m]_offset_-3m) (0.00s) --- PASS: TestInstantSplitter/avg_over_time({app="foo"}[3m]_offset_-5m) (0.00s) --- PASS: TestInstantSplitter/count_over_time({app="foo"}[3m]_offset_-30s) (0.00s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m]_@_start()) (0.00s) --- PASS: TestInstantSplitter/sum(sum_over_time({app="foo"}[3m]_@_end())) (0.02s) --- PASS: TestInstantSplitter/avg(avg_over_time({app="foo"}[3m]_@_1609746000)) (0.00s) --- PASS: TestInstantSplitter/max_over_time({app="foo"}[3m]_@_1609746000_offset_1m) (0.00s) --- PASS: TestInstantSplitter/max_over_time({app="foo"}[3m]_offset_1m_@_1609746000) (0.00s) --- PASS: TestInstantSplitter/topk(10,_histogram_quantile(0.9,_rate({app="foo"}[3m]))) (0.01s) --- PASS: TestInstantSplitter/stddev(rate(metric[3m])) (0.00s) --- PASS: TestInstantSplitter/count_values("dst",_count_over_time(metric[3m])) (0.00s) --- PASS: TestInstantSplitter/sum(max(rate({app="foo"}[3m]))) (0.00s) --- PASS: TestInstantSplitter/label_replace(sum(sum_over_time(up[1m])_+_count_over_time(up[3m])),_"dst",_"$1",_"src",_"(.*)") (0.00s) --- PASS: TestInstantSplitter/ceil(sum(sum_over_time(up[1m])_+_count_over_time(up[3m]))) (0.00s) === RUN TestInstantSplitterUnevenRangeInterval === RUN TestInstantSplitterUnevenRangeInterval/rate({app="foo"}[5m]) === RUN TestInstantSplitterUnevenRangeInterval/avg_over_time({app="foo"}[3m]) === RUN TestInstantSplitterUnevenRangeInterval/sum_over_time({app="foo"}[4m]_offset_1m) === RUN TestInstantSplitterUnevenRangeInterval/count_over_time({app="foo"}[3m]_offset_1m) --- PASS: TestInstantSplitterUnevenRangeInterval (0.02s) --- PASS: TestInstantSplitterUnevenRangeInterval/rate({app="foo"}[5m]) (0.02s) --- PASS: TestInstantSplitterUnevenRangeInterval/avg_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterUnevenRangeInterval/sum_over_time({app="foo"}[4m]_offset_1m) (0.00s) --- PASS: TestInstantSplitterUnevenRangeInterval/count_over_time({app="foo"}[3m]_offset_1m) (0.00s) === RUN TestInstantSplitterSkippedQueryReason === RUN TestInstantSplitterSkippedQueryReason/absent_over_time({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/changes({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/delta({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/deriv({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/holt_winters({app="foo"}[3m],_1,_10) === RUN TestInstantSplitterSkippedQueryReason/idelta({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/irate({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/last_over_time({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/predict_linear({app="foo"}[3m],_1) === RUN TestInstantSplitterSkippedQueryReason/quantile_over_time(0.95,_foo[3m]) === RUN TestInstantSplitterSkippedQueryReason/resets(foo[3m]) === RUN TestInstantSplitterSkippedQueryReason/stddev_over_time(foo[3m]) === RUN TestInstantSplitterSkippedQueryReason/stdvar_over_time(foo[3m]) === RUN TestInstantSplitterSkippedQueryReason/time() === RUN TestInstantSplitterSkippedQueryReason/vector(10) === RUN TestInstantSplitterSkippedQueryReason/topk(10,_histogram_quantile(0.9,_delta({app="foo"}[3m]))) === RUN TestInstantSplitterSkippedQueryReason/rate({app="foo"}[1m]) === RUN TestInstantSplitterSkippedQueryReason/5 === RUN TestInstantSplitterSkippedQueryReason/20_/_10 === RUN TestInstantSplitterSkippedQueryReason/(20_/_10) === RUN TestInstantSplitterSkippedQueryReason/(20)_/_(10) === RUN TestInstantSplitterSkippedQueryReason/time()_!=_bool_0 === RUN TestInstantSplitterSkippedQueryReason/rate({app="foo"}[1m])_/_rate({app="bar"}[5h:5m])_>_0.5 === RUN TestInstantSplitterSkippedQueryReason/sum(rate({app="foo"}[1h:5m])_*_60)_by_(bar) === RUN TestInstantSplitterSkippedQueryReason/sum_over_time(metric_counter[1h:5m]) === RUN TestInstantSplitterSkippedQueryReason/sum(rate(metric_counter[30m:5s])) === RUN TestInstantSplitterSkippedQueryReason/sum_over_time((metric_counter[30m:5s])) === RUN TestInstantSplitterSkippedQueryReason/sum_over_time((((metric_counter[30m:5s])))) === RUN TestInstantSplitterSkippedQueryReason/quantile_over_time(1,_metric_counter[10m:1m]) === RUN TestInstantSplitterSkippedQueryReason/sum(avg_over_time(metric_counter[1h:5m]))_by_(bar) === RUN TestInstantSplitterSkippedQueryReason/min_over_time(sum_by(group_1)_(rate(metric_counter[5m]))[10m:2m]) === RUN TestInstantSplitterSkippedQueryReason/max_over_time(stddev_over_time(deriv(rate(metric_counter[10m])[5m:1m])[2m:])[10m:]) === RUN TestInstantSplitterSkippedQueryReason/rate(sum_by(group_1)_(rate(metric_counter[5m]))[10m:]) === RUN TestInstantSplitterSkippedQueryReason/absent_over_time(rate(metric_counter[5m])[10m:]) === RUN TestInstantSplitterSkippedQueryReason/max_over_time(stddev_over_time(deriv(sort(metric_counter)[5m:1m])[2m:])[10m:]) === RUN TestInstantSplitterSkippedQueryReason/max_over_time(absent_over_time(deriv(rate(metric_counter[1m])[5m:1m])[2m:])[10m:]) --- PASS: TestInstantSplitterSkippedQueryReason (0.06s) --- PASS: TestInstantSplitterSkippedQueryReason/absent_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/changes({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/delta({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/deriv({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/holt_winters({app="foo"}[3m],_1,_10) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/idelta({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/irate({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/last_over_time({app="foo"}[3m]) (0.01s) --- PASS: TestInstantSplitterSkippedQueryReason/predict_linear({app="foo"}[3m],_1) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/quantile_over_time(0.95,_foo[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/resets(foo[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/stddev_over_time(foo[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/stdvar_over_time(foo[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/time() (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/vector(10) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/topk(10,_histogram_quantile(0.9,_delta({app="foo"}[3m]))) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/rate({app="foo"}[1m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/5 (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/20_/_10 (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/(20_/_10) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/(20)_/_(10) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/time()_!=_bool_0 (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/rate({app="foo"}[1m])_/_rate({app="bar"}[5h:5m])_>_0.5 (0.02s) --- PASS: TestInstantSplitterSkippedQueryReason/sum(rate({app="foo"}[1h:5m])_*_60)_by_(bar) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum_over_time(metric_counter[1h:5m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum(rate(metric_counter[30m:5s])) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum_over_time((metric_counter[30m:5s])) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum_over_time((((metric_counter[30m:5s])))) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/quantile_over_time(1,_metric_counter[10m:1m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum(avg_over_time(metric_counter[1h:5m]))_by_(bar) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/min_over_time(sum_by(group_1)_(rate(metric_counter[5m]))[10m:2m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/max_over_time(stddev_over_time(deriv(rate(metric_counter[10m])[5m:1m])[2m:])[10m:]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/rate(sum_by(group_1)_(rate(metric_counter[5m]))[10m:]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/absent_over_time(rate(metric_counter[5m])[10m:]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/max_over_time(stddev_over_time(deriv(sort(metric_counter)[5m:1m])[2m:])[10m:]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/max_over_time(absent_over_time(deriv(rate(metric_counter[1m])[5m:1m])[2m:])[10m:]) (0.00s) === RUN TestGetRangeIntervals === RUN TestGetRangeIntervals/time() === RUN TestGetRangeIntervals/sum(rate(metric[1m])) === RUN TestGetRangeIntervals/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) === RUN TestGetRangeIntervals/sum_over_time(rate(metric[1m])[1h:5m]) --- PASS: TestGetRangeIntervals (0.00s) --- PASS: TestGetRangeIntervals/time() (0.00s) --- PASS: TestGetRangeIntervals/sum(rate(metric[1m])) (0.00s) --- PASS: TestGetRangeIntervals/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) (0.00s) --- PASS: TestGetRangeIntervals/sum_over_time(rate(metric[1m])[1h:5m]) (0.00s) === RUN TestUpdateRangeInterval === RUN TestUpdateRangeInterval/time() === RUN TestUpdateRangeInterval/sum(rate(metric[1m])) === RUN TestUpdateRangeInterval/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*")) === RUN TestUpdateRangeInterval/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) === RUN TestUpdateRangeInterval/sum(rate(metric[1m]))#01 --- PASS: TestUpdateRangeInterval (0.01s) --- PASS: TestUpdateRangeInterval/time() (0.00s) --- PASS: TestUpdateRangeInterval/sum(rate(metric[1m])) (0.00s) --- PASS: TestUpdateRangeInterval/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*")) (0.00s) --- PASS: TestUpdateRangeInterval/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) (0.00s) --- PASS: TestUpdateRangeInterval/sum(rate(metric[1m]))#01 (0.00s) === RUN TestUpdateOffset === RUN TestUpdateOffset/time() === RUN TestUpdateOffset/sum(rate(metric[1m])) === RUN TestUpdateOffset/sum(rate(metric[1m]))#01 === RUN TestUpdateOffset/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*")) === RUN TestUpdateOffset/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*"))#01 === RUN TestUpdateOffset/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) --- PASS: TestUpdateOffset (0.00s) --- PASS: TestUpdateOffset/time() (0.00s) --- PASS: TestUpdateOffset/sum(rate(metric[1m])) (0.00s) --- PASS: TestUpdateOffset/sum(rate(metric[1m]))#01 (0.00s) --- PASS: TestUpdateOffset/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*")) (0.00s) --- PASS: TestUpdateOffset/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*"))#01 (0.00s) --- PASS: TestUpdateOffset/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) (0.00s) === RUN TestGetOffsets === RUN TestGetOffsets/time() === RUN TestGetOffsets/sum(rate(metric[5m]_offset_1m)) === RUN TestGetOffsets/sum(rate(metric[5m]_offset_3m))_+_sum(rate(metric[5m]_offset_5m)) === RUN TestGetOffsets/rate(metric[5m]_offset_5s) === RUN TestGetOffsets/avg_over_time(metric[5m]_offset_-5m) === RUN TestGetOffsets/sum_over_time(rate(metric[5m]_offset_3s)[1h:5m]_offset_1m) --- PASS: TestGetOffsets (0.00s) --- PASS: TestGetOffsets/time() (0.00s) --- PASS: TestGetOffsets/sum(rate(metric[5m]_offset_1m)) (0.00s) --- PASS: TestGetOffsets/sum(rate(metric[5m]_offset_3m))_+_sum(rate(metric[5m]_offset_5m)) (0.00s) --- PASS: TestGetOffsets/rate(metric[5m]_offset_5s) (0.00s) --- PASS: TestGetOffsets/avg_over_time(metric[5m]_offset_-5m) (0.00s) --- PASS: TestGetOffsets/sum_over_time(rate(metric[5m]_offset_3s)[1h:5m]_offset_1m) (0.00s) === RUN TestCanParallel === RUN TestCanParallel/[0] === RUN TestCanParallel/[1] === RUN TestCanParallel/[2] --- PASS: TestCanParallel (0.01s) --- PASS: TestCanParallel/[0] (0.00s) --- PASS: TestCanParallel/[1] (0.00s) --- PASS: TestCanParallel/[2] (0.00s) === RUN TestCanParallel_String === RUN TestCanParallel_String/[0] === RUN TestCanParallel_String/[1] === RUN TestCanParallel_String/[2] === RUN TestCanParallel_String/[3] === RUN TestCanParallel_String/[4] === RUN TestCanParallel_String/[5] === RUN TestCanParallel_String/[6] === RUN TestCanParallel_String/[7] === RUN TestCanParallel_String/[8] === RUN TestCanParallel_String/[9] === RUN TestCanParallel_String/[10] --- PASS: TestCanParallel_String (0.06s) --- PASS: TestCanParallel_String/[0] (0.00s) --- PASS: TestCanParallel_String/[1] (0.01s) --- PASS: TestCanParallel_String/[2] (0.00s) --- PASS: TestCanParallel_String/[3] (0.00s) --- PASS: TestCanParallel_String/[4] (0.00s) --- PASS: TestCanParallel_String/[5] (0.00s) --- PASS: TestCanParallel_String/[6] (0.00s) --- PASS: TestCanParallel_String/[7] (0.04s) --- PASS: TestCanParallel_String/[8] (0.00s) --- PASS: TestCanParallel_String/[9] (0.00s) --- PASS: TestCanParallel_String/[10] (0.00s) === RUN TestFunctionsWithDefaultsIsUpToDate === RUN TestFunctionsWithDefaultsIsUpToDate/abs === RUN TestFunctionsWithDefaultsIsUpToDate/clamp_max === RUN TestFunctionsWithDefaultsIsUpToDate/deriv === RUN TestFunctionsWithDefaultsIsUpToDate/last_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/sin === RUN TestFunctionsWithDefaultsIsUpToDate/sinh === RUN TestFunctionsWithDefaultsIsUpToDate/asin === RUN TestFunctionsWithDefaultsIsUpToDate/avg_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/cosh === RUN TestFunctionsWithDefaultsIsUpToDate/stddev_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/asinh === RUN TestFunctionsWithDefaultsIsUpToDate/ceil === RUN TestFunctionsWithDefaultsIsUpToDate/cos === RUN TestFunctionsWithDefaultsIsUpToDate/holt_winters === RUN TestFunctionsWithDefaultsIsUpToDate/min_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/rad === RUN TestFunctionsWithDefaultsIsUpToDate/absent_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/delta === RUN TestFunctionsWithDefaultsIsUpToDate/label_replace === RUN TestFunctionsWithDefaultsIsUpToDate/quantile_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/scalar === RUN TestFunctionsWithDefaultsIsUpToDate/timestamp === RUN TestFunctionsWithDefaultsIsUpToDate/label_join === RUN TestFunctionsWithDefaultsIsUpToDate/rate === RUN TestFunctionsWithDefaultsIsUpToDate/exp === RUN TestFunctionsWithDefaultsIsUpToDate/log2 === RUN TestFunctionsWithDefaultsIsUpToDate/vector === RUN TestFunctionsWithDefaultsIsUpToDate/clamp_min === RUN TestFunctionsWithDefaultsIsUpToDate/days_in_month === RUN TestFunctionsWithDefaultsIsUpToDate/day_of_year === RUN TestFunctionsWithDefaultsIsUpToDate/deg === RUN TestFunctionsWithDefaultsIsUpToDate/hour === RUN TestFunctionsWithDefaultsIsUpToDate/increase === RUN TestFunctionsWithDefaultsIsUpToDate/round === RUN TestFunctionsWithDefaultsIsUpToDate/sum_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/sqrt === RUN TestFunctionsWithDefaultsIsUpToDate/atanh === RUN TestFunctionsWithDefaultsIsUpToDate/day_of_week === RUN TestFunctionsWithDefaultsIsUpToDate/histogram_quantile === RUN TestFunctionsWithDefaultsIsUpToDate/max_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/pi === RUN TestFunctionsWithDefaultsIsUpToDate/predict_linear === RUN TestFunctionsWithDefaultsIsUpToDate/resets === RUN TestFunctionsWithDefaultsIsUpToDate/absent === RUN TestFunctionsWithDefaultsIsUpToDate/acos === RUN TestFunctionsWithDefaultsIsUpToDate/sgn === RUN TestFunctionsWithDefaultsIsUpToDate/sort === RUN TestFunctionsWithDefaultsIsUpToDate/stdvar_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/tan === RUN TestFunctionsWithDefaultsIsUpToDate/atan === RUN TestFunctionsWithDefaultsIsUpToDate/day_of_month === RUN TestFunctionsWithDefaultsIsUpToDate/irate === RUN TestFunctionsWithDefaultsIsUpToDate/month === RUN TestFunctionsWithDefaultsIsUpToDate/tanh === RUN TestFunctionsWithDefaultsIsUpToDate/idelta === RUN TestFunctionsWithDefaultsIsUpToDate/minute === RUN TestFunctionsWithDefaultsIsUpToDate/acosh === RUN TestFunctionsWithDefaultsIsUpToDate/count_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/present_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/changes === RUN TestFunctionsWithDefaultsIsUpToDate/ln === RUN TestFunctionsWithDefaultsIsUpToDate/log10 === RUN TestFunctionsWithDefaultsIsUpToDate/floor === RUN TestFunctionsWithDefaultsIsUpToDate/year === RUN TestFunctionsWithDefaultsIsUpToDate/clamp === RUN TestFunctionsWithDefaultsIsUpToDate/sort_desc === RUN TestFunctionsWithDefaultsIsUpToDate/time --- PASS: TestFunctionsWithDefaultsIsUpToDate (0.02s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/abs (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/clamp_max (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/deriv (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/last_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sin (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sinh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/asin (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/avg_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/cosh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/stddev_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/asinh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/ceil (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/cos (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/holt_winters (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/min_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/rad (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/absent_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/delta (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/label_replace (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/quantile_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/scalar (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/timestamp (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/label_join (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/rate (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/exp (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/log2 (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/vector (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/clamp_min (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/days_in_month (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/day_of_year (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/deg (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/hour (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/increase (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/round (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sum_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sqrt (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/atanh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/day_of_week (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/histogram_quantile (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/max_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/pi (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/predict_linear (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/resets (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/absent (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/acos (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sgn (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sort (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/stdvar_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/tan (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/atan (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/day_of_month (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/irate (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/month (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/tanh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/idelta (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/minute (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/acosh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/count_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/present_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/changes (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/ln (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/log10 (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/floor (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/year (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/clamp (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sort_desc (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/time (0.00s) === RUN TestCountVectorSelectors === RUN TestCountVectorSelectors/input_expr_contains_multiple_vector_selectors === RUN TestCountVectorSelectors/no_vector_selectors === RUN TestCountVectorSelectors/input_is_a_vector_selector === RUN TestCountVectorSelectors/input_expr_contains_a_vector_selector --- PASS: TestCountVectorSelectors (0.00s) --- PASS: TestCountVectorSelectors/input_expr_contains_multiple_vector_selectors (0.00s) --- PASS: TestCountVectorSelectors/no_vector_selectors (0.00s) --- PASS: TestCountVectorSelectors/input_is_a_vector_selector (0.00s) --- PASS: TestCountVectorSelectors/input_expr_contains_a_vector_selector (0.00s) === RUN TestShardSummer === RUN TestShardSummer/quantile(0.9,foo) === RUN TestShardSummer/absent(foo) === RUN TestShardSummer/absent_over_time(foo[1m]) === RUN TestShardSummer/histogram_quantile(0.5,_rate(bar1{baz="blip"}[30s])) === RUN TestShardSummer/sum_by_(foo)_(histogram_quantile(0.9,_rate(http_request_duration_seconds_bucket[10m]))) === RUN TestShardSummer/sum_by_(foo,bar)_(min_over_time(bar1{baz="blip"}[1m])) === RUN TestShardSummer/sum(rate(bar1[1m]))_or_rate(bar2[1m]) === RUN TestShardSummer/sum(rate(bar1[1m]))_or_sum(rate(bar2[1m])) === RUN TestShardSummer/histogram_quantile(0.5,_sum(rate(cortex_cache_value_size_bytes_bucket[5m]))_by_(le)) === RUN TestShardSummer/sum(_______count(_________count(___________bar1_________)__by_(drive,instance)_______)__by_(instance)_____) === RUN TestShardSummer/sum(rate(foo[1m])) === RUN TestShardSummer/count(rate(foo[1m])) === RUN TestShardSummer/count(up) === RUN TestShardSummer/avg(count(test)) === RUN TestShardSummer/count_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/count_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/max(rate(foo[1m])) === RUN TestShardSummer/max_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/max_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/sum_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/sum_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/avg_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/avg_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/avg(rate(foo[1m])) === RUN TestShardSummer/topk(10,avg_by_(foo)(rate(foo[1m]))) === RUN TestShardSummer/min_over_time(metric_counter[5m]) === RUN TestShardSummer/sum_by_(user,_cluster,_namespace)_(quantile_over_time(0.99,_cortex_ingester_active_series[7d])) === RUN TestShardSummer/min_over_time(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:2m]____) === RUN TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:]) === RUN TestShardSummer/max_over_time((_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:])) === RUN TestShardSummer/rate(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:]____) === RUN TestShardSummer/absent_over_time(rate(metric_counter[5m])[10m:]) === RUN TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______sort(metric_counter)______[5m:1m])_____[2m:])____[10m:]) === RUN TestShardSummer/max_over_time(_____absent_over_time(______deriv(_______rate(metric_counter[1m])______[5m:1m])_____[2m:])____[10m:]) === RUN TestShardSummer/quantile_over_time(0.99,_cortex_ingester_active_series[1w]) === RUN TestShardSummer/ceil(sum_by_(foo)_(rate(cortex_ingester_active_series[1w]))) === RUN TestShardSummer/ln(bar)_-_resets(foo[1d]) === RUN TestShardSummer/predict_linear(foo[10m],3600) === RUN TestShardSummer/label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*") === RUN TestShardSummer/ln(exp(label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*"))) === RUN TestShardSummer/ln(_____label_replace(______sum_by_(cluster)_(up{job="api-server",service="a:c"})_____,_"foo",_"$1",_"service",_"(.*):.*")____) === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_@_end())) === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10)) === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2 === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2_^_2 === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m])_/_time()_*_2) === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time()_*2 === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time() === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_vector(3)_^_month() === RUN TestShardSummer/vector(3)_^_month() === RUN TestShardSummer/sum(rate(metric_counter[1m]))_/_vector(3)_^_year(foo) === RUN TestShardSummer/foo_>_bar === RUN TestShardSummer/foo_*_2 === RUN TestShardSummer/foo_>_0 === RUN TestShardSummer/0_<=_foo === RUN TestShardSummer/foo_>_(2_*_2) === RUN TestShardSummer/sum_by_(label)_(foo_>_0) === RUN TestShardSummer/sum_by_(label)_(foo_>_0)_>_0 === RUN TestShardSummer/sum_over_time(foo[1m])_>_(2_*_2) === RUN TestShardSummer/foo_>_sum(bar) === RUN TestShardSummer/foo_>_scalar(sum(bar)) === RUN TestShardSummer/scalar(min(foo))_>_bool_scalar(sum(bar)) === RUN TestShardSummer/foo_*_on(a,_b)_group_left(c)_avg_by(a,_b,_c)_(bar) === RUN TestShardSummer/vector(1)_>_0_and_vector(1) === RUN TestShardSummer/sum(foo)_>_0_and_vector(1) === RUN TestShardSummer/max_by(pod)_(_____________________max_without(prometheus_replica,_instance,_node)_(kube_pod_labels{namespace="test"})_____________________*_____________________on(cluster,_pod,_namespace)_group_right()_pod:container_cpu_usage:sum_____________) === RUN TestShardSummer/sum(rate(metric[1m]))_and_max(metric)_>_0 === RUN TestShardSummer/sum(rate(metric[1m]))_>_avg(rate(metric[1m])) --- PASS: TestShardSummer (0.24s) --- PASS: TestShardSummer/quantile(0.9,foo) (0.00s) --- PASS: TestShardSummer/absent(foo) (0.02s) --- PASS: TestShardSummer/absent_over_time(foo[1m]) (0.00s) --- PASS: TestShardSummer/histogram_quantile(0.5,_rate(bar1{baz="blip"}[30s])) (0.00s) --- PASS: TestShardSummer/sum_by_(foo)_(histogram_quantile(0.9,_rate(http_request_duration_seconds_bucket[10m]))) (0.00s) --- PASS: TestShardSummer/sum_by_(foo,bar)_(min_over_time(bar1{baz="blip"}[1m])) (0.00s) --- PASS: TestShardSummer/sum(rate(bar1[1m]))_or_rate(bar2[1m]) (0.00s) --- PASS: TestShardSummer/sum(rate(bar1[1m]))_or_sum(rate(bar2[1m])) (0.00s) --- PASS: TestShardSummer/histogram_quantile(0.5,_sum(rate(cortex_cache_value_size_bytes_bucket[5m]))_by_(le)) (0.00s) --- PASS: TestShardSummer/sum(_______count(_________count(___________bar1_________)__by_(drive,instance)_______)__by_(instance)_____) (0.00s) --- PASS: TestShardSummer/sum(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/count(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/count(up) (0.00s) --- PASS: TestShardSummer/avg(count(test)) (0.00s) --- PASS: TestShardSummer/count_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/count_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/max(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/max_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/max_without_(foo)_(rate(foo[1m])) (0.03s) --- PASS: TestShardSummer/sum_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/sum_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/avg_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/avg_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/avg(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/topk(10,avg_by_(foo)(rate(foo[1m]))) (0.00s) --- PASS: TestShardSummer/min_over_time(metric_counter[5m]) (0.00s) --- PASS: TestShardSummer/sum_by_(user,_cluster,_namespace)_(quantile_over_time(0.99,_cortex_ingester_active_series[7d])) (0.02s) --- PASS: TestShardSummer/min_over_time(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:2m]____) (0.00s) --- PASS: TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: TestShardSummer/max_over_time((_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:])) (0.00s) --- PASS: TestShardSummer/rate(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:]____) (0.00s) --- PASS: TestShardSummer/absent_over_time(rate(metric_counter[5m])[10m:]) (0.00s) --- PASS: TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______sort(metric_counter)______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: TestShardSummer/max_over_time(_____absent_over_time(______deriv(_______rate(metric_counter[1m])______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: TestShardSummer/quantile_over_time(0.99,_cortex_ingester_active_series[1w]) (0.00s) --- PASS: TestShardSummer/ceil(sum_by_(foo)_(rate(cortex_ingester_active_series[1w]))) (0.00s) --- PASS: TestShardSummer/ln(bar)_-_resets(foo[1d]) (0.00s) --- PASS: TestShardSummer/predict_linear(foo[10m],3600) (0.01s) --- PASS: TestShardSummer/label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*") (0.00s) --- PASS: TestShardSummer/ln(exp(label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*"))) (0.00s) --- PASS: TestShardSummer/ln(_____label_replace(______sum_by_(cluster)_(up{job="api-server",service="a:c"})_____,_"foo",_"$1",_"service",_"(.*):.*")____) (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_@_end())) (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10)) (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2 (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2_^_2 (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m])_/_time()_*_2) (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time()_*2 (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time() (0.01s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_vector(3)_^_month() (0.00s) --- PASS: TestShardSummer/vector(3)_^_month() (0.00s) --- PASS: TestShardSummer/sum(rate(metric_counter[1m]))_/_vector(3)_^_year(foo) (0.00s) --- PASS: TestShardSummer/foo_>_bar (0.00s) --- PASS: TestShardSummer/foo_*_2 (0.01s) --- PASS: TestShardSummer/foo_>_0 (0.00s) --- PASS: TestShardSummer/0_<=_foo (0.00s) --- PASS: TestShardSummer/foo_>_(2_*_2) (0.00s) --- PASS: TestShardSummer/sum_by_(label)_(foo_>_0) (0.00s) --- PASS: TestShardSummer/sum_by_(label)_(foo_>_0)_>_0 (0.00s) --- PASS: TestShardSummer/sum_over_time(foo[1m])_>_(2_*_2) (0.00s) --- PASS: TestShardSummer/foo_>_sum(bar) (0.00s) --- PASS: TestShardSummer/foo_>_scalar(sum(bar)) (0.00s) --- PASS: TestShardSummer/scalar(min(foo))_>_bool_scalar(sum(bar)) (0.00s) --- PASS: TestShardSummer/foo_*_on(a,_b)_group_left(c)_avg_by(a,_b,_c)_(bar) (0.00s) --- PASS: TestShardSummer/vector(1)_>_0_and_vector(1) (0.00s) --- PASS: TestShardSummer/sum(foo)_>_0_and_vector(1) (0.00s) --- PASS: TestShardSummer/max_by(pod)_(_____________________max_without(prometheus_replica,_instance,_node)_(kube_pod_labels{namespace="test"})_____________________*_____________________on(cluster,_pod,_namespace)_group_right()_pod:container_cpu_usage:sum_____________) (0.00s) --- PASS: TestShardSummer/sum(rate(metric[1m]))_and_max(metric)_>_0 (0.00s) --- PASS: TestShardSummer/sum(rate(metric[1m]))_>_avg(rate(metric[1m])) (0.00s) === RUN TestShardSummerWithEncoding === RUN TestShardSummerWithEncoding/[0] --- PASS: TestShardSummerWithEncoding (0.00s) --- PASS: TestShardSummerWithEncoding/[0] (0.00s) === RUN TestIsSubqueryCall === RUN TestIsSubqueryCall/time() === RUN TestIsSubqueryCall/rate(metric[1m]) === RUN TestIsSubqueryCall/rate(metric[1h:5m]) === RUN TestIsSubqueryCall/quantile_over_time(1,_metric[1h:5m]) === RUN TestIsSubqueryCall/sum_over_time((metric_counter[30m:5s])) === RUN TestIsSubqueryCall/sum_over_time((((metric_counter[30m:5s])))) --- PASS: TestIsSubqueryCall (0.00s) --- PASS: TestIsSubqueryCall/time() (0.00s) --- PASS: TestIsSubqueryCall/rate(metric[1m]) (0.00s) --- PASS: TestIsSubqueryCall/rate(metric[1h:5m]) (0.00s) --- PASS: TestIsSubqueryCall/quantile_over_time(1,_metric[1h:5m]) (0.00s) --- PASS: TestIsSubqueryCall/sum_over_time((metric_counter[30m:5s])) (0.00s) --- PASS: TestIsSubqueryCall/sum_over_time((((metric_counter[30m:5s])))) (0.00s) === RUN TestEvalPredicate === RUN TestEvalPredicate/should_return_error_if_the_predicate_returns_error === RUN TestEvalPredicate/should_return_false_if_the_predicate_returns_false_for_all_nodes_in_the_subtree === RUN TestEvalPredicate/should_return_true_if_the_predicate_returns_true_for_at_least_1_node_in_the_subtree === RUN TestEvalPredicate/hasEmbeddedQueries() --- PASS: TestEvalPredicate (0.00s) --- PASS: TestEvalPredicate/should_return_error_if_the_predicate_returns_error (0.00s) --- PASS: TestEvalPredicate/should_return_false_if_the_predicate_returns_false_for_all_nodes_in_the_subtree (0.00s) --- PASS: TestEvalPredicate/should_return_true_if_the_predicate_returns_true_for_at_least_1_node_in_the_subtree (0.00s) --- PASS: TestEvalPredicate/hasEmbeddedQueries() (0.00s) === RUN TestSubtreeFolder === RUN TestSubtreeFolder/embed_an_entire_histogram === RUN TestSubtreeFolder/embed_a_binary_expression_across_two_functions === RUN TestSubtreeFolder/embed_one_out_of_two_legs_of_the_query_(right_leg_has_already_been_embedded) === RUN TestSubtreeFolder/should_not_embed_scalars --- PASS: TestSubtreeFolder (0.00s) --- PASS: TestSubtreeFolder/embed_an_entire_histogram (0.00s) --- PASS: TestSubtreeFolder/embed_a_binary_expression_across_two_functions (0.00s) --- PASS: TestSubtreeFolder/embed_one_out_of_two_legs_of_the_query_(right_leg_has_already_been_embedded) (0.00s) --- PASS: TestSubtreeFolder/should_not_embed_scalars (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/querymiddleware/astmapper 1.675s === RUN TestWriteError === RUN TestWriteError/unknown === RUN TestWriteError/context_deadline_exceeded === RUN TestWriteError/context_canceled === RUN TestWriteError/rpc_error:_code_=_Code(400)_desc_=_ --- PASS: TestWriteError (0.08s) --- PASS: TestWriteError/unknown (0.02s) --- PASS: TestWriteError/context_deadline_exceeded (0.05s) --- PASS: TestWriteError/context_canceled (0.00s) --- PASS: TestWriteError/rpc_error:_code_=_Code(400)_desc_=_ (0.00s) === RUN TestHandler_ServeHTTP === RUN TestHandler_ServeHTTP/test_handler_with_stats_enabled === RUN TestHandler_ServeHTTP/test_handler_with_stats_disabled --- PASS: TestHandler_ServeHTTP (0.04s) --- PASS: TestHandler_ServeHTTP/test_handler_with_stats_enabled (0.03s) --- PASS: TestHandler_ServeHTTP/test_handler_with_stats_disabled (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/transport 1.161s === RUN TestFrontend --- PASS: TestFrontend (0.26s) === RUN TestFrontendPropagateTrace --- PASS: TestFrontendPropagateTrace (0.14s) === RUN TestFrontendCheckReady === RUN TestFrontendCheckReady/connected_clients_are_ready === RUN TestFrontendCheckReady/no_url,_no_clients_is_not_ready --- PASS: TestFrontendCheckReady (0.00s) --- PASS: TestFrontendCheckReady/connected_clients_are_ready (0.00s) --- PASS: TestFrontendCheckReady/no_url,_no_clients_is_not_ready (0.00s) === RUN TestFrontendCancel --- PASS: TestFrontendCancel (0.23s) === RUN TestFrontendMetricsCleanup --- PASS: TestFrontendMetricsCleanup (0.06s) === RUN TestDequeuesExpiredRequests --- PASS: TestDequeuesExpiredRequests (1.00s) === RUN TestRoundRobinQueues --- PASS: TestRoundRobinQueues (1.01s) PASS ok github.com/grafana/mimir/pkg/frontend/v1 4.763s ? github.com/grafana/mimir/pkg/frontend/v1/frontendv1pb [no test files] === RUN TestFrontendBasicWorkflow --- PASS: TestFrontendBasicWorkflow (0.32s) === RUN TestFrontendRequestsPerWorkerMetric --- PASS: TestFrontendRequestsPerWorkerMetric (0.16s) === RUN TestFrontendRetryEnqueue --- PASS: TestFrontendRetryEnqueue (0.15s) === RUN TestFrontendTooManyRequests --- PASS: TestFrontendTooManyRequests (0.02s) === RUN TestFrontendEnqueueFailure --- PASS: TestFrontendEnqueueFailure (0.35s) === RUN TestFrontendCancellation --- PASS: TestFrontendCancellation (0.27s) === RUN TestFrontendWorkerCancellation --- PASS: TestFrontendWorkerCancellation (0.27s) === RUN TestFrontendFailedCancellation --- PASS: TestFrontendFailedCancellation (0.25s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_with_default_config === RUN TestConfig_Validate/should_pass_if_scheduler_address_is_configured,_and_query-scheduler_discovery_mode_is_the_default_one === RUN TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_scheduler_address_is_configured --- PASS: TestConfig_Validate (0.02s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestConfig_Validate/should_pass_if_scheduler_address_is_configured,_and_query-scheduler_discovery_mode_is_the_default_one (0.00s) --- PASS: TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_scheduler_address_is_configured (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/v2 3.110s ? github.com/grafana/mimir/pkg/frontend/v2/frontendv2pb [no test files] === RUN TestRequestActivity --- PASS: TestRequestActivity (0.00s) === RUN TestRingConfig_DefaultConfigToLifecyclerConfig --- PASS: TestRingConfig_DefaultConfigToLifecyclerConfig (0.07s) === RUN TestRingConfig_CustomConfigToLifecyclerConfig --- PASS: TestRingConfig_CustomConfigToLifecyclerConfig (0.03s) === RUN TestIngester_Push === RUN TestIngester_Push/should_succeed_on_valid_series_with_exemplars === RUN TestIngester_Push/should_soft_fail_on_two_different_sample_values_at_the_same_timestamp === RUN TestIngester_Push/should_discard_metadata_when_max_metadata_per_user_exceeded === RUN TestIngester_Push/should_discard_metadata_when_max_metadata_per_metric_exceeded === RUN TestIngester_Push/should_soft_fail_on_some_samples_out_of_bound_in_a_write_request === RUN TestIngester_Push/should_soft_fail_on_exemplar_with_unknown_series === RUN TestIngester_Push/should_succeed_with_a_request_containing_only_metadata === RUN TestIngester_Push/should_succeed_on_valid_series_and_metadata === RUN TestIngester_Push/successful_push,_active_series_disabled === RUN TestIngester_Push/should_soft_fail_on_sample_out-of-order === RUN TestIngester_Push/should_soft_fail_on_all_samples_out_of_bound_in_a_write_request --- PASS: TestIngester_Push (1.81s) --- PASS: TestIngester_Push/should_succeed_on_valid_series_with_exemplars (0.37s) --- PASS: TestIngester_Push/should_soft_fail_on_two_different_sample_values_at_the_same_timestamp (0.21s) --- PASS: TestIngester_Push/should_discard_metadata_when_max_metadata_per_user_exceeded (0.04s) --- PASS: TestIngester_Push/should_discard_metadata_when_max_metadata_per_metric_exceeded (0.04s) --- PASS: TestIngester_Push/should_soft_fail_on_some_samples_out_of_bound_in_a_write_request (0.28s) --- PASS: TestIngester_Push/should_soft_fail_on_exemplar_with_unknown_series (0.18s) --- PASS: TestIngester_Push/should_succeed_with_a_request_containing_only_metadata (0.08s) --- PASS: TestIngester_Push/should_succeed_on_valid_series_and_metadata (0.19s) --- PASS: TestIngester_Push/successful_push,_active_series_disabled (0.14s) --- PASS: TestIngester_Push/should_soft_fail_on_sample_out-of-order (0.17s) --- PASS: TestIngester_Push/should_soft_fail_on_all_samples_out_of_bound_in_a_write_request (0.09s) === RUN TestIngester_Push_ShouldCorrectlyTrackMetricsInMultiTenantScenario --- PASS: TestIngester_Push_ShouldCorrectlyTrackMetricsInMultiTenantScenario (0.22s) === RUN TestIngester_Push_DecreaseInactiveSeries --- PASS: TestIngester_Push_DecreaseInactiveSeries (0.10s) === RUN Test_Ingester_LabelNames === RUN Test_Ingester_LabelNames/without_matchers === RUN Test_Ingester_LabelNames/with_matchers --- PASS: Test_Ingester_LabelNames (0.16s) --- PASS: Test_Ingester_LabelNames/without_matchers (0.01s) --- PASS: Test_Ingester_LabelNames/with_matchers (0.00s) === RUN Test_Ingester_LabelValues --- PASS: Test_Ingester_LabelValues (0.08s) === RUN Test_Ingester_Query === RUN Test_Ingester_Query/should_filter_series_by_multiple_matchers === RUN Test_Ingester_Query/should_filter_series_by_matcher_and_time_range === RUN Test_Ingester_Query/should_return_an_empty_response_if_no_metric_matches === RUN Test_Ingester_Query/should_filter_series_by_==_matcher === RUN Test_Ingester_Query/should_filter_series_by_!=_matcher === RUN Test_Ingester_Query/should_filter_series_by_=~_matcher === RUN Test_Ingester_Query/should_filter_series_by_!~_matcher --- PASS: Test_Ingester_Query (0.12s) --- PASS: Test_Ingester_Query/should_filter_series_by_multiple_matchers (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_matcher_and_time_range (0.00s) --- PASS: Test_Ingester_Query/should_return_an_empty_response_if_no_metric_matches (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_==_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_!=_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_=~_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_!~_matcher (0.00s) === RUN TestIngester_LabelNamesCardinality === RUN TestIngester_LabelNamesCardinality/expected_all_label_with_values === RUN TestIngester_LabelNamesCardinality/expected_label_values_only_from_`metric_0` --- PASS: TestIngester_LabelNamesCardinality (0.07s) --- PASS: TestIngester_LabelNamesCardinality/expected_all_label_with_values (0.00s) --- PASS: TestIngester_LabelNamesCardinality/expected_label_values_only_from_`metric_0` (0.00s) === RUN TestIngester_LabelValuesCardinality === RUN TestIngester_LabelValuesCardinality/expected_all_label_values_cardinality === RUN TestIngester_LabelValuesCardinality/expected_status_values_cardinality_applying_matchers === RUN TestIngester_LabelValuesCardinality/empty_response_is_returned_when_no_matchers_match_the_requested_labels --- PASS: TestIngester_LabelValuesCardinality (0.13s) --- PASS: TestIngester_LabelValuesCardinality/expected_all_label_values_cardinality (0.01s) --- PASS: TestIngester_LabelValuesCardinality/expected_status_values_cardinality_applying_matchers (0.00s) --- PASS: TestIngester_LabelValuesCardinality/empty_response_is_returned_when_no_matchers_match_the_requested_labels (0.00s) === RUN TestIngester_Query_QuerySharding --- PASS: TestIngester_Query_QuerySharding (3.78s) === RUN TestIngester_Query_ShouldNotCreateTSDBIfDoesNotExists --- PASS: TestIngester_Query_ShouldNotCreateTSDBIfDoesNotExists (0.03s) === RUN TestIngester_LabelValues_ShouldNotCreateTSDBIfDoesNotExists --- PASS: TestIngester_LabelValues_ShouldNotCreateTSDBIfDoesNotExists (0.04s) === RUN TestIngester_LabelNames_ShouldNotCreateTSDBIfDoesNotExists --- PASS: TestIngester_LabelNames_ShouldNotCreateTSDBIfDoesNotExists (0.03s) === RUN TestIngester_Push_ShouldNotCreateTSDBIfNotInActiveState --- PASS: TestIngester_Push_ShouldNotCreateTSDBIfNotInActiveState (0.03s) === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/allow_to_create_TSDB_if_in_ACTIVE_state === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_PENDING_state === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_JOINING_state === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_LEAVING_state --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive (0.26s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/allow_to_create_TSDB_if_in_ACTIVE_state (0.13s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_PENDING_state (0.03s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_JOINING_state (0.04s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_LEAVING_state (0.06s) === RUN Test_Ingester_MetricsForLabelMatchers === RUN Test_Ingester_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match === RUN Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher === RUN Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers === RUN Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_time_range_to_return_nothing_when_queried_for_older_time_ranges === RUN Test_Ingester_MetricsForLabelMatchers/should_not_return_duplicated_metrics_on_overlapping_matchers === RUN Test_Ingester_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide --- PASS: Test_Ingester_MetricsForLabelMatchers (0.13s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_time_range_to_return_nothing_when_queried_for_older_time_ranges (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_not_return_duplicated_metrics_on_overlapping_matchers (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide (0.00s) === RUN Test_Ingester_MetricsForLabelMatchers_Deduplication --- PASS: Test_Ingester_MetricsForLabelMatchers_Deduplication (14.29s) === RUN TestIngester_QueryStream === RUN TestIngester_QueryStream/should_query_samples_when_configured_with_QueryStreamSamples === RUN TestIngester_QueryStream/should_query_chunks_when_configured_with_QueryStreamChunks === RUN TestIngester_QueryStream/should_support_sharding_when_query_samples === RUN TestIngester_QueryStream/should_support_sharding_when_query_chunks === RUN TestIngester_QueryStream/should_query_chunks_by_default --- PASS: TestIngester_QueryStream (6.35s) --- PASS: TestIngester_QueryStream/should_query_samples_when_configured_with_QueryStreamSamples (0.11s) --- PASS: TestIngester_QueryStream/should_query_chunks_when_configured_with_QueryStreamChunks (0.12s) --- PASS: TestIngester_QueryStream/should_support_sharding_when_query_samples (0.24s) --- PASS: TestIngester_QueryStream/should_support_sharding_when_query_chunks (0.23s) --- PASS: TestIngester_QueryStream/should_query_chunks_by_default (0.14s) === RUN TestIngester_QueryStreamManySamples --- PASS: TestIngester_QueryStreamManySamples (1.30s) === RUN TestIngester_QueryStreamManySamplesChunks --- PASS: TestIngester_QueryStreamManySamplesChunks (9.03s) === RUN TestIngester_OpenExistingTSDBOnStartup === PAUSE TestIngester_OpenExistingTSDBOnStartup === RUN TestIngester_shipBlocks --- PASS: TestIngester_shipBlocks (0.36s) === RUN TestIngester_dontShipBlocksWhenTenantDeletionMarkerIsPresent --- PASS: TestIngester_dontShipBlocksWhenTenantDeletionMarkerIsPresent (8.63s) === RUN TestIngester_seriesCountIsCorrectAfterClosingTSDBForDeletedTenant --- PASS: TestIngester_seriesCountIsCorrectAfterClosingTSDBForDeletedTenant (0.13s) === RUN TestIngester_closeAndDeleteUserTSDBIfIdle_shouldNotCloseTSDBIfShippingIsInProgress --- PASS: TestIngester_closeAndDeleteUserTSDBIfIdle_shouldNotCloseTSDBIfShippingIsInProgress (0.09s) === RUN TestIngester_closingAndOpeningTsdbConcurrently --- PASS: TestIngester_closingAndOpeningTsdbConcurrently (0.26s) === RUN TestIngester_idleCloseEmptyTSDB --- PASS: TestIngester_idleCloseEmptyTSDB (0.25s) === RUN TestIngester_invalidSamplesDontChangeLastUpdateTime --- PASS: TestIngester_invalidSamplesDontChangeLastUpdateTime (0.98s) === RUN TestIngester_flushing === RUN TestIngester_flushing/ingesterShutdown === RUN TestIngester_flushing/shutdownHandler === RUN TestIngester_flushing/flushHandler === RUN TestIngester_flushing/flushHandlerWithListOfTenants === RUN TestIngester_flushing/flushMultipleBlocksWithDataSpanning3Days --- PASS: TestIngester_flushing (23.64s) --- PASS: TestIngester_flushing/ingesterShutdown (3.21s) --- PASS: TestIngester_flushing/shutdownHandler (3.11s) --- PASS: TestIngester_flushing/flushHandler (3.03s) --- PASS: TestIngester_flushing/flushHandlerWithListOfTenants (3.82s) --- PASS: TestIngester_flushing/flushMultipleBlocksWithDataSpanning3Days (10.47s) === RUN TestIngester_ForFlush --- PASS: TestIngester_ForFlush (5.45s) === RUN Test_Ingester_UserStats --- PASS: Test_Ingester_UserStats (0.15s) === RUN Test_Ingester_AllUserStats --- PASS: Test_Ingester_AllUserStats (0.32s) === RUN TestIngesterCompactIdleBlock --- PASS: TestIngesterCompactIdleBlock (3.82s) === RUN TestIngesterCompactAndCloseIdleTSDB --- PASS: TestIngesterCompactAndCloseIdleTSDB (4.23s) === RUN TestHeadCompactionOnStartup --- PASS: TestHeadCompactionOnStartup (30.66s) === RUN TestIngester_CloseTSDBsOnShutdown --- PASS: TestIngester_CloseTSDBsOnShutdown (0.12s) === RUN TestIngesterNotDeleteUnshippedBlocks --- PASS: TestIngesterNotDeleteUnshippedBlocks (11.58s) === RUN TestIngesterPushErrorDuringForcedCompaction --- PASS: TestIngesterPushErrorDuringForcedCompaction (0.12s) === RUN TestIngesterNoFlushWithInFlightRequest --- PASS: TestIngesterNoFlushWithInFlightRequest (7.44s) === RUN TestIngester_PushInstanceLimits === RUN TestIngester_PushInstanceLimits/should_succeed_creating_one_user_and_series === RUN TestIngester_PushInstanceLimits/should_fail_creating_two_series === RUN TestIngester_PushInstanceLimits/should_fail_creating_two_users === RUN TestIngester_PushInstanceLimits/should_fail_pushing_samples_in_two_requests_due_to_rate_limit --- PASS: TestIngester_PushInstanceLimits (0.53s) --- PASS: TestIngester_PushInstanceLimits/should_succeed_creating_one_user_and_series (0.10s) --- PASS: TestIngester_PushInstanceLimits/should_fail_creating_two_series (0.08s) --- PASS: TestIngester_PushInstanceLimits/should_fail_creating_two_users (0.14s) --- PASS: TestIngester_PushInstanceLimits/should_fail_pushing_samples_in_two_requests_due_to_rate_limit (0.20s) === RUN TestIngester_instanceLimitsMetrics --- PASS: TestIngester_instanceLimitsMetrics (0.03s) === RUN TestIngester_inflightPushRequests ingester_test.go:4601: 1 100000 1.705535693s --- PASS: TestIngester_inflightPushRequests (4.36s) === RUN TestIngesterPurgeMetadata --- PASS: TestIngesterPurgeMetadata (0.06s) === RUN TestIngesterMetadataMetrics --- PASS: TestIngesterMetadataMetrics (0.10s) === RUN TestIngesterSendsOnlySeriesWithData --- PASS: TestIngesterSendsOnlySeriesWithData (0.96s) === RUN TestIngester_Push_SeriesWithBlankLabel --- PASS: TestIngester_Push_SeriesWithBlankLabel (0.07s) === RUN TestIngesterUserLimitExceeded --- PASS: TestIngesterUserLimitExceeded (0.23s) === RUN TestIngesterMetricLimitExceeded --- PASS: TestIngesterMetricLimitExceeded (0.13s) === RUN TestIngesterActiveSeries === RUN TestIngesterActiveSeries/should_cleanup_metrics_when_tsdb_closed === RUN TestIngesterActiveSeries/should_track_custom_matchers,_removing_when_zero === RUN TestIngesterActiveSeries/successful_push,_active_series_disabled === RUN TestIngesterActiveSeries/successful_push,_should_count_active_series --- PASS: TestIngesterActiveSeries (1.56s) --- PASS: TestIngesterActiveSeries/should_cleanup_metrics_when_tsdb_closed (0.25s) --- PASS: TestIngesterActiveSeries/should_track_custom_matchers,_removing_when_zero (0.46s) --- PASS: TestIngesterActiveSeries/successful_push,_active_series_disabled (0.39s) --- PASS: TestIngesterActiveSeries/successful_push,_should_count_active_series (0.45s) === RUN TestIngesterActiveSeriesConfigChanges === RUN TestIngesterActiveSeriesConfigChanges/override_flag_based_config_with_runtime_overwrite === RUN TestIngesterActiveSeriesConfigChanges/remove_runtime_overwrite_and_revert_to_flag_based_config === RUN TestIngesterActiveSeriesConfigChanges/changing_runtime_override_should_result_in_new_metrics === RUN TestIngesterActiveSeriesConfigChanges/should_cleanup_loading_metric_at_close --- PASS: TestIngesterActiveSeriesConfigChanges (1.36s) --- PASS: TestIngesterActiveSeriesConfigChanges/override_flag_based_config_with_runtime_overwrite (0.34s) --- PASS: TestIngesterActiveSeriesConfigChanges/remove_runtime_overwrite_and_revert_to_flag_based_config (0.44s) --- PASS: TestIngesterActiveSeriesConfigChanges/changing_runtime_override_should_result_in_new_metrics (0.15s) --- PASS: TestIngesterActiveSeriesConfigChanges/should_cleanup_loading_metric_at_close (0.42s) === RUN TestGetIgnoreSeriesLimitForMetricNamesMap --- PASS: TestGetIgnoreSeriesLimitForMetricNamesMap (0.00s) === RUN Test_Ingester_OutOfOrder --- PASS: Test_Ingester_OutOfOrder (4.70s) === RUN TestNewIngestErrMsgs === RUN TestNewIngestErrMsgs/newIngestErrSampleOutOfOrder === RUN TestNewIngestErrMsgs/newIngestErrSampleDuplicateTimestamp === RUN TestNewIngestErrMsgs/newIngestErrExemplarMissingSeries === RUN TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld === RUN TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld_out_of_order_enabled --- PASS: TestNewIngestErrMsgs (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleOutOfOrder (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleDuplicateTimestamp (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrExemplarMissingSeries (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld_out_of_order_enabled (0.00s) === RUN TestInstanceLimitsUnmarshal --- PASS: TestInstanceLimitsUnmarshal (0.02s) === RUN TestLabelNamesAndValuesAreSentInBatches --- PASS: TestLabelNamesAndValuesAreSentInBatches (0.00s) === RUN TestIngester_LabelValuesCardinality_SentInBatches --- PASS: TestIngester_LabelValuesCardinality_SentInBatches (0.58s) === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/empty_response_is_returned_when_no_labels_are_provided === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_if_response_size_is_less_then_batch_size === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/only_matching_series_are_returned_when_a_matcher_is_provided --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage (0.25s) --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/empty_response_is_returned_when_no_labels_are_provided (0.03s) --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message (0.08s) --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_if_response_size_is_less_then_batch_size (0.07s) --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/only_matching_series_are_returned_when_a_matcher_is_provided (0.07s) === RUN TestLabelNamesAndValues_ContextCancellation --- PASS: TestLabelNamesAndValues_ContextCancellation (0.10s) === RUN TestCountLabelValueSeries_ContextCancellation --- PASS: TestCountLabelValueSeries_ContextCancellation (0.00s) === RUN TestIngesterRestart --- PASS: TestIngesterRestart (0.43s) === RUN TestIngester_ShutdownHandler === RUN TestIngester_ShutdownHandler/unregister=false === RUN TestIngester_ShutdownHandler/unregister=true --- PASS: TestIngester_ShutdownHandler (0.04s) --- PASS: TestIngester_ShutdownHandler/unregister=false (0.02s) --- PASS: TestIngester_ShutdownHandler/unregister=true (0.02s) === RUN TestLimiter_maxSeriesPerMetric === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters === RUN TestLimiter_maxSeriesPerMetric/limit_is_disabled === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones --- PASS: TestLimiter_maxSeriesPerMetric (0.04s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.01s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.01s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) === RUN TestLimiter_maxMetadataPerMetric === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters === RUN TestLimiter_maxMetadataPerMetric/limit_is_disabled === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones --- PASS: TestLimiter_maxMetadataPerMetric (0.03s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) === RUN TestLimiter_maxSeriesPerUser === RUN TestLimiter_maxSeriesPerUser/limit_is_disabled === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones --- PASS: TestLimiter_maxSeriesPerUser (0.03s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) === RUN TestLimiter_maxMetadataPerUser === RUN TestLimiter_maxMetadataPerUser/limit_is_disabled === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 --- PASS: TestLimiter_maxMetadataPerUser (0.03s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) === RUN TestLimiter_AssertMaxSeriesPerMetric === RUN TestLimiter_AssertMaxSeriesPerMetric/limit_is_disabled === RUN TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_below_the_limit === RUN TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_above_the_limit --- PASS: TestLimiter_AssertMaxSeriesPerMetric (0.01s) --- PASS: TestLimiter_AssertMaxSeriesPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_above_the_limit (0.00s) === RUN TestLimiter_AssertMaxMetadataPerMetric === RUN TestLimiter_AssertMaxMetadataPerMetric/limit_is_disabled === RUN TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_below_the_limit === RUN TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_above_the_limit --- PASS: TestLimiter_AssertMaxMetadataPerMetric (0.01s) --- PASS: TestLimiter_AssertMaxMetadataPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_above_the_limit (0.00s) === RUN TestLimiter_AssertMaxSeriesPerUser === RUN TestLimiter_AssertMaxSeriesPerUser/limit_is_disabled === RUN TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_below_the_limit === RUN TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_above_the_limit --- PASS: TestLimiter_AssertMaxSeriesPerUser (0.01s) --- PASS: TestLimiter_AssertMaxSeriesPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_above_the_limit (0.00s) === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser/limit_is_disabled === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_below_the_limit === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_above_the_limit --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser (0.01s) --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_above_the_limit (0.00s) === RUN TestLimiter_FormatError --- PASS: TestLimiter_FormatError (0.00s) === RUN TestTSDBMetrics --- PASS: TestTSDBMetrics (0.02s) === RUN TestTSDBMetricsWithRemoval --- PASS: TestTSDBMetricsWithRemoval (0.02s) === RUN TestShipper === RUN TestShipper/no_shipper_file_yet === RUN TestShipper/sync_first_block === RUN TestShipper/sync_without_any_new_block === RUN TestShipper/sync_block_without_external_labels === RUN TestShipper/sync_block_with_0_samples === RUN TestShipper/check_if_uploaded_block_has_files_set === CONT TestShipper shipper_test.go:149: level=warn msg="reading meta file failed, will override it" err="failed to read /tmp/TestShipper1189602508/001/thanos.shipper.json: open /tmp/TestShipper1189602508/001/thanos.shipper.json: no such file or directory" level=info msg="upload new block" id=00000000010000000000000000 level=debug msg="uploaded file" from=/tmp/TestShipper1189602508/001/00000000010000000000000000/index dst=00000000010000000000000000/index bucket="fs: /tmp/TestShipper1189602508/002" level=info msg="upload new block" id=00000000020000000000000000 level=debug msg="uploaded file" from=/tmp/TestShipper1189602508/001/00000000020000000000000000/index dst=00000000020000000000000000/index bucket="fs: /tmp/TestShipper1189602508/002" level=debug msg="ignoring empty block" block=00000000030000000000000000 --- PASS: TestShipper (0.06s) --- PASS: TestShipper/no_shipper_file_yet (0.00s) --- PASS: TestShipper/sync_first_block (0.01s) --- PASS: TestShipper/sync_without_any_new_block (0.00s) --- PASS: TestShipper/sync_block_without_external_labels (0.02s) --- PASS: TestShipper/sync_block_with_0_samples (0.01s) --- PASS: TestShipper/check_if_uploaded_block_has_files_set (0.00s) === RUN TestShipper_DeceivingUploadErrors level=warn msg="reading meta file failed, will override it" err="failed to read /tmp/TestShipper_DeceivingUploadErrors3587129203/001/thanos.shipper.json: open /tmp/TestShipper_DeceivingUploadErrors3587129203/001/thanos.shipper.json: no such file or directory" level=info msg="upload new block" id=00000000010000000000000000 level=debug msg="uploaded file" from=/tmp/TestShipper_DeceivingUploadErrors3587129203/001/00000000010000000000000000/index dst=00000000010000000000000000/index bucket="fs: /tmp/TestShipper_DeceivingUploadErrors3587129203/002" level=error msg="shipping failed" block=00000000010000000000000000 err="upload meta file: base name matches, will fail upload" --- PASS: TestShipper_DeceivingUploadErrors (0.02s) === RUN TestUserMetricsMetadata === RUN TestUserMetricsMetadata/should_succeed_for_multiple_metadata_per_metric === RUN TestUserMetricsMetadata/should_fail_when_metadata_per_user_limit_reached === RUN TestUserMetricsMetadata/should_fail_when_metadata_per_metric_limit_reached --- PASS: TestUserMetricsMetadata (0.02s) --- PASS: TestUserMetricsMetadata/should_succeed_for_multiple_metadata_per_metric (0.00s) --- PASS: TestUserMetricsMetadata/should_fail_when_metadata_per_user_limit_reached (0.01s) --- PASS: TestUserMetricsMetadata/should_fail_when_metadata_per_metric_limit_reached (0.01s) === CONT TestIngester_OpenExistingTSDBOnStartup === RUN TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_is_the_root_directory_is_missing === RUN TestIngester_OpenExistingTSDBOnStartup/should_load_TSDB_for_any_non-empty_user_directory === RUN TestIngester_OpenExistingTSDBOnStartup/should_load_all_TSDBs_on_concurrency_<_number_of_TSDBs === RUN TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_>_number_of_TSDBs === RUN TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_<_number_of_TSDBs === RUN TestIngester_OpenExistingTSDBOnStartup/should_not_load_TSDB_if_the_user_directory_is_empty === RUN TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_if_the_root_directory_is_empty --- PASS: TestIngester_OpenExistingTSDBOnStartup (0.56s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_is_the_root_directory_is_missing (0.02s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_load_TSDB_for_any_non-empty_user_directory (0.11s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_load_all_TSDBs_on_concurrency_<_number_of_TSDBs (0.17s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_>_number_of_TSDBs (0.08s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_<_number_of_TSDBs (0.14s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_not_load_TSDB_if_the_user_directory_is_empty (0.02s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_if_the_root_directory_is_empty (0.03s) PASS ok github.com/grafana/mimir/pkg/ingester 154.793s === RUN TestActiveSeries_UpdateSeries_NoMatchers --- PASS: TestActiveSeries_UpdateSeries_NoMatchers (0.01s) === RUN TestActiveSeries_UpdateSeries_WithMatchers --- PASS: TestActiveSeries_UpdateSeries_WithMatchers (0.01s) === RUN TestActiveSeries_ShouldCorrectlyHandleFingerprintCollisions --- PASS: TestActiveSeries_ShouldCorrectlyHandleFingerprintCollisions (0.00s) === RUN TestActiveSeries_Purge_NoMatchers === RUN TestActiveSeries_Purge_NoMatchers/ttl:_1 === RUN TestActiveSeries_Purge_NoMatchers/ttl:_2 === RUN TestActiveSeries_Purge_NoMatchers/ttl:_3 === RUN TestActiveSeries_Purge_NoMatchers/ttl:_4 --- PASS: TestActiveSeries_Purge_NoMatchers (0.03s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_1 (0.00s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_2 (0.00s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_3 (0.00s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_4 (0.02s) === RUN TestActiveSeries_Purge_WithMatchers === RUN TestActiveSeries_Purge_WithMatchers/ttl=1 === RUN TestActiveSeries_Purge_WithMatchers/ttl=2 === RUN TestActiveSeries_Purge_WithMatchers/ttl=3 === RUN TestActiveSeries_Purge_WithMatchers/ttl=4 --- PASS: TestActiveSeries_Purge_WithMatchers (0.02s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=1 (0.00s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=2 (0.01s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=3 (0.00s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=4 (0.00s) === RUN TestActiveSeries_PurgeOpt --- PASS: TestActiveSeries_PurgeOpt (0.00s) === RUN TestActiveSeries_ReloadSeriesMatchers --- PASS: TestActiveSeries_ReloadSeriesMatchers (0.01s) === RUN TestActiveSeries_ReloadSeriesMatchers_LessMatchers --- PASS: TestActiveSeries_ReloadSeriesMatchers_LessMatchers (0.01s) === RUN TestActiveSeries_ReloadSeriesMatchers_SameSizeNewLabels --- PASS: TestActiveSeries_ReloadSeriesMatchers_SameSizeNewLabels (0.01s) === RUN TestCustomTrackersConfigs === RUN TestCustomTrackersConfigs/empty_flag_value_produces_empty_config === RUN TestCustomTrackersConfigs/empty_matcher_fails invalid value "foo:" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: "foo:" Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/empty_whitespace-only_matcher_fails invalid value "foo: " for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: "foo: " Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/second_empty_whitespace-only_matcher_fails invalid value "foo: ;bar:{}" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: "foo: " Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/empty_name_fails invalid value ":{}" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: ":{}" Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/empty_whitespace-only_name_fails invalid value " :{}" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: " :{}" Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/one_matcher === RUN TestCustomTrackersConfigs/whitespaces_are_trimmed_from_name_and_matcher === RUN TestCustomTrackersConfigs/two_matchers_in_one_flag_value === RUN TestCustomTrackersConfigs/two_matchers_in_two_flag_values === RUN TestCustomTrackersConfigs/two_matchers_with_same_name_in_same_flag invalid value "foo:{foo=\"bar\"};foo:{boo=\"bam\"}" for flag -ingester.active-series-custom-trackers: matcher "foo" for active series custom trackers is provided twice Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/two_matchers_with_same_name_in_separate_flags invalid value "foo:{boo=\"bam\"}" for flag -ingester.active-series-custom-trackers: matcher "foo" for active series custom trackers is provided more than once Usage of test: -ingester.active-series-custom-trackers value ...usage docs... --- PASS: TestCustomTrackersConfigs (0.06s) --- PASS: TestCustomTrackersConfigs/empty_flag_value_produces_empty_config (0.00s) --- PASS: TestCustomTrackersConfigs/empty_matcher_fails (0.00s) --- PASS: TestCustomTrackersConfigs/empty_whitespace-only_matcher_fails (0.00s) --- PASS: TestCustomTrackersConfigs/second_empty_whitespace-only_matcher_fails (0.00s) --- PASS: TestCustomTrackersConfigs/empty_name_fails (0.00s) --- PASS: TestCustomTrackersConfigs/empty_whitespace-only_name_fails (0.00s) --- PASS: TestCustomTrackersConfigs/one_matcher (0.00s) --- PASS: TestCustomTrackersConfigs/whitespaces_are_trimmed_from_name_and_matcher (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_in_one_flag_value (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_in_two_flag_values (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_with_same_name_in_same_flag (0.01s) --- PASS: TestCustomTrackersConfigs/two_matchers_with_same_name_in_separate_flags (0.01s) === RUN TestCustomTrackerConfig_Equality === RUN TestCustomTrackerConfig_Equality/EqualityBetweenSet === RUN TestCustomTrackerConfig_Equality/EqualityBetweenSet#01 === RUN TestCustomTrackerConfig_Equality/EqualityBetweenSet#02 === RUN TestCustomTrackerConfig_Equality/NotEqualsAcrossSets --- PASS: TestCustomTrackerConfig_Equality (0.01s) --- PASS: TestCustomTrackerConfig_Equality/EqualityBetweenSet (0.00s) --- PASS: TestCustomTrackerConfig_Equality/EqualityBetweenSet#01 (0.00s) --- PASS: TestCustomTrackerConfig_Equality/EqualityBetweenSet#02 (0.00s) --- PASS: TestCustomTrackerConfig_Equality/NotEqualsAcrossSets (0.00s) === RUN TestTrackersConfigs_Deserialization === RUN TestTrackersConfigs_Deserialization/ShouldDeserializeCorrectInput === RUN TestTrackersConfigs_Deserialization/ShouldErrorOnMalformedInput --- PASS: TestTrackersConfigs_Deserialization (0.03s) --- PASS: TestTrackersConfigs_Deserialization/ShouldDeserializeCorrectInput (0.00s) --- PASS: TestTrackersConfigs_Deserialization/ShouldErrorOnMalformedInput (0.03s) === RUN TestTrackersConfigs_SerializeDeserialize === RUN TestTrackersConfigs_SerializeDeserialize/ShouldSerializeDeserializeResultsTheSame --- PASS: TestTrackersConfigs_SerializeDeserialize (0.01s) --- PASS: TestTrackersConfigs_SerializeDeserialize/ShouldSerializeDeserializeResultsTheSame (0.01s) === RUN TestMatcher_MatchesSeries === RUN TestMatcher_MatchesSeries/{foo="true",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{foo="true",_bar="100",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{foo="true",_bar="200",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{bar="200",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{bar="100",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{baz="unrelated"} --- PASS: TestMatcher_MatchesSeries (0.01s) --- PASS: TestMatcher_MatchesSeries/{foo="true",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{foo="true",_bar="100",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{foo="true",_bar="200",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{bar="200",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{bar="100",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{baz="unrelated"} (0.00s) === RUN TestCustomTrackersConfigs_MalformedMatcher === RUN TestCustomTrackersConfigs_MalformedMatcher/{foo} === RUN TestCustomTrackersConfigs_MalformedMatcher/{foo=~"} --- PASS: TestCustomTrackersConfigs_MalformedMatcher (0.04s) --- PASS: TestCustomTrackersConfigs_MalformedMatcher/{foo} (0.03s) --- PASS: TestCustomTrackersConfigs_MalformedMatcher/{foo=~"} (0.00s) === RUN TestAmlabelMatchersToProm_HappyCase --- PASS: TestAmlabelMatchersToProm_HappyCase (0.00s) === RUN TestAmlabelMatchersToProm_MatchTypeValues --- PASS: TestAmlabelMatchersToProm_MatchTypeValues (0.01s) PASS ok github.com/grafana/mimir/pkg/ingester/activeseries 1.881s === RUN TestMarshall --- PASS: TestMarshall (0.01s) === RUN TestQueryRequest --- PASS: TestQueryRequest (0.00s) === RUN TestLabelNamesRequest --- PASS: TestLabelNamesRequest (0.00s) === RUN TestFingerprintCollisions --- PASS: TestFingerprintCollisions (0.00s) === RUN TestSendQueryStream --- PASS: TestSendQueryStream (0.15s) PASS ok github.com/grafana/mimir/pkg/ingester/client 1.172s === RUN TestMimir === RUN TestMimir/-target=read === RUN TestMimir/-target=backend === RUN TestMimir/-target=all,alertmanager === RUN TestMimir/-target=write --- PASS: TestMimir (1.95s) --- PASS: TestMimir/-target=read (0.65s) --- PASS: TestMimir/-target=backend (0.50s) --- PASS: TestMimir/-target=all,alertmanager (0.58s) --- PASS: TestMimir/-target=write (0.17s) === RUN TestMimirServerShutdownWithActivityTrackerEnabled level=info ts=2022-12-01T20:48:11.391190381Z caller=server.go:306 http=127.0.0.1:45019 grpc=127.0.0.1:46071 msg="server listening on addresses" level=debug ts=2022-12-01T20:48:11.460967073Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.473855371Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.493454169Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.505182867Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.516925366Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.520818565Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.541677063Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.557532661Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.56856976Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:11.574452559Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:11.579542458Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:11.580244858Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:11.581009858Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:11.592972557Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=error ts=2022-12-01T20:48:11.600818456Z caller=metrics.go:193 msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" level=info ts=2022-12-01T20:48:11.617468554Z caller=memberlist_client.go:436 msg="Using memberlist cluster label and node name" cluster_label= node=felix0-7966f864 ts=2022-12-01T20:48:11.617981754Z caller=memberlist_logger.go:74 level=debug msg="configured Transport is not a NodeAwareTransport and some features may not work as desired" level=debug ts=2022-12-01T20:48:11.630188252Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_stats auth=true gzip=true level=debug ts=2022-12-01T20:48:11.637701351Z caller=tcp_transport.go:393 component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=192.168.122.136 advertisePort=7946 level=debug ts=2022-12-01T20:48:11.641123951Z caller=api.go:159 msg="api: registering route" methods=POST path=/prometheus/api/v1/read auth=true gzip=true level=debug ts=2022-12-01T20:48:11.64980005Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query auth=true gzip=true level=debug ts=2022-12-01T20:48:11.65046835Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_range auth=true gzip=true level=debug ts=2022-12-01T20:48:11.652017349Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_exemplars auth=true gzip=true level=debug ts=2022-12-01T20:48:11.653110449Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/labels auth=true gzip=true level=debug ts=2022-12-01T20:48:11.655426549Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/label/{name}/values auth=true gzip=true level=debug ts=2022-12-01T20:48:11.656515949Z caller=api.go:159 msg="api: registering route" methods=GET,POST,DELETE path=/prometheus/api/v1/series auth=true gzip=true level=debug ts=2022-12-01T20:48:11.657138649Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:11.657704149Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/metadata auth=true gzip=true level=debug ts=2022-12-01T20:48:11.658240249Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_names auth=true gzip=true level=debug ts=2022-12-01T20:48:11.658809749Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_values auth=true gzip=true level=debug ts=2022-12-01T20:48:11.659885048Z caller=api.go:159 msg="api: registering route" methods=GET path=/services auth=false gzip=true level=debug ts=2022-12-01T20:48:11.660563048Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/ingester/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:11.662111548Z caller=module_service.go:72 msg="module waiting for initialization" module=server waiting_for=activity-tracker level=debug ts=2022-12-01T20:48:11.663151248Z caller=module_service.go:72 msg="module waiting for initialization" module=distributor-service waiting_for=activity-tracker level=info ts=2022-12-01T20:48:11.664020348Z caller=module_service.go:82 msg=initialising module=sanity-check level=info ts=2022-12-01T20:48:11.670162347Z caller=sanity_check.go:32 msg="Checking directories read/write access" level=info ts=2022-12-01T20:48:11.670974447Z caller=sanity_check.go:37 msg="Directories read/write access successfully checked" level=info ts=2022-12-01T20:48:11.672881347Z caller=sanity_check.go:39 msg="Checking object storage config" level=info ts=2022-12-01T20:48:11.664291048Z caller=module_service.go:82 msg=initialising module=activity-tracker level=info ts=2022-12-01T20:48:11.664453148Z caller=module_service.go:82 msg=initialising module=usage-stats level=debug ts=2022-12-01T20:48:11.680520346Z caller=tcp_transport.go:393 component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=192.168.122.136 advertisePort=7946 level=debug ts=2022-12-01T20:48:11.682032746Z caller=module_service.go:72 msg="module waiting for initialization" module=server waiting_for=sanity-check level=debug ts=2022-12-01T20:48:11.682294146Z caller=module_service.go:72 msg="module waiting for initialization" module=distributor-service waiting_for=memberlist-kv level=debug ts=2022-12-01T20:48:11.664649648Z caller=module_service.go:72 msg="module waiting for initialization" module=store-queryable waiting_for=memberlist-kv level=debug ts=2022-12-01T20:48:11.664787848Z caller=module_service.go:72 msg="module waiting for initialization" module=memberlist-kv waiting_for=activity-tracker level=debug ts=2022-12-01T20:48:11.682878346Z caller=module_service.go:72 msg="module waiting for initialization" module=memberlist-kv waiting_for=sanity-check level=debug ts=2022-12-01T20:48:11.665412948Z caller=module_service.go:72 msg="module waiting for initialization" module=ring waiting_for=activity-tracker level=debug ts=2022-12-01T20:48:11.683151246Z caller=module_service.go:72 msg="module waiting for initialization" module=ring waiting_for=memberlist-kv level=info ts=2022-12-01T20:48:11.685582445Z caller=sanity_check.go:44 msg="Object storage config successfully checked" level=debug ts=2022-12-01T20:48:11.692187044Z caller=module_service.go:72 msg="module waiting for initialization" module=memberlist-kv waiting_for=server level=debug ts=2022-12-01T20:48:11.692633444Z caller=module_service.go:72 msg="module waiting for initialization" module=server waiting_for=usage-stats level=info ts=2022-12-01T20:48:11.693115144Z caller=module_service.go:82 msg=initialising module=server level=debug ts=2022-12-01T20:48:11.696226444Z caller=module_service.go:72 msg="module waiting for initialization" module=memberlist-kv waiting_for=usage-stats level=info ts=2022-12-01T20:48:11.696630144Z caller=module_service.go:82 msg=initialising module=memberlist-kv level=debug ts=2022-12-01T20:48:11.697131944Z caller=module_service.go:72 msg="module waiting for initialization" module=ring waiting_for=sanity-check level=debug ts=2022-12-01T20:48:11.697559744Z caller=module_service.go:72 msg="module waiting for initialization" module=ring waiting_for=server level=debug ts=2022-12-01T20:48:11.697753744Z caller=module_service.go:72 msg="module waiting for initialization" module=ring waiting_for=usage-stats level=info ts=2022-12-01T20:48:11.697900644Z caller=module_service.go:82 msg=initialising module=ring level=debug ts=2022-12-01T20:48:11.699005844Z caller=module_service.go:72 msg="module waiting for initialization" module=store-queryable waiting_for=sanity-check level=debug ts=2022-12-01T20:48:11.699368744Z caller=module_service.go:72 msg="module waiting for initialization" module=store-queryable waiting_for=server level=debug ts=2022-12-01T20:48:11.699544744Z caller=module_service.go:72 msg="module waiting for initialization" module=store-queryable waiting_for=usage-stats level=debug ts=2022-12-01T20:48:11.699744044Z caller=module_service.go:72 msg="module waiting for initialization" module=store-queryable waiting_for=activity-tracker level=info ts=2022-12-01T20:48:11.699905544Z caller=module_service.go:82 msg=initialising module=store-queryable level=debug ts=2022-12-01T20:48:11.700259444Z caller=module_service.go:72 msg="module waiting for initialization" module=distributor-service waiting_for=ring level=info ts=2022-12-01T20:48:11.701030843Z caller=ring.go:263 msg="ring doesn't exist in KV store yet" level=info ts=2022-12-01T20:48:11.701263543Z caller=ring.go:263 msg="ring doesn't exist in KV store yet" level=debug ts=2022-12-01T20:48:11.702048443Z caller=module_service.go:72 msg="module waiting for initialization" module=distributor-service waiting_for=sanity-check level=debug ts=2022-12-01T20:48:11.702229043Z caller=module_service.go:72 msg="module waiting for initialization" module=distributor-service waiting_for=server level=debug ts=2022-12-01T20:48:11.702373043Z caller=module_service.go:72 msg="module waiting for initialization" module=distributor-service waiting_for=usage-stats level=info ts=2022-12-01T20:48:11.703004443Z caller=module_service.go:82 msg=initialising module=distributor-service level=info ts=2022-12-01T20:48:11.704352343Z caller=mimir.go:762 msg="Application started" level=debug ts=2022-12-01T20:48:11.72840984Z caller=logging.go:76 msg="GET /ready (200) 12.865198ms" level=info ts=2022-12-01T20:48:11.743449238Z caller=signals.go:55 msg="=== received SIGINT/SIGTERM ===\n*** exiting" level=debug ts=2022-12-01T20:48:11.745893938Z caller=module_service.go:127 msg="module waiting for" module=server waiting_for=memberlist-kv level=debug ts=2022-12-01T20:48:11.745856038Z caller=module_service.go:127 msg="module waiting for" module=memberlist-kv waiting_for=distributor-service level=debug ts=2022-12-01T20:48:11.746127838Z caller=module_service.go:127 msg="module waiting for" module=ring waiting_for=distributor-service level=debug ts=2022-12-01T20:48:11.745961338Z caller=module_service.go:127 msg="module waiting for" module=sanity-check waiting_for=distributor-service level=debug ts=2022-12-01T20:48:11.746152638Z caller=module_service.go:104 msg=stopping module=distributor-service level=debug ts=2022-12-01T20:48:11.746215738Z caller=module_service.go:127 msg="module waiting for" module=usage-stats waiting_for=ring level=debug ts=2022-12-01T20:48:11.746018938Z caller=module_service.go:127 msg="module waiting for" module=activity-tracker waiting_for=memberlist-kv level=debug ts=2022-12-01T20:48:11.745731438Z caller=module_service.go:104 msg=stopping module=store-queryable level=info ts=2022-12-01T20:48:11.747254338Z caller=module_service.go:114 msg="module stopped" module=distributor-service level=debug ts=2022-12-01T20:48:11.747562338Z caller=module_service.go:127 msg="module waiting for" module=sanity-check waiting_for=memberlist-kv level=info ts=2022-12-01T20:48:11.747758038Z caller=module_service.go:114 msg="module stopped" module=store-queryable level=debug ts=2022-12-01T20:48:11.747806238Z caller=module_service.go:104 msg=stopping module=ring level=debug ts=2022-12-01T20:48:11.747897038Z caller=module_service.go:127 msg="module waiting for" module=memberlist-kv waiting_for=ring level=info ts=2022-12-01T20:48:11.748628638Z caller=module_service.go:114 msg="module stopped" module=ring level=debug ts=2022-12-01T20:48:11.748819938Z caller=module_service.go:127 msg="module waiting for" module=memberlist-kv waiting_for=store-queryable level=debug ts=2022-12-01T20:48:11.748964238Z caller=module_service.go:104 msg=stopping module=memberlist-kv level=debug ts=2022-12-01T20:48:11.749337038Z caller=module_service.go:127 msg="module waiting for" module=usage-stats waiting_for=server level=info ts=2022-12-01T20:48:11.749495338Z caller=memberlist_client.go:641 msg="leaving memberlist cluster" level=info ts=2022-12-01T20:48:11.752171437Z caller=module_service.go:114 msg="module stopped" module=memberlist-kv level=debug ts=2022-12-01T20:48:11.752708337Z caller=module_service.go:127 msg="module waiting for" module=activity-tracker waiting_for=ring level=debug ts=2022-12-01T20:48:11.752726637Z caller=module_service.go:127 msg="module waiting for" module=server waiting_for=ring level=debug ts=2022-12-01T20:48:11.752880737Z caller=module_service.go:127 msg="module waiting for" module=activity-tracker waiting_for=server level=debug ts=2022-12-01T20:48:11.752940537Z caller=module_service.go:127 msg="module waiting for" module=server waiting_for=store-queryable level=debug ts=2022-12-01T20:48:11.753090737Z caller=module_service.go:127 msg="module waiting for" module=server waiting_for=distributor-service level=debug ts=2022-12-01T20:48:11.753260437Z caller=module_service.go:104 msg=stopping module=server level=debug ts=2022-12-01T20:48:11.752805137Z caller=module_service.go:127 msg="module waiting for" module=sanity-check waiting_for=ring level=debug ts=2022-12-01T20:48:11.754880037Z caller=module_service.go:127 msg="module waiting for" module=sanity-check waiting_for=server level=info ts=2022-12-01T20:48:11.757996936Z caller=server_service.go:55 msg="server stopped" level=info ts=2022-12-01T20:48:11.758224036Z caller=module_service.go:114 msg="module stopped" module=server level=debug ts=2022-12-01T20:48:11.758526836Z caller=module_service.go:127 msg="module waiting for" module=sanity-check waiting_for=store-queryable level=debug ts=2022-12-01T20:48:11.758702836Z caller=module_service.go:104 msg=stopping module=sanity-check level=info ts=2022-12-01T20:48:11.758901836Z caller=module_service.go:114 msg="module stopped" module=sanity-check level=debug ts=2022-12-01T20:48:11.759263036Z caller=module_service.go:127 msg="module waiting for" module=activity-tracker waiting_for=store-queryable level=debug ts=2022-12-01T20:48:11.759369836Z caller=module_service.go:127 msg="module waiting for" module=usage-stats waiting_for=store-queryable level=debug ts=2022-12-01T20:48:11.759566936Z caller=module_service.go:127 msg="module waiting for" module=usage-stats waiting_for=distributor-service level=debug ts=2022-12-01T20:48:11.759711436Z caller=module_service.go:127 msg="module waiting for" module=usage-stats waiting_for=memberlist-kv level=debug ts=2022-12-01T20:48:11.759849936Z caller=module_service.go:104 msg=stopping module=usage-stats level=debug ts=2022-12-01T20:48:11.759425636Z caller=module_service.go:127 msg="module waiting for" module=activity-tracker waiting_for=distributor-service level=debug ts=2022-12-01T20:48:11.760170536Z caller=module_service.go:104 msg=stopping module=activity-tracker level=info ts=2022-12-01T20:48:11.760232736Z caller=module_service.go:114 msg="module stopped" module=usage-stats level=info ts=2022-12-01T20:48:11.866650423Z caller=module_service.go:114 msg="module stopped" module=activity-tracker level=info ts=2022-12-01T20:48:11.867080623Z caller=mimir.go:763 msg="Application stopped" --- PASS: TestMimirServerShutdownWithActivityTrackerEnabled (0.78s) === RUN TestConfigValidation === RUN TestConfigValidation/should_pass_validation_if_the_http_prefix_is_empty level=debug ts=2022-12-01T20:48:11.887914421Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.89168592Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.89542792Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.97844151Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.982684509Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:11.992818908Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.009489206Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.033383903Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestConfigValidation/S3:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-12-01T20:48:12.059655Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.076932998Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.081342097Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.087422996Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.092353596Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.098978695Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.109751594Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.133847091Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestConfigValidation/GCS:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-12-01T20:48:12.146543389Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.168175787Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.174111086Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.181241485Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.184897885Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.205370682Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.212908281Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.229575079Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestConfigValidation/Azure:_should_fail_if_container_and_account_names_are_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-12-01T20:48:12.267271775Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.271156474Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.274874674Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.284410172Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.294602271Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.336287066Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.354530364Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.367783062Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestConfigValidation/Azure:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-12-01T20:48:12.378169661Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.381941861Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.38644866Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.391854359Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.395404159Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.399073158Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.406946858Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.416492756Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestConfigValidation/Swift:_should_fail_if_container_and_project_names_are_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-12-01T20:48:12.429030955Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.433346554Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.437241054Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.443582953Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.447250153Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.451584452Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.459904351Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.46809435Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestConfigValidation/Swift:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-12-01T20:48:12.478371449Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.482063048Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.486496248Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.493546247Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.497230647Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.500861646Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.508279545Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.517642544Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestConfigValidation/Alertmanager:_should_ignore_invalid_alertmanager_configuration_when_alertmanager_is_not_running level=debug ts=2022-12-01T20:48:12.529742443Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.533706342Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.537604342Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.543726141Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.54827004Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.55173434Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.558631439Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.566700138Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestConfigValidation/Alertmanager:_should_fail_with_invalid_alertmanager_configuration_when_alertmanager_is_not_running level=debug ts=2022-12-01T20:48:12.576954037Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.580653836Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.584591836Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.594502335Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.606970533Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.610445833Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.617663032Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.660214627Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestConfigValidation/S3:_should_pass_if_bucket_name_is_shared_between_alertmanager_and_ruler_storage_because_they_already_use_separate_prefixes_(rules/_and_alerts/) level=debug ts=2022-12-01T20:48:12.691787123Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.71565642Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.71937962Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.730093818Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.734045518Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.738073917Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.745578916Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:12.765165414Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" --- PASS: TestConfigValidation (0.91s) --- PASS: TestConfigValidation/should_pass_validation_if_the_http_prefix_is_empty (0.17s) --- PASS: TestConfigValidation/S3:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage (0.10s) --- PASS: TestConfigValidation/GCS:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage (0.11s) --- PASS: TestConfigValidation/Azure:_should_fail_if_container_and_account_names_are_shared_between_alertmanager_and_blocks_storage (0.11s) --- PASS: TestConfigValidation/Azure:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage (0.05s) --- PASS: TestConfigValidation/Swift:_should_fail_if_container_and_project_names_are_shared_between_alertmanager_and_blocks_storage (0.05s) --- PASS: TestConfigValidation/Swift:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage (0.05s) --- PASS: TestConfigValidation/Alertmanager:_should_ignore_invalid_alertmanager_configuration_when_alertmanager_is_not_running (0.05s) --- PASS: TestConfigValidation/Alertmanager:_should_fail_with_invalid_alertmanager_configuration_when_alertmanager_is_not_running (0.11s) --- PASS: TestConfigValidation/S3:_should_pass_if_bucket_name_is_shared_between_alertmanager_and_ruler_storage_because_they_already_use_separate_prefixes_(rules/_and_alerts/) (0.09s) === RUN TestConfig_validateFilesystemPaths === RUN TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_filesystem_backend_directory_is_equal_to_alertmanager_data_directory === RUN TestConfig_validateFilesystemPaths/should_fail_if_store-gateway_and_compactor_data_directory_overlap === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_they're_both_root_directories === RUN TestConfig_validateFilesystemPaths/should_succeed_if_blocks_storage_filesystem_directory_overlaps_with_alertmanager_data_directory,_but_we're_running_alertmanager_in_microservices_mode === RUN TestConfig_validateFilesystemPaths/should_fail_if_ruler_filesystem_backend_directory_is_equal_to_ruler_data_directory === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_they're_both_child_of_the_same_directory === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_one_has_the_same_prefix_of_the_other_one === RUN TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_filesystem_backend_directory_is_a_subdirectory_of_alertmanager_data_directory === RUN TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_data_directory_is_a_subdirectory_of_alertmanager_filesystem_backend_directory,_and_matches_with_the_prefix_used_to_store_alerts === RUN TestConfig_validateFilesystemPaths/should_fail_if_tsdb_directory_and_blocks_storage_filesystem_directory_overlap === RUN TestConfig_validateFilesystemPaths/should_succeed_if_store-gateway_and_compactor_data_directory_overlap,_but_it's_running_only_the_store-gateway === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_overlap,_but_blocks_storage_has_prefix_configured === RUN TestConfig_validateFilesystemPaths/should_fail_if_blocks_storage_filesystem_directory_overlaps_with_alertmanager_data_directory,_and_alertmanager_is_running_along_with_other_components === RUN TestConfig_validateFilesystemPaths/should_succeed_with_the_default_configuration === RUN TestConfig_validateFilesystemPaths/should_succeed_if_alertmanager_data_directory_is_a_subdirectory_of_alertmanager_filesystem_backend_directory,_but_doesn't_match_with_the_prefix_used_to_store_alerts === RUN TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_data_directory_(relative)_is_a_subdirectory_of_alertmanager_filesystem_backend_directory_(absolute),_and_matches_with_the_prefix_used_to_store_alertmanager_config --- PASS: TestConfig_validateFilesystemPaths (1.46s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_filesystem_backend_directory_is_equal_to_alertmanager_data_directory (0.09s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_store-gateway_and_compactor_data_directory_overlap (0.13s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_they're_both_root_directories (0.15s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_blocks_storage_filesystem_directory_overlaps_with_alertmanager_data_directory,_but_we're_running_alertmanager_in_microservices_mode (0.14s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_ruler_filesystem_backend_directory_is_equal_to_ruler_data_directory (0.11s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap (0.14s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_they're_both_child_of_the_same_directory (0.13s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_one_has_the_same_prefix_of_the_other_one (0.11s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_filesystem_backend_directory_is_a_subdirectory_of_alertmanager_data_directory (0.05s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_data_directory_is_a_subdirectory_of_alertmanager_filesystem_backend_directory,_and_matches_with_the_prefix_used_to_store_alerts (0.05s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_tsdb_directory_and_blocks_storage_filesystem_directory_overlap (0.05s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_store-gateway_and_compactor_data_directory_overlap,_but_it's_running_only_the_store-gateway (0.04s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_overlap,_but_blocks_storage_has_prefix_configured (0.04s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_blocks_storage_filesystem_directory_overlaps_with_alertmanager_data_directory,_and_alertmanager_is_running_along_with_other_components (0.05s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_with_the_default_configuration (0.04s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_alertmanager_data_directory_is_a_subdirectory_of_alertmanager_filesystem_backend_directory,_but_doesn't_match_with_the_prefix_used_to_store_alerts (0.05s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_data_directory_(relative)_is_a_subdirectory_of_alertmanager_filesystem_backend_directory_(absolute),_and_matches_with_the_prefix_used_to_store_alertmanager_config (0.05s) === RUN TestIsAbsPathOverlapping === RUN TestIsAbsPathOverlapping/check_if_"/"_overlaps_"/" === RUN TestIsAbsPathOverlapping/check_if_"/data"_overlaps_"/" === RUN TestIsAbsPathOverlapping/check_if_"/"_overlaps_"/data" === RUN TestIsAbsPathOverlapping/check_if_"/data"_overlaps_"/data-more" === RUN TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data" === RUN TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data/more" === RUN TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data-more" === RUN TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/more/data" --- PASS: TestIsAbsPathOverlapping (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/"_overlaps_"/" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/data"_overlaps_"/" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/"_overlaps_"/data" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/data"_overlaps_"/data-more" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data/more" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data-more" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/more/data" (0.00s) === RUN TestGrpcAuthMiddleware level=info ts=2022-12-01T20:48:14.330918823Z caller=server_service.go:55 msg="server stopped" --- PASS: TestGrpcAuthMiddleware (0.09s) === RUN TestFlagDefaults --- PASS: TestFlagDefaults (0.07s) === RUN TestAPIConfig level=debug ts=2022-12-01T20:48:14.411751914Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.416068813Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.420232613Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.426427112Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.430182811Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.433721111Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.44127241Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.450094909Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestAPIConfig/running_with_default_config level=debug ts=2022-12-01T20:48:14.460928908Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.465063207Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.469573807Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.477324806Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.482273605Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.486517804Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.493849404Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.5228882Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.528280999Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:14.530296099Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:14.530866099Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:14.531359699Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:14.531954799Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/defaults_with_default_config level=debug ts=2022-12-01T20:48:14.615195989Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.619249188Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.638718886Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.645123785Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.654458084Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.657918384Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.665117083Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.68647898Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.69140048Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:14.693716579Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:14.694054979Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:14.694329679Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:14.694641679Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/diff_with_default_config level=debug ts=2022-12-01T20:48:14.726037075Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.733844874Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.737984374Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.745225873Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.748744473Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.752921272Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.759869371Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.76906407Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:14.77391047Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:14.775545669Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:14.776534769Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:14.777051269Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:14.777389469Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/running_with_changed_target_config level=debug ts=2022-12-01T20:48:15.006219341Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.009702141Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.026740039Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.032313238Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.035441238Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.038568837Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.058643135Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.066355734Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.070740733Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:15.072175033Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.072615233Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.072866033Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:15.073169733Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/defaults_with_changed_target_config level=debug ts=2022-12-01T20:48:15.09872063Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.10199953Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.105401529Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.110978128Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.114072328Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.117159728Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.129658126Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.137086025Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.141730925Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:15.143289725Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.143546925Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.143807824Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:15.144086024Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/diff_with_changed_target_config level=debug ts=2022-12-01T20:48:15.170542921Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.173862621Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.17755182Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.18290792Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.186151819Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.189258319Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.196273118Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.203420117Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.207690717Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:15.209059717Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.212945716Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.213236216Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:15.213562016Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true --- PASS: TestAPIConfig (0.97s) --- PASS: TestAPIConfig/running_with_default_config (0.14s) --- PASS: TestAPIConfig/defaults_with_default_config (0.11s) --- PASS: TestAPIConfig/diff_with_default_config (0.28s) --- PASS: TestAPIConfig/running_with_changed_target_config (0.09s) --- PASS: TestAPIConfig/defaults_with_changed_target_config (0.07s) --- PASS: TestAPIConfig/diff_with_changed_target_config (0.21s) === RUN TestMimir_InitRulerStorage level=debug ts=2022-12-01T20:48:15.386707595Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.390493894Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.394030594Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.399907593Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.403131393Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.406284393Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.413559992Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.42714599Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.435407889Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.444219788Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.448407087Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.454799387Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.458279086Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.461602186Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.468911085Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.477587384Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.486110383Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.489705882Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.493535082Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.498882181Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.502301481Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.50633518Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.51332018Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.521582779Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" === RUN TestMimir_InitRulerStorage/should_not_init_the_ruler_storage_on_default_config_with_target=all level=info ts=2022-12-01T20:48:15.528785478Z caller=modules.go:563 msg="The ruler is not being started because you need to configure the ruler storage." === RUN TestMimir_InitRulerStorage/should_init_the_ruler_storage_on_ruler_storage_config_with_target=all === RUN TestMimir_InitRulerStorage/should_init_the_ruler_storage_with_target=ruler --- PASS: TestMimir_InitRulerStorage (0.15s) --- PASS: TestMimir_InitRulerStorage/should_not_init_the_ruler_storage_on_default_config_with_target=all (0.00s) --- PASS: TestMimir_InitRulerStorage/should_init_the_ruler_storage_on_ruler_storage_config_with_target=all (0.00s) --- PASS: TestMimir_InitRulerStorage/should_init_the_ruler_storage_with_target=ruler (0.00s) === RUN TestMultiKVSetup === RUN TestMultiKVSetup/alertmanager time="2022-12-01T20:48:15Z" level=info msg="server listening on addresses" grpc="[::]:41979" http="[::]:33987" level=debug ts=2022-12-01T20:48:15.598130969Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.601694669Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.605739668Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.611519968Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.614821767Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.618127867Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.625192966Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.634144865Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.648675663Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:15.67466846Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.67514216Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.67545736Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:15.679434159Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:15.686805058Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=debug ts=2022-12-01T20:48:15.732852953Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:15.733427053Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=warn ts=2022-12-01T20:48:15.735696552Z caller=store.go:63 msg="-alertmanager-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" level=error ts=2022-12-01T20:48:15.741037952Z caller=metrics.go:193 msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" level=info ts=2022-12-01T20:48:15.744765251Z caller=memberlist_client.go:436 msg="Using memberlist cluster label and node name" cluster_label= node=felix0-ae1ab2c8 ts=2022-12-01T20:48:15.745247451Z caller=memberlist_logger.go:74 level=debug msg="configured Transport is not a NodeAwareTransport and some features may not work as desired" level=debug ts=2022-12-01T20:48:15.760312249Z caller=api.go:159 msg="api: registering route" methods=GET path=/multitenant_alertmanager/status auth=false gzip=true level=debug ts=2022-12-01T20:48:15.760839549Z caller=api.go:159 msg="api: registering route" methods=GET path=/multitenant_alertmanager/configs auth=false gzip=true level=debug ts=2022-12-01T20:48:15.761235749Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/multitenant_alertmanager/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:15.761596749Z caller=api.go:159 msg="api: registering route" methods=POST path=/multitenant_alertmanager/delete_tenant_config auth=true gzip=true level=debug ts=2022-12-01T20:48:15.761990049Z caller=api.go:159 msg="api: registering route" methods=GET path=/alertmanager/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:15.762367249Z caller=api.go:164 msg="api: registering route" methods= prefix=/alertmanager auth=true gzip=true level=debug ts=2022-12-01T20:48:15.763041749Z caller=api.go:206 msg="api: registering alertmanager" path_prefix=/alertmanager level=debug ts=2022-12-01T20:48:15.763241749Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/alerts auth=true gzip=true level=debug ts=2022-12-01T20:48:15.763576749Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/alerts auth=true gzip=true level=debug ts=2022-12-01T20:48:15.763915049Z caller=api.go:159 msg="api: registering route" methods=DELETE path=/api/v1/alerts auth=true gzip=true === RUN TestMultiKVSetup/store-gateway level=debug ts=2022-12-01T20:48:15.773970448Z caller=tcp_transport.go:393 component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=192.168.122.136 advertisePort=7946 level=debug ts=2022-12-01T20:48:15.807275044Z caller=tcp_transport.go:393 component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=192.168.122.136 advertisePort=7946 time="2022-12-01T20:48:15Z" level=info msg="server listening on addresses" grpc="[::]:34907" http="[::]:38453" level=debug ts=2022-12-01T20:48:15.91980183Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.92385973Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.927972029Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.934284728Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.937679328Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.941057727Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.953615526Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.963107225Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:15.968100924Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:15.970267624Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.970677824Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:15.971013624Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:15.971389924Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:15.976752823Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=debug ts=2022-12-01T20:48:15.979330823Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:15.979757823Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=error ts=2022-12-01T20:48:15.984861822Z caller=metrics.go:193 msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" level=info ts=2022-12-01T20:48:15.995374921Z caller=inmemory.go:173 msg="created in-memory index cache" maxItemSizeBytes=134217728 maxSizeBytes=1073741824 maxItems=maxInt level=debug ts=2022-12-01T20:48:16.00551952Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/store-gateway/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:16.00619782Z caller=api.go:159 msg="api: registering route" methods=GET path=/store-gateway/tenants auth=false gzip=true level=debug ts=2022-12-01T20:48:16.00659462Z caller=api.go:159 msg="api: registering route" methods=GET path=/store-gateway/tenant/{tenant}/blocks auth=false gzip=true === RUN TestMultiKVSetup/querier time="2022-12-01T20:48:16Z" level=info msg="server listening on addresses" grpc="[::]:39061" http="[::]:40905" level=debug ts=2022-12-01T20:48:16.180796098Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.184738498Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.188447897Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.194392497Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.198337996Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.201670996Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.209857895Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.227972893Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.237396091Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:16.240752791Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:16.241103391Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:16.241383991Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:16.241741091Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:16.24680929Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=debug ts=2022-12-01T20:48:16.24894569Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:16.24967939Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=error ts=2022-12-01T20:48:16.254120789Z caller=metrics.go:193 msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" level=debug ts=2022-12-01T20:48:16.266968588Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_stats auth=true gzip=true level=debug ts=2022-12-01T20:48:16.270132787Z caller=api.go:159 msg="api: registering route" methods=POST path=/prometheus/api/v1/read auth=true gzip=true level=debug ts=2022-12-01T20:48:16.270525187Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query auth=true gzip=true level=debug ts=2022-12-01T20:48:16.270889087Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_range auth=true gzip=true level=debug ts=2022-12-01T20:48:16.271300487Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_exemplars auth=true gzip=true level=debug ts=2022-12-01T20:48:16.271689487Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/labels auth=true gzip=true level=debug ts=2022-12-01T20:48:16.272016687Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/label/{name}/values auth=true gzip=true level=debug ts=2022-12-01T20:48:16.272639287Z caller=api.go:159 msg="api: registering route" methods=GET,POST,DELETE path=/prometheus/api/v1/series auth=true gzip=true level=debug ts=2022-12-01T20:48:16.273036987Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:16.273450287Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/metadata auth=true gzip=true level=debug ts=2022-12-01T20:48:16.273809987Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_names auth=true gzip=true level=debug ts=2022-12-01T20:48:16.274235187Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_values auth=true gzip=true === RUN TestMultiKVSetup/ingester time="2022-12-01T20:48:16Z" level=info msg="server listening on addresses" grpc="[::]:34559" http="[::]:44239" level=debug ts=2022-12-01T20:48:16.401615571Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.405323971Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.408919971Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.41497307Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.418220269Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.421449169Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.427716668Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.435492567Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.440357267Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:16.441708867Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:16.441979167Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:16.442232967Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:16.442993966Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:16.443907666Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:16.444223366Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=debug ts=2022-12-01T20:48:16.450932465Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=warn ts=2022-12-01T20:48:16.453620565Z caller=ingester.go:254 msg="-blocks-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" level=error ts=2022-12-01T20:48:16.464131264Z caller=metrics.go:193 msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" level=info ts=2022-12-01T20:48:16.465215864Z caller=ingester.go:336 msg="TSDB idle compaction timeout set" timeout=1h12m35.603343014s level=debug ts=2022-12-01T20:48:16.467676363Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/ingester/flush auth=false gzip=true level=debug ts=2022-12-01T20:48:16.468118763Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/ingester/shutdown auth=false gzip=true level=debug ts=2022-12-01T20:48:16.468486463Z caller=api.go:159 msg="api: registering route" methods=POST path=/ingester/push auth=true gzip=false === RUN TestMultiKVSetup/compactor time="2022-12-01T20:48:16Z" level=info msg="server listening on addresses" grpc="[::]:38687" http="[::]:42377" level=debug ts=2022-12-01T20:48:16.674813338Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.679619238Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.684124937Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.698131535Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.705325834Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.712378334Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.727166832Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.735665231Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.74106963Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:16.74306363Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:16.74353163Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:16.74382943Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:16.74414823Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:16.748740129Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=debug ts=2022-12-01T20:48:16.751088829Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:16.751417429Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=debug ts=2022-12-01T20:48:16.754555528Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/compactor/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:16.754882428Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/start auth=true gzip=false level=debug ts=2022-12-01T20:48:16.755350628Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/files auth=true gzip=false level=debug ts=2022-12-01T20:48:16.755941228Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/finish auth=true gzip=false level=debug ts=2022-12-01T20:48:16.756378328Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/upload/block/{block}/check auth=true gzip=false level=debug ts=2022-12-01T20:48:16.756839328Z caller=api.go:159 msg="api: registering route" methods=POST path=/compactor/delete_tenant auth=true gzip=true level=debug ts=2022-12-01T20:48:16.757183228Z caller=api.go:159 msg="api: registering route" methods=GET path=/compactor/delete_tenant_status auth=true gzip=true === RUN TestMultiKVSetup/query-scheduler time="2022-12-01T20:48:16Z" level=info msg="server listening on addresses" grpc="[::]:36811" http="[::]:42823" level=debug ts=2022-12-01T20:48:16.871133414Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.875094014Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.879579013Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.885268913Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.888790212Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.892316412Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.915521309Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.930782407Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:16.955576604Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:16.958730304Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:16.976380402Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:16.976887901Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:16.977270601Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:16.9916363Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=debug ts=2022-12-01T20:48:16.994573099Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:16.994974199Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=debug ts=2022-12-01T20:48:16.998238699Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/query-scheduler/ring auth=false gzip=true === RUN TestMultiKVSetup/backend time="2022-12-01T20:48:17Z" level=info msg="server listening on addresses" grpc="[::]:38857" http="[::]:44331" level=debug ts=2022-12-01T20:48:17.127283683Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.130670083Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.134614382Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.139852482Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.142978481Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.146201981Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.15232548Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.159700679Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.164160179Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:17.165489578Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:17.166068778Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:17.166365678Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:17.166677378Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:17.167365478Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:17.167676778Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=debug ts=2022-12-01T20:48:17.173682778Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=error ts=2022-12-01T20:48:17.177717477Z caller=metrics.go:193 msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" level=info ts=2022-12-01T20:48:17.182966176Z caller=modules.go:563 msg="The ruler is not being started because you need to configure the ruler storage." level=debug ts=2022-12-01T20:48:17.186816676Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/query-scheduler/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:17.192921875Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/compactor/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:17.193337075Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/start auth=true gzip=false level=debug ts=2022-12-01T20:48:17.193870875Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/files auth=true gzip=false level=debug ts=2022-12-01T20:48:17.194335075Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/finish auth=true gzip=false level=debug ts=2022-12-01T20:48:17.194810375Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/upload/block/{block}/check auth=true gzip=false level=debug ts=2022-12-01T20:48:17.195248775Z caller=api.go:159 msg="api: registering route" methods=POST path=/compactor/delete_tenant auth=true gzip=true level=debug ts=2022-12-01T20:48:17.195601475Z caller=api.go:159 msg="api: registering route" methods=GET path=/compactor/delete_tenant_status auth=true gzip=true level=warn ts=2022-12-01T20:48:17.198017375Z caller=store.go:63 msg="-alertmanager-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" level=debug ts=2022-12-01T20:48:17.221148972Z caller=api.go:159 msg="api: registering route" methods=GET path=/multitenant_alertmanager/status auth=false gzip=true level=debug ts=2022-12-01T20:48:17.221740372Z caller=api.go:159 msg="api: registering route" methods=GET path=/multitenant_alertmanager/configs auth=false gzip=true level=debug ts=2022-12-01T20:48:17.222125372Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/multitenant_alertmanager/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:17.222661372Z caller=api.go:159 msg="api: registering route" methods=POST path=/multitenant_alertmanager/delete_tenant_config auth=true gzip=true level=debug ts=2022-12-01T20:48:17.223083371Z caller=api.go:159 msg="api: registering route" methods=GET path=/alertmanager/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:17.223455371Z caller=api.go:164 msg="api: registering route" methods= prefix=/alertmanager auth=true gzip=true level=debug ts=2022-12-01T20:48:17.223720971Z caller=api.go:206 msg="api: registering alertmanager" path_prefix=/alertmanager level=debug ts=2022-12-01T20:48:17.223880971Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/alerts auth=true gzip=true level=debug ts=2022-12-01T20:48:17.224177271Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/alerts auth=true gzip=true level=debug ts=2022-12-01T20:48:17.224481171Z caller=api.go:159 msg="api: registering route" methods=DELETE path=/api/v1/alerts auth=true gzip=true level=info ts=2022-12-01T20:48:17.254032468Z caller=inmemory.go:173 msg="created in-memory index cache" maxItemSizeBytes=134217728 maxSizeBytes=1073741824 maxItems=maxInt level=debug ts=2022-12-01T20:48:17.254895268Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/store-gateway/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:17.255347068Z caller=api.go:159 msg="api: registering route" methods=GET path=/store-gateway/tenants auth=false gzip=true level=debug ts=2022-12-01T20:48:17.255696168Z caller=api.go:159 msg="api: registering route" methods=GET path=/store-gateway/tenant/{tenant}/blocks auth=false gzip=true level=info ts=2022-12-01T20:48:17.276130565Z caller=modules.go:573 msg="RulerStorage is nil. Not starting the ruler." === RUN TestMultiKVSetup/all time="2022-12-01T20:48:17Z" level=info msg="server listening on addresses" grpc="[::]:41459" http="[::]:41347" level=debug ts=2022-12-01T20:48:17.47810184Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.488339439Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.495561238Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.515267036Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.519352035Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.524659035Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.532571934Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.541682533Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.549484132Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:17.573371729Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:17.574933929Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:17.575497729Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:17.578027828Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:17.579344528Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:17.579964828Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=debug ts=2022-12-01T20:48:17.586755927Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=error ts=2022-12-01T20:48:17.590345927Z caller=metrics.go:193 msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" level=warn ts=2022-12-01T20:48:17.599596726Z caller=ingester.go:254 msg="-blocks-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" level=info ts=2022-12-01T20:48:17.612159524Z caller=ingester.go:336 msg="TSDB idle compaction timeout set" timeout=1h10m9.981889874s level=debug ts=2022-12-01T20:48:17.630017022Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/ingester/flush auth=false gzip=true level=debug ts=2022-12-01T20:48:17.633297522Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/ingester/shutdown auth=false gzip=true level=debug ts=2022-12-01T20:48:17.633909622Z caller=api.go:159 msg="api: registering route" methods=POST path=/ingester/push auth=true gzip=false level=info ts=2022-12-01T20:48:17.64766912Z caller=inmemory.go:173 msg="created in-memory index cache" maxItemSizeBytes=134217728 maxSizeBytes=1073741824 maxItems=maxInt level=debug ts=2022-12-01T20:48:17.64962112Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/store-gateway/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:17.650495119Z caller=api.go:159 msg="api: registering route" methods=GET path=/store-gateway/tenants auth=false gzip=true level=debug ts=2022-12-01T20:48:17.650929719Z caller=api.go:159 msg="api: registering route" methods=GET path=/store-gateway/tenant/{tenant}/blocks auth=false gzip=true level=debug ts=2022-12-01T20:48:17.656808919Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/compactor/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:17.657380219Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/start auth=true gzip=false level=debug ts=2022-12-01T20:48:17.658061519Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/files auth=true gzip=false level=debug ts=2022-12-01T20:48:17.658653818Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/finish auth=true gzip=false level=debug ts=2022-12-01T20:48:17.659365718Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/upload/block/{block}/check auth=true gzip=false level=debug ts=2022-12-01T20:48:17.660301418Z caller=api.go:159 msg="api: registering route" methods=POST path=/compactor/delete_tenant auth=true gzip=true level=debug ts=2022-12-01T20:48:17.660901418Z caller=api.go:159 msg="api: registering route" methods=GET path=/compactor/delete_tenant_status auth=true gzip=true level=info ts=2022-12-01T20:48:17.689685415Z caller=modules.go:563 msg="The ruler is not being started because you need to configure the ruler storage." level=info ts=2022-12-01T20:48:17.716858211Z caller=modules.go:573 msg="RulerStorage is nil. Not starting the ruler." level=debug ts=2022-12-01T20:48:17.72438271Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_stats auth=true gzip=true level=debug ts=2022-12-01T20:48:17.72551311Z caller=api.go:159 msg="api: registering route" methods=POST path=/prometheus/api/v1/read auth=true gzip=true level=debug ts=2022-12-01T20:48:17.72955281Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query auth=true gzip=true level=debug ts=2022-12-01T20:48:17.72992701Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_range auth=true gzip=true level=debug ts=2022-12-01T20:48:17.73028781Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_exemplars auth=true gzip=true level=debug ts=2022-12-01T20:48:17.73078001Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/labels auth=true gzip=true level=debug ts=2022-12-01T20:48:17.73117391Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/label/{name}/values auth=true gzip=true level=debug ts=2022-12-01T20:48:17.73169931Z caller=api.go:159 msg="api: registering route" methods=GET,POST,DELETE path=/prometheus/api/v1/series auth=true gzip=true level=debug ts=2022-12-01T20:48:17.73204311Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:17.73240881Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/metadata auth=true gzip=true level=debug ts=2022-12-01T20:48:17.736649809Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_names auth=true gzip=true level=debug ts=2022-12-01T20:48:17.737140209Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_values auth=true gzip=true level=debug ts=2022-12-01T20:48:17.743377808Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/push auth=true gzip=false level=debug ts=2022-12-01T20:48:17.743836108Z caller=api.go:159 msg="api: registering route" methods=POST path=/otlp/v1/metrics auth=true gzip=false level=debug ts=2022-12-01T20:48:17.744162308Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/distributor/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:17.744483108Z caller=api.go:159 msg="api: registering route" methods=GET path=/distributor/all_user_stats auth=false gzip=true level=debug ts=2022-12-01T20:48:17.744829808Z caller=api.go:159 msg="api: registering route" methods=GET path=/distributor/ha_tracker auth=false gzip=true level=info ts=2022-12-01T20:48:17.751676007Z caller=modules.go:416 msg="The querier worker has not been configured with either the query-frontend or query-scheduler address. Because Mimir is running in monolithic mode, it's attempting an automatic worker configuration. If queries are unresponsive, consider explicitly configuring the query-frontend or query-scheduler address for querier worker." address=127.0.0.1:0 level=info ts=2022-12-01T20:48:17.751943307Z caller=worker.go:130 msg="Starting querier worker connected to query-frontend" frontend=127.0.0.1:0 === RUN TestMultiKVSetup/ruler time="2022-12-01T20:48:17Z" level=info msg="server listening on addresses" grpc="[::]:38335" http="[::]:40025" level=debug ts=2022-12-01T20:48:17.931166085Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.934566185Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.938401384Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.944145984Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.947308383Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.950477383Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.957187082Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.964903081Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:17.969766781Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:17.97152948Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:17.97184828Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:17.97211548Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:17.97268848Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:17.97376248Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:17.97408778Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=debug ts=2022-12-01T20:48:17.981470479Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=error ts=2022-12-01T20:48:17.984773179Z caller=metrics.go:193 msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" level=warn ts=2022-12-01T20:48:17.988785478Z caller=storage.go:29 msg="-ruler-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" level=info ts=2022-12-01T20:48:18.038571672Z caller=mapper.go:52 msg="cleaning up mapped rules directory" path=./data-ruler/ level=debug ts=2022-12-01T20:48:18.051297471Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/ruler/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:18.051772071Z caller=api.go:159 msg="api: registering route" methods=POST path=/ruler/delete_tenant_config auth=true gzip=true level=debug ts=2022-12-01T20:48:18.052158871Z caller=api.go:159 msg="api: registering route" methods=GET path=/ruler/rule_groups auth=false gzip=true level=debug ts=2022-12-01T20:48:18.05644927Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/rules auth=true gzip=true level=debug ts=2022-12-01T20:48:18.05708237Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/alerts auth=true gzip=true level=debug ts=2022-12-01T20:48:18.05747747Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:18.05790157Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/config/v1/rules auth=true gzip=true level=debug ts=2022-12-01T20:48:18.05831467Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/config/v1/rules/{namespace} auth=true gzip=true level=debug ts=2022-12-01T20:48:18.05885777Z caller=api.go:159 msg="api: registering route" methods=GET path=/prometheus/config/v1/rules/{namespace}/{groupName} auth=true gzip=true level=debug ts=2022-12-01T20:48:18.063354669Z caller=api.go:159 msg="api: registering route" methods=POST path=/prometheus/config/v1/rules/{namespace} auth=true gzip=true level=debug ts=2022-12-01T20:48:18.063864269Z caller=api.go:159 msg="api: registering route" methods=DELETE path=/prometheus/config/v1/rules/{namespace}/{groupName} auth=true gzip=true level=debug ts=2022-12-01T20:48:18.064429269Z caller=api.go:159 msg="api: registering route" methods=DELETE path=/prometheus/config/v1/rules/{namespace} auth=true gzip=true === RUN TestMultiKVSetup/distributor time="2022-12-01T20:48:18Z" level=info msg="server listening on addresses" grpc="[::]:38065" http="[::]:33817" level=debug ts=2022-12-01T20:48:18.299328841Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:18.30365614Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:18.308648739Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:18.330393637Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:18.334207536Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:18.338443036Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:18.346612635Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:18.354688834Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="enp1s0 tap0" level=debug ts=2022-12-01T20:48:18.360002533Z caller=api.go:159 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-12-01T20:48:18.361531433Z caller=api.go:159 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-12-01T20:48:18.361853333Z caller=api.go:164 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-12-01T20:48:18.362149533Z caller=api.go:159 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-12-01T20:48:18.362879233Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-12-01T20:48:18.363979133Z caller=api.go:159 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-12-01T20:48:18.364302633Z caller=api.go:159 msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true level=debug ts=2022-12-01T20:48:18.371454032Z caller=api.go:159 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=error ts=2022-12-01T20:48:18.375108631Z caller=metrics.go:193 msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" level=debug ts=2022-12-01T20:48:18.38837793Z caller=api.go:159 msg="api: registering route" methods=POST path=/api/v1/push auth=true gzip=false level=debug ts=2022-12-01T20:48:18.38901743Z caller=api.go:159 msg="api: registering route" methods=POST path=/otlp/v1/metrics auth=true gzip=false level=debug ts=2022-12-01T20:48:18.390186429Z caller=api.go:159 msg="api: registering route" methods=GET,POST path=/distributor/ring auth=false gzip=true level=debug ts=2022-12-01T20:48:18.390532329Z caller=api.go:159 msg="api: registering route" methods=GET path=/distributor/all_user_stats auth=false gzip=true level=debug ts=2022-12-01T20:48:18.390884929Z caller=api.go:159 msg="api: registering route" methods=GET path=/distributor/ha_tracker auth=false gzip=true --- PASS: TestMultiKVSetup (2.86s) --- PASS: TestMultiKVSetup/alertmanager (0.23s) --- PASS: TestMultiKVSetup/store-gateway (0.24s) --- PASS: TestMultiKVSetup/querier (0.26s) --- PASS: TestMultiKVSetup/ingester (0.19s) --- PASS: TestMultiKVSetup/compactor (0.28s) --- PASS: TestMultiKVSetup/query-scheduler (0.24s) --- PASS: TestMultiKVSetup/backend (0.28s) --- PASS: TestMultiKVSetup/all (0.48s) --- PASS: TestMultiKVSetup/ruler (0.31s) --- PASS: TestMultiKVSetup/distributor (0.32s) === RUN TestLoadRuntimeConfig_ShouldLoadAnchoredYAML --- PASS: TestLoadRuntimeConfig_ShouldLoadAnchoredYAML (0.00s) === RUN TestLoadRuntimeConfig_ShouldLoadEmptyFile --- PASS: TestLoadRuntimeConfig_ShouldLoadEmptyFile (0.00s) === RUN TestLoadRuntimeConfig_MissingPointerFieldsAreNil --- PASS: TestLoadRuntimeConfig_MissingPointerFieldsAreNil (0.00s) === RUN TestLoadRuntimeConfig_ShouldReturnErrorOnMultipleDocumentsInTheConfig --- PASS: TestLoadRuntimeConfig_ShouldReturnErrorOnMultipleDocumentsInTheConfig (0.00s) === RUN TestCheckObjectStoresConfig === RUN TestCheckObjectStoresConfig/should_succeed_with_the_default_config === PAUSE TestCheckObjectStoresConfig/should_succeed_with_the_default_config === RUN TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) === PAUSE TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config === RUN TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all === PAUSE TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all === RUN TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester === PAUSE TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester === RUN TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager === PAUSE TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager === RUN TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler === PAUSE TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config === CONT TestCheckObjectStoresConfig/should_succeed_with_the_default_config === CONT TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config === CONT TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler === CONT TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager === CONT TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config === CONT TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) --- PASS: TestCheckObjectStoresConfig (0.00s) --- PASS: TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester (0.09s) --- PASS: TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all (0.11s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config (0.11s) --- PASS: TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler (0.11s) --- PASS: TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager (0.12s) --- PASS: TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) (0.05s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config (0.18s) --- PASS: TestCheckObjectStoresConfig/should_succeed_with_the_default_config (0.22s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config (0.20s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config (2.30s) === RUN TestCheckDirectoryReadWriteAccess === RUN TestCheckDirectoryReadWriteAccess/store-gateway === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/compactor === RUN TestCheckDirectoryReadWriteAccess/compactor/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/compactor/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/compactor/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/compactor/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ruler === RUN TestCheckDirectoryReadWriteAccess/ruler/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ruler/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ruler/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ruler/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ingester === RUN TestCheckDirectoryReadWriteAccess/ingester/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/ingester/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ingester/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ingester/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access --- PASS: TestCheckDirectoryReadWriteAccess (1.15s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway (0.36s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_on_directory_without_write_access (0.14s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_on_directory_with_read-write_access (0.11s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.07s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor (0.17s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_fail_on_directory_without_write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_pass_on_directory_with_read-write_access (0.05s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler (0.23s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_pass_on_directory_with_read-write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.07s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_fail_on_directory_without_write_access (0.05s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager (0.16s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_on_directory_without_write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_on_directory_with_read-write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester (0.22s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_fail_on_directory_without_write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_pass_on_directory_with_read-write_access (0.08s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.06s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.04s) === RUN TestServerStopViaContext level=info ts=2022-12-01T20:48:22.473850633Z caller=server_service.go:55 msg="server stopped" --- PASS: TestServerStopViaContext (0.51s) === RUN TestServerStopViaShutdown level=info ts=2022-12-01T20:48:22.477941432Z caller=server_service.go:55 msg="server stopped" --- PASS: TestServerStopViaShutdown (0.00s) === RUN TestServerStopViaStop level=info ts=2022-12-01T20:48:22.49363433Z caller=server_service.go:55 msg="server stopped" --- PASS: TestServerStopViaStop (0.01s) === RUN TestJaegerToOpenTelemetryTraceID --- PASS: TestJaegerToOpenTelemetryTraceID (0.00s) === RUN TestJaegerToOpenTelemetrySpanID --- PASS: TestJaegerToOpenTelemetrySpanID (0.00s) === RUN TestOpenTelemetrySpanBridge_RecordError === RUN TestOpenTelemetrySpanBridge_RecordError/no_attributes === RUN TestOpenTelemetrySpanBridge_RecordError/one_attribute === RUN TestOpenTelemetrySpanBridge_RecordError/multiple_attributes --- PASS: TestOpenTelemetrySpanBridge_RecordError (0.03s) --- PASS: TestOpenTelemetrySpanBridge_RecordError/no_attributes (0.01s) --- PASS: TestOpenTelemetrySpanBridge_RecordError/one_attribute (0.01s) --- PASS: TestOpenTelemetrySpanBridge_RecordError/multiple_attributes (0.01s) === RUN TestOpenTelemetrySpanBridge_AddEvent === RUN TestOpenTelemetrySpanBridge_AddEvent/no_attributes === RUN TestOpenTelemetrySpanBridge_AddEvent/one_attribute === RUN TestOpenTelemetrySpanBridge_AddEvent/multiple_attributes --- PASS: TestOpenTelemetrySpanBridge_AddEvent (0.01s) --- PASS: TestOpenTelemetrySpanBridge_AddEvent/no_attributes (0.00s) --- PASS: TestOpenTelemetrySpanBridge_AddEvent/one_attribute (0.00s) --- PASS: TestOpenTelemetrySpanBridge_AddEvent/multiple_attributes (0.00s) === RUN TestCommonConfigCanBeExtended === RUN TestCommonConfigCanBeExtended/flag_inheritance === RUN TestCommonConfigCanBeExtended/yaml_inheritance --- PASS: TestCommonConfigCanBeExtended (0.15s) --- PASS: TestCommonConfigCanBeExtended/flag_inheritance (0.10s) --- PASS: TestCommonConfigCanBeExtended/yaml_inheritance (0.05s) === RUN TestMimirConfigCanBeInlined --- PASS: TestMimirConfigCanBeInlined (0.05s) PASS ok github.com/grafana/mimir/pkg/mimir 17.934s === RUN TestJsoniterMarshalForSample --- PASS: TestJsoniterMarshalForSample (0.00s) === RUN TestStdlibJsonMarshalForSample --- PASS: TestStdlibJsonMarshalForSample (0.01s) === RUN TestJsoniterUnmarshalForSample --- PASS: TestJsoniterUnmarshalForSample (0.00s) === RUN TestStdlibJsonUnmarshalForSample --- PASS: TestStdlibJsonUnmarshalForSample (0.01s) === RUN TestMetricMetadataToMetricTypeToMetricType === RUN TestMetricMetadataToMetricTypeToMetricType/with_a_single-word_metric === RUN TestMetricMetadataToMetricTypeToMetricType/with_a_two-word_metric === RUN TestMetricMetadataToMetricTypeToMetricType/with_an_unknown_metric --- PASS: TestMetricMetadataToMetricTypeToMetricType (0.00s) --- PASS: TestMetricMetadataToMetricTypeToMetricType/with_a_single-word_metric (0.00s) --- PASS: TestMetricMetadataToMetricTypeToMetricType/with_a_two-word_metric (0.00s) --- PASS: TestMetricMetadataToMetricTypeToMetricType/with_an_unknown_metric (0.00s) === RUN TestFromLabelAdaptersToLabels --- PASS: TestFromLabelAdaptersToLabels (0.00s) === RUN TestFromLabelAdaptersToLabelsWithCopy --- PASS: TestFromLabelAdaptersToLabelsWithCopy (0.00s) === RUN TestFromPointsToSamples --- PASS: TestFromPointsToSamples (0.00s) === RUN TestLabelAdapter_Marshal === RUN TestLabelAdapter_Marshal/foo === RUN TestLabelAdapter_Marshal/very_long_label_name === RUN TestLabelAdapter_Marshal/#00 === RUN TestLabelAdapter_Marshal/#01 --- PASS: TestLabelAdapter_Marshal (0.00s) --- PASS: TestLabelAdapter_Marshal/foo (0.00s) --- PASS: TestLabelAdapter_Marshal/very_long_label_name (0.00s) --- PASS: TestLabelAdapter_Marshal/#00 (0.00s) --- PASS: TestLabelAdapter_Marshal/#01 (0.00s) === RUN TestPreallocTimeseriesSliceFromPool === RUN TestPreallocTimeseriesSliceFromPool/new_instance_is_provided_when_not_available_to_reuse === RUN TestPreallocTimeseriesSliceFromPool/instance_is_cleaned_before_reusing --- PASS: TestPreallocTimeseriesSliceFromPool (0.00s) --- PASS: TestPreallocTimeseriesSliceFromPool/new_instance_is_provided_when_not_available_to_reuse (0.00s) --- PASS: TestPreallocTimeseriesSliceFromPool/instance_is_cleaned_before_reusing (0.00s) === RUN TestTimeseriesFromPool === RUN TestTimeseriesFromPool/new_instance_is_provided_when_not_available_to_reuse === RUN TestTimeseriesFromPool/instance_is_cleaned_before_reusing --- PASS: TestTimeseriesFromPool (0.00s) --- PASS: TestTimeseriesFromPool/new_instance_is_provided_when_not_available_to_reuse (0.00s) --- PASS: TestTimeseriesFromPool/instance_is_cleaned_before_reusing (0.00s) === RUN TestCopyToYoloString --- PASS: TestCopyToYoloString (0.00s) === RUN TestDeepCopyTimeseries --- PASS: TestDeepCopyTimeseries (0.00s) === RUN TestDeepCopyTimeseriesExemplars --- PASS: TestDeepCopyTimeseriesExemplars (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirpb 1.041s ? github.com/grafana/mimir/pkg/mimirtool/analyze [no test files] ? github.com/grafana/mimir/pkg/mimirtool/backfill [no test files] === RUN TestBuildURL === RUN TestBuildURL/builds_the_correct_URL_with_a_trailing_slash === RUN TestBuildURL/builds_the_correct_URL_without_a_trailing_slash === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_with_trailing_slash === RUN TestBuildURL/builds_the_correct_URL_with_a_trailing_slash_and_the_target_path_contains_special_characters === RUN TestBuildURL/builds_the_correct_URL_without_a_trailing_slash_and_the_target_path_contains_special_characters === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_contains_special_characters === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_starts_with_a_escaped_slash === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_ends_with_a_escaped_slash --- PASS: TestBuildURL (0.03s) --- PASS: TestBuildURL/builds_the_correct_URL_with_a_trailing_slash (0.01s) --- PASS: TestBuildURL/builds_the_correct_URL_without_a_trailing_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_with_trailing_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_with_a_trailing_slash_and_the_target_path_contains_special_characters (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_without_a_trailing_slash_and_the_target_path_contains_special_characters (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_contains_special_characters (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_starts_with_a_escaped_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_ends_with_a_escaped_slash (0.00s) === RUN TestMimirClient_X === RUN TestMimirClient_X/regular-characters === RUN TestMimirClient_X/special-characters-spaces === RUN TestMimirClient_X/special-characters-slashes === RUN TestMimirClient_X/special-characters-slash-first === RUN TestMimirClient_X/special-characters-slash-first#01 --- PASS: TestMimirClient_X (0.11s) --- PASS: TestMimirClient_X/regular-characters (0.07s) --- PASS: TestMimirClient_X/special-characters-spaces (0.01s) --- PASS: TestMimirClient_X/special-characters-slashes (0.01s) --- PASS: TestMimirClient_X/special-characters-slash-first (0.01s) --- PASS: TestMimirClient_X/special-characters-slash-first#01 (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/client 1.694s === RUN TestParseMetricsInBoard --- PASS: TestParseMetricsInBoard (0.19s) === RUN TestParseMetricsInBoardWithTimeseriesPanel --- PASS: TestParseMetricsInBoardWithTimeseriesPanel (0.00s) === RUN TestParseMetricsInRuleFile --- PASS: TestParseMetricsInRuleFile (0.29s) === RUN TestNewEnvVarsWithPrefix === RUN TestNewEnvVarsWithPrefix/PREFIX === RUN TestNewEnvVarsWithPrefix/PREFIX/Address === RUN TestNewEnvVarsWithPrefix/PREFIX/APIKey === RUN TestNewEnvVarsWithPrefix/PREFIX/APIUser === RUN TestNewEnvVarsWithPrefix/PREFIX/TLSCAPath === RUN TestNewEnvVarsWithPrefix/PREFIX/TLSCertPath === RUN TestNewEnvVarsWithPrefix/PREFIX/TLSKeyPath === RUN TestNewEnvVarsWithPrefix/PREFIX/TenantID === RUN TestNewEnvVarsWithPrefix/PREFIX/UseLegacyRoutes === RUN TestNewEnvVarsWithPrefix/PREFIX/AuthToken === RUN TestNewEnvVarsWithPrefix/PREFIX_ === RUN TestNewEnvVarsWithPrefix/PREFIX_/Address === RUN TestNewEnvVarsWithPrefix/PREFIX_/APIKey === RUN TestNewEnvVarsWithPrefix/PREFIX_/APIUser === RUN TestNewEnvVarsWithPrefix/PREFIX_/TLSCAPath === RUN TestNewEnvVarsWithPrefix/PREFIX_/TLSCertPath === RUN TestNewEnvVarsWithPrefix/PREFIX_/TLSKeyPath === RUN TestNewEnvVarsWithPrefix/PREFIX_/TenantID === RUN TestNewEnvVarsWithPrefix/PREFIX_/UseLegacyRoutes === RUN TestNewEnvVarsWithPrefix/PREFIX_/AuthToken === RUN TestNewEnvVarsWithPrefix/#00 === RUN TestNewEnvVarsWithPrefix/#00/Address === RUN TestNewEnvVarsWithPrefix/#00/APIKey === RUN TestNewEnvVarsWithPrefix/#00/APIUser === RUN TestNewEnvVarsWithPrefix/#00/TLSCAPath === RUN TestNewEnvVarsWithPrefix/#00/TLSCertPath === RUN TestNewEnvVarsWithPrefix/#00/TLSKeyPath === RUN TestNewEnvVarsWithPrefix/#00/TenantID === RUN TestNewEnvVarsWithPrefix/#00/UseLegacyRoutes === RUN TestNewEnvVarsWithPrefix/#00/AuthToken --- PASS: TestNewEnvVarsWithPrefix (0.03s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX (0.01s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/Address (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/APIKey (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/APIUser (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TLSCAPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TLSCertPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TLSKeyPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TenantID (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/UseLegacyRoutes (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/AuthToken (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_ (0.01s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/Address (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/APIKey (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/APIUser (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TLSCAPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TLSCertPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TLSKeyPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TenantID (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/UseLegacyRoutes (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/AuthToken (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00 (0.01s) --- PASS: TestNewEnvVarsWithPrefix/#00/Address (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/APIKey (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/APIUser (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TLSCAPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TLSCertPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TLSKeyPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TenantID (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/UseLegacyRoutes (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/AuthToken (0.00s) === RUN TestTimeSeriesIterator === RUN TestTimeSeriesIterator/empty_time_series === RUN TestTimeSeriesIterator/simple === RUN TestTimeSeriesIterator/edge-cases --- PASS: TestTimeSeriesIterator (0.00s) --- PASS: TestTimeSeriesIterator/empty_time_series (0.00s) --- PASS: TestTimeSeriesIterator/simple (0.00s) --- PASS: TestTimeSeriesIterator/edge-cases (0.00s) === RUN TestCheckDuplicates === RUN TestCheckDuplicates/no_duplicates === RUN TestCheckDuplicates/with_duplicates --- PASS: TestCheckDuplicates (0.00s) --- PASS: TestCheckDuplicates/no_duplicates (0.00s) --- PASS: TestCheckDuplicates/with_duplicates (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/commands 7.832s === RUN TestConvert_Cortex === RUN TestConvert_Cortex/shouldn't_need_any_conversion === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion === RUN TestConvert_Cortex/shouldn't_need_any_conversion_with_flags === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion_with_flags === RUN TestConvert_Cortex/simple_rename === PAUSE TestConvert_Cortex/simple_rename === RUN TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ === PAUSE TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ === RUN TestConvert_Cortex/query_range_cache_params_are_renamed === PAUSE TestConvert_Cortex/query_range_cache_params_are_renamed === RUN TestConvert_Cortex/with_non-primitive_flags === PAUSE TestConvert_Cortex/with_non-primitive_flags === RUN TestConvert_Cortex/with_renamed_flags === PAUSE TestConvert_Cortex/with_renamed_flags === RUN TestConvert_Cortex/config_flags_have_precedence === PAUSE TestConvert_Cortex/config_flags_have_precedence === RUN TestConvert_Cortex/ruler.storage_maps_to_ruler_storage === PAUSE TestConvert_Cortex/ruler.storage_maps_to_ruler_storage === RUN TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage === PAUSE TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage === RUN TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage === PAUSE TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage === RUN TestConvert_Cortex/ruler_S3_SSE_conversion_work === PAUSE TestConvert_Cortex/ruler_S3_SSE_conversion_work === RUN TestConvert_Cortex/alertmanager_S3_SSE_conversion_work === PAUSE TestConvert_Cortex/alertmanager_S3_SSE_conversion_work === RUN TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values === PAUSE TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values === RUN TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service === PAUSE TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service === RUN TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service === PAUSE TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service === RUN TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML === PAUSE TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML === RUN TestConvert_Cortex/ingester_ring_config === PAUSE TestConvert_Cortex/ingester_ring_config === RUN TestConvert_Cortex/sharding_with_consul_enabled === PAUSE TestConvert_Cortex/sharding_with_consul_enabled === RUN TestConvert_Cortex/sharding_disabled === PAUSE TestConvert_Cortex/sharding_disabled === RUN TestConvert_Cortex/ruler_S3_URL === PAUSE TestConvert_Cortex/ruler_S3_URL === RUN TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence === PAUSE TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 === RUN TestConvert_Cortex/alertmanager_S3_URL === PAUSE TestConvert_Cortex/alertmanager_S3_URL === RUN TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten === PAUSE TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten === RUN TestConvert_Cortex/CSV_string_slice_with_single_value === PAUSE TestConvert_Cortex/CSV_string_slice_with_single_value === RUN TestConvert_Cortex/CSV_string_slice === PAUSE TestConvert_Cortex/CSV_string_slice === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === RUN TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped === PAUSE TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped === RUN TestConvert_Cortex/duration_list_flags === PAUSE TestConvert_Cortex/duration_list_flags === RUN TestConvert_Cortex/duration_list_YAML === PAUSE TestConvert_Cortex/duration_list_YAML === RUN TestConvert_Cortex/instance_id_is_preserved === PAUSE TestConvert_Cortex/instance_id_is_preserved === RUN TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true === PAUSE TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true === CONT TestConvert_Cortex/shouldn't_need_any_conversion === CONT TestConvert_Cortex/ruler_S3_URL === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays === CONT TestConvert_Cortex/alertmanager_S3_URL === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned === RUN TestConvert_Cortex/ruler_S3_URL/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL/gem170->gem === CONT TestConvert_Cortex/sharding_with_consul_enabled === CONT TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir === RUN TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir === PAUSE TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir === RUN TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem === PAUSE TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem === CONT TestConvert_Cortex/ingester_ring_config === RUN TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir === RUN TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir === RUN TestConvert_Cortex/alertmanager_S3_URL/gem170->gem === PAUSE TestConvert_Cortex/alertmanager_S3_URL/gem170->gem === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir === CONT TestConvert_Cortex/CSV_string_slice === CONT TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML === RUN TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir === RUN TestConvert_Cortex/ingester_ring_config/cortex->mimir === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir === RUN TestConvert_Cortex/CSV_string_slice/cortex->mimir === PAUSE TestConvert_Cortex/ingester_ring_config/cortex->mimir === PAUSE TestConvert_Cortex/CSV_string_slice/cortex->mimir === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem === RUN TestConvert_Cortex/CSV_string_slice/gem170->gem === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem === PAUSE TestConvert_Cortex/CSV_string_slice/gem170->gem === RUN TestConvert_Cortex/ingester_ring_config/gem170->gem === PAUSE TestConvert_Cortex/ingester_ring_config/gem170->gem === CONT TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service === RUN TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir === PAUSE TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir === RUN TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem === PAUSE TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem === RUN TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir === PAUSE TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_SSE_conversion_work === RUN TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem === CONT TestConvert_Cortex/sharding_disabled === PAUSE TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem === PAUSE TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem === CONT TestConvert_Cortex/ruler_S3_SSE_conversion_work === RUN TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir === RUN TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem === RUN TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir === CONT TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values === RUN TestConvert_Cortex/sharding_disabled/cortex->mimir === PAUSE TestConvert_Cortex/sharding_disabled/cortex->mimir === RUN TestConvert_Cortex/sharding_disabled/gem170->gem === PAUSE TestConvert_Cortex/sharding_disabled/gem170->gem === RUN TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem === RUN TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir === PAUSE TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir === RUN TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem === PAUSE TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem === CONT TestConvert_Cortex/CSV_string_slice_with_single_value === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem === CONT TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir === RUN TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir === PAUSE TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir === RUN TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem === PAUSE TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem === CONT TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped === RUN TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir === PAUSE TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir === RUN TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem === PAUSE TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem === RUN TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir === PAUSE TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir === RUN TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem === PAUSE TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem === CONT TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true === CONT TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten === CONT TestConvert_Cortex/duration_list_YAML === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir === RUN TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem === RUN TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem === RUN TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir === RUN TestConvert_Cortex/duration_list_YAML/cortex->mimir === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem === PAUSE TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir === RUN TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem === PAUSE TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir === CONT TestConvert_Cortex/instance_id_is_preserved === RUN TestConvert_Cortex/instance_id_is_preserved/cortex->mimir === CONT TestConvert_Cortex/with_non-primitive_flags === RUN TestConvert_Cortex/with_non-primitive_flags/cortex->mimir === PAUSE TestConvert_Cortex/with_non-primitive_flags/cortex->mimir === RUN TestConvert_Cortex/with_non-primitive_flags/gem170->gem === PAUSE TestConvert_Cortex/with_non-primitive_flags/gem170->gem === PAUSE TestConvert_Cortex/instance_id_is_preserved/cortex->mimir === RUN TestConvert_Cortex/instance_id_is_preserved/gem170->gem === PAUSE TestConvert_Cortex/instance_id_is_preserved/gem170->gem === CONT TestConvert_Cortex/ruler.storage_maps_to_ruler_storage === RUN TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir === PAUSE TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir === RUN TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem === PAUSE TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem === RUN TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir === PAUSE TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir === RUN TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem === PAUSE TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem === CONT TestConvert_Cortex/with_renamed_flags === RUN TestConvert_Cortex/with_renamed_flags/cortex->mimir === PAUSE TestConvert_Cortex/with_renamed_flags/cortex->mimir === RUN TestConvert_Cortex/with_renamed_flags/gem170->gem === PAUSE TestConvert_Cortex/with_renamed_flags/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence === RUN TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem === PAUSE TestConvert_Cortex/duration_list_YAML/cortex->mimir === RUN TestConvert_Cortex/duration_list_YAML/gem170->gem === PAUSE TestConvert_Cortex/duration_list_YAML/gem170->gem === CONT TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ === CONT TestConvert_Cortex/query_range_cache_params_are_renamed === RUN TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir === RUN TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem === RUN TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir === PAUSE TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir === RUN TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem === PAUSE TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem === PAUSE TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem === CONT TestConvert_Cortex/shouldn't_need_any_conversion_with_flags === RUN TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir === RUN TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir === CONT TestConvert_Cortex/duration_list_flags === CONT TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir === RUN TestConvert_Cortex/duration_list_flags/cortex->mimir === PAUSE TestConvert_Cortex/duration_list_flags/cortex->mimir === RUN TestConvert_Cortex/duration_list_flags/gem170->gem === PAUSE TestConvert_Cortex/duration_list_flags/gem170->gem === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL/gem170->gem === CONT TestConvert_Cortex/simple_rename === CONT TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage === CONT TestConvert_Cortex/config_flags_have_precedence === CONT TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_Cortex/simple_rename/cortex->mimir === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_Cortex/simple_rename/cortex->mimir === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir === RUN TestConvert_Cortex/simple_rename/gem170->gem === PAUSE TestConvert_Cortex/simple_rename/gem170->gem === CONT TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir === RUN TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir === PAUSE TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir === RUN TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem === CONT TestConvert_Cortex/alertmanager_S3_URL/gem170->gem === RUN TestConvert_Cortex/config_flags_have_precedence/cortex->mimir === PAUSE TestConvert_Cortex/config_flags_have_precedence/cortex->mimir === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir === PAUSE TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem === CONT TestConvert_Cortex/CSV_string_slice/cortex->mimir === CONT TestConvert_Cortex/ingester_ring_config/cortex->mimir === CONT TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir === CONT TestConvert_Cortex/CSV_string_slice/gem170->gem === CONT TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem === CONT TestConvert_Cortex/ingester_ring_config/gem170->gem === CONT TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir === CONT TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir === CONT TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem === CONT TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem === CONT TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem === CONT TestConvert_Cortex/sharding_disabled/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir === CONT TestConvert_Cortex/sharding_disabled/gem170->gem === CONT TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem === CONT TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir === CONT TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir === CONT TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir === CONT TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem === CONT TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem === CONT TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem === CONT TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem === CONT TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir === CONT TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem === CONT TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem === CONT TestConvert_Cortex/with_non-primitive_flags/cortex->mimir === CONT TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir === CONT TestConvert_Cortex/instance_id_is_preserved/cortex->mimir === CONT TestConvert_Cortex/with_non-primitive_flags/gem170->gem === CONT TestConvert_Cortex/instance_id_is_preserved/gem170->gem === CONT TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem === CONT TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir === CONT TestConvert_Cortex/with_renamed_flags/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir === CONT TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem === CONT TestConvert_Cortex/duration_list_YAML/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem === CONT TestConvert_Cortex/with_renamed_flags/gem170->gem === CONT TestConvert_Cortex/duration_list_YAML/gem170->gem === CONT TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir === CONT TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir === CONT TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem === CONT TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem === CONT TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir === CONT TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir === CONT TestConvert_Cortex/duration_list_flags/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir === CONT TestConvert_Cortex/duration_list_flags/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir === CONT TestConvert_Cortex/simple_rename/cortex->mimir === CONT TestConvert_Cortex/config_flags_have_precedence/cortex->mimir === CONT TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir === CONT TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem === CONT TestConvert_Cortex/simple_rename/gem170->gem --- PASS: TestConvert_Cortex (0.03s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL (0.00s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir (0.83s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL/gem170->gem (0.89s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays (0.00s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir (0.73s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem (0.83s) --- PASS: TestConvert_Cortex/ruler_S3_URL (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL/cortex->mimir (0.73s) --- PASS: TestConvert_Cortex/ruler_S3_URL/gem170->gem (0.93s) --- PASS: TestConvert_Cortex/sharding_with_consul_enabled (0.00s) --- PASS: TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir (0.71s) --- PASS: TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem (1.07s) --- PASS: TestConvert_Cortex/CSV_string_slice (0.00s) --- PASS: TestConvert_Cortex/CSV_string_slice/gem170->gem (0.51s) --- PASS: TestConvert_Cortex/CSV_string_slice/cortex->mimir (0.77s) --- PASS: TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service (0.00s) --- PASS: TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir (0.37s) --- PASS: TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem (0.61s) --- PASS: TestConvert_Cortex/ingester_ring_config (0.00s) --- PASS: TestConvert_Cortex/ingester_ring_config/cortex->mimir (0.54s) --- PASS: TestConvert_Cortex/ingester_ring_config/gem170->gem (0.74s) --- PASS: TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML (0.00s) --- PASS: TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir (0.62s) --- PASS: TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem (0.75s) --- PASS: TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage (0.01s) --- PASS: TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir (0.64s) --- PASS: TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem (0.88s) --- PASS: TestConvert_Cortex/alertmanager_S3_SSE_conversion_work (0.00s) --- PASS: TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir (0.38s) --- PASS: TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem (0.70s) --- PASS: TestConvert_Cortex/sharding_disabled (0.00s) --- PASS: TestConvert_Cortex/sharding_disabled/cortex->mimir (0.64s) --- PASS: TestConvert_Cortex/sharding_disabled/gem170->gem (0.69s) --- PASS: TestConvert_Cortex/ruler_S3_SSE_conversion_work (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir (0.52s) --- PASS: TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem (0.82s) --- PASS: TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values (0.00s) --- PASS: TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir (0.56s) --- PASS: TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem (0.92s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned (0.01s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir (0.49s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem (0.73s) --- PASS: TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service (0.00s) --- PASS: TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir (0.58s) --- PASS: TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem (0.64s) --- PASS: TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped (0.00s) --- PASS: TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir (0.57s) --- PASS: TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem (0.94s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion (0.02s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir (0.36s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem (0.60s) --- PASS: TestConvert_Cortex/CSV_string_slice_with_single_value (0.00s) --- PASS: TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir (0.45s) --- PASS: TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem (0.91s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir (0.67s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem (0.77s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false (0.00s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir (0.34s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten (0.00s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir (0.62s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem (0.73s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir (0.59s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem (0.70s) --- PASS: TestConvert_Cortex/with_non-primitive_flags (0.00s) --- PASS: TestConvert_Cortex/with_non-primitive_flags/cortex->mimir (0.57s) --- PASS: TestConvert_Cortex/with_non-primitive_flags/gem170->gem (0.77s) --- PASS: TestConvert_Cortex/instance_id_is_preserved (0.00s) --- PASS: TestConvert_Cortex/instance_id_is_preserved/cortex->mimir (0.45s) --- PASS: TestConvert_Cortex/instance_id_is_preserved/gem170->gem (0.87s) --- PASS: TestConvert_Cortex/ruler.storage_maps_to_ruler_storage (0.00s) --- PASS: TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir (0.45s) --- PASS: TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem (0.89s) --- PASS: TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true (0.01s) --- PASS: TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir (0.58s) --- PASS: TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem (0.72s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir (0.69s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem (0.74s) --- PASS: TestConvert_Cortex/with_renamed_flags (0.00s) --- PASS: TestConvert_Cortex/with_renamed_flags/cortex->mimir (0.62s) --- PASS: TestConvert_Cortex/with_renamed_flags/gem170->gem (0.65s) --- PASS: TestConvert_Cortex/duration_list_YAML (0.01s) --- PASS: TestConvert_Cortex/duration_list_YAML/cortex->mimir (0.59s) --- PASS: TestConvert_Cortex/duration_list_YAML/gem170->gem (0.75s) --- PASS: TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ (0.00s) --- PASS: TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir (0.65s) --- PASS: TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem (0.83s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true (0.00s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir (0.43s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default (0.00s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir (0.36s) --- PASS: TestConvert_Cortex/query_range_cache_params_are_renamed (0.00s) --- PASS: TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir (0.47s) --- PASS: TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem (0.85s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion_with_flags (0.00s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir (0.59s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem (0.82s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false (0.00s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir (0.41s) --- PASS: TestConvert_Cortex/config_flags_have_precedence (0.00s) --- PASS: TestConvert_Cortex/config_flags_have_precedence/cortex->mimir (0.60s) --- PASS: TestConvert_Cortex/duration_list_flags (0.00s) --- PASS: TestConvert_Cortex/duration_list_flags/cortex->mimir (0.68s) --- PASS: TestConvert_Cortex/duration_list_flags/gem170->gem (0.82s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir (0.59s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem (0.81s) --- PASS: TestConvert_Cortex/simple_rename (0.00s) --- PASS: TestConvert_Cortex/simple_rename/cortex->mimir (0.55s) --- PASS: TestConvert_Cortex/simple_rename/gem170->gem (0.50s) --- PASS: TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage (0.00s) --- PASS: TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir (0.48s) --- PASS: TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem (0.54s) === RUN TestConvert_GEM === RUN TestConvert_GEM/proxy_targets_get_translated === PAUSE TestConvert_GEM/proxy_targets_get_translated === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/instance_id_is_preserved === PAUSE TestConvert_GEM/instance_id_is_preserved === CONT TestConvert_GEM/proxy_targets_get_translated === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/proxy_targets_get_translated/gem170->gem === PAUSE TestConvert_GEM/proxy_targets_get_translated/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === CONT TestConvert_GEM/proxy_targets_get_translated/gem170->gem === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem === CONT TestConvert_GEM/instance_id_is_preserved === RUN TestConvert_GEM/instance_id_is_preserved/gem170->gem === PAUSE TestConvert_GEM/instance_id_is_preserved/gem170->gem === CONT TestConvert_GEM/instance_id_is_preserved/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem --- PASS: TestConvert_GEM (0.02s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false (0.01s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem (0.40s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem (0.44s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem (0.50s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem (0.53s) --- PASS: TestConvert_GEM/instance_id_is_preserved (0.00s) --- PASS: TestConvert_GEM/instance_id_is_preserved/gem170->gem (0.58s) --- PASS: TestConvert_GEM/proxy_targets_get_translated (0.00s) --- PASS: TestConvert_GEM/proxy_targets_get_translated/gem170->gem (0.63s) === RUN TestConvert_InvalidConfigs === RUN TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory === RUN TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets === CONT TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory === CONT TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets === RUN TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir === RUN TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir === RUN TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem === CONT TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir === RUN TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem === CONT TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem === CONT TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir === CONT TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem --- PASS: TestConvert_InvalidConfigs (0.00s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets (0.00s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir (0.10s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem (0.12s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory (0.01s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir (0.11s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem (0.12s) === RUN TestReportDeletedFlags === RUN TestReportDeletedFlags/unsupported_config_options_and_flags === RUN TestReportDeletedFlags/flags_without_YAML_equivalents === RUN TestReportDeletedFlags/no_unsupported_options === RUN TestReportDeletedFlags/unsupported_config_option === RUN TestReportDeletedFlags/unsupported_CLI_flag --- PASS: TestReportDeletedFlags (0.14s) --- PASS: TestReportDeletedFlags/unsupported_config_options_and_flags (0.04s) --- PASS: TestReportDeletedFlags/flags_without_YAML_equivalents (0.02s) --- PASS: TestReportDeletedFlags/no_unsupported_options (0.04s) --- PASS: TestReportDeletedFlags/unsupported_config_option (0.03s) --- PASS: TestReportDeletedFlags/unsupported_CLI_flag (0.02s) === RUN TestChangedCortexDefaults === RUN TestChangedCortexDefaults/cortex->mimir === PAUSE TestChangedCortexDefaults/cortex->mimir === CONT TestChangedCortexDefaults/cortex->mimir --- PASS: TestChangedCortexDefaults (0.17s) --- PASS: TestChangedCortexDefaults/cortex->mimir (0.63s) === RUN TestChangedGEMDefaults === RUN TestChangedGEMDefaults/gem170->gem === PAUSE TestChangedGEMDefaults/gem170->gem === CONT TestChangedGEMDefaults/gem170->gem --- PASS: TestChangedGEMDefaults (0.21s) --- PASS: TestChangedGEMDefaults/gem170->gem (0.57s) === RUN TestConvert_UseNewDefaults === RUN TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true === PAUSE TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true === CONT TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true === RUN TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem === PAUSE TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false === RUN TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem === CONT TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir === CONT TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem --- PASS: TestConvert_UseNewDefaults (0.00s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false (0.00s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir (0.40s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem (0.46s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true (0.00s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir (0.41s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem (0.47s) --- PASS: TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true (0.00s) --- PASS: TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir (0.43s) --- PASS: TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem (0.50s) === RUN TestConvert_NotInYAMLIsNotPrinted === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem --- PASS: TestConvert_NotInYAMLIsNotPrinted (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir (0.30s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem (0.35s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir (0.43s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem (0.46s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir (0.42s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem (0.52s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir (0.40s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem (0.53s) === RUN TestConvert_PassingOnlyYAMLReturnsOnlyYAML === RUN TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir === PAUSE TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir === RUN TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem === PAUSE TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem === CONT TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir === CONT TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem --- PASS: TestConvert_PassingOnlyYAMLReturnsOnlyYAML (0.00s) --- PASS: TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir (0.20s) --- PASS: TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem (0.29s) === RUN TestConvert_PassingOnlyFlagsReturnsOnlyFlags === RUN TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir === PAUSE TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir === RUN TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem === PAUSE TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem === CONT TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir === CONT TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem --- PASS: TestConvert_PassingOnlyFlagsReturnsOnlyFlags (0.00s) --- PASS: TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem (0.22s) --- PASS: TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir (0.27s) === RUN TestRemovedParamsAndFlagsAreCorrect === PAUSE TestRemovedParamsAndFlagsAreCorrect === RUN TestInspectedEntry_SetThenGet === RUN TestInspectedEntry_SetThenGet/a_simple_field === RUN TestInspectedEntry_SetThenGet/a_field_within_a_struct === RUN TestInspectedEntry_SetThenGet/fails_with_a_non-existent_field === RUN TestInspectedEntry_SetThenGet/a_field_within_an_inlined_struct --- PASS: TestInspectedEntry_SetThenGet (0.02s) --- PASS: TestInspectedEntry_SetThenGet/a_simple_field (0.02s) --- PASS: TestInspectedEntry_SetThenGet/a_field_within_a_struct (0.00s) --- PASS: TestInspectedEntry_SetThenGet/fails_with_a_non-existent_field (0.00s) --- PASS: TestInspectedEntry_SetThenGet/a_field_within_an_inlined_struct (0.00s) === RUN TestInspectedEntry_Walk === RUN TestInspectedEntry_Walk/no_recursion === RUN TestInspectedEntry_Walk/with_an_inlined_field === RUN TestInspectedEntry_Walk/with_a_skipped_struct === RUN TestInspectedEntry_Walk/with_a_skipped_field --- PASS: TestInspectedEntry_Walk (0.00s) --- PASS: TestInspectedEntry_Walk/no_recursion (0.00s) --- PASS: TestInspectedEntry_Walk/with_an_inlined_field (0.00s) --- PASS: TestInspectedEntry_Walk/with_a_skipped_struct (0.00s) --- PASS: TestInspectedEntry_Walk/with_a_skipped_field (0.00s) === RUN TestInspectedEntry_Delete === RUN TestInspectedEntry_Delete/deletes_a_path === RUN TestInspectedEntry_Delete/fails_to_delete_a_non-existent_path === RUN TestInspectedEntry_Delete/cleans_up_empty_fields === RUN TestInspectedEntry_Delete/deletes_subtree --- PASS: TestInspectedEntry_Delete (0.01s) --- PASS: TestInspectedEntry_Delete/deletes_a_path (0.00s) --- PASS: TestInspectedEntry_Delete/fails_to_delete_a_non-existent_path (0.00s) --- PASS: TestInspectedEntry_Delete/cleans_up_empty_fields (0.00s) --- PASS: TestInspectedEntry_Delete/deletes_subtree (0.00s) === RUN TestInspectedConfig_MarshalThenUnmarshalRetainsTypeInformation --- PASS: TestInspectedConfig_MarshalThenUnmarshalRetainsTypeInformation (0.31s) === RUN TestInspectedEntry_MarshalYAML --- PASS: TestInspectedEntry_MarshalYAML (0.13s) === RUN TestInspectConfig_HasDefaultValues --- PASS: TestInspectConfig_HasDefaultValues (0.11s) === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/int === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/[]string === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/duration === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/bool === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/float === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/string === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/time === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/url --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes (0.02s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/int (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/[]string (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/duration (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/bool (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/float (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/string (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/time (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/url (0.00s) === RUN TestDecodeDurationInVariousFormats === RUN TestDecodeDurationInVariousFormats/number === RUN TestDecodeDurationInVariousFormats/time.Duration === RUN TestDecodeDurationInVariousFormats/model.Duration --- PASS: TestDecodeDurationInVariousFormats (0.38s) --- PASS: TestDecodeDurationInVariousFormats/number (0.13s) --- PASS: TestDecodeDurationInVariousFormats/time.Duration (0.14s) --- PASS: TestDecodeDurationInVariousFormats/model.Duration (0.10s) === CONT TestRemovedParamsAndFlagsAreCorrect --- PASS: TestRemovedParamsAndFlagsAreCorrect (1.98s) PASS ok github.com/grafana/mimir/pkg/mimirtool/config 21.278s ? github.com/grafana/mimir/pkg/mimirtool/minisdk [no test files] === RUN TestPrintRuleSet === RUN TestPrintRuleSet/prints_colorless_json === RUN TestPrintRuleSet/prints_colorful_json === RUN TestPrintRuleSet/prints_colorless_yaml === RUN TestPrintRuleSet/prints_colorful_yaml === RUN TestPrintRuleSet/defaults_to_tabwriter --- PASS: TestPrintRuleSet (0.14s) --- PASS: TestPrintRuleSet/prints_colorless_json (0.00s) --- PASS: TestPrintRuleSet/prints_colorful_json (0.00s) --- PASS: TestPrintRuleSet/prints_colorless_yaml (0.02s) --- PASS: TestPrintRuleSet/prints_colorful_yaml (0.00s) --- PASS: TestPrintRuleSet/defaults_to_tabwriter (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/printer 1.707s === RUN Test_rulesEqual === RUN Test_rulesEqual/rule_node_identical === RUN Test_rulesEqual/rule_node_diff === RUN Test_rulesEqual/rule_node_annotations_diff === RUN Test_rulesEqual/rule_node_annotations_nil_diff === RUN Test_rulesEqual/rule_node_yaml_diff --- PASS: Test_rulesEqual (0.01s) --- PASS: Test_rulesEqual/rule_node_identical (0.00s) --- PASS: Test_rulesEqual/rule_node_diff (0.00s) --- PASS: Test_rulesEqual/rule_node_annotations_diff (0.00s) --- PASS: Test_rulesEqual/rule_node_annotations_nil_diff (0.00s) --- PASS: Test_rulesEqual/rule_node_yaml_diff (0.00s) === RUN TestCompareGroups === RUN TestCompareGroups/identical_configs === RUN TestCompareGroups/differently_ordered_source_tenants_(should_still_be_equivalent) === RUN TestCompareGroups/different_rule_length === RUN TestCompareGroups/identical_rw_configs === RUN TestCompareGroups/different_rw_config_lengths === RUN TestCompareGroups/different_rw_configs === RUN TestCompareGroups/different_source_tenants === RUN TestCompareGroups/repeated_subset_of_source_tenants === RUN TestCompareGroups/repeated_single_tenant_(tenants_should_be_deduplicated) --- PASS: TestCompareGroups (0.01s) --- PASS: TestCompareGroups/identical_configs (0.00s) --- PASS: TestCompareGroups/differently_ordered_source_tenants_(should_still_be_equivalent) (0.00s) --- PASS: TestCompareGroups/different_rule_length (0.00s) --- PASS: TestCompareGroups/identical_rw_configs (0.00s) --- PASS: TestCompareGroups/different_rw_config_lengths (0.00s) --- PASS: TestCompareGroups/different_rw_configs (0.00s) --- PASS: TestCompareGroups/different_source_tenants (0.00s) --- PASS: TestCompareGroups/repeated_subset_of_source_tenants (0.00s) --- PASS: TestCompareGroups/repeated_single_tenant_(tenants_should_be_deduplicated) (0.00s) === RUN TestParseFiles === RUN TestParseFiles/basic_file === RUN TestParseFiles/file_namespace_overlap time="2022-12-01T20:47:11Z" level=error msg="repeated namespace attempted to be loaded" file=testdata/basic_namespace_repeated.yaml namespace=example_namespace === RUN TestParseFiles/multiple_namespace_file === RUN TestParseFiles/federated_rule_groups --- PASS: TestParseFiles (0.09s) --- PASS: TestParseFiles/basic_file (0.05s) --- PASS: TestParseFiles/file_namespace_overlap (0.04s) --- PASS: TestParseFiles/multiple_namespace_file (0.00s) --- PASS: TestParseFiles/federated_rule_groups (0.00s) === RUN TestAggregateBy === RUN TestAggregateBy/with_no_rules === RUN TestAggregateBy/no_modification === RUN TestAggregateBy/no_change_in_the_query_but_lints_with_'without'_in_the_aggregation === RUN TestAggregateBy/with_an_aggregation_modification === RUN TestAggregateBy/with_'count'_as_the_aggregation === RUN TestAggregateBy/with_vector_matching_in_binary_operations === RUN TestAggregateBy/with_a_query_skipped --- PASS: TestAggregateBy (0.06s) --- PASS: TestAggregateBy/with_no_rules (0.00s) --- PASS: TestAggregateBy/no_modification (0.03s) --- PASS: TestAggregateBy/no_change_in_the_query_but_lints_with_'without'_in_the_aggregation (0.02s) --- PASS: TestAggregateBy/with_an_aggregation_modification (0.00s) --- PASS: TestAggregateBy/with_'count'_as_the_aggregation (0.00s) --- PASS: TestAggregateBy/with_vector_matching_in_binary_operations (0.00s) --- PASS: TestAggregateBy/with_a_query_skipped (0.00s) === RUN TestLintExpressions === RUN TestLintExpressions/it_lints_simple_expressions === RUN TestLintExpressions/it_lints_aggregations_expressions === RUN TestLintExpressions/with_no_opinion === RUN TestLintExpressions/with_a_complex_expression === RUN TestLintExpressions/with_an_invalid_expression --- PASS: TestLintExpressions (0.02s) --- PASS: TestLintExpressions/it_lints_simple_expressions (0.00s) --- PASS: TestLintExpressions/it_lints_aggregations_expressions (0.00s) --- PASS: TestLintExpressions/with_no_opinion (0.00s) --- PASS: TestLintExpressions/with_a_complex_expression (0.02s) --- PASS: TestLintExpressions/with_an_invalid_expression (0.00s) === RUN TestCheckRecordingRules === RUN TestCheckRecordingRules/follows_rule_name_conventions === RUN TestCheckRecordingRules/doesn't_follow_rule_name_conventions time="2022-12-01T20:47:11Z" level=error msg="bad recording rule name" error="recording rule name does not match level:metric:operation format, must contain at least one colon" file= rule=level_metric_operation ruleGroup= === RUN TestCheckRecordingRules/almost_follows_rule_name_conventions time="2022-12-01T20:47:11Z" level=error msg="bad recording rule name" error="recording rule name does not match level:metric:operation format, must contain at least one colon" file= rule="level:metric_operation" ruleGroup= === RUN TestCheckRecordingRules/almost_follows_rule_name_conventions#01 === RUN TestCheckRecordingRules/follows_rule_name_conventions_extra --- PASS: TestCheckRecordingRules (0.00s) --- PASS: TestCheckRecordingRules/follows_rule_name_conventions (0.00s) --- PASS: TestCheckRecordingRules/doesn't_follow_rule_name_conventions (0.00s) --- PASS: TestCheckRecordingRules/almost_follows_rule_name_conventions (0.00s) --- PASS: TestCheckRecordingRules/almost_follows_rule_name_conventions#01 (0.00s) --- PASS: TestCheckRecordingRules/follows_rule_name_conventions_extra (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/rules 1.435s ? github.com/grafana/mimir/pkg/mimirtool/rules/rwrulefmt [no test files] ? github.com/grafana/mimir/pkg/mimirtool/version [no test files] === RUN TestBlockQuerierSeries === PAUSE TestBlockQuerierSeries === RUN TestBlockQuerierSeriesSet === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() --- PASS: TestBlockQuerierSeriesSet (0.01s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() (2.68s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() (2.71s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() (2.72s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() (2.87s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() (3.01s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() (2.04s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() (2.15s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() (2.46s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() (2.49s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() (5.73s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() (3.96s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() (8.86s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() (4.51s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() (9.47s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() (6.94s) === RUN TestBlocksConsistencyChecker_Check === RUN TestBlocksConsistencyChecker_Check/no_known_blocks === RUN TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_a_single_store-gateway === RUN TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_multiple_store-gateway === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_more_blocks_than_expected === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected,_but_the_missing_block_has_been_recently_uploaded === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_recently_marked_for_deletion === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_marked_for_deletion_long_time_ago --- PASS: TestBlocksConsistencyChecker_Check (0.02s) --- PASS: TestBlocksConsistencyChecker_Check/no_known_blocks (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_a_single_store-gateway (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_multiple_store-gateway (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_more_blocks_than_expected (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected,_but_the_missing_block_has_been_recently_uploaded (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_recently_marked_for_deletion (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_marked_for_deletion_long_time_ago (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_within_a_single_block === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_within_multiple_blocks === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block === RUN TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low === RUN TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high === RUN TestBucketIndexBlocksFinder_GetBlocks/matching_all_blocks === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT --- PASS: TestBucketIndexBlocksFinder_GetBlocks (0.04s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT (0.01s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_within_a_single_block (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_within_multiple_blocks (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/matching_all_blocks (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks_BucketIndexDoesNotExist --- PASS: TestBucketIndexBlocksFinder_GetBlocks_BucketIndexDoesNotExist (0.01s) === RUN TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsCorrupted --- PASS: TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsCorrupted (0.01s) === RUN TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsTooOld --- PASS: TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsTooOld (0.01s) === RUN TestBlocksFinderBucketIndexErrMsgs === RUN TestBlocksFinderBucketIndexErrMsgs/newBucketIndexTooOldError --- PASS: TestBlocksFinderBucketIndexErrMsgs (0.00s) --- PASS: TestBlocksFinderBucketIndexErrMsgs/newBucketIndexTooOldError (0.00s) === RUN TestBucketScanBlocksFinder_InitialScan --- PASS: TestBucketScanBlocksFinder_InitialScan (0.13s) === RUN TestBucketScanBlocksFinder_InitialScanFailure --- PASS: TestBucketScanBlocksFinder_InitialScanFailure (5.01s) === RUN TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyTenants level=debug user=1 component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info user=1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.007563477s duration_ms=1007 cached=0 returned=0 partial=0 level=error msg="unable to run the initial blocks scan" err="context canceled" --- PASS: TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyTenants (1.07s) === RUN TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyBlocks level=error msg="unable to run the initial blocks scan" err="context canceled" --- PASS: TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyBlocks (1.02s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsNewUser --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsNewUser (0.09s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsNewBlock --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsNewBlock (0.04s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsBlockMarkedForDeletion --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsBlockMarkedForDeletion (0.05s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsDeletedBlock --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsDeletedBlock (0.05s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsDeletedUser --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsDeletedUser (0.04s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsUserWhichWasPreviouslyDeleted --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsUserWhichWasPreviouslyDeleted (0.05s) === RUN TestBucketScanBlocksFinder_GetBlocks === RUN TestBucketScanBlocksFinder_GetBlocks/matching_all_blocks === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_within_a_single_block === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_within_multiple_blocks === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block === RUN TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low === RUN TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high --- PASS: TestBucketScanBlocksFinder_GetBlocks (0.07s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/matching_all_blocks (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_within_a_single_block (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_within_multiple_blocks (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high (0.00s) === RUN TestBlocksStoreQuerier_Select === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt_-_global_limit === RUN TestBlocksStoreQuerier_Select/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return === RUN TestBlocksStoreQuerier_Select/error_while_finding_blocks_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Select/error_while_getting_clients_to_query_the_store-gateway === RUN TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(single_returned_series) === RUN TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts_-_global === RUN TestBlocksStoreQuerier_Select/max_chunk_bytes_per_query_limit_hit_while_fetching_chunks === RUN TestBlocksStoreQuerier_Select/no_block_in_the_storage_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(multiple_returned_series) === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series_(single_returned_series) === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_greater_then_the_number_of_chunks_fetched === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts === RUN TestBlocksStoreQuerier_Select/max_series_per_query_limit_hit_while_fetching_chunks === RUN TestBlocksStoreQuerier_Select/blocks_with_non-matching_shard_are_filtered_out === RUN TestBlocksStoreQuerier_Select/all_blocks_are_queried_if_shards_don't_match --- PASS: TestBlocksStoreQuerier_Select (1.10s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) (0.07s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) (0.05s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt_-_global_limit (0.03s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return (0.05s) --- PASS: TestBlocksStoreQuerier_Select/error_while_finding_blocks_matching_the_query_time_range (0.00s) --- PASS: TestBlocksStoreQuerier_Select/error_while_getting_clients_to_query_the_store-gateway (0.00s) --- PASS: TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(single_returned_series) (0.06s) --- PASS: TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) (0.05s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts (0.13s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) (0.06s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts_-_global (0.10s) --- PASS: TestBlocksStoreQuerier_Select/max_chunk_bytes_per_query_limit_hit_while_fetching_chunks (0.02s) --- PASS: TestBlocksStoreQuerier_Select/no_block_in_the_storage_matching_the_query_time_range (0.00s) --- PASS: TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(multiple_returned_series) (0.07s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series_(single_returned_series) (0.04s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_greater_then_the_number_of_chunks_fetched (0.06s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt (0.03s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts (0.10s) --- PASS: TestBlocksStoreQuerier_Select/max_series_per_query_limit_hit_while_fetching_chunks (0.03s) --- PASS: TestBlocksStoreQuerier_Select/blocks_with_non-matching_shard_are_filtered_out (0.06s) --- PASS: TestBlocksStoreQuerier_Select/all_blocks_are_queried_if_shards_don't_match (0.05s) === RUN TestBlocksStoreQuerier_Labels === RUN TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_holds_the_required_blocks === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) === RUN TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts === RUN TestBlocksStoreQuerier_Labels/no_block_in_the_storage_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Labels/error_while_finding_blocks_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Labels/error_while_getting_clients_to_query_the_store-gateway === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return --- PASS: TestBlocksStoreQuerier_Labels (0.15s) --- PASS: TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_holds_the_required_blocks (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) (0.02s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) (0.02s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts (0.03s) --- PASS: TestBlocksStoreQuerier_Labels/no_block_in_the_storage_matching_the_query_time_range (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/error_while_finding_blocks_matching_the_query_time_range (0.02s) --- PASS: TestBlocksStoreQuerier_Labels/error_while_getting_clients_to_query_the_store-gateway (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return (0.01s) === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_manipulate_query_time_range_if_queryStoreAfter_is_enabled_and_query_max_time_is_recent === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_skip_the_query_if_the_query_min_time_is_more_recent_than_queryStoreAfter === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_disabled === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_enabled_but_query_max_time_is_older --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter (0.01s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_manipulate_query_time_range_if_queryStoreAfter_is_enabled_and_query_max_time_is_recent (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_skip_the_query_if_the_query_min_time_is_more_recent_than_queryStoreAfter (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_disabled (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_enabled_but_query_max_time_is_older (0.00s) === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange/should_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_and_query_overlaps === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_disabled === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_but_query_fits_within --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange (0.03s) --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange/should_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_and_query_overlaps (0.01s) --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_disabled (0.01s) --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_but_query_fits_within (0.00s) === RUN TestBlocksStoreQuerier_PromQLExecution === RUN TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_chunks_in_the_right_order === RUN TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_out-of-order_chunks --- PASS: TestBlocksStoreQuerier_PromQLExecution (0.18s) --- PASS: TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_chunks_in_the_right_order (0.11s) --- PASS: TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_out-of-order_chunks (0.07s) === RUN TestCanBlockWithCompactorShardIdContainQueryShard --- PASS: TestCanBlockWithCompactorShardIdContainQueryShard (1.91s) === RUN TestFilterBlocksByShard === RUN TestFilterBlocksByShard/equal_number_of_query_shards === RUN TestFilterBlocksByShard/double_the_equal_number_of_query_shards_1 === RUN TestFilterBlocksByShard/non-divisible_number_of_shards_(less_than_compactor_shards) === RUN TestFilterBlocksByShard/non-divisible_number_of_shards_(higher_than_compactor_shards) === RUN TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2 === RUN TestFilterBlocksByShard/less_query_shards_than_compactor_shards_1 === RUN TestFilterBlocksByShard/less_query_shards_than_compactor_shards_2 === RUN TestFilterBlocksByShard/double_the_equal_number_of_query_shards_2 === RUN TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2_(2nd_test) --- PASS: TestFilterBlocksByShard (0.01s) --- PASS: TestFilterBlocksByShard/equal_number_of_query_shards (0.00s) --- PASS: TestFilterBlocksByShard/double_the_equal_number_of_query_shards_1 (0.00s) --- PASS: TestFilterBlocksByShard/non-divisible_number_of_shards_(less_than_compactor_shards) (0.00s) --- PASS: TestFilterBlocksByShard/non-divisible_number_of_shards_(higher_than_compactor_shards) (0.00s) --- PASS: TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2 (0.00s) --- PASS: TestFilterBlocksByShard/less_query_shards_than_compactor_shards_1 (0.00s) --- PASS: TestFilterBlocksByShard/less_query_shards_than_compactor_shards_2 (0.00s) --- PASS: TestFilterBlocksByShard/double_the_equal_number_of_query_shards_2 (0.00s) --- PASS: TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2_(2nd_test) (0.00s) === RUN TestBlocksStoreQueryableErrMsgs === RUN TestBlocksStoreQueryableErrMsgs/newStoreConsistencyCheckFailedError --- PASS: TestBlocksStoreQueryableErrMsgs (0.00s) --- PASS: TestBlocksStoreQueryableErrMsgs/newStoreConsistencyCheckFailedError (0.00s) === RUN TestBlocksStoreReplicationSet_GetClientsFor === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 --- PASS: TestBlocksStoreReplicationSet_GetClientsFor (0.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 (1.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances (1.02s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 (1.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 (2.02s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 (2.02s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded (2.03s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 (1.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available (1.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 (1.00s) === RUN TestBlocksStoreReplicationSet_GetClientsFor_ShouldSupportRandomLoadBalancingStrategy --- PASS: TestBlocksStoreReplicationSet_GetClientsFor_ShouldSupportRandomLoadBalancingStrategy (1.01s) === RUN TestLabelNamesCardinalityHandler --- PASS: TestLabelNamesCardinalityHandler (0.01s) === RUN TestLabelNamesCardinalityHandler_MatchersTest === RUN TestLabelNamesCardinalityHandler_MatchersTest/expected_selector_to_be_parsed === RUN TestLabelNamesCardinalityHandler_MatchersTest/expected_no_error_if_selector_is_missed === RUN TestLabelNamesCardinalityHandler_MatchersTest/selector_with_metric_name_to_be_parse === RUN TestLabelNamesCardinalityHandler_MatchersTest/selector_with_two_matchers_to_be_parse --- PASS: TestLabelNamesCardinalityHandler_MatchersTest (0.03s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/expected_selector_to_be_parsed (0.01s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/expected_no_error_if_selector_is_missed (0.01s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/selector_with_metric_name_to_be_parse (0.00s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/selector_with_two_matchers_to_be_parse (0.00s) === RUN TestLabelNamesCardinalityHandler_LimitTest === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_10_labels_in_response_if_limit_param_is_10 === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_default_limit_20_to_be_applied_if_limit_param_is_not_defined === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_all_items_in_response_if_limit_param_is_greater_than_count_of_items === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_empty_items_list_in_response_if_limit_param_is_0 --- PASS: TestLabelNamesCardinalityHandler_LimitTest (0.02s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_10_labels_in_response_if_limit_param_is_10 (0.00s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_default_limit_20_to_be_applied_if_limit_param_is_not_defined (0.00s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_all_items_in_response_if_limit_param_is_greater_than_count_of_items (0.00s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_empty_items_list_in_response_if_limit_param_is_0 (0.00s) === RUN TestLabelNamesCardinalityHandler_DistributorError === RUN TestLabelNamesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor === RUN TestLabelNamesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error --- PASS: TestLabelNamesCardinalityHandler_DistributorError (0.03s) --- PASS: TestLabelNamesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor (0.02s) --- PASS: TestLabelNamesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error (0.00s) === RUN TestLabelNamesCardinalityHandler_NegativeTests === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative#01 === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_tenantId_is_not_defined === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_multiple_limits_are_sent === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_that_cardinality_analysis_feature_is_disabled --- PASS: TestLabelNamesCardinalityHandler_NegativeTests (0.01s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative#01 (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_tenantId_is_not_defined (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_multiple_limits_are_sent (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_that_cardinality_analysis_feature_is_disabled (0.00s) === RUN TestLabelValuesCardinalityHandler_Success === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector --- PASS: TestLabelValuesCardinalityHandler_Success (0.08s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector (0.00s) === RUN TestLabelValuesCardinalityHandler_FeatureFlag === RUN TestLabelValuesCardinalityHandler_FeatureFlag/should_return_an_error_if_the_cardinality_analysis_feature_is_disabled_by_default === RUN TestLabelValuesCardinalityHandler_FeatureFlag/should_succeed_if_the_cardinality_analysis_feature_is_enabled_by_default --- PASS: TestLabelValuesCardinalityHandler_FeatureFlag (0.00s) --- PASS: TestLabelValuesCardinalityHandler_FeatureFlag/should_return_an_error_if_the_cardinality_analysis_feature_is_disabled_by_default (0.00s) --- PASS: TestLabelValuesCardinalityHandler_FeatureFlag/should_succeed_if_the_cardinality_analysis_feature_is_enabled_by_default (0.00s) === RUN TestLabelValuesCardinalityHandler_ParseError === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_no_tenant_id_is_provided === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_ === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_empty === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_invalid === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/multiple_selector_params_are_provided === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_not_a_number === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_a_negative_number === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_exceeds_the_maximum_limit_parameter --- PASS: TestLabelValuesCardinalityHandler_ParseError (0.01s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_no_tenant_id_is_provided (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_ (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_empty (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_invalid (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/multiple_selector_params_are_provided (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_not_a_number (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_a_negative_number (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_exceeds_the_maximum_limit_parameter (0.00s) === RUN TestLabelValuesCardinalityHandler_DistributorError === RUN TestLabelValuesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor === RUN TestLabelValuesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error --- PASS: TestLabelValuesCardinalityHandler_DistributorError (0.01s) --- PASS: TestLabelValuesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor (0.00s) --- PASS: TestLabelValuesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error (0.00s) === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_but_query_min_time_is_newer === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_min_time_is_older === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_skip_the_query_if_the_query_max_time_is_older_than_queryIngestersWithin === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_max_time_is_older,_but_the_query_is_for_/series === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_disabled --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin (0.02s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_but_query_min_time_is_newer (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_min_time_is_older (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_skip_the_query_if_the_query_max_time_is_older_than_queryIngestersWithin (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_max_time_is_older,_but_the_query_is_for_/series (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_disabled (0.00s) === RUN TestDistributorQueryableFilter --- PASS: TestDistributorQueryableFilter (0.00s) === RUN TestIngesterStreaming --- PASS: TestIngesterStreaming (0.01s) === RUN TestIngesterStreamingMixedResults --- PASS: TestIngesterStreamingMixedResults (0.00s) === RUN TestDistributorQuerier_LabelNames === RUN TestDistributorQuerier_LabelNames/with_matchers === RUN TestDistributorQuerier_LabelNames/with_matchers/queryLabelNamesWithMatchers=true --- PASS: TestDistributorQuerier_LabelNames (0.00s) --- PASS: TestDistributorQuerier_LabelNames/with_matchers (0.00s) --- PASS: TestDistributorQuerier_LabelNames/with_matchers/queryLabelNamesWithMatchers=true (0.00s) === RUN TestDuplicatesSamples --- PASS: TestDuplicatesSamples (0.01s) === RUN TestApiStatusCodes === RUN TestApiStatusCodes/error_from_queryable/0 === RUN TestApiStatusCodes/error_from_querier/0 === RUN TestApiStatusCodes/error_from_seriesset/0 === RUN TestApiStatusCodes/error_from_seriesset/1 === RUN TestApiStatusCodes/error_from_queryable/1 === RUN TestApiStatusCodes/error_from_querier/1 === RUN TestApiStatusCodes/error_from_queryable/2 === RUN TestApiStatusCodes/error_from_querier/2 === RUN TestApiStatusCodes/error_from_seriesset/2 === RUN TestApiStatusCodes/error_from_queryable/3 === RUN TestApiStatusCodes/error_from_querier/3 === RUN TestApiStatusCodes/error_from_seriesset/3 === RUN TestApiStatusCodes/error_from_queryable/4 === RUN TestApiStatusCodes/error_from_querier/4 === RUN TestApiStatusCodes/error_from_seriesset/4 === RUN TestApiStatusCodes/error_from_queryable/5 === RUN TestApiStatusCodes/error_from_querier/5 === RUN TestApiStatusCodes/error_from_seriesset/5 === RUN TestApiStatusCodes/error_from_queryable/6 === RUN TestApiStatusCodes/error_from_querier/6 === RUN TestApiStatusCodes/error_from_seriesset/6 === RUN TestApiStatusCodes/error_from_queryable/7 === RUN TestApiStatusCodes/error_from_querier/7 === RUN TestApiStatusCodes/error_from_seriesset/7 === RUN TestApiStatusCodes/error_from_querier/8 === RUN TestApiStatusCodes/error_from_seriesset/8 === RUN TestApiStatusCodes/error_from_queryable/8 === RUN TestApiStatusCodes/error_from_queryable/9 === RUN TestApiStatusCodes/error_from_querier/9 === RUN TestApiStatusCodes/error_from_seriesset/9 === RUN TestApiStatusCodes/error_from_queryable/10 === RUN TestApiStatusCodes/error_from_querier/10 === RUN TestApiStatusCodes/error_from_seriesset/10 --- PASS: TestApiStatusCodes (0.14s) --- PASS: TestApiStatusCodes/error_from_queryable/0 (0.01s) --- PASS: TestApiStatusCodes/error_from_querier/0 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/0 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/1 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/1 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/1 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/2 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/2 (0.02s) --- PASS: TestApiStatusCodes/error_from_seriesset/2 (0.01s) --- PASS: TestApiStatusCodes/error_from_queryable/3 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/3 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/3 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/4 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/4 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/4 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/5 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/5 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/5 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/6 (0.01s) --- PASS: TestApiStatusCodes/error_from_querier/6 (0.01s) --- PASS: TestApiStatusCodes/error_from_seriesset/6 (0.01s) --- PASS: TestApiStatusCodes/error_from_queryable/7 (0.01s) --- PASS: TestApiStatusCodes/error_from_querier/7 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/7 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/8 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/8 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/8 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/9 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/9 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/9 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/10 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/10 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/10 (0.00s) === RUN TestMetadataHandler_Success --- PASS: TestMetadataHandler_Success (0.00s) === RUN TestMetadataHandler_Error --- PASS: TestMetadataHandler_Error (0.00s) === RUN TestPartitionChunksOutputIsSortedByLabels --- PASS: TestPartitionChunksOutputIsSortedByLabels (1.26s) === RUN TestQuerier === RUN TestQuerier/rate(foo[1m])/iterators=false === RUN TestQuerier/rate(foo[1m])/iterators=true === RUN TestQuerier/foo/iterators=false === RUN TestQuerier/foo/iterators=true === RUN TestQuerier/rate(foo[1m])/iterators=false#01 === RUN TestQuerier/rate(foo[1m])/iterators=true#01 === RUN TestQuerier/foo/iterators=false#01 === RUN TestQuerier/foo/iterators=true#01 --- PASS: TestQuerier (0.63s) --- PASS: TestQuerier/rate(foo[1m])/iterators=false (0.06s) --- PASS: TestQuerier/rate(foo[1m])/iterators=true (0.05s) --- PASS: TestQuerier/foo/iterators=false (0.06s) --- PASS: TestQuerier/foo/iterators=true (0.08s) --- PASS: TestQuerier/rate(foo[1m])/iterators=false#01 (0.03s) --- PASS: TestQuerier/rate(foo[1m])/iterators=true#01 (0.03s) --- PASS: TestQuerier/foo/iterators=false#01 (0.02s) --- PASS: TestQuerier/foo/iterators=true#01 (0.02s) === RUN TestQuerier_QueryableReturnsChunksOutsideQueriedRange --- PASS: TestQuerier_QueryableReturnsChunksOutsideQueriedRange (0.02s) === RUN TestQuerier_QueryIngestersWithinConfig === RUN TestQuerier_QueryIngestersWithinConfig/hit-test1 === RUN TestQuerier_QueryIngestersWithinConfig/hit-test2 === RUN TestQuerier_QueryIngestersWithinConfig/hit-test2#01 === RUN TestQuerier_QueryIngestersWithinConfig/dont-hit-test1 === RUN TestQuerier_QueryIngestersWithinConfig/dont-hit-test2 --- PASS: TestQuerier_QueryIngestersWithinConfig (0.02s) --- PASS: TestQuerier_QueryIngestersWithinConfig/hit-test1 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/hit-test2 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/hit-test2#01 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/dont-hit-test1 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/dont-hit-test2 (0.00s) === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_manipulate_query_if_end_time_is_after_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_far_in_the_future_but_limit_is_disabled === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_in_the_future_but_below_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_skip_executing_a_query_outside_the_allowed_time_range --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture (0.03s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_manipulate_query_if_end_time_is_after_the_limit (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_far_in_the_future_but_limit_is_disabled (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_in_the_future_but_below_the_limit (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_skip_executing_a_query_outside_the_allowed_time_range (0.01s) === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_short_time_range_and_rate_time_window_close_to_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_short_time_range_and_rate_time_window_over_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_large_time_range_over_the_limit_and_short_rate_time_window --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength (0.04s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_short_time_range_and_rate_time_window_close_to_the_limit (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_short_time_range_and_rate_time_window_over_the_limit (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_large_time_range_over_the_limit_and_short_rate_time_window (0.01s) === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_values --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback (0.11s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window (0.03s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/query_range (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/series (0.02s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit (0.02s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window (0.02s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit (0.02s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_values (0.00s) === RUN TestQuerier_MaxLabelsQueryRange === RUN TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit === RUN TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit/series --- PASS: TestQuerier_MaxLabelsQueryRange (0.01s) --- PASS: TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit (0.00s) --- PASS: TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit/series (0.00s) === RUN TestQuerier_QueryStoreAfterConfig === RUN TestQuerier_QueryStoreAfterConfig/hit_only_ingester === RUN TestQuerier_QueryStoreAfterConfig/hit_both === RUN TestQuerier_QueryStoreAfterConfig/hit_only_storage --- PASS: TestQuerier_QueryStoreAfterConfig (0.11s) --- PASS: TestQuerier_QueryStoreAfterConfig/hit_only_ingester (0.04s) --- PASS: TestQuerier_QueryStoreAfterConfig/hit_both (0.04s) --- PASS: TestQuerier_QueryStoreAfterConfig/hit_only_storage (0.04s) === RUN TestUseAlwaysQueryable --- PASS: TestUseAlwaysQueryable (0.00s) === RUN TestUseBeforeTimestamp --- PASS: TestUseBeforeTimestamp (0.00s) === RUN TestStoreQueryable --- PASS: TestStoreQueryable (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_if_'query_store_after'_is_enabled_and_shuffle-sharding_is_disabled === RUN TestConfig_Validate/should_pass_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_<_'query_ingesters_within' === RUN TestConfig_Validate/should_fail_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_>_'query_ingesters_within' === RUN TestConfig_Validate/should_pass_with_default_config --- PASS: TestConfig_Validate (0.00s) --- PASS: TestConfig_Validate/should_pass_if_'query_store_after'_is_enabled_and_shuffle-sharding_is_disabled (0.00s) --- PASS: TestConfig_Validate/should_pass_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_<_'query_ingesters_within' (0.00s) --- PASS: TestConfig_Validate/should_fail_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_>_'query_ingesters_within' (0.00s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.00s) === RUN TestSampledRemoteRead --- PASS: TestSampledRemoteRead (0.01s) === RUN TestStreamedRemoteRead === RUN TestStreamedRemoteRead/with_120_samples,_we_expect_1_frame_with_1_chunk === RUN TestStreamedRemoteRead/with_121_samples,_we_expect_1_frame_with_2_chunks === RUN TestStreamedRemoteRead/with_241_samples,_we_expect_1_frame_with_2_chunks,_and_1_frame_with_1_chunk_due_to_frame_limit --- PASS: TestStreamedRemoteRead (0.02s) --- PASS: TestStreamedRemoteRead/with_120_samples,_we_expect_1_frame_with_1_chunk (0.02s) --- PASS: TestStreamedRemoteRead/with_121_samples,_we_expect_1_frame_with_2_chunks (0.00s) --- PASS: TestStreamedRemoteRead/with_241_samples,_we_expect_1_frame_with_2_chunks,_and_1_frame_with_1_chunk_due_to_frame_limit (0.00s) === RUN Test_newStoreGatewayClientFactory --- PASS: Test_newStoreGatewayClientFactory (0.14s) === RUN TestTimeSeriesSeriesSet --- PASS: TestTimeSeriesSeriesSet (0.00s) === RUN TestTimeSeriesIterator --- PASS: TestTimeSeriesIterator (0.00s) === CONT TestBlockQuerierSeries === RUN TestBlockQuerierSeries/empty_series === RUN TestBlockQuerierSeries/should_return_series_on_success === RUN TestBlockQuerierSeries/should_return_error_on_failure_while_reading_encoded_chunk_data --- PASS: TestBlockQuerierSeries (0.00s) --- PASS: TestBlockQuerierSeries/empty_series (0.00s) --- PASS: TestBlockQuerierSeries/should_return_series_on_success (0.00s) --- PASS: TestBlockQuerierSeries/should_return_error_on_failure_while_reading_encoded_chunk_data (0.00s) PASS ok github.com/grafana/mimir/pkg/querier 30.968s === RUN TestSeekCorrectlyDealWithSinglePointChunks --- PASS: TestSeekCorrectlyDealWithSinglePointChunks (0.01s) === RUN TestChunkIter --- PASS: TestChunkIter (0.02s) === RUN TestSeek --- PASS: TestSeek (0.00s) === RUN TestMergeIter --- PASS: TestMergeIter (0.05s) === RUN TestMergeHarder --- PASS: TestMergeHarder (3.06s) === RUN TestNonOverlappingIter --- PASS: TestNonOverlappingIter (0.06s) === RUN TestNonOverlappingIterSparse --- PASS: TestNonOverlappingIterSparse (0.01s) === RUN TestStream === RUN TestStream/0 === RUN TestStream/1 === RUN TestStream/2 === RUN TestStream/3 === RUN TestStream/4 --- PASS: TestStream (0.01s) --- PASS: TestStream/0 (0.00s) --- PASS: TestStream/1 (0.00s) --- PASS: TestStream/2 (0.00s) --- PASS: TestStream/3 (0.00s) --- PASS: TestStream/4 (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/batch 3.800s === RUN TestQueryTrackerUnlimitedMaxConcurrency --- PASS: TestQueryTrackerUnlimitedMaxConcurrency (0.02s) === RUN TestQueryTrackerWithNilActivityTrackerInsertDoesntAllocate --- PASS: TestQueryTrackerWithNilActivityTrackerInsertDoesntAllocate (0.01s) === RUN TestActivityDescription --- PASS: TestActivityDescription (0.02s) PASS ok github.com/grafana/mimir/pkg/querier/engine 0.888s === RUN TestChunkMergeIterator === RUN TestChunkMergeIterator/0 === RUN TestChunkMergeIterator/1 === RUN TestChunkMergeIterator/2 === RUN TestChunkMergeIterator/3 --- PASS: TestChunkMergeIterator (0.08s) --- PASS: TestChunkMergeIterator/0 (0.00s) --- PASS: TestChunkMergeIterator/1 (0.01s) --- PASS: TestChunkMergeIterator/2 (0.00s) --- PASS: TestChunkMergeIterator/3 (0.00s) === RUN TestChunkMergeIteratorSeek --- PASS: TestChunkMergeIteratorSeek (0.01s) PASS ok github.com/grafana/mimir/pkg/querier/iterators 0.438s === RUN TestStats_WallTime === RUN TestStats_WallTime/add_and_load_wall_time === RUN TestStats_WallTime/add_and_load_wall_time_nil_receiver --- PASS: TestStats_WallTime (0.01s) --- PASS: TestStats_WallTime/add_and_load_wall_time (0.00s) --- PASS: TestStats_WallTime/add_and_load_wall_time_nil_receiver (0.00s) === RUN TestStats_AddFetchedSeries === RUN TestStats_AddFetchedSeries/add_and_load_series === RUN TestStats_AddFetchedSeries/add_and_load_series_nil_receiver --- PASS: TestStats_AddFetchedSeries (0.00s) --- PASS: TestStats_AddFetchedSeries/add_and_load_series (0.00s) --- PASS: TestStats_AddFetchedSeries/add_and_load_series_nil_receiver (0.00s) === RUN TestStats_AddFetchedChunkBytes === RUN TestStats_AddFetchedChunkBytes/add_and_load_bytes === RUN TestStats_AddFetchedChunkBytes/add_and_load_bytes_nil_receiver --- PASS: TestStats_AddFetchedChunkBytes (0.00s) --- PASS: TestStats_AddFetchedChunkBytes/add_and_load_bytes (0.00s) --- PASS: TestStats_AddFetchedChunkBytes/add_and_load_bytes_nil_receiver (0.00s) === RUN TestStats_AddFetchedChunks === RUN TestStats_AddFetchedChunks/add_and_load_chunks === RUN TestStats_AddFetchedChunks/add_and_load_chunks_nil_receiver --- PASS: TestStats_AddFetchedChunks (0.00s) --- PASS: TestStats_AddFetchedChunks/add_and_load_chunks (0.00s) --- PASS: TestStats_AddFetchedChunks/add_and_load_chunks_nil_receiver (0.00s) === RUN TestStats_AddShardedQueries === RUN TestStats_AddShardedQueries/add_and_load_sharded_queries === RUN TestStats_AddShardedQueries/add_and_load_sharded_queries_nil_receiver --- PASS: TestStats_AddShardedQueries (0.00s) --- PASS: TestStats_AddShardedQueries/add_and_load_sharded_queries (0.00s) --- PASS: TestStats_AddShardedQueries/add_and_load_sharded_queries_nil_receiver (0.00s) === RUN TestStats_AddSplitQueries === RUN TestStats_AddSplitQueries/add_and_load_split_queries === RUN TestStats_AddSplitQueries/add_and_load_split_queries_nil_receiver --- PASS: TestStats_AddSplitQueries (0.00s) --- PASS: TestStats_AddSplitQueries/add_and_load_split_queries (0.00s) --- PASS: TestStats_AddSplitQueries/add_and_load_split_queries_nil_receiver (0.00s) === RUN TestStats_Merge === RUN TestStats_Merge/merge_two_stats_objects === RUN TestStats_Merge/merge_two_nil_stats_objects --- PASS: TestStats_Merge (0.00s) --- PASS: TestStats_Merge/merge_two_stats_objects (0.00s) --- PASS: TestStats_Merge/merge_two_nil_stats_objects (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/stats 0.661s === RUN TestMergeExemplarQueryable_ExemplarQuerier === RUN TestMergeExemplarQueryable_ExemplarQuerier/error_getting_tenant_IDs === RUN TestMergeExemplarQueryable_ExemplarQuerier/error_getting_upstream_querier === RUN TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_bypass_single_querier_happy_path === RUN TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_federated_happy_path === RUN TestMergeExemplarQueryable_ExemplarQuerier/multi_tenant_federated_happy_path --- PASS: TestMergeExemplarQueryable_ExemplarQuerier (0.01s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/error_getting_tenant_IDs (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/error_getting_upstream_querier (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_bypass_single_querier_happy_path (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_federated_happy_path (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/multi_tenant_federated_happy_path (0.00s) === RUN TestMergeExemplarQuerier_Select === RUN TestMergeExemplarQuerier_Select/two_tenants_one_filtered === RUN TestMergeExemplarQuerier_Select/two_tenants_no_filtering === RUN TestMergeExemplarQuerier_Select/two_tenants_two_groups_of_matchers_filtering === RUN TestMergeExemplarQuerier_Select/no_matchers_to_filter === RUN TestMergeExemplarQuerier_Select/upstream_error --- PASS: TestMergeExemplarQuerier_Select (0.01s) --- PASS: TestMergeExemplarQuerier_Select/two_tenants_one_filtered (0.01s) --- PASS: TestMergeExemplarQuerier_Select/two_tenants_no_filtering (0.00s) --- PASS: TestMergeExemplarQuerier_Select/two_tenants_two_groups_of_matchers_filtering (0.00s) --- PASS: TestMergeExemplarQuerier_Select/no_matchers_to_filter (0.00s) --- PASS: TestMergeExemplarQuerier_Select/upstream_error (0.00s) === RUN TestMergeMetadataSupplier_MetricsMetadata === RUN TestMergeMetadataSupplier_MetricsMetadata/invalid_tenant_IDs === RUN TestMergeMetadataSupplier_MetricsMetadata/single_tenant_bypass logger.go:22: user team-a method mergeMetadataSupplier.MetricsMetadata level debug msg only a single tenant, bypassing federated metadata supplier === RUN TestMergeMetadataSupplier_MetricsMetadata/multiple_tenants_no_duplicates logger.go:22: method mergeMetadataSupplier.MetricsMetadata level debug msg adding results for tenant to merged results user team-a results 1 logger.go:22: method mergeMetadataSupplier.MetricsMetadata level debug msg adding results for tenant to merged results user team-b results 1 === RUN TestMergeMetadataSupplier_MetricsMetadata/multiple_tenants_with_duplicates logger.go:22: method mergeMetadataSupplier.MetricsMetadata level debug msg adding results for tenant to merged results user team-a results 1 logger.go:22: method mergeMetadataSupplier.MetricsMetadata level debug msg adding results for tenant to merged results user team-b results 2 --- PASS: TestMergeMetadataSupplier_MetricsMetadata (0.02s) --- PASS: TestMergeMetadataSupplier_MetricsMetadata/invalid_tenant_IDs (0.00s) --- PASS: TestMergeMetadataSupplier_MetricsMetadata/single_tenant_bypass (0.01s) --- PASS: TestMergeMetadataSupplier_MetricsMetadata/multiple_tenants_no_duplicates (0.00s) --- PASS: TestMergeMetadataSupplier_MetricsMetadata/multiple_tenants_with_duplicates (0.00s) === RUN TestMergeQueryable_Querier === RUN TestMergeQueryable_Querier/querying_without_a_tenant_specified_should_error --- PASS: TestMergeQueryable_Querier (0.00s) --- PASS: TestMergeQueryable_Querier/querying_without_a_tenant_specified_should_error (0.00s) === RUN TestMergeQueryable_Select === RUN TestMergeQueryable_Select/three_tenants === RUN TestMergeQueryable_Select/three_tenants/should_return_all_series_when_no_matchers_are_provided === RUN TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_the_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_the_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants/should_return_one_series_for_each_tenant_when_there_is_an_equals_matcher_for_the_host1_instance === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_no_matchers_are_provided === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_with_not-equals_matcher_for_the_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_where_there_are_conflicting_tenant_matchers === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_an_equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_a_regexp_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_when_there_is_a_not-equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label === RUN TestMergeQueryable_Select/three_tenants,_two_with_warnings === RUN TestMergeQueryable_Select/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables === RUN TestMergeQueryable_Select/three_tenants,_one_erroring === RUN TestMergeQueryable_Select/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant --- PASS: TestMergeQueryable_Select (0.03s) --- PASS: TestMergeQueryable_Select/three_tenants (0.01s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_all_series_when_no_matchers_are_provided (0.01s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_the_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_the_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_one_series_for_each_tenant_when_there_is_an_equals_matcher_for_the_host1_instance (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set (0.01s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_with_not-equals_matcher_for_the_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_where_there_are_conflicting_tenant_matchers (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_an_equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_a_regexp_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_when_there_is_a_not-equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_two_with_warnings (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_one_erroring (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant (0.00s) === RUN TestMergeQueryable_LabelNames === RUN TestMergeQueryable_LabelNames/single_tenant === RUN TestMergeQueryable_LabelNames/single_tenant/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed === RUN TestMergeQueryable_LabelNames/single_tenant#01 === RUN TestMergeQueryable_LabelNames/single_tenant#01/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed_with_matchers === RUN TestMergeQueryable_LabelNames/single_tenant_without_bypass === RUN TestMergeQueryable_LabelNames/single_tenant_without_bypass/should_return_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed === RUN TestMergeQueryable_LabelNames/three_tenants === RUN TestMergeQueryable_LabelNames/three_tenants/should_return_the___tenant_id___label_and_all_tenant_team_labels === RUN TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set === RUN TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set/should_return__the___tenant_id___label_and_all_tenant_team_labels,_and_the___original_tenant_id___label === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables === RUN TestMergeQueryable_LabelNames/three_tenants,_one_erroring === RUN TestMergeQueryable_LabelNames/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01/should_propagate_non-tenant_matchers_to_downstream_queriers === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03/should_only_query_tenant-b_and_tenant-c_when_there_is_an_regex_matcher_for_team-b|team-c_tenant === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04/only_tenant-b_is_selected_and_it_already_has_a_defaultTenantLabel_which_is_prepended_with_original__prefix --- PASS: TestMergeQueryable_LabelNames (0.02s) --- PASS: TestMergeQueryable_LabelNames/single_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant#01 (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant#01/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed_with_matchers (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant_without_bypass (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant_without_bypass/should_return_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants/should_return_the___tenant_id___label_and_all_tenant_team_labels (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set/should_return__the___tenant_id___label_and_all_tenant_team_labels,_and_the___original_tenant_id___label (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_one_erroring (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01/should_propagate_non-tenant_matchers_to_downstream_queriers (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03/should_only_query_tenant-b_and_tenant-c_when_there_is_an_regex_matcher_for_team-b|team-c_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04/only_tenant-b_is_selected_and_it_already_has_a_defaultTenantLabel_which_is_prepended_with_original__prefix (0.00s) === RUN TestMergeQueryable_LabelValues === RUN TestMergeQueryable_LabelValues/single_tenant === RUN TestMergeQueryable_LabelValues/single_tenant/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/single_tenant/should_return_no_tenant_values_for_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed === RUN TestMergeQueryable_LabelValues/single_tenant_without_bypass === RUN TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_a_tenant_team_value_for_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed === RUN TestMergeQueryable_LabelValues/three_tenants === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants/should_propagate_non-tenant_matchers_to_downstream_queriers === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_no_values_for_the_instance_label_when_there_are_conflicting_tenant_matchers === RUN TestMergeQueryable_LabelValues/three_tenants/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_all_tenant_team_values_for_the___tenant_id___label_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-b_tenant_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_tenant_values_for___tenant_id___label_name === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_with_matchers === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01 === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01/should_not_return_warnings_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01 === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01/should_not_return_errors_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label --- PASS: TestMergeQueryable_LabelValues (0.02s) --- PASS: TestMergeQueryable_LabelValues/single_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant/should_return_no_tenant_values_for_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant_without_bypass (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_a_tenant_team_value_for_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants (0.01s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_propagate_non-tenant_matchers_to_downstream_queriers (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_no_values_for_the_instance_label_when_there_are_conflicting_tenant_matchers (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_all_tenant_team_values_for_the___tenant_id___label_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-b_tenant_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_tenant_values_for___tenant_id___label_name (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_with_matchers (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01 (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01/should_not_return_warnings_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01 (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01/should_not_return_errors_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label (0.00s) === RUN TestSetLabelsRetainExisting --- PASS: TestSetLabelsRetainExisting (0.00s) === RUN TestTracingMergeQueryable --- PASS: TestTracingMergeQueryable (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/tenantfederation 1.460s === RUN TestFrontendProcessor_processQueriesOnSingleStream === RUN TestFrontendProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query === RUN TestFrontendProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled --- PASS: TestFrontendProcessor_processQueriesOnSingleStream (1.08s) --- PASS: TestFrontendProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query (0.03s) --- PASS: TestFrontendProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled (1.05s) === RUN TestRecvFailDoesntCancelProcess --- PASS: TestRecvFailDoesntCancelProcess (0.15s) === RUN TestContextCancelStopsProcess --- PASS: TestContextCancelStopsProcess (0.03s) === RUN TestSchedulerProcessor_processQueriesOnSingleStream === RUN TestSchedulerProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query === RUN TestSchedulerProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled === RUN TestSchedulerProcessor_processQueriesOnSingleStream/should_not_log_an_error_when_the_query-scheduler_is_terminates_while_waiting_for_the_next_query_to_run --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream (1.18s) --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query (0.02s) --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled (1.14s) --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream/should_not_log_an_error_when_the_query-scheduler_is_terminates_while_waiting_for_the_next_query_to_run (0.02s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_scheduler_address_is_configured === RUN TestConfig_Validate/should_pass_with_default_config === RUN TestConfig_Validate/should_pass_if_frontend_address_is_configured,_but_not_scheduler_address === RUN TestConfig_Validate/should_pass_if_scheduler_address_is_configured,_but_not_frontend_address === RUN TestConfig_Validate/should_fail_if_both_scheduler_and_frontend_address_are_configured === RUN TestConfig_Validate/should_pass_if_query-scheduler_service_discovery_is_set_to_ring,_and_no_frontend_and_scheduler_address_is_configured === RUN TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_frontend_address_is_configured --- PASS: TestConfig_Validate (0.01s) --- PASS: TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_scheduler_address_is_configured (0.00s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestConfig_Validate/should_pass_if_frontend_address_is_configured,_but_not_scheduler_address (0.00s) --- PASS: TestConfig_Validate/should_pass_if_scheduler_address_is_configured,_but_not_frontend_address (0.00s) --- PASS: TestConfig_Validate/should_fail_if_both_scheduler_and_frontend_address_are_configured (0.00s) --- PASS: TestConfig_Validate/should_pass_if_query-scheduler_service_discovery_is_set_to_ring,_and_no_frontend_and_scheduler_address_is_configured (0.00s) --- PASS: TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_frontend_address_is_configured (0.00s) === RUN TestConfig_IsFrontendOrSchedulerConfigured === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_0 === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_1 === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_2 === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_3 === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_4 --- PASS: TestConfig_IsFrontendOrSchedulerConfigured (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_0 (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_1 (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_2 (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_3 (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_4 (0.00s) === RUN TestResetConcurrency === RUN TestResetConcurrency/Create_at_least_one_processor_per_target_if_max_concurrent_=_0,_with_all_targets_in_use === RUN TestResetConcurrency/Create_at_least_one_processor_per_target_if_max_concurrent_=_0,_with_some_targets_in_use === RUN TestResetConcurrency/Max_concurrent_dividing_with_a_remainder,_with_all_targets_in_use === RUN TestResetConcurrency/Max_concurrent_dividing_with_a_remainder,_with_some_targets_in_use === RUN TestResetConcurrency/Max_concurrent_dividing_evenly,_with_all_targets_in_use === RUN TestResetConcurrency/Max_concurrent_dividing_evenly,_with_some_targets_in_use --- PASS: TestResetConcurrency (0.05s) --- PASS: TestResetConcurrency/Create_at_least_one_processor_per_target_if_max_concurrent_=_0,_with_all_targets_in_use (0.01s) --- PASS: TestResetConcurrency/Create_at_least_one_processor_per_target_if_max_concurrent_=_0,_with_some_targets_in_use (0.01s) --- PASS: TestResetConcurrency/Max_concurrent_dividing_with_a_remainder,_with_all_targets_in_use (0.01s) --- PASS: TestResetConcurrency/Max_concurrent_dividing_with_a_remainder,_with_some_targets_in_use (0.01s) --- PASS: TestResetConcurrency/Max_concurrent_dividing_evenly,_with_all_targets_in_use (0.01s) --- PASS: TestResetConcurrency/Max_concurrent_dividing_evenly,_with_some_targets_in_use (0.01s) === RUN TestQuerierWorker_getDesiredConcurrency === RUN TestQuerierWorker_getDesiredConcurrency/should_return_empty_map_on_no_instances === RUN TestQuerierWorker_getDesiredConcurrency/should_divide_the_max_concurrency_between_in-use_instances,_and_create_1_connection_for_each_instance_not_in-use === RUN TestQuerierWorker_getDesiredConcurrency/should_create_1_connection_for_each_instance_if_max_concurrency_is_set_to_0 === RUN TestQuerierWorker_getDesiredConcurrency/should_create_1_connection_for_each_instance_if_max_concurrency_is_>_0_but_less_than_the_number_of_in-use_instances --- PASS: TestQuerierWorker_getDesiredConcurrency (0.00s) --- PASS: TestQuerierWorker_getDesiredConcurrency/should_return_empty_map_on_no_instances (0.00s) --- PASS: TestQuerierWorker_getDesiredConcurrency/should_divide_the_max_concurrency_between_in-use_instances,_and_create_1_connection_for_each_instance_not_in-use (0.00s) --- PASS: TestQuerierWorker_getDesiredConcurrency/should_create_1_connection_for_each_instance_if_max_concurrency_is_set_to_0 (0.00s) --- PASS: TestQuerierWorker_getDesiredConcurrency/should_create_1_connection_for_each_instance_if_max_concurrency_is_>_0_but_less_than_the_number_of_in-use_instances (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/worker 3.528s === RUN TestRuler === RUN TestRuler/should_load_and_evaluate_no_rules_if_rules_evaluation_is_disabled_for_the_tenant level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_no_rules_if_rules_evaluation_is_disabled_for_the_tenant209151895/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="filtered out all rules because evaluation is disabled for the tenant" user=user1 recording_rules_enabled=false alerting_rules_enabled=false level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_no_rules_if_rules_evaluation_is_disabled_for_the_tenant209151895/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler/should_load_and_evaluate_the_configured_rules_with_special_characters level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_the_configured_rules_with_special_characters2118280167/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRulershould_load_and_evaluate_the_configured_rules_with_special_characters2118280167/001/user1/%29%28_+%3F%2F%7Cnamespace1+%2F%3F level=info user=user1 msg="Starting rule manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_the_configured_rules_with_special_characters2118280167/001 === RUN TestRuler/should_support_federated_rules level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_support_federated_rules4270801824/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRulershould_support_federated_rules4270801824/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_support_federated_rules4270801824/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler/should_load_and_evaluate_the_configured_rules level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_the_configured_rules368656485/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRulershould_load_and_evaluate_the_configured_rules368656485/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_the_configured_rules368656485/001 === RUN TestRuler/should_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant2968703710/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="filtered out rules because evaluation is disabled for the tenant" user=user1 removed_rules=1 recording_rules_enabled=true alerting_rules_enabled=false level=info msg="updating rule file" file=/tmp/TestRulershould_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant2968703710/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant2968703710/001 === RUN TestRuler/should_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant2757189270/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="filtered out rules because evaluation is disabled for the tenant" user=user1 removed_rules=1 recording_rules_enabled=false alerting_rules_enabled=true level=info msg="updating rule file" file=/tmp/TestRulershould_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant2757189270/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant2757189270/001 --- PASS: TestRuler (0.71s) --- PASS: TestRuler/should_load_and_evaluate_no_rules_if_rules_evaluation_is_disabled_for_the_tenant (0.27s) --- PASS: TestRuler/should_load_and_evaluate_the_configured_rules_with_special_characters (0.09s) --- PASS: TestRuler/should_support_federated_rules (0.09s) --- PASS: TestRuler/should_load_and_evaluate_the_configured_rules (0.08s) --- PASS: TestRuler/should_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant (0.08s) --- PASS: TestRuler/should_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant (0.08s) === RUN TestRuler_alerts level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_alerts2466873096/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_alerts2466873096/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestRuler_alerts2466873096/001/user2/namespace1 level=info user=user2 msg="Starting rule manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info user=user2 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_alerts2466873096/001 --- PASS: TestRuler_alerts (0.09s) === RUN TestRuler_Create level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Create1082611165/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" === RUN TestRuler_Create/with_an_empty_payload === RUN TestRuler_Create/with_no_rule_group_name === RUN TestRuler_Create/with_no_rules === RUN TestRuler_Create/with_a_a_valid_rules_file level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Create1082611165/001 level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_Create (0.06s) --- PASS: TestRuler_Create/with_an_empty_payload (0.01s) --- PASS: TestRuler_Create/with_no_rule_group_name (0.00s) --- PASS: TestRuler_Create/with_no_rules (0.00s) --- PASS: TestRuler_Create/with_a_a_valid_rules_file (0.03s) === RUN TestRuler_DeleteNamespace level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_DeleteNamespace1549366518/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_DeleteNamespace1549366518/001/user1/namespace1 level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info msg="updating rule file" file=/tmp/TestRuler_DeleteNamespace1549366518/001/user1/namespace2 level=info user=user1 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_DeleteNamespace1549366518/001 --- PASS: TestRuler_DeleteNamespace (0.05s) === RUN TestRuler_LimitsPerGroup level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_LimitsPerGroup1351847786/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" === RUN TestRuler_LimitsPerGroup/when_exceeding_the_rules_per_rule_group_limit level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_LimitsPerGroup1351847786/001 --- PASS: TestRuler_LimitsPerGroup (0.03s) --- PASS: TestRuler_LimitsPerGroup/when_exceeding_the_rules_per_rule_group_limit (0.00s) === RUN TestRuler_RulerGroupLimits level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_RulerGroupLimits1184770686/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" === RUN TestRuler_RulerGroupLimits/when_pushing_the_first_group_within_bounds_of_the_limit === RUN TestRuler_RulerGroupLimits/when_exceeding_the_rule_group_limit_after_sending_the_first_group level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_RulerGroupLimits1184770686/001 level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_RulerGroupLimits (0.03s) --- PASS: TestRuler_RulerGroupLimits/when_pushing_the_first_group_within_bounds_of_the_limit (0.01s) --- PASS: TestRuler_RulerGroupLimits/when_exceeding_the_rule_group_limit_after_sending_the_first_group (0.00s) === RUN Test_newRulerClientFactory --- PASS: Test_newRulerClientFactory (0.18s) === RUN TestPusherAppendable === RUN TestPusherAppendable/tenant_without_delay,_normal_value === RUN TestPusherAppendable/tenant_without_delay,_stale_nan_value === RUN TestPusherAppendable/ALERTS,_normal_value === RUN TestPusherAppendable/ALERTS,_stale_nan_value --- PASS: TestPusherAppendable (0.01s) --- PASS: TestPusherAppendable/tenant_without_delay,_normal_value (0.00s) --- PASS: TestPusherAppendable/tenant_without_delay,_stale_nan_value (0.01s) --- PASS: TestPusherAppendable/ALERTS,_normal_value (0.00s) --- PASS: TestPusherAppendable/ALERTS,_stale_nan_value (0.00s) === RUN TestPusherErrors === RUN TestPusherErrors/500_error === RUN TestPusherErrors/unknown_error === RUN TestPusherErrors/no_error === RUN TestPusherErrors/400_error --- PASS: TestPusherErrors (0.02s) --- PASS: TestPusherErrors/500_error (0.00s) --- PASS: TestPusherErrors/unknown_error (0.00s) --- PASS: TestPusherErrors/no_error (0.00s) --- PASS: TestPusherErrors/400_error (0.00s) === RUN TestMetricsQueryFuncErrors === RUN TestMetricsQueryFuncErrors/promql.ErrQueryTimeout === RUN TestMetricsQueryFuncErrors/unknown_error === RUN TestMetricsQueryFuncErrors/no_error === RUN TestMetricsQueryFuncErrors/httpgrpc_400_error === RUN TestMetricsQueryFuncErrors/httpgrpc_500_error === RUN TestMetricsQueryFuncErrors/unknown_but_non-queryable_error === RUN TestMetricsQueryFuncErrors/promql.ErrStorage === RUN TestMetricsQueryFuncErrors/promql.ErrQueryCanceled === RUN TestMetricsQueryFuncErrors/promql.ErrTooManySamples --- PASS: TestMetricsQueryFuncErrors (0.01s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrQueryTimeout (0.00s) --- PASS: TestMetricsQueryFuncErrors/unknown_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/no_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/httpgrpc_400_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/httpgrpc_500_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/unknown_but_non-queryable_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrStorage (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrQueryCanceled (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrTooManySamples (0.00s) === RUN TestRecordAndReportRuleQueryMetrics --- PASS: TestRecordAndReportRuleQueryMetrics (1.00s) === RUN TestManagerFactory_CorrectQueryableUsed === RUN TestManagerFactory_CorrectQueryableUsed/regular_rule_group_(without_source_tenants)_uses_regular_querier level=info msg="cleaning up mapped rules directory" path=/tmp/TestManagerFactory_CorrectQueryableUsedregular_rule_group_(without_source_tenants)_uses_regular_querier2709388702/001 level=info msg="updating rule file" file=/tmp/TestManagerFactory_CorrectQueryableUsedregular_rule_group_(without_source_tenants)_uses_regular_querier2709388702/001/tenant-1/namespace level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" === RUN TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_single_source_tenant_uses_federated_querier level=info msg="cleaning up mapped rules directory" path=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_single_source_tenant_uses_federated_querier2195369432/001 level=info msg="updating rule file" file=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_single_source_tenant_uses_federated_querier2195369432/001/tenant-1/namespace level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" === RUN TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_multiple_source_tenants_uses_federated_querier level=info msg="cleaning up mapped rules directory" path=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_multiple_source_tenants_uses_federated_querier1339882514/001 level=info msg="updating rule file" file=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_multiple_source_tenants_uses_federated_querier1339882514/001/tenant-1/namespace level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" --- PASS: TestManagerFactory_CorrectQueryableUsed (0.10s) --- PASS: TestManagerFactory_CorrectQueryableUsed/regular_rule_group_(without_source_tenants)_uses_regular_querier (0.04s) --- PASS: TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_single_source_tenant_uses_federated_querier (0.03s) --- PASS: TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_multiple_source_tenants_uses_federated_querier (0.03s) === RUN TestRulerShutdown level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulerShutdown2940307104/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRulerShutdown2940307104/001/user1/namespace1 level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info user=user1 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestRulerShutdown2940307104/001/user2/namespace1 level=info user=user1 msg="Stopping notification manager..." level=info user=user2 msg="Starting rule manager..." level=info user=user2 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulerShutdown2940307104/001 --- PASS: TestRulerShutdown (0.05s) === RUN TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances836288208/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances836288208/001/user2/namespace1 level=info msg="updating rule file" file=/tmp/TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances836288208/001/user1/namespace1 level=info user=user2 msg="Starting rule manager..." level=info user=user1 msg="Starting rule manager..." level=warn msg="auto-forgetting instance from the ring because it is unhealthy for a long time" instance=unhealthy-id last_heartbeat="2022-12-01 20:46:24 +0000 UTC" forget_period=2m0s level=info user=user1 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info user=user2 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances836288208/001 --- PASS: TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances (0.16s) === RUN TestManagerMetrics --- PASS: TestManagerMetrics (0.03s) === RUN TestMetricsArePerUser --- PASS: TestMetricsArePerUser (0.01s) === RUN TestSyncRuleGroups --- PASS: TestSyncRuleGroups (0.06s) === RUN Test_mapper_MapRules === RUN Test_mapper_MapRules/basic_rulegroup level=info msg="updating rule file" file=/rules/user1/file%20%2Fone === RUN Test_mapper_MapRules/identical_rulegroup === RUN Test_mapper_MapRules/out_of_order_identical_rulegroup === RUN Test_mapper_MapRules/updated_rulegroup level=info msg="updating rule file" file=/rules/user1/file%20%2Fone --- PASS: Test_mapper_MapRules (0.02s) --- PASS: Test_mapper_MapRules/basic_rulegroup (0.01s) --- PASS: Test_mapper_MapRules/identical_rulegroup (0.00s) --- PASS: Test_mapper_MapRules/out_of_order_identical_rulegroup (0.00s) --- PASS: Test_mapper_MapRules/updated_rulegroup (0.00s) === RUN Test_mapper_MapRulesMultipleFiles === RUN Test_mapper_MapRulesMultipleFiles/basic_rulegroup level=info msg="updating rule file" file=/rules/user1/file%20%2Fone === RUN Test_mapper_MapRulesMultipleFiles/add_a_file level=info msg="updating rule file" file=/rules/user1/file%20%2Ftwo === RUN Test_mapper_MapRulesMultipleFiles/update_one_file level=info msg="updating rule file" file=/rules/user1/file%20%2Ftwo === RUN Test_mapper_MapRulesMultipleFiles/delete_one_file --- PASS: Test_mapper_MapRulesMultipleFiles (0.01s) --- PASS: Test_mapper_MapRulesMultipleFiles/basic_rulegroup (0.00s) --- PASS: Test_mapper_MapRulesMultipleFiles/add_a_file (0.00s) --- PASS: Test_mapper_MapRulesMultipleFiles/update_one_file (0.00s) --- PASS: Test_mapper_MapRulesMultipleFiles/delete_one_file (0.00s) === RUN Test_mapper_MapRulesSpecialCharNamespace === RUN Test_mapper_MapRulesSpecialCharNamespace/create_special_characters_rulegroup level=info msg="updating rule file" file=/rules/user1/+A_%2FReallyStrange%3C%3ENAME:SPACE%2F%3F === RUN Test_mapper_MapRulesSpecialCharNamespace/delete_special_characters_rulegroup --- PASS: Test_mapper_MapRulesSpecialCharNamespace (0.00s) --- PASS: Test_mapper_MapRulesSpecialCharNamespace/create_special_characters_rulegroup (0.00s) --- PASS: Test_mapper_MapRulesSpecialCharNamespace/delete_special_characters_rulegroup (0.00s) === RUN Test_mapper_CleanupShouldNotFailIfPathDoesNotExist --- PASS: Test_mapper_CleanupShouldNotFailIfPathDoesNotExist (0.00s) === RUN TestBuildNotifierConfig === RUN TestBuildNotifierConfig/with_no_valid_hosts,_returns_an_empty_config === RUN TestBuildNotifierConfig/with_a_single_URL_and_no_service_discovery === RUN TestBuildNotifierConfig/with_a_single_URL,_v2_API,_and_no_service_discovery === RUN TestBuildNotifierConfig/with_a_SRV_URL_but_no_service_discovery_(missing_dns+_prefix) === RUN TestBuildNotifierConfig/with_multiple_URLs_and_no_service_discovery === RUN TestBuildNotifierConfig/with_basic_authentication_URL_and_no_service_discovery === RUN TestBuildNotifierConfig/with_basic_authentication_URL_and_service_discovery === RUN TestBuildNotifierConfig/with_basic_authentication_URL,_no_service_discovery,_and_explicit_config === RUN TestBuildNotifierConfig/with_multiple_URLs_and_service_discovery === RUN TestBuildNotifierConfig/with_DNS_service_discovery_and_missing_scheme === RUN TestBuildNotifierConfig/with_only_dns+_prefix === RUN TestBuildNotifierConfig/misspelled_DNS_SD_format_prefix_(dnsserv+_vs_dnssrv+) --- PASS: TestBuildNotifierConfig (0.01s) --- PASS: TestBuildNotifierConfig/with_no_valid_hosts,_returns_an_empty_config (0.00s) --- PASS: TestBuildNotifierConfig/with_a_single_URL_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_a_single_URL,_v2_API,_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_a_SRV_URL_but_no_service_discovery_(missing_dns+_prefix) (0.00s) --- PASS: TestBuildNotifierConfig/with_multiple_URLs_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_basic_authentication_URL_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_basic_authentication_URL_and_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_basic_authentication_URL,_no_service_discovery,_and_explicit_config (0.00s) --- PASS: TestBuildNotifierConfig/with_multiple_URLs_and_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_DNS_service_discovery_and_missing_scheme (0.00s) --- PASS: TestBuildNotifierConfig/with_only_dns+_prefix (0.00s) --- PASS: TestBuildNotifierConfig/misspelled_DNS_SD_format_prefix_(dnsserv+_vs_dnssrv+) (0.00s) === RUN TestRemoteQuerier_ReadReq --- PASS: TestRemoteQuerier_ReadReq (0.01s) === RUN TestRemoteQuerier_ReadReqTimeout --- PASS: TestRemoteQuerier_ReadReqTimeout (1.00s) === RUN TestRemoteQuerier_QueryReq --- PASS: TestRemoteQuerier_QueryReq (0.00s) === RUN TestRemoteQuerier_QueryReqTimeout --- PASS: TestRemoteQuerier_QueryReqTimeout (1.00s) === RUN TestRemoteQuerier_BackoffRetry === RUN TestRemoteQuerier_BackoffRetry/succeed_on_failed_requests_<=_max_retries === RUN TestRemoteQuerier_BackoffRetry/fail_on_failed_requests_>_max_retries === RUN TestRemoteQuerier_BackoffRetry/return_last_known_error_on_context_cancellation --- PASS: TestRemoteQuerier_BackoffRetry (0.95s) --- PASS: TestRemoteQuerier_BackoffRetry/succeed_on_failed_requests_<=_max_retries (0.52s) --- PASS: TestRemoteQuerier_BackoffRetry/fail_on_failed_requests_>_max_retries (0.37s) --- PASS: TestRemoteQuerier_BackoffRetry/return_last_known_error_on_context_cancellation (0.05s) === RUN TestRemoteQuerier_StatusErrorResponses --- PASS: TestRemoteQuerier_StatusErrorResponses (0.00s) === RUN TestNotifierSendsUserIDHeader level=info msg="cleaning up mapped rules directory" path=/tmp/TestNotifierSendsUserIDHeader3661287783/001 level=info user=1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestNotifierSendsUserIDHeader3661287783/001 --- PASS: TestNotifierSendsUserIDHeader (5.18s) === RUN TestRuler_Rules === RUN TestRuler_Rules/rules_-_user1 level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesrules_-_user11500549039/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_Rulesrules_-_user11500549039/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestRuler_Rulesrules_-_user11500549039/001/user2/namespace1 level=info user=user2 msg="Starting rule manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info user=user2 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesrules_-_user11500549039/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler_Rules/rules_-_user2 level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesrules_-_user2333899592/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_Rulesrules_-_user2333899592/001/user1/namespace1 level=info msg="updating rule file" file=/tmp/TestRuler_Rulesrules_-_user2333899592/001/user2/namespace1 level=info user=user1 msg="Starting rule manager..." level=info user=user2 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info user=user2 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user2 msg="Stopping rule manager..." level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info user=user2 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesrules_-_user2333899592/001 === RUN TestRuler_Rules/federated_rule_group level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesfederated_rule_group2168778902/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_Rulesfederated_rule_group2168778902/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesfederated_rule_group2168778902/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_Rules (0.46s) --- PASS: TestRuler_Rules/rules_-_user1 (0.30s) --- PASS: TestRuler_Rules/rules_-_user2 (0.08s) --- PASS: TestRuler_Rules/federated_rule_group (0.07s) === RUN TestGetRules === RUN TestGetRules/Shuffle_Shard_Size_0 level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_03357259589/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_03357259589/002 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_03357259589/003 level=info msg="ring doesn't exist in KV store yet" level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_03357259589/001/user2/namespace level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_03357259589/002/user2/namespace level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_03357259589/002/user3/namespace level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_03357259589/002/user1/namespace level=info user=user3 msg="Starting rule manager..." level=info user=user1 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_03357259589/003/user2/namespace level=info user=user2 msg="Starting rule manager..." === RUN TestGetRules/Shuffle_Shard_Size_2 level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_24139221240/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_24139221240/002 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_24139221240/003 level=info msg="ring doesn't exist in KV store yet" level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_24139221240/002/user1/namespace level=info user=user1 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_24139221240/002/user2/namespace level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_24139221240/003/user2/namespace level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_24139221240/003/user3/namespace level=info user=user3 msg="Starting rule manager..." --- PASS: TestGetRules (0.40s) --- PASS: TestGetRules/Shuffle_Shard_Size_0 (0.19s) --- PASS: TestGetRules/Shuffle_Shard_Size_2 (0.20s) === RUN TestSharding === RUN TestSharding/shard_size_0,_JOINING_ruler level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_2,_three_rulers,_single_enabled_user level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 === RUN TestSharding/shard_size_0,_unhealthy_ACTIVE_ruler level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= level=error msg="failed to check if the ruler replica owns the rule group" user=user3 namespace=namespace group=first err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" level=error msg="failed to check if the ruler replica owns the rule group" user=user1 namespace=namespace group=second err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" level=error msg="failed to check if the ruler replica owns the rule group" user=user1 namespace=namespace group=second err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" level=error msg="failed to check if the ruler replica owns the rule group" user=user3 namespace=namespace group=first err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" === RUN TestSharding/shard_size_0,_single_ruler level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_2,_two_rulers level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_2,_three_rulers,_single_disabled_user level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 === RUN TestSharding/single_ruler,_with_ring_setup level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_0,_multiple_ACTIVE_rulers level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_disabled_user level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 === RUN TestSharding/shard_size_2,_three_rulers level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/single_ruler_with_ring_setup,_single_user_disabled level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 === RUN TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_enabled_user level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 === RUN TestSharding/shard_size_1,_two_rulers,_distributed_users level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_2,_three_rulers,_ruler2_has_no_users level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/single_ruler,_with_ring_setup,_single_user_enabled level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 === RUN TestSharding/shard_size_0,_LEAVING_ruler level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_1,_multiple_rulers level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= --- PASS: TestSharding (2.22s) --- PASS: TestSharding/shard_size_0,_JOINING_ruler (0.12s) --- PASS: TestSharding/shard_size_2,_three_rulers,_single_enabled_user (0.12s) --- PASS: TestSharding/shard_size_0,_unhealthy_ACTIVE_ruler (0.13s) --- PASS: TestSharding/shard_size_0,_single_ruler (0.13s) --- PASS: TestSharding/shard_size_2,_two_rulers (0.14s) --- PASS: TestSharding/shard_size_2,_three_rulers,_single_disabled_user (0.13s) --- PASS: TestSharding/single_ruler,_with_ring_setup (0.12s) --- PASS: TestSharding/shard_size_0,_multiple_ACTIVE_rulers (0.13s) --- PASS: TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_disabled_user (0.15s) --- PASS: TestSharding/shard_size_2,_three_rulers (0.13s) --- PASS: TestSharding/single_ruler_with_ring_setup,_single_user_disabled (0.12s) --- PASS: TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_enabled_user (0.13s) --- PASS: TestSharding/shard_size_1,_two_rulers,_distributed_users (0.13s) --- PASS: TestSharding/shard_size_2,_three_rulers,_ruler2_has_no_users (0.13s) --- PASS: TestSharding/single_ruler,_with_ring_setup,_single_user_enabled (0.13s) --- PASS: TestSharding/shard_size_0,_LEAVING_ruler (0.13s) --- PASS: TestSharding/shard_size_1,_multiple_rulers (0.13s) === RUN TestDeleteTenantRuleGroups --- PASS: TestDeleteTenantRuleGroups (0.01s) === RUN TestRuler_ListAllRules level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_ListAllRules1549310926/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_ListAllRules1549310926/001/user1/namespace1 level=info msg="updating rule file" file=/tmp/TestRuler_ListAllRules1549310926/001/user2/namespace1 level=info user=user1 msg="Starting rule manager..." level=info user=user2 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user2 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info msg="unregistering instance from ring" ring=ruler level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="instance removed from the ring" ring=ruler level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_ListAllRules1549310926/001 --- PASS: TestRuler_ListAllRules (0.09s) === RUN TestSendAlerts === RUN TestSendAlerts/0 === RUN TestSendAlerts/1 === RUN TestSendAlerts/2 --- PASS: TestSendAlerts (0.00s) --- PASS: TestSendAlerts/0 (0.00s) --- PASS: TestSendAlerts/1 (0.00s) --- PASS: TestSendAlerts/2 (0.00s) === RUN TestFilterRuleGroupsByEnabled === RUN TestFilterRuleGroupsByEnabled/should_remove_alerting_rules_if_disabled_for_a_given_tenant === RUN TestFilterRuleGroupsByEnabled/should_remove_recording_rules_if_disabled_for_a_given_tenant === RUN TestFilterRuleGroupsByEnabled/should_remove_all_config_for_a_user_if_both_recording_and_alerting_rules_are_disabled === RUN TestFilterRuleGroupsByEnabled/should_remove_configs_for_all_users_if_both_recording_and_alerting_rules_are_disabled_for_every_user === RUN TestFilterRuleGroupsByEnabled/should_return_an_empty_map_on_empty_input --- PASS: TestFilterRuleGroupsByEnabled (0.03s) --- PASS: TestFilterRuleGroupsByEnabled/should_remove_alerting_rules_if_disabled_for_a_given_tenant (0.00s) --- PASS: TestFilterRuleGroupsByEnabled/should_remove_recording_rules_if_disabled_for_a_given_tenant (0.00s) --- PASS: TestFilterRuleGroupsByEnabled/should_remove_all_config_for_a_user_if_both_recording_and_alerting_rules_are_disabled (0.00s) --- PASS: TestFilterRuleGroupsByEnabled/should_remove_configs_for_all_users_if_both_recording_and_alerting_rules_are_disabled_for_every_user (0.00s) --- PASS: TestFilterRuleGroupsByEnabled/should_return_an_empty_map_on_empty_input (0.00s) === RUN TestConfig_TranslatesToPrometheusTargetGroup === RUN TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_single_address === RUN TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_multiple_addresses === RUN TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_no_addresses --- PASS: TestConfig_TranslatesToPrometheusTargetGroup (0.02s) --- PASS: TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_single_address (0.01s) --- PASS: TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_multiple_addresses (0.01s) --- PASS: TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_no_addresses (0.00s) === RUN TestConfig_ConstructsLookupNamesCorrectly === RUN TestConfig_ConstructsLookupNamesCorrectly/dns+ === RUN TestConfig_ConstructsLookupNamesCorrectly/dnssrv+ === RUN TestConfig_ConstructsLookupNamesCorrectly/dnssrvnoa+ --- PASS: TestConfig_ConstructsLookupNamesCorrectly (0.04s) --- PASS: TestConfig_ConstructsLookupNamesCorrectly/dns+ (0.01s) --- PASS: TestConfig_ConstructsLookupNamesCorrectly/dnssrv+ (0.02s) --- PASS: TestConfig_ConstructsLookupNamesCorrectly/dnssrvnoa+ (0.01s) === RUN TestRuler_TenantFederationFlag === RUN TestRuler_TenantFederationFlag/tenant_federation_disabled level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled722067909/001 level=info user=tenant-1 msg="Stopping notification manager..." level=info user=tenant-1 msg="Starting rule manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled722067909/001 === RUN TestRuler_TenantFederationFlag/tenant_federation_disabled_with_a_federated_rules_and_a_regular_rule level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled_with_a_federated_rules_and_a_regular_rule1307098227/001 level=info msg="updating rule file" file=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled_with_a_federated_rules_and_a_regular_rule1307098227/001/tenant-1/ns level=info user=tenant-1 msg="Stopping notification manager..." level=info user=tenant-1 msg="Starting rule manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled_with_a_federated_rules_and_a_regular_rule1307098227/001 === RUN TestRuler_TenantFederationFlag/tenant_federation_enabled_only_with_federated_groups level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_only_with_federated_groups3869694441/001 level=info msg="updating rule file" file=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_only_with_federated_groups3869694441/001/tenant-1/ns level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_only_with_federated_groups3869694441/001 === RUN TestRuler_TenantFederationFlag/tenant_federation_enabled_with_federated_and_regular_groups level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_with_federated_and_regular_groups1195652557/001 level=info msg="updating rule file" file=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_with_federated_and_regular_groups1195652557/001/tenant-1/ns level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_with_federated_and_regular_groups1195652557/001 --- PASS: TestRuler_TenantFederationFlag (0.14s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_disabled (0.04s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_disabled_with_a_federated_rules_and_a_regular_rule (0.03s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_enabled_only_with_federated_groups (0.04s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_enabled_with_federated_and_regular_groups (0.03s) PASS ok github.com/grafana/mimir/pkg/ruler 15.700s ? github.com/grafana/mimir/pkg/ruler/rulespb [no test files] === RUN TestIsDefaults === RUN TestIsDefaults/should_return_true_if_the_config_only_contains_default_values === RUN TestIsDefaults/should_return_false_if_the_config_contains_zero_values === RUN TestIsDefaults/should_return_false_if_the_config_contains_default_values_and_some_overrides === RUN TestIsDefaults/should_return_true_if_only_a_non-config_field_has_changed --- PASS: TestIsDefaults (0.03s) --- PASS: TestIsDefaults/should_return_true_if_the_config_only_contains_default_values (0.02s) --- PASS: TestIsDefaults/should_return_false_if_the_config_contains_zero_values (0.00s) --- PASS: TestIsDefaults/should_return_false_if_the_config_contains_default_values_and_some_overrides (0.00s) --- PASS: TestIsDefaults/should_return_true_if_only_a_non-config_field_has_changed (0.00s) PASS ok github.com/grafana/mimir/pkg/ruler/rulestore 1.214s === RUN TestListRules --- PASS: TestListRules (0.01s) === RUN TestLoadRules --- PASS: TestLoadRules (0.02s) === RUN TestDelete --- PASS: TestDelete (0.00s) === RUN TestParseRuleGroupObjectKey === RUN TestParseRuleGroupObjectKey/valid_object_key === RUN TestParseRuleGroupObjectKey/empty_object_key === RUN TestParseRuleGroupObjectKey/invalid_object_key_pattern === RUN TestParseRuleGroupObjectKey/empty_namespace === RUN TestParseRuleGroupObjectKey/invalid_namespace_encoding === RUN TestParseRuleGroupObjectKey/empty_group === RUN TestParseRuleGroupObjectKey/invalid_group_encoding --- PASS: TestParseRuleGroupObjectKey (0.00s) --- PASS: TestParseRuleGroupObjectKey/valid_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKey/empty_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKey/invalid_object_key_pattern (0.00s) --- PASS: TestParseRuleGroupObjectKey/empty_namespace (0.00s) --- PASS: TestParseRuleGroupObjectKey/invalid_namespace_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKey/empty_group (0.00s) --- PASS: TestParseRuleGroupObjectKey/invalid_group_encoding (0.00s) === RUN TestParseRuleGroupObjectKeyWithUser === RUN TestParseRuleGroupObjectKeyWithUser/empty_user === RUN TestParseRuleGroupObjectKeyWithUser/empty_namespace === RUN TestParseRuleGroupObjectKeyWithUser/invalid_namespace_encoding === RUN TestParseRuleGroupObjectKeyWithUser/empty_group_name === RUN TestParseRuleGroupObjectKeyWithUser/invalid_group_encoding === RUN TestParseRuleGroupObjectKeyWithUser/valid_object_key === RUN TestParseRuleGroupObjectKeyWithUser/empty_object_key === RUN TestParseRuleGroupObjectKeyWithUser/invalid_object_key_pattern --- PASS: TestParseRuleGroupObjectKeyWithUser (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_user (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_namespace (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/invalid_namespace_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_group_name (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/invalid_group_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/valid_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/invalid_object_key_pattern (0.00s) === RUN TestListAllRuleGroupsWithNoNamespaceOrGroup --- PASS: TestListAllRuleGroupsWithNoNamespaceOrGroup (0.00s) PASS ok github.com/grafana/mimir/pkg/ruler/rulestore/bucketclient 1.219s === RUN TestClient_LoadAllRuleGroups --- PASS: TestClient_LoadAllRuleGroups (0.05s) PASS ok github.com/grafana/mimir/pkg/ruler/rulestore/local 1.021s === RUN TestSchedulerBasicEnqueue --- PASS: TestSchedulerBasicEnqueue (0.25s) === RUN TestSchedulerEnqueueWithCancel --- PASS: TestSchedulerEnqueueWithCancel (0.57s) === RUN TestSchedulerEnqueueByMultipleFrontendsWithCancel --- PASS: TestSchedulerEnqueueByMultipleFrontendsWithCancel (0.54s) === RUN TestSchedulerEnqueueWithFrontendDisconnect --- PASS: TestSchedulerEnqueueWithFrontendDisconnect (0.53s) === RUN TestCancelRequestInProgress --- PASS: TestCancelRequestInProgress (0.55s) === RUN TestTracingContext --- PASS: TestTracingContext (0.22s) === RUN TestSchedulerShutdown_FrontendLoop --- PASS: TestSchedulerShutdown_FrontendLoop (0.04s) === RUN TestSchedulerShutdown_QuerierLoop --- PASS: TestSchedulerShutdown_QuerierLoop (0.02s) === RUN TestSchedulerMaxOutstandingRequests --- PASS: TestSchedulerMaxOutstandingRequests (0.03s) === RUN TestSchedulerForwardsErrorToFrontend --- PASS: TestSchedulerForwardsErrorToFrontend (0.04s) === RUN TestSchedulerMetrics --- PASS: TestSchedulerMetrics (0.09s) PASS ok github.com/grafana/mimir/pkg/scheduler 4.688s === RUN TestRequestQueue_GetNextRequestForQuerier_ShouldGetRequestAfterReshardingBecauseQuerierHasBeenForgotten --- PASS: TestRequestQueue_GetNextRequestForQuerier_ShouldGetRequestAfterReshardingBecauseQuerierHasBeenForgotten (5.02s) === RUN TestContextCond === RUN TestContextCond/wait_until_broadcast === PAUSE TestContextCond/wait_until_broadcast === RUN TestContextCond/wait_until_context_deadline === PAUSE TestContextCond/wait_until_context_deadline === RUN TestContextCond/wait_on_already_canceled_context === PAUSE TestContextCond/wait_on_already_canceled_context === RUN TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait === PAUSE TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait === RUN TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel === PAUSE TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel === CONT TestContextCond/wait_until_broadcast === CONT TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait === CONT TestContextCond/wait_on_already_canceled_context === CONT TestContextCond/wait_until_context_deadline === CONT TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel --- PASS: TestContextCond (0.01s) --- PASS: TestContextCond/wait_on_already_canceled_context (0.00s) --- PASS: TestContextCond/wait_until_broadcast (0.10s) --- PASS: TestContextCond/wait_until_context_deadline (0.10s) --- PASS: TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait (0.42s) --- PASS: TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel (0.58s) === RUN TestQueues --- PASS: TestQueues (0.01s) === RUN TestQueuesOnTerminatingQuerier --- PASS: TestQueuesOnTerminatingQuerier (0.00s) === RUN TestQueuesWithQueriers user_queues_test.go:170: mean: 166.66666666666666 stddev: 11.178352094810558 --- PASS: TestQueuesWithQueriers (0.31s) === RUN TestQueuesConsistency === RUN TestQueuesConsistency/without_forget_delay === RUN TestQueuesConsistency/with_forget_delay --- PASS: TestQueuesConsistency (0.42s) --- PASS: TestQueuesConsistency/without_forget_delay (0.19s) --- PASS: TestQueuesConsistency/with_forget_delay (0.22s) === RUN TestQueues_ForgetDelay --- PASS: TestQueues_ForgetDelay (0.11s) === RUN TestQueues_ForgetDelay_ShouldCorrectlyHandleQuerierReconnectingBeforeForgetDelayIsPassed --- PASS: TestQueues_ForgetDelay_ShouldCorrectlyHandleQuerierReconnectingBeforeForgetDelayIsPassed (0.06s) === RUN TestShuffleQueriers --- PASS: TestShuffleQueriers (0.00s) === RUN TestShuffleQueriersCorrectness --- PASS: TestShuffleQueriersCorrectness (1.13s) PASS ok github.com/grafana/mimir/pkg/scheduler/queue 8.246s === RUN TestConfig_Validate === RUN TestConfig_Validate/should_fail_if_service_discovery_mode_is_set_to_DNS_and_max_used_instances_has_been_configured === RUN TestConfig_Validate/should_pass_if_service_discovery_mode_is_set_to_ring_and_max_used_instances_has_been_configured === RUN TestConfig_Validate/should_fail_if_service_discovery_mode_is_set_to_ring_but_max_used_instances_is_negative === RUN TestConfig_Validate/should_pass_with_default_config === RUN TestConfig_Validate/should_fail_if_service_discovery_mode_is_invalid --- PASS: TestConfig_Validate (0.04s) --- PASS: TestConfig_Validate/should_fail_if_service_discovery_mode_is_set_to_DNS_and_max_used_instances_has_been_configured (0.01s) --- PASS: TestConfig_Validate/should_pass_if_service_discovery_mode_is_set_to_ring_and_max_used_instances_has_been_configured (0.00s) --- PASS: TestConfig_Validate/should_fail_if_service_discovery_mode_is_set_to_ring_but_max_used_instances_is_negative (0.00s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.01s) --- PASS: TestConfig_Validate/should_fail_if_service_discovery_mode_is_invalid (0.00s) === RUN TestRingConfig_DefaultConfigToBasicLifecyclerConfig --- PASS: TestRingConfig_DefaultConfigToBasicLifecyclerConfig (0.04s) === RUN TestRingConfig_CustomConfigToBasicLifecyclerConfig --- PASS: TestRingConfig_CustomConfigToBasicLifecyclerConfig (0.05s) PASS ok github.com/grafana/mimir/pkg/scheduler/schedulerdiscovery 1.013s ? github.com/grafana/mimir/pkg/scheduler/schedulerpb [no test files] === RUN TestDeletePrefix --- PASS: TestDeletePrefix (0.00s) === RUN TestNewClient === PAUSE TestNewClient === RUN TestClientMock_MockGet --- PASS: TestClientMock_MockGet (1.42s) === RUN TestClient_ConfigValidation === RUN TestClient_ConfigValidation/valid_storage_prefix === RUN TestClient_ConfigValidation/storage_prefix_non-alphanumeric_characters === RUN TestClient_ConfigValidation/storage_prefix_suffixed_with_a_slash_(non-alphanumeric) === RUN TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(..) === RUN TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(.) === RUN TestClient_ConfigValidation/unsupported_backend --- PASS: TestClient_ConfigValidation (0.02s) --- PASS: TestClient_ConfigValidation/valid_storage_prefix (0.02s) --- PASS: TestClient_ConfigValidation/storage_prefix_non-alphanumeric_characters (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_suffixed_with_a_slash_(non-alphanumeric) (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(..) (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(.) (0.00s) --- PASS: TestClient_ConfigValidation/unsupported_backend (0.00s) === RUN TestNewPrefixedBucketClient === RUN TestNewPrefixedBucketClient/with_prefix === RUN TestNewPrefixedBucketClient/without_prefix --- PASS: TestNewPrefixedBucketClient (0.03s) --- PASS: TestNewPrefixedBucketClient/with_prefix (0.02s) --- PASS: TestNewPrefixedBucketClient/without_prefix (0.01s) === RUN TestPrefixedBucketClient === RUN TestPrefixedBucketClient/Upload prefixed_bucket_client_test.go:25: PASS: Upload(string,string,string) === RUN TestPrefixedBucketClient/Delete prefixed_bucket_client_test.go:32: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:32: PASS: Delete(string,string) === RUN TestPrefixedBucketClient/Iter prefixed_bucket_client_test.go:42: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:42: PASS: Delete(string,string) prefixed_bucket_client_test.go:42: PASS: Iter(string,string,string,string) === RUN TestPrefixedBucketClient/Get prefixed_bucket_client_test.go:53: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:53: PASS: Delete(string,string) prefixed_bucket_client_test.go:53: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:53: PASS: Get(string,string) === RUN TestPrefixedBucketClient/GetRange prefixed_bucket_client_test.go:64: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:64: PASS: Delete(string,string) prefixed_bucket_client_test.go:64: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:64: PASS: Get(string,string) prefixed_bucket_client_test.go:64: PASS: GetRange(string,string,string,string) === RUN TestPrefixedBucketClient/Exists prefixed_bucket_client_test.go:72: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:72: PASS: Delete(string,string) prefixed_bucket_client_test.go:72: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:72: PASS: Get(string,string) prefixed_bucket_client_test.go:72: PASS: GetRange(string,string,string,string) prefixed_bucket_client_test.go:72: PASS: Exists(string,string) === RUN TestPrefixedBucketClient/Attributes prefixed_bucket_client_test.go:79: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:79: PASS: Delete(string,string) prefixed_bucket_client_test.go:79: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:79: PASS: Get(string,string) prefixed_bucket_client_test.go:79: PASS: GetRange(string,string,string,string) prefixed_bucket_client_test.go:79: PASS: Exists(string,string) prefixed_bucket_client_test.go:79: PASS: Attributes(string,string) --- PASS: TestPrefixedBucketClient (0.11s) --- PASS: TestPrefixedBucketClient/Upload (0.00s) --- PASS: TestPrefixedBucketClient/Delete (0.00s) --- PASS: TestPrefixedBucketClient/Iter (0.08s) --- PASS: TestPrefixedBucketClient/Get (0.01s) --- PASS: TestPrefixedBucketClient/GetRange (0.00s) --- PASS: TestPrefixedBucketClient/Exists (0.00s) --- PASS: TestPrefixedBucketClient/Attributes (0.00s) === RUN TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig === RUN TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/default_client === RUN TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/client_with_expected_errors --- PASS: TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig (0.14s) --- PASS: TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/default_client (0.11s) --- PASS: TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/client_with_expected_errors (0.03s) === CONT TestNewClient === RUN TestNewClient/should_create_an_S3_bucket === RUN TestNewClient/should_create_a_GCS_bucket === RUN TestNewClient/should_return_error_on_unknown_backend --- PASS: TestNewClient (0.09s) --- PASS: TestNewClient/should_create_an_S3_bucket (0.03s) --- PASS: TestNewClient/should_create_a_GCS_bucket (0.05s) --- PASS: TestNewClient/should_return_error_on_unknown_backend (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/bucket 2.838s ? github.com/grafana/mimir/pkg/storage/bucket/azure [no test files] ? github.com/grafana/mimir/pkg/storage/bucket/filesystem [no test files] ? github.com/grafana/mimir/pkg/storage/bucket/gcs [no test files] === RUN TestSSEConfig_Validate === RUN TestSSEConfig_Validate/should_pass_with_default_config === RUN TestSSEConfig_Validate/should_fail_on_invalid_SSE_type === RUN TestSSEConfig_Validate/should_fail_on_invalid_SSE_KMS_encryption_context === RUN TestSSEConfig_Validate/should_pass_on_valid_SSE_KMS_encryption_context --- PASS: TestSSEConfig_Validate (0.02s) --- PASS: TestSSEConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestSSEConfig_Validate/should_fail_on_invalid_SSE_type (0.00s) --- PASS: TestSSEConfig_Validate/should_fail_on_invalid_SSE_KMS_encryption_context (0.00s) --- PASS: TestSSEConfig_Validate/should_pass_on_valid_SSE_KMS_encryption_context (0.00s) === RUN TestSSEConfig_BuildMinioConfig === RUN TestSSEConfig_BuildMinioConfig/SSE_KMS_without_encryption_context === RUN TestSSEConfig_BuildMinioConfig/SSE_KMS_with_encryption_context --- PASS: TestSSEConfig_BuildMinioConfig (0.01s) --- PASS: TestSSEConfig_BuildMinioConfig/SSE_KMS_without_encryption_context (0.00s) --- PASS: TestSSEConfig_BuildMinioConfig/SSE_KMS_with_encryption_context (0.01s) === RUN TestParseKMSEncryptionContext --- PASS: TestParseKMSEncryptionContext (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/bucket/s3 0.693s ? github.com/grafana/mimir/pkg/storage/bucket/swift [no test files] === RUN TestLen --- PASS: TestLen (0.00s) === RUN TestChunk === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/204 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/204 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/204 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/204 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/408 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/408 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/408 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/408 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/612 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/612 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/612 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/612 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/816 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/816 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/816 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/816 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1020 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1020 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1020 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1020 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1224 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1224 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1224 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1224 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1428 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1428 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1428 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1428 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1632 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1632 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1632 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1632 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1836 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1836 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1836 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1836 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/2040 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/2040 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/2040 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/2040 --- PASS: TestChunk (10.56s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/204 (0.02s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/204 (0.03s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/204 (0.01s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/204 (0.01s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/408 (0.03s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/408 (0.12s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/408 (0.05s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/408 (0.05s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/612 (0.12s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/612 (0.12s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/612 (0.05s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/612 (0.05s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/816 (0.09s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/816 (0.22s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/816 (0.17s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/816 (0.17s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1020 (0.14s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1020 (0.20s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1020 (0.24s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1020 (0.21s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1224 (0.24s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1224 (0.29s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1224 (0.36s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1224 (0.38s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1428 (0.23s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1428 (0.34s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1428 (0.23s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1428 (0.25s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1632 (0.36s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1632 (0.70s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1632 (0.30s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1632 (0.29s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1836 (0.49s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1836 (0.57s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1836 (0.42s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1836 (0.41s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/2040 (0.65s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/2040 (0.86s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/2040 (0.64s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/2040 (0.45s) PASS ok github.com/grafana/mimir/pkg/storage/chunk 10.803s ? github.com/grafana/mimir/pkg/storage/lazyquery [no test files] === RUN TestConcreteSeriesSet --- PASS: TestConcreteSeriesSet (0.02s) === RUN TestMatrixToSeriesSetSortsMetricLabels --- PASS: TestMatrixToSeriesSetSortsMetricLabels (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/series 0.619s === RUN TestParseShard === RUN TestParseShard/should_return_error_on_invalid_index_(not_positive) === RUN TestParseShard/should_return_error_on_invalid_count_(not_positive) === RUN TestParseShard/should_return_error_on_invalid_separator === RUN TestParseShard/should_return_error_on_invalid_format === RUN TestParseShard/should_return_error_on_invalid_index_(not_an_integer) === RUN TestParseShard/should_succeed_on_valid_first_shard_ID === RUN TestParseShard/should_succeed_on_valid_last_shard_selector === RUN TestParseShard/should_return_error_on_invalid_index_(too_large) === RUN TestParseShard/should_return_error_on_invalid_index_(too_small) --- PASS: TestParseShard (0.02s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(not_positive) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_count_(not_positive) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_separator (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_format (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(not_an_integer) (0.00s) --- PASS: TestParseShard/should_succeed_on_valid_first_shard_ID (0.00s) --- PASS: TestParseShard/should_succeed_on_valid_last_shard_selector (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(too_large) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(too_small) (0.00s) === RUN TestRemoveShardFromMatchers === RUN TestRemoveShardFromMatchers/should_return_no_shard_on_no_shard_label_matcher === RUN TestRemoveShardFromMatchers/should_return_matching_shard_and_filter_out_its_matcher === RUN TestRemoveShardFromMatchers/should_return_no_shard_on_empty_label_matchers --- PASS: TestRemoveShardFromMatchers (0.02s) --- PASS: TestRemoveShardFromMatchers/should_return_no_shard_on_no_shard_label_matcher (0.00s) --- PASS: TestRemoveShardFromMatchers/should_return_matching_shard_and_filter_out_its_matcher (0.00s) --- PASS: TestRemoveShardFromMatchers/should_return_no_shard_on_empty_label_matchers (0.00s) === RUN TestShardFromMatchers === RUN TestShardFromMatchers/0 === RUN TestShardFromMatchers/1 === RUN TestShardFromMatchers/2 --- PASS: TestShardFromMatchers (0.00s) --- PASS: TestShardFromMatchers/0 (0.00s) --- PASS: TestShardFromMatchers/1 (0.00s) --- PASS: TestShardFromMatchers/2 (0.00s) === RUN TestFormatAndParseShardId --- PASS: TestFormatAndParseShardId (0.05s) PASS ok github.com/grafana/mimir/pkg/storage/sharding 0.373s === RUN TestIsTenantDir --- PASS: TestIsTenantDir (0.00s) === RUN TestIsBucketIndexFile --- PASS: TestIsBucketIndexFile (0.00s) === RUN TestIsBlockIndexFile --- PASS: TestIsBlockIndexFile (0.00s) === RUN TestConfig_Validate === PAUSE TestConfig_Validate === RUN TestConfig_DurationList === PAUSE TestConfig_DurationList === RUN TestIndexCacheConfig_Validate === RUN TestIndexCacheConfig_Validate/one_memcached_address_should_pass === RUN TestIndexCacheConfig_Validate/default_config_should_pass === RUN TestIndexCacheConfig_Validate/unsupported_backend_should_fail === RUN TestIndexCacheConfig_Validate/no_memcached_addresses_should_fail --- PASS: TestIndexCacheConfig_Validate (0.00s) --- PASS: TestIndexCacheConfig_Validate/one_memcached_address_should_pass (0.00s) --- PASS: TestIndexCacheConfig_Validate/default_config_should_pass (0.00s) --- PASS: TestIndexCacheConfig_Validate/unsupported_backend_should_fail (0.00s) --- PASS: TestIndexCacheConfig_Validate/no_memcached_addresses_should_fail (0.00s) === RUN TestTenantDeletionMarkExists === RUN TestTenantDeletionMarkExists/mark_doesn't_exist === RUN TestTenantDeletionMarkExists/mark_exists === RUN TestTenantDeletionMarkExists/empty --- PASS: TestTenantDeletionMarkExists (0.00s) --- PASS: TestTenantDeletionMarkExists/mark_doesn't_exist (0.00s) --- PASS: TestTenantDeletionMarkExists/mark_exists (0.00s) --- PASS: TestTenantDeletionMarkExists/empty (0.00s) === RUN TestUploadBlock === RUN TestUploadBlock/wrong_dir === RUN TestUploadBlock/wrong_existing_dir_(not_a_block) === RUN TestUploadBlock/empty_block_dir === RUN TestUploadBlock/missing_chunks === RUN TestUploadBlock/missing_index_file === RUN TestUploadBlock/missing_meta.json_file === RUN TestUploadBlock/missing_meta.json_file,_but_valid_metadata_supplied_as_argument === RUN TestUploadBlock/full_block === RUN TestUploadBlock/upload_is_idempotent === RUN TestUploadBlock/upload_with_no_external_labels_works_just_fine === RUN TestUploadBlock/upload_with_supplied_meta.json --- PASS: TestUploadBlock (7.15s) --- PASS: TestUploadBlock/wrong_dir (0.00s) --- PASS: TestUploadBlock/wrong_existing_dir_(not_a_block) (0.00s) --- PASS: TestUploadBlock/empty_block_dir (0.00s) --- PASS: TestUploadBlock/missing_chunks (0.01s) --- PASS: TestUploadBlock/missing_index_file (0.00s) --- PASS: TestUploadBlock/missing_meta.json_file (0.00s) --- PASS: TestUploadBlock/missing_meta.json_file,_but_valid_metadata_supplied_as_argument (0.00s) --- PASS: TestUploadBlock/full_block (0.01s) --- PASS: TestUploadBlock/upload_is_idempotent (0.01s) --- PASS: TestUploadBlock/upload_with_no_external_labels_works_just_fine (2.43s) --- PASS: TestUploadBlock/upload_with_supplied_meta.json (1.97s) === RUN TestUsersScanner_ScanUsers_ShouldReturnedOwnedUsersOnly --- PASS: TestUsersScanner_ScanUsers_ShouldReturnedOwnedUsersOnly (0.02s) === RUN TestUsersScanner_ScanUsers_ShouldReturnUsersForWhichOwnerCheckOrTenantDeletionCheckFailed --- PASS: TestUsersScanner_ScanUsers_ShouldReturnUsersForWhichOwnerCheckOrTenantDeletionCheckFailed (0.01s) === RUN TestUsersScanner_ScanUsers_ShouldNotReturnPrefixedUsedByMimirInternals --- PASS: TestUsersScanner_ScanUsers_ShouldNotReturnPrefixedUsedByMimirInternals (0.01s) === RUN TestHashBlockID --- PASS: TestHashBlockID (0.00s) === CONT TestConfig_Validate === RUN TestConfig_Validate/should_fail_on_invalid_compaction_interval === CONT TestConfig_DurationList === RUN TestConfig_DurationList/default_to_2h === RUN TestConfig_DurationList/parse_ranges_correctly === RUN TestConfig_DurationList/handle_multiple_flag_parse --- PASS: TestConfig_DurationList (0.01s) --- PASS: TestConfig_DurationList/default_to_2h (0.01s) --- PASS: TestConfig_DurationList/parse_ranges_correctly (0.00s) --- PASS: TestConfig_DurationList/handle_multiple_flag_parse (0.00s) === RUN TestConfig_Validate/should_fail_on_invalid_compaction_concurrency === RUN TestConfig_Validate/should_fail_on_empty_block_ranges === RUN TestConfig_Validate/should_pass_on_S3_backend === RUN TestConfig_Validate/should_fail_on_invalid_ship_concurrency === RUN TestConfig_Validate/should_fail_on_invalid_opening_concurrency === RUN TestConfig_Validate/should_fail_on_invalid_TSDB_WAL_segment_size === RUN TestConfig_Validate/should_pass_on_valid_stripe_size === RUN TestConfig_Validate/should_fail_on_negative_stripe_size === RUN TestConfig_Validate/should_fail_on_stripe_size_0 === RUN TestConfig_Validate/should_fail_on_stripe_size_1 === RUN TestConfig_Validate/should_fail_on_too_high_compaction_interval === RUN TestConfig_Validate/should_pass_on_valid_compaction_concurrency === RUN TestConfig_Validate/should_pass_on_GCS_backend === RUN TestConfig_Validate/should_fail_on_unknown_storage_backend === RUN TestConfig_Validate/should_pass_on_invalid_ship_concurrency_but_shipping_is_disabled --- PASS: TestConfig_Validate (0.04s) --- PASS: TestConfig_Validate/should_fail_on_invalid_compaction_interval (0.01s) --- PASS: TestConfig_Validate/should_fail_on_invalid_compaction_concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_empty_block_ranges (0.00s) --- PASS: TestConfig_Validate/should_pass_on_S3_backend (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_ship_concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_opening_concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_TSDB_WAL_segment_size (0.00s) --- PASS: TestConfig_Validate/should_pass_on_valid_stripe_size (0.00s) --- PASS: TestConfig_Validate/should_fail_on_negative_stripe_size (0.00s) --- PASS: TestConfig_Validate/should_fail_on_stripe_size_0 (0.00s) --- PASS: TestConfig_Validate/should_fail_on_stripe_size_1 (0.00s) --- PASS: TestConfig_Validate/should_fail_on_too_high_compaction_interval (0.00s) --- PASS: TestConfig_Validate/should_pass_on_valid_compaction_concurrency (0.00s) --- PASS: TestConfig_Validate/should_pass_on_GCS_backend (0.00s) --- PASS: TestConfig_Validate/should_fail_on_unknown_storage_backend (0.00s) --- PASS: TestConfig_Validate/should_pass_on_invalid_ship_concurrency_but_shipping_is_disabled (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb 8.807s === RUN TestChunksCaching === RUN TestChunksCaching/basic_test === RUN TestChunksCaching/same_request_will_hit_all_subranges_in_the_cache === RUN TestChunksCaching/request_data_close_to_the_end_of_object === RUN TestChunksCaching/another_request_data_close_to_the_end_of_object,_cached_by_previous_test === RUN TestChunksCaching/entire_object,_combination_of_cached_and_uncached_subranges === RUN TestChunksCaching/entire_object_again,_everything_is_cached === RUN TestChunksCaching/entire_object_again,_nothing_is_cached === RUN TestChunksCaching/missing_first_subranges === RUN TestChunksCaching/missing_last_subranges === RUN TestChunksCaching/missing_middle_subranges === RUN TestChunksCaching/missing_everything_except_middle_subranges === RUN TestChunksCaching/missing_everything_except_middle_subranges,_one_subrequest_only === RUN TestChunksCaching/missing_everything_except_middle_subranges,_two_subrequests --- PASS: TestChunksCaching (0.37s) --- PASS: TestChunksCaching/basic_test (0.04s) --- PASS: TestChunksCaching/same_request_will_hit_all_subranges_in_the_cache (0.02s) --- PASS: TestChunksCaching/request_data_close_to_the_end_of_object (0.00s) --- PASS: TestChunksCaching/another_request_data_close_to_the_end_of_object,_cached_by_previous_test (0.00s) --- PASS: TestChunksCaching/entire_object,_combination_of_cached_and_uncached_subranges (0.05s) --- PASS: TestChunksCaching/entire_object_again,_everything_is_cached (0.04s) --- PASS: TestChunksCaching/entire_object_again,_nothing_is_cached (0.05s) --- PASS: TestChunksCaching/missing_first_subranges (0.00s) --- PASS: TestChunksCaching/missing_last_subranges (0.00s) --- PASS: TestChunksCaching/missing_middle_subranges (0.00s) --- PASS: TestChunksCaching/missing_everything_except_middle_subranges (0.00s) --- PASS: TestChunksCaching/missing_everything_except_middle_subranges,_one_subrequest_only (0.00s) --- PASS: TestChunksCaching/missing_everything_except_middle_subranges,_two_subrequests (0.03s) === RUN TestMergeRanges === RUN TestMergeRanges/0 === RUN TestMergeRanges/1 === RUN TestMergeRanges/2 === RUN TestMergeRanges/3 --- PASS: TestMergeRanges (0.00s) --- PASS: TestMergeRanges/0 (0.00s) --- PASS: TestMergeRanges/1 (0.00s) --- PASS: TestMergeRanges/2 (0.00s) --- PASS: TestMergeRanges/3 (0.00s) === RUN TestInvalidOffsetAndLength --- PASS: TestInvalidOffsetAndLength (0.00s) === RUN TestCachedIter --- PASS: TestCachedIter (0.00s) === RUN TestExists --- PASS: TestExists (0.00s) === RUN TestExistsCachingDisabled --- PASS: TestExistsCachingDisabled (0.00s) === RUN TestGet --- PASS: TestGet (0.00s) === RUN TestGetTooBigObject --- PASS: TestGetTooBigObject (0.00s) === RUN TestGetPartialRead --- PASS: TestGetPartialRead (0.00s) === RUN TestAttributes --- PASS: TestAttributes (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb/bucketcache 1.478s === RUN TestIndex_RemoveBlock --- PASS: TestIndex_RemoveBlock (0.01s) === RUN TestDetectBlockSegmentsFormat === RUN TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits_but_non_consecutive === RUN TestDetectBlockSegmentsFormat/meta.json_without_SegmentFiles_and_Files === RUN TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_0_based_6_digits === RUN TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits === RUN TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits_but_non_consecutive === RUN TestDetectBlockSegmentsFormat/meta.json_with_Files,_0_based_6_digits === RUN TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits --- PASS: TestDetectBlockSegmentsFormat (0.01s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits_but_non_consecutive (0.01s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_without_SegmentFiles_and_Files (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_0_based_6_digits (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits_but_non_consecutive (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_Files,_0_based_6_digits (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits (0.00s) === RUN TestBlockFromThanosMeta === RUN TestBlockFromThanosMeta/meta.json_with_external_labels,_no_compactor_shard_ID === RUN TestBlockFromThanosMeta/meta.json_with_external_labels,_with_compactor_shard_ID === RUN TestBlockFromThanosMeta/meta.json_with_external_labels,_with_invalid_shard_ID === RUN TestBlockFromThanosMeta/meta.json_without_SegmentFiles_and_Files === RUN TestBlockFromThanosMeta/meta.json_with_SegmentFiles === RUN TestBlockFromThanosMeta/meta.json_with_Files --- PASS: TestBlockFromThanosMeta (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_external_labels,_no_compactor_shard_ID (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_external_labels,_with_compactor_shard_ID (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_external_labels,_with_invalid_shard_ID (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_without_SegmentFiles_and_Files (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_SegmentFiles (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_Files (0.00s) === RUN TestBlock_Within --- PASS: TestBlock_Within (0.00s) === RUN TestBlock_ThanosMeta === RUN TestBlock_ThanosMeta/block_with_segment_files_format_1_based_6_digits === RUN TestBlock_ThanosMeta/block_with_unknown_segment_files_format --- PASS: TestBlock_ThanosMeta (0.00s) --- PASS: TestBlock_ThanosMeta/block_with_segment_files_format_1_based_6_digits (0.00s) --- PASS: TestBlock_ThanosMeta/block_with_unknown_segment_files_format (0.00s) === RUN TestBlockDeletionMark_ThanosDeletionMark --- PASS: TestBlockDeletionMark_ThanosDeletionMark (0.00s) === RUN TestBlockDeletionMarks_Clone --- PASS: TestBlockDeletionMarks_Clone (0.00s) === RUN TestLoader_GetIndex_ShouldLazyLoadBucketIndex --- PASS: TestLoader_GetIndex_ShouldLazyLoadBucketIndex (0.06s) === RUN TestLoader_GetIndex_ShouldCacheError --- PASS: TestLoader_GetIndex_ShouldCacheError (0.01s) === RUN TestLoader_GetIndex_ShouldCacheIndexNotFoundError --- PASS: TestLoader_GetIndex_ShouldCacheIndexNotFoundError (0.01s) === RUN TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadSuccess --- PASS: TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadSuccess (1.24s) === RUN TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadFailure --- PASS: TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadFailure (1.20s) === RUN TestLoader_ShouldUpdateIndexInBackgroundOnPreviousIndexNotFound --- PASS: TestLoader_ShouldUpdateIndexInBackgroundOnPreviousIndexNotFound (0.84s) === RUN TestLoader_ShouldNotCacheCriticalErrorOnBackgroundUpdates --- PASS: TestLoader_ShouldNotCacheCriticalErrorOnBackgroundUpdates (1.10s) === RUN TestLoader_ShouldCacheIndexNotFoundOnBackgroundUpdates --- PASS: TestLoader_ShouldCacheIndexNotFoundOnBackgroundUpdates (1.15s) === RUN TestLoader_ShouldOffloadIndexIfNotFoundDuringBackgroundUpdates --- PASS: TestLoader_ShouldOffloadIndexIfNotFoundDuringBackgroundUpdates (0.84s) === RUN TestLoader_ShouldOffloadIndexIfIdleTimeoutIsReachedDuringBackgroundUpdates --- PASS: TestLoader_ShouldOffloadIndexIfIdleTimeoutIsReachedDuringBackgroundUpdates (1.10s) === RUN TestGlobalMarkersBucket_Delete_ShouldSucceedIfDeletionMarkDoesNotExistInTheBlockButExistInTheGlobalLocation --- PASS: TestGlobalMarkersBucket_Delete_ShouldSucceedIfDeletionMarkDoesNotExistInTheBlockButExistInTheGlobalLocation (0.02s) === RUN TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist === RUN TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/deletion_mark === RUN TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/no_compact --- PASS: TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist (0.03s) --- PASS: TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/deletion_mark (0.02s) --- PASS: TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/no_compact (0.02s) === RUN TestUploadToGlobalMarkerPath === RUN TestUploadToGlobalMarkerPath/deletion_mark === RUN TestUploadToGlobalMarkerPath/no_compact --- PASS: TestUploadToGlobalMarkerPath (0.03s) --- PASS: TestUploadToGlobalMarkerPath/deletion_mark (0.01s) --- PASS: TestUploadToGlobalMarkerPath/no_compact (0.01s) === RUN TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist === RUN TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/deletion_mark === RUN TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/no_compact --- PASS: TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist (0.05s) --- PASS: TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/deletion_mark (0.04s) --- PASS: TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/no_compact (0.01s) === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/#00 === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/index === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/no-compact-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/no-compact-mark.json --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark (0.01s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/#00 (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/index (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/no-compact-mark.json (0.00s) === RUN TestGlobalMarkersBucket_isBlockDeletionMark === RUN TestGlobalMarkersBucket_isBlockDeletionMark/#00 === RUN TestGlobalMarkersBucket_isBlockDeletionMark/deletion-mark.json === RUN TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/index === RUN TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/deletion-mark.json === RUN TestGlobalMarkersBucket_isBlockDeletionMark//path/to/00000000010000000000000000/deletion-mark.json --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/#00 (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/index (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark//path/to/00000000010000000000000000/deletion-mark.json (0.00s) === RUN TestGlobalMarkersBucket_isNoCompactMark === RUN TestGlobalMarkersBucket_isNoCompactMark/#00 === RUN TestGlobalMarkersBucket_isNoCompactMark/no-compact-mark.json === RUN TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/index === RUN TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/no-compact-mark.json === RUN TestGlobalMarkersBucket_isNoCompactMark//path/to/00000000010000000000000000/no-compact-mark.json --- PASS: TestGlobalMarkersBucket_isNoCompactMark (0.01s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/#00 (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/index (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark//path/to/00000000010000000000000000/no-compact-mark.json (0.00s) === RUN TestBucketWithGlobalMarkers_ShouldWorkCorrectlyWithBucketMetrics --- PASS: TestBucketWithGlobalMarkers_ShouldWorkCorrectlyWithBucketMetrics (0.01s) === RUN TestBlockDeletionMarkFilepath --- PASS: TestBlockDeletionMarkFilepath (0.00s) === RUN TestIsBlockDeletionMarkFilename --- PASS: TestIsBlockDeletionMarkFilename (0.00s) === RUN TestNoCompactMarkFilepath --- PASS: TestNoCompactMarkFilepath (0.00s) === RUN TestIsNoCompactMarkFilename --- PASS: TestIsNoCompactMarkFilename (0.00s) === RUN TestReadIndex_ShouldReturnErrorIfIndexDoesNotExist --- PASS: TestReadIndex_ShouldReturnErrorIfIndexDoesNotExist (0.00s) === RUN TestReadIndex_ShouldReturnErrorIfIndexIsCorrupted --- PASS: TestReadIndex_ShouldReturnErrorIfIndexIsCorrupted (0.01s) === RUN TestReadIndex_ShouldReturnTheParsedIndexOnSuccess --- PASS: TestReadIndex_ShouldReturnTheParsedIndexOnSuccess (0.06s) === RUN TestDeleteIndex_ShouldNotReturnErrorIfIndexDoesNotExist --- PASS: TestDeleteIndex_ShouldNotReturnErrorIfIndexDoesNotExist (0.00s) === RUN TestUpdater_UpdateIndex --- PASS: TestUpdater_UpdateIndex (0.05s) === RUN TestUpdater_UpdateIndex_ShouldSkipPartialBlocks --- PASS: TestUpdater_UpdateIndex_ShouldSkipPartialBlocks (0.03s) === RUN TestUpdater_UpdateIndex_ShouldSkipBlocksWithCorruptedMeta --- PASS: TestUpdater_UpdateIndex_ShouldSkipBlocksWithCorruptedMeta (0.04s) === RUN TestUpdater_UpdateIndex_ShouldSkipCorruptedDeletionMarks --- PASS: TestUpdater_UpdateIndex_ShouldSkipCorruptedDeletionMarks (0.04s) === RUN TestUpdater_UpdateIndex_NoTenantInTheBucket --- PASS: TestUpdater_UpdateIndex_NoTenantInTheBucket (0.01s) === RUN TestUpdater_UpdateIndexFromVersion1ToVersion2 --- PASS: TestUpdater_UpdateIndexFromVersion1ToVersion2 (0.02s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb/bucketindex 9.356s ? github.com/grafana/mimir/pkg/storage/tsdb/testutil [no test files] === RUN TestBucketStore_e2e === PAUSE TestBucketStore_e2e === RUN TestBucketStore_ManyParts_e2e === PAUSE TestBucketStore_ManyParts_e2e === RUN TestBucketStore_Series_ChunksLimiter_e2e === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_succeed_if_the_max_chunks_limit_is_not_exceeded === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_ResourceExhausted === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_422 === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_series_limit_is_exceeded_-_422 --- PASS: TestBucketStore_Series_ChunksLimiter_e2e (56.00s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_succeed_if_the_max_chunks_limit_is_not_exceeded (15.09s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_ResourceExhausted (13.40s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_422 (13.59s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_series_limit_is_exceeded_-_422 (13.90s) === RUN TestBucketStore_LabelNames_e2e === PAUSE TestBucketStore_LabelNames_e2e === RUN TestBucketStore_LabelValues_e2e === PAUSE TestBucketStore_LabelValues_e2e === RUN TestBucketIndexMetadataFetcher_Fetch --- PASS: TestBucketIndexMetadataFetcher_Fetch (0.05s) === RUN TestBucketIndexMetadataFetcher_Fetch_NoBucketIndex --- PASS: TestBucketIndexMetadataFetcher_Fetch_NoBucketIndex (0.01s) === RUN TestBucketIndexMetadataFetcher_Fetch_CorruptedBucketIndex --- PASS: TestBucketIndexMetadataFetcher_Fetch_CorruptedBucketIndex (0.01s) === RUN TestBucketStores_InitialSync --- PASS: TestBucketStores_InitialSync (4.84s) === RUN TestBucketStores_InitialSyncShouldRetryOnFailure --- PASS: TestBucketStores_InitialSyncShouldRetryOnFailure (3.19s) === RUN TestBucketStores_SyncBlocks --- PASS: TestBucketStores_SyncBlocks (4.28s) === RUN TestBucketStores_syncUsersBlocks === RUN TestBucketStores_syncUsersBlocks/when_sharding_is_disabled_all_users_should_be_synced === RUN TestBucketStores_syncUsersBlocks/when_sharding_is_enabled_only_stores_for_filtered_users_should_be_created --- PASS: TestBucketStores_syncUsersBlocks (0.08s) --- PASS: TestBucketStores_syncUsersBlocks/when_sharding_is_disabled_all_users_should_be_synced (0.05s) --- PASS: TestBucketStores_syncUsersBlocks/when_sharding_is_enabled_only_stores_for_filtered_users_should_be_created (0.02s) === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_entire_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_beginning_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_middle_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_end_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_end_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_entire_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_beginning_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_middle_of_the_block --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks (4.29s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true (2.17s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_entire_block (0.01s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_beginning_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_middle_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_end_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false (2.11s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_end_of_the_block (0.01s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_entire_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_beginning_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_middle_of_the_block (0.00s) === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_2nd_(out_of_order)_chunk_only === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_all_samples === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_1st_chunk_only --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks (1.85s) --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_2nd_(out_of_order)_chunk_only (0.01s) --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_all_samples (0.00s) --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_1st_chunk_only (0.00s) === RUN TestBucketStores_deleteLocalFilesForExcludedTenants --- PASS: TestBucketStores_deleteLocalFilesForExcludedTenants (3.88s) === RUN TestBucketBlock_matchLabels --- PASS: TestBucketBlock_matchLabels (0.01s) === RUN TestBucketBlockSet_remove --- PASS: TestBucketBlockSet_remove (0.00s) === RUN TestReadIndexCache_LoadSeries --- PASS: TestReadIndexCache_LoadSeries (0.01s) === RUN TestBlockLabelNames === RUN TestBlockLabelNames/happy_case_with_no_matchers === RUN TestBlockLabelNames/index_reader_error_with_no_matchers === RUN TestBlockLabelNames/happy_case_cached_with_no_matchers === RUN TestBlockLabelNames/error_with_matchers === RUN TestBlockLabelNames/happy_case_cached_with_matchers --- PASS: TestBlockLabelNames (2.57s) --- PASS: TestBlockLabelNames/happy_case_with_no_matchers (0.01s) --- PASS: TestBlockLabelNames/index_reader_error_with_no_matchers (0.00s) --- PASS: TestBlockLabelNames/happy_case_cached_with_no_matchers (0.01s) --- PASS: TestBlockLabelNames/error_with_matchers (0.01s) --- PASS: TestBlockLabelNames/happy_case_cached_with_matchers (0.03s) === RUN TestBlockLabelValues === RUN TestBlockLabelValues/happy_case_with_no_matchers === RUN TestBlockLabelValues/index_reader_error_with_no_matchers === RUN TestBlockLabelValues/happy_case_cached_with_no_matchers === RUN TestBlockLabelValues/error_with_matchers === RUN TestBlockLabelValues/happy_case_cached_with_matchers --- PASS: TestBlockLabelValues (1.81s) --- PASS: TestBlockLabelValues/happy_case_with_no_matchers (0.01s) --- PASS: TestBlockLabelValues/index_reader_error_with_no_matchers (0.00s) --- PASS: TestBlockLabelValues/happy_case_cached_with_no_matchers (0.00s) --- PASS: TestBlockLabelValues/error_with_matchers (0.00s) --- PASS: TestBlockLabelValues/happy_case_cached_with_matchers (0.01s) === RUN TestBucketIndexReader_ExpandedPostings === RUN TestBucketIndexReader_ExpandedPostings/happy_cases === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/j="foo",n="1" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j!="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".+" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i!="" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",i!="2",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~"1.+",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!="2",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!~"2.*",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"0xxx|1xxx|2xxx" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"(0|1|2)xxx" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"[0-2]xxx" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i!~[0-2]xxx === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*",_i!~[0-2]xxx === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/p!="" === RUN TestBucketIndexReader_ExpandedPostings/corrupted_or_undecodable_postings_cache_doesn't_fail === RUN TestBucketIndexReader_ExpandedPostings/promise === RUN TestBucketIndexReader_ExpandedPostings/cached === RUN TestBucketIndexReader_ExpandedPostings/corrupt_cached_expanded_postings_don't_make_request_fail === RUN TestBucketIndexReader_ExpandedPostings/expandedPostings_returning_error_is_not_cached --- PASS: TestBucketIndexReader_ExpandedPostings (1.86s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases (0.06s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/j="foo",n="1" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j!="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".+" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i!="" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",i!="2",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~"1.+",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!="2",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!~"2.*",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"0xxx|1xxx|2xxx" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"(0|1|2)xxx" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"[0-2]xxx" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i!~[0-2]xxx (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*",_i!~[0-2]xxx (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/p!="" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/corrupted_or_undecodable_postings_cache_doesn't_fail (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/promise (0.01s) --- PASS: TestBucketIndexReader_ExpandedPostings/cached (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/corrupt_cached_expanded_postings_don't_make_request_fail (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/expandedPostings_returning_error_is_not_cached (0.00s) === RUN TestBucketSeries === RUN TestBucketSeries/10000SeriesWith1Samples bucket_test.go:2207: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSeries10000SeriesWith1Samples1746485336/001/0 bucket_test.go:2207: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSeries10000SeriesWith1Samples1746485336/001/1 bucket_test.go:2207: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSeries10000SeriesWith1Samples1746485336/001/2 bucket_test.go:2207: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSeries10000SeriesWith1Samples1746485336/001/3 === RUN TestBucketSeries/10000SeriesWith1Samples/10000of10000 === RUN TestBucketSeries/1000SeriesWith10Samples bucket_test.go:2207: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSeries1000SeriesWith10Samples60671645/001/0 bucket_test.go:2207: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSeries1000SeriesWith10Samples60671645/001/1 bucket_test.go:2207: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSeries1000SeriesWith10Samples60671645/001/2 bucket_test.go:2207: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSeries1000SeriesWith10Samples60671645/001/3 === RUN TestBucketSeries/1000SeriesWith10Samples/10000of10000 === RUN TestBucketSeries/1SeriesWith10000Samples bucket_test.go:2207: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSeries1SeriesWith10000Samples3227280093/001/0 bucket_test.go:2207: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSeries1SeriesWith10000Samples3227280093/001/1 bucket_test.go:2207: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSeries1SeriesWith10000Samples3227280093/001/2 bucket_test.go:2207: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSeries1SeriesWith10000Samples3227280093/001/3 === RUN TestBucketSeries/1SeriesWith10000Samples/10000of10000 --- PASS: TestBucketSeries (23.76s) --- PASS: TestBucketSeries/10000SeriesWith1Samples (8.77s) --- PASS: TestBucketSeries/10000SeriesWith1Samples/10000of10000 (0.47s) --- PASS: TestBucketSeries/1000SeriesWith10Samples (7.47s) --- PASS: TestBucketSeries/1000SeriesWith10Samples/10000of10000 (0.06s) --- PASS: TestBucketSeries/1SeriesWith10000Samples (7.45s) --- PASS: TestBucketSeries/1SeriesWith10000Samples/10000of10000 (0.01s) === RUN TestBucketSkipChunksSeries === RUN TestBucketSkipChunksSeries/10000SeriesWith1Samples bucket_test.go:2207: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries10000SeriesWith1Samples1998562771/001/0 bucket_test.go:2207: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries10000SeriesWith1Samples1998562771/001/1 bucket_test.go:2207: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries10000SeriesWith1Samples1998562771/001/2 bucket_test.go:2207: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries10000SeriesWith1Samples1998562771/001/3 === RUN TestBucketSkipChunksSeries/10000SeriesWith1Samples/10000of10000 === RUN TestBucketSkipChunksSeries/1000SeriesWith10Samples bucket_test.go:2207: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1000SeriesWith10Samples3245815617/001/0 bucket_test.go:2207: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1000SeriesWith10Samples3245815617/001/1 bucket_test.go:2207: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1000SeriesWith10Samples3245815617/001/2 bucket_test.go:2207: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1000SeriesWith10Samples3245815617/001/3 === RUN TestBucketSkipChunksSeries/1000SeriesWith10Samples/10000of10000 === RUN TestBucketSkipChunksSeries/1SeriesWith10000Samples bucket_test.go:2207: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1SeriesWith10000Samples3954424547/001/0 bucket_test.go:2207: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1SeriesWith10000Samples3954424547/001/1 bucket_test.go:2207: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1SeriesWith10000Samples3954424547/001/2 bucket_test.go:2207: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1SeriesWith10000Samples3954424547/001/3 === RUN TestBucketSkipChunksSeries/1SeriesWith10000Samples/10000of10000 --- PASS: TestBucketSkipChunksSeries (24.17s) --- PASS: TestBucketSkipChunksSeries/10000SeriesWith1Samples (9.09s) --- PASS: TestBucketSkipChunksSeries/10000SeriesWith1Samples/10000of10000 (0.33s) --- PASS: TestBucketSkipChunksSeries/1000SeriesWith10Samples (7.62s) --- PASS: TestBucketSkipChunksSeries/1000SeriesWith10Samples/10000of10000 (0.03s) --- PASS: TestBucketSkipChunksSeries/1SeriesWith10000Samples (7.43s) --- PASS: TestBucketSkipChunksSeries/1SeriesWith10000Samples/10000of10000 (0.00s) === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_one_block._Fill_the_cache_on_the_way. === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_second_block._This_should_revoke_previous_cache. === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault/remove_second_block._Cache_stays._Ask_for_first_again. --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault (3.82s) --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_one_block._Fill_the_cache_on_the_way. (0.02s) --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_second_block._This_should_revoke_previous_cache. (0.01s) --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault/remove_second_block._Cache_stays._Ask_for_first_again. (0.01s) === RUN TestSeries_RequestAndResponseHints bucket_test.go:2207: Creating 2 1-sample series with 1ms interval in /tmp/TestSeries_RequestAndResponseHints2648080453/001/0 bucket_test.go:2207: Creating 2 1-sample series with 1ms interval in /tmp/TestSeries_RequestAndResponseHints2648080453/001/1 === RUN TestSeries_RequestAndResponseHints/querying_a_range_containing_1_block_should_return_1_block_in_the_response_hints === RUN TestSeries_RequestAndResponseHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints === RUN TestSeries_RequestAndResponseHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block --- PASS: TestSeries_RequestAndResponseHints (3.68s) --- PASS: TestSeries_RequestAndResponseHints/querying_a_range_containing_1_block_should_return_1_block_in_the_response_hints (0.01s) --- PASS: TestSeries_RequestAndResponseHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints (0.00s) --- PASS: TestSeries_RequestAndResponseHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block (0.00s) === RUN TestSeries_ErrorUnmarshallingRequestHints --- PASS: TestSeries_ErrorUnmarshallingRequestHints (0.01s) === RUN TestSeries_BlockWithMultipleChunks === RUN TestSeries_BlockWithMultipleChunks/query_the_entire_block === RUN TestSeries_BlockWithMultipleChunks/query_the_beginning_of_the_block === RUN TestSeries_BlockWithMultipleChunks/query_the_middle_of_the_block === RUN TestSeries_BlockWithMultipleChunks/query_the_end_of_the_block --- PASS: TestSeries_BlockWithMultipleChunks (1.88s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_entire_block (0.00s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_beginning_of_the_block (0.00s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_middle_of_the_block (0.00s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_end_of_the_block (0.00s) === RUN TestBigEndianPostingsCount --- PASS: TestBigEndianPostingsCount (0.00s) === RUN TestLabelNamesAndValuesHints bucket_test.go:2207: Creating 2 1-sample series with 1ms interval in /tmp/TestLabelNamesAndValuesHints1706261202/001/0 bucket_test.go:2207: Creating 2 1-sample series with 1ms interval in /tmp/TestLabelNamesAndValuesHints1706261202/001/1 === RUN TestLabelNamesAndValuesHints/querying_a_range_containing_1_block_should_return_1_block_in_the_labels_hints === RUN TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints === RUN TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block --- PASS: TestLabelNamesAndValuesHints (3.54s) --- PASS: TestLabelNamesAndValuesHints/querying_a_range_containing_1_block_should_return_1_block_in_the_labels_hints (0.00s) --- PASS: TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints (0.00s) --- PASS: TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block (0.00s) === RUN TestBlockSeries_skipChunks_ignoresMintMaxt --- PASS: TestBlockSeries_skipChunks_ignoresMintMaxt (1.75s) === RUN TestBlockSeries_Cache === RUN TestBlockSeries_Cache/does_not_update_cache_on_error === RUN TestBlockSeries_Cache/caches_series --- PASS: TestBlockSeries_Cache (1.70s) --- PASS: TestBlockSeries_Cache/does_not_update_cache_on_error (0.00s) --- PASS: TestBlockSeries_Cache/caches_series (0.01s) === RUN TestFilterPostingsByCachedShardHash === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_when_all_postings_are_in_the_cache === RUN TestFilterPostingsByCachedShardHash/should_be_a_noop_if_the_cache_is_empty === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_beginning_of_the_slice === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_in_the_middle_of_the_slice === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_end_of_the_slice --- PASS: TestFilterPostingsByCachedShardHash (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_when_all_postings_are_in_the_cache (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_be_a_noop_if_the_cache_is_empty (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_beginning_of_the_slice (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_in_the_middle_of_the_slice (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_end_of_the_slice (0.00s) === RUN TestFilterPostingsByCachedShardHash_NoAllocations --- PASS: TestFilterPostingsByCachedShardHash_NoAllocations (0.00s) === RUN TestChunkBytesPool_Get --- PASS: TestChunkBytesPool_Get (0.00s) === RUN TestIsHealthyForStoreGatewayOperations === PAUSE TestIsHealthyForStoreGatewayOperations === RUN TestUnregisterOnShutdownFlag --- PASS: TestUnregisterOnShutdownFlag (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_by_default === RUN TestConfig_Validate/should_fail_if_shard_size_is_negative === RUN TestConfig_Validate/should_pass_if_shard_size_has_been_set --- PASS: TestConfig_Validate (0.02s) --- PASS: TestConfig_Validate/should_pass_by_default (0.01s) --- PASS: TestConfig_Validate/should_fail_if_shard_size_is_negative (0.00s) --- PASS: TestConfig_Validate/should_pass_if_shard_size_has_been_set (0.01s) === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_not_in_the_ring === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_PENDING_state_and_has_no_tokens === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_JOINING_state_and_has_some_tokens === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_ACTIVE_state_and_has_all_tokens === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_LEAVING_state_and_has_all_tokens --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled (3.53s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_not_in_the_ring (0.38s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_PENDING_state_and_has_no_tokens (0.18s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_JOINING_state_and_has_some_tokens (2.16s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_ACTIVE_state_and_has_all_tokens (0.41s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_LEAVING_state_and_has_all_tokens (0.39s) === RUN TestStoreGateway_InitialSyncFailure --- PASS: TestStoreGateway_InitialSyncFailure (5.30s) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1669928050291147304 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1669928050291790804 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1669928050296575102 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1669928050299644700 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1669928050302915899 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1669928050305222298 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1669928050306484298 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1669928050313103195 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1669928054616056007 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1669928054631444301 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1669928054748221952 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1669928054785401137 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1669928054826291720 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1669928057019031609 --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability (43.03s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) (4.32s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) (4.33s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) (4.46s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) (4.47s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) (4.52s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) (6.72s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) (4.36s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) (5.12s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) (5.60s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) (6.30s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) (6.12s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) (10.81s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) (10.93s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) (5.91s) === RUN TestStoreGateway_BlocksSyncWithDefaultSharding_RingTopologyChangedAfterScaleUp gateway_test.go:403: random generator seed: 1669928106829740218 --- PASS: TestStoreGateway_BlocksSyncWithDefaultSharding_RingTopologyChangedAfterScaleUp (59.09s) === RUN TestStoreGateway_ShouldSupportLoadRingTokensFromFile === RUN TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_more_then_the_configured_ones === RUN TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_less_than_the_configured_ones === RUN TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_equal_to_the_configured_ones --- PASS: TestStoreGateway_ShouldSupportLoadRingTokensFromFile (1.06s) --- PASS: TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_more_then_the_configured_ones (0.35s) --- PASS: TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_less_than_the_configured_ones (0.34s) --- PASS: TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_equal_to_the_configured_ones (0.35s) === RUN TestStoreGateway_SyncOnRingTopologyChanged === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_is_removed_from_the_ring === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_changes_state === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_healthy_instance_becomes_unhealthy === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_unhealthy_instance_becomes_healthy === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_NOT_sync_when_an_instance_updates_the_heartbeat === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_is_added_to_the_ring --- PASS: TestStoreGateway_SyncOnRingTopologyChanged (3.37s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_is_removed_from_the_ring (0.51s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_changes_state (0.49s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_healthy_instance_becomes_unhealthy (0.32s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_unhealthy_instance_becomes_healthy (0.49s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_NOT_sync_when_an_instance_updates_the_heartbeat (0.62s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state (0.46s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_is_added_to_the_ring (0.47s) === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_healthy_in_the_ring === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_unhealthy_in_the_ring === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_missing_in_the_ring_(e.g._removed_from_another_instance_because_of_the_auto-forget_feature) === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_re-registered_to_the_ring_and_it's_healthy --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing (2.41s) --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_healthy_in_the_ring (0.02s) --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_unhealthy_in_the_ring (0.06s) --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_missing_in_the_ring_(e.g._removed_from_another_instance_because_of_the_auto-forget_feature) (0.06s) --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_re-registered_to_the_ring_and_it's_healthy (0.07s) === RUN TestStoreGateway_RingLifecyclerShouldAutoForgetUnhealthyInstances --- PASS: TestStoreGateway_RingLifecyclerShouldAutoForgetUnhealthyInstances (0.46s) === RUN TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels === RUN TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels/bucket_index_enabled_=_true === RUN TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels/bucket_index_enabled_=_false --- PASS: TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels (4.30s) --- PASS: TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels/bucket_index_enabled_=_true (0.28s) --- PASS: TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels/bucket_index_enabled_=_false (0.25s) === RUN TestStoreGateway_Series_QuerySharding === RUN TestStoreGateway_Series_QuerySharding/should_touch_all_series_on_sharding_disabled === RUN TestStoreGateway_Series_QuerySharding/should_touch_only_series_belonging_to_the_specified_shard --- PASS: TestStoreGateway_Series_QuerySharding (1.87s) --- PASS: TestStoreGateway_Series_QuerySharding/should_touch_all_series_on_sharding_disabled (0.01s) --- PASS: TestStoreGateway_Series_QuerySharding/should_touch_only_series_belonging_to_the_specified_shard (0.00s) === RUN TestStoreGateway_Series_QueryShardingConcurrency --- PASS: TestStoreGateway_Series_QueryShardingConcurrency (4.24s) === RUN TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit === RUN TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/no_limit_enforced_if_zero === RUN TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/should_return_NO_error_if_the_actual_number_of_queried_chunks_is_<=_limit === RUN TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/should_return_error_if_the_actual_number_of_queried_chunks_is_>_limit --- PASS: TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit (2.43s) --- PASS: TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/no_limit_enforced_if_zero (0.17s) --- PASS: TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/should_return_NO_error_if_the_actual_number_of_queried_chunks_is_<=_limit (0.17s) --- PASS: TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/should_return_error_if_the_actual_number_of_queried_chunks_is_>_limit (0.15s) === RUN TestByteRanges_contiguous --- PASS: TestByteRanges_contiguous (0.00s) === RUN TestReadByteRanges === RUN TestReadByteRanges/unexpected_EOF_while_discarding_bytes === RUN TestReadByteRanges/unexpected_EOF_at_the_beginning_of_a_byte_range === RUN TestReadByteRanges/no_ranges === RUN TestReadByteRanges/single_range_with_offset_==_0 === RUN TestReadByteRanges/discard_bytes_before_the_first_range === RUN TestReadByteRanges/multiple_non-contiguous_ranges === RUN TestReadByteRanges/discard_bytes_after_the_last_range === RUN TestReadByteRanges/unexpected_EOF_while_reading_byte_range === RUN TestReadByteRanges/single_range_with_offset_>_0 === RUN TestReadByteRanges/multiple_contiguous_ranges_with_first_offset_==_0 === RUN TestReadByteRanges/multiple_contiguous_ranges_with_first_offset_>_0 --- PASS: TestReadByteRanges (0.01s) --- PASS: TestReadByteRanges/unexpected_EOF_while_discarding_bytes (0.00s) --- PASS: TestReadByteRanges/unexpected_EOF_at_the_beginning_of_a_byte_range (0.00s) --- PASS: TestReadByteRanges/no_ranges (0.00s) --- PASS: TestReadByteRanges/single_range_with_offset_==_0 (0.00s) --- PASS: TestReadByteRanges/discard_bytes_before_the_first_range (0.00s) --- PASS: TestReadByteRanges/multiple_non-contiguous_ranges (0.00s) --- PASS: TestReadByteRanges/discard_bytes_after_the_last_range (0.00s) --- PASS: TestReadByteRanges/unexpected_EOF_while_reading_byte_range (0.00s) --- PASS: TestReadByteRanges/single_range_with_offset_>_0 (0.00s) --- PASS: TestReadByteRanges/multiple_contiguous_ranges_with_first_offset_==_0 (0.00s) --- PASS: TestReadByteRanges/multiple_contiguous_ranges_with_first_offset_>_0 (0.00s) === RUN TestLimiter --- PASS: TestLimiter (0.00s) === RUN TestIgnoreDeletionMarkFilter_Filter --- PASS: TestIgnoreDeletionMarkFilter_Filter (0.02s) === RUN TestIgnoreDeletionMarkFilter_FilterWithBucketIndex --- PASS: TestIgnoreDeletionMarkFilter_FilterWithBucketIndex (0.03s) === RUN TestTimeMetaFilter --- PASS: TestTimeMetaFilter (0.00s) === RUN TestMetadataFetcherMetrics --- PASS: TestMetadataFetcherMetrics (0.01s) === RUN TestGapBasedPartitioner_Metrics --- PASS: TestGapBasedPartitioner_Metrics (0.00s) === RUN TestGapBasedPartitioner_Partition --- PASS: TestGapBasedPartitioner_Partition (0.00s) === RUN TestDiffVarintCodec === RUN TestDiffVarintCodec/raw/all postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 10000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/all postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 478 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/j!="foo" postings_codec_test.go:77: postings entries: 6000 postings_codec_test.go:78: original size (4*entries): 24000 bytes postings_codec_test.go:84: encoded size 6000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/j!="foo" postings_codec_test.go:77: postings entries: 6000 postings_codec_test.go:78: original size (4*entries): 24000 bytes postings_codec_test.go:84: encoded size 292 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/i=~".+" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 10000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i=~".+" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 478 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/i=~"1.+" postings_codec_test.go:77: postings entries: 5550 postings_codec_test.go:78: original size (4*entries): 22200 bytes postings_codec_test.go:84: encoded size 5560 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i=~"1.+" postings_codec_test.go:77: postings entries: 5550 postings_codec_test.go:78: original size (4*entries): 22200 bytes postings_codec_test.go:84: encoded size 283 bytes postings_codec_test.go:85: ratio: 0.013 === RUN TestDiffVarintCodec/raw/i!~"" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 10000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i!~"" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 478 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/n="1" postings_codec_test.go:77: postings entries: 400 postings_codec_test.go:78: original size (4*entries): 1600 bytes postings_codec_test.go:84: encoded size 401 bytes postings_codec_test.go:85: ratio: 0.251 === RUN TestDiffVarintCodec/snappy/n="1" postings_codec_test.go:77: postings entries: 400 postings_codec_test.go:78: original size (4*entries): 1600 bytes postings_codec_test.go:84: encoded size 31 bytes postings_codec_test.go:85: ratio: 0.019 === RUN TestDiffVarintCodec/raw/j="foo" postings_codec_test.go:77: postings entries: 4000 postings_codec_test.go:78: original size (4*entries): 16000 bytes postings_codec_test.go:84: encoded size 4000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/j="foo" postings_codec_test.go:77: postings entries: 4000 postings_codec_test.go:78: original size (4*entries): 16000 bytes postings_codec_test.go:84: encoded size 197 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/i=~".*" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 10000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i=~".*" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 478 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/i=~"^$"' postings_codec_test.go:77: postings entries: 0 postings_codec_test.go:78: original size (4*entries): 0 bytes postings_codec_test.go:84: encoded size 0 bytes postings_codec_test.go:85: ratio: NaN === RUN TestDiffVarintCodec/snappy/i=~"^$"' postings_codec_test.go:77: postings entries: 0 postings_codec_test.go:78: original size (4*entries): 0 bytes postings_codec_test.go:84: encoded size 4 bytes postings_codec_test.go:85: ratio: +Inf === RUN TestDiffVarintCodec/raw/n!="2" postings_codec_test.go:77: postings entries: 9600 postings_codec_test.go:78: original size (4*entries): 38400 bytes postings_codec_test.go:84: encoded size 9600 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/n!="2" postings_codec_test.go:77: postings entries: 9600 postings_codec_test.go:78: original size (4*entries): 38400 bytes postings_codec_test.go:84: encoded size 466 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/i!~"2.*" postings_codec_test.go:77: postings entries: 9450 postings_codec_test.go:78: original size (4*entries): 37800 bytes postings_codec_test.go:84: encoded size 9450 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i!~"2.*" postings_codec_test.go:77: postings entries: 9450 postings_codec_test.go:78: original size (4*entries): 37800 bytes postings_codec_test.go:84: encoded size 463 bytes postings_codec_test.go:85: ratio: 0.012 --- PASS: TestDiffVarintCodec (0.46s) --- PASS: TestDiffVarintCodec/raw/all (0.01s) --- PASS: TestDiffVarintCodec/snappy/all (0.01s) --- PASS: TestDiffVarintCodec/raw/j!="foo" (0.00s) --- PASS: TestDiffVarintCodec/snappy/j!="foo" (0.01s) --- PASS: TestDiffVarintCodec/raw/i=~".+" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i=~".+" (0.00s) --- PASS: TestDiffVarintCodec/raw/i=~"1.+" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i=~"1.+" (0.00s) --- PASS: TestDiffVarintCodec/raw/i!~"" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i!~"" (0.00s) --- PASS: TestDiffVarintCodec/raw/n="1" (0.00s) --- PASS: TestDiffVarintCodec/snappy/n="1" (0.00s) --- PASS: TestDiffVarintCodec/raw/j="foo" (0.00s) --- PASS: TestDiffVarintCodec/snappy/j="foo" (0.00s) --- PASS: TestDiffVarintCodec/raw/i=~".*" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i=~".*" (0.00s) --- PASS: TestDiffVarintCodec/raw/i=~"^$"' (0.00s) --- PASS: TestDiffVarintCodec/snappy/i=~"^$"' (0.00s) --- PASS: TestDiffVarintCodec/raw/n!="2" (0.00s) --- PASS: TestDiffVarintCodec/snappy/n!="2" (0.00s) --- PASS: TestDiffVarintCodec/raw/i!~"2.*" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i!~"2.*" (0.00s) === RUN TestShuffleShardingStrategy === RUN TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_some_previously_loaded_blocks === PAUSE TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_some_previously_loaded_blocks === RUN TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_2_(should_still_sync_blocks_on_the_only_available_instance) === PAUSE TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_2_(should_still_sync_blocks_on_the_only_available_instance) === RUN TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === PAUSE TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === RUN TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_2_(should_sync_blocks_on_2_instances_because_of_the_shard_size) === PAUSE TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_2_(should_sync_blocks_on_2_instances_because_of_the_shard_size) === RUN TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_3_and_NO_previously_loaded_blocks === PAUSE TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_3_and_NO_previously_loaded_blocks === RUN TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_1,_SS_=_3_and_NO_previously_loaded_blocks === PAUSE TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_1,_SS_=_3_and_NO_previously_loaded_blocks === RUN TestShuffleShardingStrategy/JOINING_instance_in_the_ring_should_get_its_shard_blocks_and_they_should_not_be_replicated_to_another_instance === PAUSE TestShuffleShardingStrategy/JOINING_instance_in_the_ring_should_get_its_shard_blocks_and_they_should_not_be_replicated_to_another_instance === RUN TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_1_and_SS_=_1 === PAUSE TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_1_and_SS_=_1 === RUN TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === PAUSE TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === RUN TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_2_(should_sync_all_blocks_on_2_instances) === PAUSE TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_2_(should_sync_all_blocks_on_2_instances) === RUN TestShuffleShardingStrategy/LEAVING_instance_in_the_ring_should_continue_to_keep_its_shard_blocks_and_they_should_NOT_be_replicated_to_another_instance === PAUSE TestShuffleShardingStrategy/LEAVING_instance_in_the_ring_should_continue_to_keep_its_shard_blocks_and_they_should_NOT_be_replicated_to_another_instance === RUN TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_1_(should_still_sync_blocks_on_the_only_available_instance) === PAUSE TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_1_(should_still_sync_blocks_on_the_only_available_instance) === RUN TestShuffleShardingStrategy/multiple_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_3 === PAUSE TestShuffleShardingStrategy/multiple_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_3 === RUN TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_NO_previously_loaded_blocks === PAUSE TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_NO_previously_loaded_blocks === RUN TestShuffleShardingStrategy/SS_=_0_disables_shuffle_sharding === PAUSE TestShuffleShardingStrategy/SS_=_0_disables_shuffle_sharding === CONT TestShuffleShardingStrategy/SS_=_0_disables_shuffle_sharding === CONT TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_some_previously_loaded_blocks === CONT TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_NO_previously_loaded_blocks === CONT TestShuffleShardingStrategy/multiple_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_3 === CONT TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_1_(should_still_sync_blocks_on_the_only_available_instance) === CONT TestShuffleShardingStrategy/LEAVING_instance_in_the_ring_should_continue_to_keep_its_shard_blocks_and_they_should_NOT_be_replicated_to_another_instance === CONT TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_2_(should_sync_all_blocks_on_2_instances) === CONT TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === CONT TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_1_and_SS_=_1 === CONT TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === CONT TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_2_(should_still_sync_blocks_on_the_only_available_instance) === CONT TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_1,_SS_=_3_and_NO_previously_loaded_blocks === CONT TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_3_and_NO_previously_loaded_blocks === CONT TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_2_(should_sync_blocks_on_2_instances_because_of_the_shard_size) === CONT TestShuffleShardingStrategy/JOINING_instance_in_the_ring_should_get_its_shard_blocks_and_they_should_not_be_replicated_to_another_instance --- PASS: TestShuffleShardingStrategy (0.01s) --- PASS: TestShuffleShardingStrategy/multiple_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_3 (1.00s) --- PASS: TestShuffleShardingStrategy/SS_=_0_disables_shuffle_sharding (1.01s) --- PASS: TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_NO_previously_loaded_blocks (1.00s) --- PASS: TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_some_previously_loaded_blocks (1.00s) --- PASS: TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_2_(should_sync_all_blocks_on_2_instances) (1.00s) --- PASS: TestShuffleShardingStrategy/LEAVING_instance_in_the_ring_should_continue_to_keep_its_shard_blocks_and_they_should_NOT_be_replicated_to_another_instance (1.00s) --- PASS: TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) (1.00s) --- PASS: TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_1_(should_still_sync_blocks_on_the_only_available_instance) (1.01s) --- PASS: TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_1_and_SS_=_1 (1.01s) --- PASS: TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_3_and_NO_previously_loaded_blocks (1.01s) --- PASS: TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_2_(should_still_sync_blocks_on_the_only_available_instance) (1.01s) --- PASS: TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_2_(should_sync_blocks_on_2_instances_because_of_the_shard_size) (1.01s) --- PASS: TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) (1.01s) --- PASS: TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_1,_SS_=_3_and_NO_previously_loaded_blocks (1.01s) --- PASS: TestShuffleShardingStrategy/JOINING_instance_in_the_ring_should_get_its_shard_blocks_and_they_should_not_be_replicated_to_another_instance (2.01s) === RUN TestSnappyGobSeriesCacheEntryCodec === RUN TestSnappyGobSeriesCacheEntryCodec/happy_case_roundtrip === RUN TestSnappyGobSeriesCacheEntryCodec/can't_decode_wrong_codec === RUN TestSnappyGobSeriesCacheEntryCodec/can't_decode_wrong_data --- PASS: TestSnappyGobSeriesCacheEntryCodec (0.01s) --- PASS: TestSnappyGobSeriesCacheEntryCodec/happy_case_roundtrip (0.01s) --- PASS: TestSnappyGobSeriesCacheEntryCodec/can't_decode_wrong_codec (0.00s) --- PASS: TestSnappyGobSeriesCacheEntryCodec/can't_decode_wrong_data (0.00s) === CONT TestBucketStore_e2e === RUN TestBucketStore_e2e/inmem === CONT TestBucketStore_LabelValues_e2e === RUN TestBucketStore_LabelValues_e2e/inmem === CONT TestBucketStore_LabelNames_e2e === RUN TestBucketStore_LabelNames_e2e/inmem === CONT TestBucketStore_ManyParts_e2e === CONT TestIsHealthyForStoreGatewayOperations === RUN TestBucketStore_ManyParts_e2e/inmem === RUN TestIsHealthyForStoreGatewayOperations/JOINING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForStoreGatewayOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForStoreGatewayOperations/PENDING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForStoreGatewayOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForStoreGatewayOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout --- PASS: TestIsHealthyForStoreGatewayOperations (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/JOINING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/PENDING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout (0.00s) === RUN TestBucketStore_e2e/inmem/no_index_cache === RUN TestBucketStore_e2e/inmem/no_index_cache/0 === RUN TestBucketStore_e2e/inmem/no_index_cache/1 === RUN TestBucketStore_e2e/inmem/no_index_cache/2 === RUN TestBucketStore_e2e/inmem/no_index_cache/3 === RUN TestBucketStore_e2e/inmem/no_index_cache/4 === RUN TestBucketStore_e2e/inmem/no_index_cache/5 === RUN TestBucketStore_e2e/inmem/no_index_cache/6 === RUN TestBucketStore_e2e/inmem/no_index_cache/7 === RUN TestBucketStore_e2e/inmem/no_index_cache/8 === RUN TestBucketStore_e2e/inmem/no_index_cache/9 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/0 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/1 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/2 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/3 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/4 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/5 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/6 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/7 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/8 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/9 === RUN TestBucketStore_e2e/inmem/with_small_index_cache === RUN TestBucketStore_e2e/inmem/with_small_index_cache/0 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/1 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/2 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/3 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/4 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/5 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/6 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/7 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/8 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/9 === RUN TestBucketStore_LabelNames_e2e/inmem/outside_the_time_range === RUN TestBucketStore_LabelNames_e2e/inmem/matcher_matching_everything === RUN TestBucketStore_LabelNames_e2e/inmem/b=1_matcher === RUN TestBucketStore_LabelNames_e2e/inmem/b=''_matcher === RUN TestBucketStore_e2e/filesystem === PAUSE TestBucketStore_e2e/filesystem === CONT TestBucketStore_e2e/filesystem === RUN TestBucketStore_ManyParts_e2e/inmem/0 === RUN TestBucketStore_LabelNames_e2e/inmem/outside_the_time_range,_with_matcher === RUN TestBucketStore_LabelNames_e2e/inmem/basic_labelNames === RUN TestBucketStore_LabelValues_e2e/inmem/label_a === RUN TestBucketStore_LabelValues_e2e/inmem/label_a,_outside_time_range === RUN TestBucketStore_LabelValues_e2e/inmem/label_a,_a=1 === RUN TestBucketStore_LabelValues_e2e/inmem/label_a,_a=2,_c=2 === RUN TestBucketStore_LabelNames_e2e/filesystem === PAUSE TestBucketStore_LabelNames_e2e/filesystem === CONT TestBucketStore_LabelNames_e2e/filesystem === RUN TestBucketStore_LabelValues_e2e/inmem/label_ext1 === RUN TestBucketStore_ManyParts_e2e/inmem/1 === RUN TestBucketStore_ManyParts_e2e/inmem/2 === RUN TestBucketStore_LabelValues_e2e/filesystem === PAUSE TestBucketStore_LabelValues_e2e/filesystem === CONT TestBucketStore_LabelValues_e2e/filesystem === RUN TestBucketStore_ManyParts_e2e/inmem/3 === RUN TestBucketStore_ManyParts_e2e/inmem/4 === RUN TestBucketStore_ManyParts_e2e/inmem/5 === RUN TestBucketStore_ManyParts_e2e/inmem/6 === RUN TestBucketStore_ManyParts_e2e/inmem/7 === RUN TestBucketStore_ManyParts_e2e/inmem/8 === RUN TestBucketStore_ManyParts_e2e/inmem/9 === RUN TestBucketStore_ManyParts_e2e/filesystem === PAUSE TestBucketStore_ManyParts_e2e/filesystem === CONT TestBucketStore_ManyParts_e2e/filesystem === RUN TestBucketStore_LabelNames_e2e/filesystem/matcher_matching_everything === RUN TestBucketStore_LabelValues_e2e/filesystem/label_a === RUN TestBucketStore_LabelValues_e2e/filesystem/label_a,_outside_time_range === RUN TestBucketStore_LabelValues_e2e/filesystem/label_a,_a=1 === RUN TestBucketStore_LabelNames_e2e/filesystem/b=1_matcher === RUN TestBucketStore_LabelValues_e2e/filesystem/label_a,_a=2,_c=2 === RUN TestBucketStore_LabelNames_e2e/filesystem/b=''_matcher === RUN TestBucketStore_LabelValues_e2e/filesystem/label_ext1 === RUN TestBucketStore_LabelNames_e2e/filesystem/outside_the_time_range,_with_matcher === RUN TestBucketStore_LabelNames_e2e/filesystem/basic_labelNames === RUN TestBucketStore_LabelNames_e2e/filesystem/outside_the_time_range --- PASS: TestBucketStore_LabelValues_e2e (11.81s) --- PASS: TestBucketStore_LabelValues_e2e/inmem (11.81s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_a (0.01s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_a,_outside_time_range (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_a,_a=1 (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_a,_a=2,_c=2 (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_ext1 (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem (10.91s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_a (0.01s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_a,_outside_time_range (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_a,_a=1 (0.01s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_a,_a=2,_c=2 (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_ext1 (0.00s) --- PASS: TestBucketStore_LabelNames_e2e (11.78s) --- PASS: TestBucketStore_LabelNames_e2e/inmem (11.78s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/outside_the_time_range (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/matcher_matching_everything (0.01s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/b=1_matcher (0.01s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/b=''_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/outside_the_time_range,_with_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/basic_labelNames (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem (10.94s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/matcher_matching_everything (0.01s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/b=1_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/b=''_matcher (0.01s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/outside_the_time_range,_with_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/basic_labelNames (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/outside_the_time_range (0.00s) === RUN TestBucketStore_e2e/filesystem/no_index_cache === RUN TestBucketStore_ManyParts_e2e/filesystem/0 === RUN TestBucketStore_e2e/filesystem/no_index_cache/0 === RUN TestBucketStore_e2e/filesystem/no_index_cache/1 === RUN TestBucketStore_e2e/filesystem/no_index_cache/2 === RUN TestBucketStore_e2e/filesystem/no_index_cache/3 === RUN TestBucketStore_ManyParts_e2e/filesystem/1 === RUN TestBucketStore_e2e/filesystem/no_index_cache/4 === RUN TestBucketStore_e2e/filesystem/no_index_cache/5 === RUN TestBucketStore_ManyParts_e2e/filesystem/2 === RUN TestBucketStore_e2e/filesystem/no_index_cache/6 === RUN TestBucketStore_ManyParts_e2e/filesystem/3 === RUN TestBucketStore_e2e/filesystem/no_index_cache/7 === RUN TestBucketStore_ManyParts_e2e/filesystem/4 === RUN TestBucketStore_e2e/filesystem/no_index_cache/8 === RUN TestBucketStore_e2e/filesystem/no_index_cache/9 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/0 === RUN TestBucketStore_ManyParts_e2e/filesystem/5 === RUN TestBucketStore_ManyParts_e2e/filesystem/6 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/1 === RUN TestBucketStore_ManyParts_e2e/filesystem/7 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/2 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/3 === RUN TestBucketStore_ManyParts_e2e/filesystem/8 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/4 === RUN TestBucketStore_ManyParts_e2e/filesystem/9 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/5 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/6 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/7 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/8 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/9 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/0 --- PASS: TestBucketStore_ManyParts_e2e (11.89s) --- PASS: TestBucketStore_ManyParts_e2e/inmem (11.89s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/0 (0.02s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/1 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/2 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/3 (0.02s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/4 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/5 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/6 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/7 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/8 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/9 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem (11.38s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/0 (0.05s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/1 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/2 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/3 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/4 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/5 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/6 (0.01s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/7 (0.02s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/8 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/9 (0.00s) === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/1 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/2 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/3 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/4 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/5 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/6 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/7 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/8 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/9 --- PASS: TestBucketStore_e2e (11.77s) --- PASS: TestBucketStore_e2e/inmem (11.77s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache (0.07s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/0 (0.01s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/1 (0.01s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/2 (0.01s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/3 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/4 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/5 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/6 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/7 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/9 (0.01s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache (0.05s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/0 (0.01s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/1 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/2 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/3 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/4 (0.01s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/5 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/6 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/7 (0.01s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/9 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache (0.17s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/0 (0.01s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/1 (0.02s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/2 (0.02s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/3 (0.02s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/4 (0.02s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/5 (0.01s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/6 (0.01s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/7 (0.02s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/9 (0.02s) --- PASS: TestBucketStore_e2e/filesystem (11.65s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache (0.10s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/0 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/1 (0.02s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/2 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/3 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/4 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/5 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/6 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/7 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/9 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache (0.07s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/0 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/1 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/2 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/3 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/4 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/5 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/6 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/7 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/9 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache (0.12s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/0 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/1 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/2 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/3 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/4 (0.04s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/5 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/6 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/7 (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/9 (0.01s) PASS ok github.com/grafana/mimir/pkg/storegateway 321.494s === RUN TestCanonicalLabelMatchersKey --- PASS: TestCanonicalLabelMatchersKey (0.01s) === RUN TestNewInMemoryIndexCache --- PASS: TestNewInMemoryIndexCache (0.02s) === RUN TestInMemoryIndexCache_AvoidsDeadlock --- PASS: TestInMemoryIndexCache_AvoidsDeadlock (0.01s) === RUN TestInMemoryIndexCache_UpdateItem === RUN TestInMemoryIndexCache_UpdateItem/Postings === RUN TestInMemoryIndexCache_UpdateItem/SeriesForRef === RUN TestInMemoryIndexCache_UpdateItem/ExpandedPostings === RUN TestInMemoryIndexCache_UpdateItem/Series === RUN TestInMemoryIndexCache_UpdateItem/LabelNames === RUN TestInMemoryIndexCache_UpdateItem/LabelValues --- PASS: TestInMemoryIndexCache_UpdateItem (0.02s) --- PASS: TestInMemoryIndexCache_UpdateItem/Postings (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/SeriesForRef (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/ExpandedPostings (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/Series (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/LabelNames (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/LabelValues (0.00s) === RUN TestInMemoryIndexCache_MaxNumberOfItemsHit --- PASS: TestInMemoryIndexCache_MaxNumberOfItemsHit (0.00s) === RUN TestInMemoryIndexCache_Eviction_WithMetrics --- PASS: TestInMemoryIndexCache_Eviction_WithMetrics (0.02s) === RUN TestMemcachedIndexCache_FetchMultiPostings === PAUSE TestMemcachedIndexCache_FetchMultiPostings === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef === PAUSE TestMemcachedIndexCache_FetchMultiSeriesForRef === RUN TestMemcachedIndexCache_FetchExpandedPostings === PAUSE TestMemcachedIndexCache_FetchExpandedPostings === RUN TestMemcachedIndexCache_FetchSeries === PAUSE TestMemcachedIndexCache_FetchSeries === RUN TestMemcachedIndexCache_FetchLabelNames === PAUSE TestMemcachedIndexCache_FetchLabelNames === RUN TestMemcachedIndexCache_FetchLabelValues === PAUSE TestMemcachedIndexCache_FetchLabelValues === RUN TestStringCacheKeys_Values === PAUSE TestStringCacheKeys_Values === RUN TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength === PAUSE TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength === CONT TestMemcachedIndexCache_FetchMultiPostings === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_empty_cache === CONT TestMemcachedIndexCache_FetchLabelNames === CONT TestStringCacheKeys_Values === RUN TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_empty_cache === RUN TestStringCacheKeys_Values/should_stringify_postings_cache_key === RUN TestStringCacheKeys_Values/should_stringify_series_cache_key --- PASS: TestStringCacheKeys_Values (0.00s) --- PASS: TestStringCacheKeys_Values/should_stringify_postings_cache_key (0.00s) --- PASS: TestStringCacheKeys_Values/should_stringify_series_cache_key (0.00s) === CONT TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength === RUN TestMemcachedIndexCache_FetchLabelNames/should_return_no_miss_on_hit === RUN TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_postings === RUN TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_series --- PASS: TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength (0.00s) --- PASS: TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_postings (0.00s) --- PASS: TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_series (0.00s) === RUN TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_memcached_error === CONT TestMemcachedIndexCache_FetchLabelValues === RUN TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_empty_cache --- PASS: TestMemcachedIndexCache_FetchLabelNames (0.01s) --- PASS: TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelNames/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_memcached_error (0.00s) === CONT TestMemcachedIndexCache_FetchExpandedPostings === RUN TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchLabelValues/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_memcached_error --- PASS: TestMemcachedIndexCache_FetchLabelValues (0.02s) --- PASS: TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelValues/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_memcached_error (0.01s) === CONT TestMemcachedIndexCache_FetchMultiSeriesForRef === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_memcached_error === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_no_misses_on_100%_hit_ratio === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_empty_cache === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_hits_and_misses_on_partial_hits === CONT TestMemcachedIndexCache_FetchSeries === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_memcached_error === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_misses_on_100%_hit_ratio === RUN TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_memcached_error --- PASS: TestMemcachedIndexCache_FetchMultiPostings (0.04s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_no_misses_on_100%_hit_ratio (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_hits_and_misses_on_partial_hits (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_memcached_error (0.00s) === RUN TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_empty_cache === RUN TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_memcached_error === RUN TestMemcachedIndexCache_FetchSeries/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_hits_and_misses_on_partial_hits === RUN TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_empty_cache --- PASS: TestMemcachedIndexCache_FetchSeries (0.01s) --- PASS: TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_memcached_error (0.00s) --- PASS: TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchSeries/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef (0.02s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_memcached_error (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_misses_on_100%_hit_ratio (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_hits_and_misses_on_partial_hits (0.00s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings (0.04s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_miss_on_hit (0.02s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_memcached_error (0.00s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_empty_cache (0.00s) PASS ok github.com/grafana/mimir/pkg/storegateway/indexcache 0.769s === RUN TestReaders === RUN TestReaders/01GK7Q8PW8PX1F4WRF7F0W7JDH === RUN TestReaders/01GK7Q8PW8PX1F4WRF7F0W7JDH/binary_reader === RUN TestReaders/01GK7Q8PW8PX1F4WRF7F0W7JDH/binary_reader_with_map_populate === RUN TestReaders/01GK7Q8PW8PX1F4WRF7F0W7JDH/lazy_binary_reader === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader_with_map_populate === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/lazy_binary_reader --- PASS: TestReaders (2.27s) --- PASS: TestReaders/01GK7Q8PW8PX1F4WRF7F0W7JDH (0.04s) --- PASS: TestReaders/01GK7Q8PW8PX1F4WRF7F0W7JDH/binary_reader (0.02s) --- PASS: TestReaders/01GK7Q8PW8PX1F4WRF7F0W7JDH/binary_reader_with_map_populate (0.01s) --- PASS: TestReaders/01GK7Q8PW8PX1F4WRF7F0W7JDH/lazy_binary_reader (0.01s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ (0.03s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader (0.01s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader_with_map_populate (0.01s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/lazy_binary_reader (0.01s) === RUN TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader --- PASS: TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader (0.00s) === RUN TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket --- PASS: TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket (2.32s) === RUN TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader --- PASS: TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader (2.22s) === RUN TestLazyBinaryReader_ShouldReopenOnUsageAfterClose --- PASS: TestLazyBinaryReader_ShouldReopenOnUsageAfterClose (2.20s) === RUN TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle --- PASS: TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle (1.91s) === RUN TestLazyBinaryReader_LoadUnloadRaceCondition --- PASS: TestLazyBinaryReader_LoadUnloadRaceCondition (7.46s) === RUN TestReaderPool_NewBinaryReader === RUN TestReaderPool_NewBinaryReader/lazy_reader_is_disabled === RUN TestReaderPool_NewBinaryReader/lazy_reader_is_enabled_but_close_on_idle_timeout_is_disabled === RUN TestReaderPool_NewBinaryReader/lazy_reader_and_close_on_idle_timeout_are_both_enabled --- PASS: TestReaderPool_NewBinaryReader (2.25s) --- PASS: TestReaderPool_NewBinaryReader/lazy_reader_is_disabled (0.00s) --- PASS: TestReaderPool_NewBinaryReader/lazy_reader_is_enabled_but_close_on_idle_timeout_is_disabled (0.00s) --- PASS: TestReaderPool_NewBinaryReader/lazy_reader_and_close_on_idle_timeout_are_both_enabled (0.00s) === RUN TestReaderPool_ShouldCloseIdleLazyReaders --- PASS: TestReaderPool_ShouldCloseIdleLazyReaders (4.18s) PASS ok github.com/grafana/mimir/pkg/storegateway/indexheader 26.291s ? github.com/grafana/mimir/pkg/storegateway/indexheader/fileutil [no test files] ? github.com/grafana/mimir/pkg/storegateway/storegatewaypb [no test files] ? github.com/grafana/mimir/pkg/storegateway/testhelper [no test files] === RUN TestBuildReport --- PASS: TestBuildReport (0.01s) === RUN TestGetNextReportAt === RUN TestGetNextReportAt/createdAt_aligned_with_interval_and_now === RUN TestGetNextReportAt/createdAt_aligned_with_interval === RUN TestGetNextReportAt/createdAt_not_aligned --- PASS: TestGetNextReportAt (0.00s) --- PASS: TestGetNextReportAt/createdAt_aligned_with_interval_and_now (0.00s) --- PASS: TestGetNextReportAt/createdAt_aligned_with_interval (0.00s) --- PASS: TestGetNextReportAt/createdAt_not_aligned (0.00s) === RUN TestSendReport === RUN TestSendReport/server_returns_2xx === RUN TestSendReport/server_returns_5xx === RUN TestSendReport/server_is_not_running --- PASS: TestSendReport (0.13s) --- PASS: TestSendReport/server_returns_2xx (0.09s) --- PASS: TestSendReport/server_returns_5xx (0.01s) --- PASS: TestSendReport/server_is_not_running (0.01s) === RUN TestReporter_SendReportPeriodically === RUN TestReporter_SendReportPeriodically/all_requests_to_stats_server_succeed === PAUSE TestReporter_SendReportPeriodically/all_requests_to_stats_server_succeed === RUN TestReporter_SendReportPeriodically/some_requests_to_stats_server_fail_and_they_get_retried === PAUSE TestReporter_SendReportPeriodically/some_requests_to_stats_server_fail_and_they_get_retried === CONT TestReporter_SendReportPeriodically/all_requests_to_stats_server_succeed === CONT TestReporter_SendReportPeriodically/some_requests_to_stats_server_fail_and_they_get_retried --- PASS: TestReporter_SendReportPeriodically (0.00s) --- PASS: TestReporter_SendReportPeriodically/all_requests_to_stats_server_succeed (4.13s) --- PASS: TestReporter_SendReportPeriodically/some_requests_to_stats_server_fail_and_they_get_retried (4.13s) === RUN TestReporter_SendReportShouldSkipToNextReportOnLongFailure === PAUSE TestReporter_SendReportShouldSkipToNextReportOnLongFailure === RUN TestReadSeedFile === RUN TestReadSeedFile/the_seed_file_does_not_exist === RUN TestReadSeedFile/an_error_occurred_while_reading_the_seed_file === RUN TestReadSeedFile/the_seed_file_is_corrupted === RUN TestReadSeedFile/the_seed_file_is_read_successfully --- PASS: TestReadSeedFile (0.05s) --- PASS: TestReadSeedFile/the_seed_file_does_not_exist (0.02s) --- PASS: TestReadSeedFile/an_error_occurred_while_reading_the_seed_file (0.01s) --- PASS: TestReadSeedFile/the_seed_file_is_corrupted (0.01s) --- PASS: TestReadSeedFile/the_seed_file_is_read_successfully (0.00s) === RUN TestWriteSeedFile === RUN TestWriteSeedFile/an_error_occurred_while_writing_the_seed_file === RUN TestWriteSeedFile/the_seed_file_is_written_successfully --- PASS: TestWriteSeedFile (0.02s) --- PASS: TestWriteSeedFile/an_error_occurred_while_writing_the_seed_file (0.01s) --- PASS: TestWriteSeedFile/the_seed_file_is_written_successfully (0.00s) === RUN TestWaitSeedFileStability === RUN TestWaitSeedFileStability/should_immediately_return_if_seed_file_does_not_exist === PAUSE TestWaitSeedFileStability/should_immediately_return_if_seed_file_does_not_exist === RUN TestWaitSeedFileStability/should_immediately_return_if_seed_file_is_corrupted === PAUSE TestWaitSeedFileStability/should_immediately_return_if_seed_file_is_corrupted === RUN TestWaitSeedFileStability/should_immediately_return_if_seed_file_was_created_more_than_'min_stability'_time_ago === PAUSE TestWaitSeedFileStability/should_immediately_return_if_seed_file_was_created_more_than_'min_stability'_time_ago === RUN TestWaitSeedFileStability/should_wait_for_'min_stability'_and_return_the_seed_file_if_was_created_less_than_'min_stability'_time_ago === PAUSE TestWaitSeedFileStability/should_wait_for_'min_stability'_and_return_the_seed_file_if_was_created_less_than_'min_stability'_time_ago === CONT TestWaitSeedFileStability/should_immediately_return_if_seed_file_does_not_exist === CONT TestWaitSeedFileStability/should_immediately_return_if_seed_file_was_created_more_than_'min_stability'_time_ago === CONT TestWaitSeedFileStability/should_wait_for_'min_stability'_and_return_the_seed_file_if_was_created_less_than_'min_stability'_time_ago === CONT TestWaitSeedFileStability/should_immediately_return_if_seed_file_is_corrupted --- PASS: TestWaitSeedFileStability (0.02s) --- PASS: TestWaitSeedFileStability/should_immediately_return_if_seed_file_does_not_exist (0.00s) --- PASS: TestWaitSeedFileStability/should_immediately_return_if_seed_file_was_created_more_than_'min_stability'_time_ago (0.00s) --- PASS: TestWaitSeedFileStability/should_immediately_return_if_seed_file_is_corrupted (0.01s) --- PASS: TestWaitSeedFileStability/should_wait_for_'min_stability'_and_return_the_seed_file_if_was_created_less_than_'min_stability'_time_ago (3.10s) === RUN TestInitSeedFile === RUN TestInitSeedFile/should_wait_for_'min_stability'_and_return_the_seed_file_if_it_exists_and_was_created_less_than_'min_stability'_time_ago === PAUSE TestInitSeedFile/should_wait_for_'min_stability'_and_return_the_seed_file_if_it_exists_and_was_created_less_than_'min_stability'_time_ago === RUN TestInitSeedFile/should_create_the_seed_file_if_doesn't_exist_and_then_wait_for_'min_stability' === PAUSE TestInitSeedFile/should_create_the_seed_file_if_doesn't_exist_and_then_wait_for_'min_stability' === RUN TestInitSeedFile/should_re-create_the_seed_file_if_exist_but_is_corrupted,_and_then_wait_for_'min_stability' === PAUSE TestInitSeedFile/should_re-create_the_seed_file_if_exist_but_is_corrupted,_and_then_wait_for_'min_stability' === RUN TestInitSeedFile/should_immediately_return_if_seed_file_exists_and_it_was_created_more_than_'min_stability'_time_ago === PAUSE TestInitSeedFile/should_immediately_return_if_seed_file_exists_and_it_was_created_more_than_'min_stability'_time_ago === CONT TestInitSeedFile/should_wait_for_'min_stability'_and_return_the_seed_file_if_it_exists_and_was_created_less_than_'min_stability'_time_ago === CONT TestInitSeedFile/should_re-create_the_seed_file_if_exist_but_is_corrupted,_and_then_wait_for_'min_stability' === CONT TestInitSeedFile/should_immediately_return_if_seed_file_exists_and_it_was_created_more_than_'min_stability'_time_ago === CONT TestInitSeedFile/should_create_the_seed_file_if_doesn't_exist_and_then_wait_for_'min_stability' --- PASS: TestInitSeedFile (0.01s) --- PASS: TestInitSeedFile/should_immediately_return_if_seed_file_exists_and_it_was_created_more_than_'min_stability'_time_ago (0.01s) --- PASS: TestInitSeedFile/should_wait_for_'min_stability'_and_return_the_seed_file_if_it_exists_and_was_created_less_than_'min_stability'_time_ago (3.15s) --- PASS: TestInitSeedFile/should_re-create_the_seed_file_if_exist_but_is_corrupted,_and_then_wait_for_'min_stability' (5.21s) --- PASS: TestInitSeedFile/should_create_the_seed_file_if_doesn't_exist_and_then_wait_for_'min_stability' (6.03s) === RUN TestInitSeedFile_CreatingConcurrency === PAUSE TestInitSeedFile_CreatingConcurrency === RUN TestCounter --- PASS: TestCounter (1.01s) === CONT TestReporter_SendReportShouldSkipToNextReportOnLongFailure === CONT TestInitSeedFile_CreatingConcurrency --- PASS: TestReporter_SendReportShouldSkipToNextReportOnLongFailure (4.12s) --- PASS: TestInitSeedFile_CreatingConcurrency (6.98s) PASS ok github.com/grafana/mimir/pkg/usagestats 22.568s === RUN TestActiveUser --- PASS: TestActiveUser (0.01s) === RUN TestActiveUserConcurrentUpdateAndPurge --- PASS: TestActiveUserConcurrentUpdateAndPurge (1.04s) === RUN TestAllowedTenants_NoConfig --- PASS: TestAllowedTenants_NoConfig (0.00s) === RUN TestAllowedTenants_Enabled --- PASS: TestAllowedTenants_Enabled (0.00s) === RUN TestAllowedTenants_Disabled --- PASS: TestAllowedTenants_Disabled (0.00s) === RUN TestAllowedTenants_Combination --- PASS: TestAllowedTenants_Combination (0.01s) === RUN TestAllowedTenants_Nil --- PASS: TestAllowedTenants_Nil (0.00s) === RUN TestGetSourceFromOutgoingCtx === RUN TestGetSourceFromOutgoingCtx/No_value_in_key === RUN TestGetSourceFromOutgoingCtx/Value_in_key === RUN TestGetSourceFromOutgoingCtx/Stored_under_wrong_key --- PASS: TestGetSourceFromOutgoingCtx (0.01s) --- PASS: TestGetSourceFromOutgoingCtx/No_value_in_key (0.00s) --- PASS: TestGetSourceFromOutgoingCtx/Value_in_key (0.00s) --- PASS: TestGetSourceFromOutgoingCtx/Stored_under_wrong_key (0.00s) === RUN TestTrackRegisteredFlags --- PASS: TestTrackRegisteredFlags (0.01s) === RUN TestLabelMatchersToString --- PASS: TestLabelMatchersToString (0.00s) === RUN TestMultiMatchersStringer === RUN TestMultiMatchersStringer/One_nested_matcher === RUN TestMultiMatchersStringer/Two_nested_matchers --- PASS: TestMultiMatchersStringer (0.01s) --- PASS: TestMultiMatchersStringer/One_nested_matcher (0.00s) --- PASS: TestMultiMatchersStringer/Two_nested_matchers (0.00s) === RUN TestMatchersStringer === RUN TestMatchersStringer/One_matcher === RUN TestMatchersStringer/Two_matchers --- PASS: TestMatchersStringer (0.00s) --- PASS: TestMatchersStringer/One_matcher (0.00s) --- PASS: TestMatchersStringer/Two_matchers (0.00s) === RUN TestMergeSampleSets --- PASS: TestMergeSampleSets (0.01s) === RUN TestMergeNSampleSets --- PASS: TestMergeNSampleSets (0.00s) === RUN TestSum --- PASS: TestSum (0.00s) === RUN TestMax --- PASS: TestMax (0.00s) === RUN TestCounterValue --- PASS: TestCounterValue (0.00s) === RUN TestGetMetricsWithLabelNames --- PASS: TestGetMetricsWithLabelNames (0.00s) === RUN TestSendSumOfGaugesPerUserWithLabels --- PASS: TestSendSumOfGaugesPerUserWithLabels (0.03s) === RUN TestSendMaxOfGauges --- PASS: TestSendMaxOfGauges (0.01s) === RUN TestSendSumOfHistogramsWithLabels --- PASS: TestSendSumOfHistogramsWithLabels (0.03s) === RUN TestSendSumOfCountersPerUser_WithLabels === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one,_and_skip_zero_value_metrics === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two,_and_skip_zero_value_metrics === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two,_and_skip_zero_value_metrics --- PASS: TestSendSumOfCountersPerUser_WithLabels (0.04s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one (0.02s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one,_and_skip_zero_value_metrics (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two,_and_skip_zero_value_metrics (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two,_and_skip_zero_value_metrics (0.01s) === RUN TestSendSumOfSummariesPerUser --- PASS: TestSendSumOfSummariesPerUser (0.00s) === RUN TestFloat64PrecisionStability metrics_helper_test.go:506: random generator seed: 1669927852245333208 --- PASS: TestFloat64PrecisionStability (21.47s) === RUN TestUserRegistries_RemoveBaseline --- PASS: TestUserRegistries_RemoveBaseline (0.03s) === RUN TestUserRegistries_RemoveUserRegistry_SoftRemoval --- PASS: TestUserRegistries_RemoveUserRegistry_SoftRemoval (0.01s) === RUN TestUserRegistries_RemoveUserRegistry_HardRemoval --- PASS: TestUserRegistries_RemoveUserRegistry_HardRemoval (0.01s) === RUN TestUserRegistries_AddUserRegistry_ReplaceRegistry --- PASS: TestUserRegistries_AddUserRegistry_ReplaceRegistry (0.01s) === RUN TestGetLabels --- PASS: TestGetLabels (0.00s) === RUN TestShuffleShardExpectedInstancesPerZone --- PASS: TestShuffleShardExpectedInstancesPerZone (0.00s) === RUN TestShuffleShardExpectedInstances --- PASS: TestShuffleShardExpectedInstances (0.00s) === RUN TestRemoveSliceIndexes === RUN TestRemoveSliceIndexes/no_change === RUN TestRemoveSliceIndexes/remove_first === RUN TestRemoveSliceIndexes/remove_middle === RUN TestRemoveSliceIndexes/remove_last === RUN TestRemoveSliceIndexes/remove_all === RUN TestRemoveSliceIndexes/remove_two_ranges === RUN TestRemoveSliceIndexes/index_overrun === RUN TestRemoveSliceIndexes/duplicate_indexes === RUN TestRemoveSliceIndexes/negative_indexes === RUN TestRemoveSliceIndexes/all_cases_combined --- PASS: TestRemoveSliceIndexes (0.01s) --- PASS: TestRemoveSliceIndexes/no_change (0.00s) --- PASS: TestRemoveSliceIndexes/remove_first (0.00s) --- PASS: TestRemoveSliceIndexes/remove_middle (0.00s) --- PASS: TestRemoveSliceIndexes/remove_last (0.00s) --- PASS: TestRemoveSliceIndexes/remove_all (0.00s) --- PASS: TestRemoveSliceIndexes/remove_two_ranges (0.00s) --- PASS: TestRemoveSliceIndexes/index_overrun (0.00s) --- PASS: TestRemoveSliceIndexes/duplicate_indexes (0.00s) --- PASS: TestRemoveSliceIndexes/negative_indexes (0.00s) --- PASS: TestRemoveSliceIndexes/all_cases_combined (0.00s) === RUN TestTimeFromMillis === RUN TestTimeFromMillis/0 === RUN TestTimeFromMillis/1 --- PASS: TestTimeFromMillis (0.00s) --- PASS: TestTimeFromMillis/0 (0.00s) --- PASS: TestTimeFromMillis/1 (0.00s) === RUN TestTimeRoundTrip === RUN TestTimeRoundTrip/0 === RUN TestTimeRoundTrip/1 === RUN TestTimeRoundTrip/2 --- PASS: TestTimeRoundTrip (0.01s) --- PASS: TestTimeRoundTrip/0 (0.00s) --- PASS: TestTimeRoundTrip/1 (0.00s) --- PASS: TestTimeRoundTrip/2 (0.00s) === RUN TestDurationWithJitter --- PASS: TestDurationWithJitter (0.02s) === RUN TestDurationWithJitter_ZeroInputDuration --- PASS: TestDurationWithJitter_ZeroInputDuration (0.00s) === RUN TestDurationWithPositiveJitter --- PASS: TestDurationWithPositiveJitter (0.02s) === RUN TestDurationWithPositiveJitter_ZeroInputDuration --- PASS: TestDurationWithPositiveJitter_ZeroInputDuration (0.00s) === RUN TestParseTime --- PASS: TestParseTime (0.01s) === RUN TestNewDisableableTicker_Enabled --- PASS: TestNewDisableableTicker_Enabled (0.10s) === RUN TestNewDisableableTicker_Disabled --- PASS: TestNewDisableableTicker_Disabled (0.10s) === RUN TestYoloBuf --- PASS: TestYoloBuf (0.00s) === RUN TestRenderHTTPResponse === RUN TestRenderHTTPResponse/Test_Renders_json === RUN TestRenderHTTPResponse/Test_Renders_html --- PASS: TestRenderHTTPResponse (0.02s) --- PASS: TestRenderHTTPResponse/Test_Renders_json (0.01s) --- PASS: TestRenderHTTPResponse/Test_Renders_html (0.01s) === RUN TestWriteTextResponse --- PASS: TestWriteTextResponse (0.00s) === RUN TestStreamWriteYAMLResponse --- PASS: TestStreamWriteYAMLResponse (0.02s) === RUN TestParseProtoReader === RUN TestParseProtoReader/rawSnappy === RUN TestParseProtoReader/noCompression === RUN TestParseProtoReader/too_big_rawSnappy === RUN TestParseProtoReader/too_big_decoded_rawSnappy === RUN TestParseProtoReader/too_big_noCompression === RUN TestParseProtoReader/bytesbuffer_rawSnappy === RUN TestParseProtoReader/bytesbuffer_noCompression === RUN TestParseProtoReader/bytesbuffer_too_big_rawSnappy === RUN TestParseProtoReader/bytesbuffer_too_big_decoded_rawSnappy === RUN TestParseProtoReader/bytesbuffer_too_big_noCompression --- PASS: TestParseProtoReader (0.01s) --- PASS: TestParseProtoReader/rawSnappy (0.00s) --- PASS: TestParseProtoReader/noCompression (0.00s) --- PASS: TestParseProtoReader/too_big_rawSnappy (0.00s) --- PASS: TestParseProtoReader/too_big_decoded_rawSnappy (0.00s) --- PASS: TestParseProtoReader/too_big_noCompression (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_rawSnappy (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_noCompression (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_too_big_rawSnappy (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_too_big_decoded_rawSnappy (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_too_big_noCompression (0.00s) === RUN TestIsRequestBodyTooLargeRegression --- PASS: TestIsRequestBodyTooLargeRegression (0.00s) === RUN TestNewMsgSizeTooLargeErr --- PASS: TestNewMsgSizeTooLargeErr (0.00s) PASS ok github.com/grafana/mimir/pkg/util 24.042s === RUN TestActivityTracker --- PASS: TestActivityTracker (0.04s) === RUN TestNilActivityTracker --- PASS: TestNilActivityTracker (0.00s) === RUN TestTrimEntrySize === RUN TestTrimEntrySize/hello_world,_100 === RUN TestTrimEntrySize/hello_world,_10 === RUN TestTrimEntrySize/hello_world,_5 === RUN TestTrimEntrySize/🎉🎄🎅,_5 === RUN TestTrimEntrySize/🎉🎄🎅,_8 === RUN TestTrimEntrySize/🎉🎄🎅,_9 === RUN TestTrimEntrySize/🎉🎄🎅,_10 === RUN TestTrimEntrySize/🎉🎄🎅,_11 === RUN TestTrimEntrySize/🎉🎄🎅,_12 --- PASS: TestTrimEntrySize (0.01s) --- PASS: TestTrimEntrySize/hello_world,_100 (0.00s) --- PASS: TestTrimEntrySize/hello_world,_10 (0.00s) --- PASS: TestTrimEntrySize/hello_world,_5 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_5 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_8 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_9 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_10 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_11 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_12 (0.00s) PASS ok github.com/grafana/mimir/pkg/util/activitytracker 0.378s ? github.com/grafana/mimir/pkg/util/chunkcompat [no test files] ? github.com/grafana/mimir/pkg/util/extract [no test files] ? github.com/grafana/mimir/pkg/util/fieldcategory [no test files] ? github.com/grafana/mimir/pkg/util/fs [no test files] === RUN TestRejectingGate === RUN TestRejectingGate/not_at_concurrency_limit === RUN TestRejectingGate/at_concurrency_limit --- PASS: TestRejectingGate (0.01s) --- PASS: TestRejectingGate/not_at_concurrency_limit (0.00s) --- PASS: TestRejectingGate/at_concurrency_limit (0.00s) === RUN TestBlockingGate === RUN TestBlockingGate/not_at_concurrency_limit === RUN TestBlockingGate/at_concurrency_limit --- PASS: TestBlockingGate (0.01s) --- PASS: TestBlockingGate/not_at_concurrency_limit (0.00s) --- PASS: TestBlockingGate/at_concurrency_limit (0.01s) === RUN TestInstrumentedGate === RUN TestInstrumentedGate/max_concurrency === RUN TestInstrumentedGate/inflight_requests --- PASS: TestInstrumentedGate (0.02s) --- PASS: TestInstrumentedGate/max_concurrency (0.02s) --- PASS: TestInstrumentedGate/inflight_requests (0.01s) PASS ok github.com/grafana/mimir/pkg/util/gate 0.465s === RUN TestID_Message --- PASS: TestID_Message (0.00s) === RUN TestID_MessageWithPerInstanceLimitConfig --- PASS: TestID_MessageWithPerInstanceLimitConfig (0.00s) === RUN TestID_MessageWithPerTenantLimitConfig --- PASS: TestID_MessageWithPerTenantLimitConfig (0.00s) PASS ok github.com/grafana/mimir/pkg/util/globalerror 0.213s === RUN TestSetAcceptEncodingForPushOptionsWithoutHeaders --- PASS: TestSetAcceptEncodingForPushOptionsWithoutHeaders (0.00s) === RUN TestSetAcceptEncodingForPushOptionsWithHeaders --- PASS: TestSetAcceptEncodingForPushOptionsWithHeaders (0.00s) === RUN TestParseEncodings --- PASS: TestParseEncodings (0.00s) === RUN TestRequestAcceptance === RUN TestRequestAcceptance/gzip === RUN TestRequestAcceptance/gzip;q=1 === RUN TestRequestAcceptance/gzip;q=1,_identity;q=0 === RUN TestRequestAcceptance/gzip;q=1,_identity;q=0,_*;q=0.5 === RUN TestRequestAcceptance/foo;q=1,_gzip;q=0.5,_*;q=0 === RUN TestRequestAcceptance/identity;q=0 === RUN TestRequestAcceptance/identity;q=0,_*;q=0.5 --- PASS: TestRequestAcceptance (0.01s) --- PASS: TestRequestAcceptance/gzip (0.01s) --- PASS: TestRequestAcceptance/gzip;q=1 (0.00s) --- PASS: TestRequestAcceptance/gzip;q=1,_identity;q=0 (0.00s) --- PASS: TestRequestAcceptance/gzip;q=1,_identity;q=0,_*;q=0.5 (0.00s) --- PASS: TestRequestAcceptance/foo;q=1,_gzip;q=0.5,_*;q=0 (0.00s) --- PASS: TestRequestAcceptance/identity;q=0 (0.00s) --- PASS: TestRequestAcceptance/identity;q=0,_*;q=0.5 (0.00s) === RUN TestGzipHandler --- PASS: TestGzipHandler (0.02s) === RUN TestGzipHandlerSmallBodyNoCompression --- PASS: TestGzipHandlerSmallBodyNoCompression (0.00s) === RUN TestGzipHandlerSmallButDoesNotAcceptIdentity --- PASS: TestGzipHandlerSmallButDoesNotAcceptIdentity (0.00s) === RUN TestGzipHandlerAlreadyCompressed --- PASS: TestGzipHandlerAlreadyCompressed (0.00s) === RUN TestNewGzipLevelHandler --- PASS: TestNewGzipLevelHandler (0.14s) === RUN TestNewGzipLevelHandlerReturnsErrorForInvalidLevels --- PASS: TestNewGzipLevelHandlerReturnsErrorForInvalidLevels (0.00s) === RUN TestMustNewGzipLevelHandlerWillPanic --- PASS: TestMustNewGzipLevelHandlerWillPanic (0.00s) === RUN TestGzipHandlerNoBody --- PASS: TestGzipHandlerNoBody (0.00s) === RUN TestGzipHandlerContentLength --- PASS: TestGzipHandlerContentLength (0.08s) === RUN TestGzipHandlerMinSizeMustBePositive --- PASS: TestGzipHandlerMinSizeMustBePositive (0.00s) === RUN TestGzipHandlerMinSize --- PASS: TestGzipHandlerMinSize (0.00s) === RUN TestGzipDoubleClose --- PASS: TestGzipDoubleClose (0.00s) === RUN TestGzipHandlerDoubleWriteHeader --- PASS: TestGzipHandlerDoubleWriteHeader (0.00s) === RUN TestStatusCodes --- PASS: TestStatusCodes (0.00s) === RUN TestFlushBeforeWrite --- PASS: TestFlushBeforeWrite (0.05s) === RUN TestImplementFlusher --- PASS: TestImplementFlusher (0.00s) === RUN TestIgnoreSubsequentWriteHeader --- PASS: TestIgnoreSubsequentWriteHeader (0.00s) === RUN TestDontWriteWhenNotWrittenTo --- PASS: TestDontWriteWhenNotWrittenTo (0.00s) === RUN TestContentTypes --- PASS: TestContentTypes (0.01s) PASS ok github.com/grafana/mimir/pkg/util/gziphandler 0.641s === RUN TestPrioritizeRecoverableErr === RUN TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error === RUN TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error,_reverse_order === RUN TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_non-grpc_error === RUN TestPrioritizeRecoverableErr/recoverable_grpc_error,_non-recoverable_grpc_error_and_non-grpc_error === RUN TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_too_many_requests_error === RUN TestPrioritizeRecoverableErr/non-recoverable_grpc_error === RUN TestPrioritizeRecoverableErr/no_error --- PASS: TestPrioritizeRecoverableErr (0.06s) --- PASS: TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error (0.03s) --- PASS: TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error,_reverse_order (0.00s) --- PASS: TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_non-grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/recoverable_grpc_error,_non-recoverable_grpc_error_and_non-grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_too_many_requests_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/non-recoverable_grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/no_error (0.00s) PASS ok github.com/grafana/mimir/pkg/util/httpgrpcutil 0.498s === RUN TestTracerTransportPropagatesTrace === RUN TestTracerTransportPropagatesTrace/no_next_transport === RUN TestTracerTransportPropagatesTrace/with_next_transport --- PASS: TestTracerTransportPropagatesTrace (0.22s) --- PASS: TestTracerTransportPropagatesTrace/no_next_transport (0.17s) --- PASS: TestTracerTransportPropagatesTrace/with_next_transport (0.04s) PASS ok github.com/grafana/mimir/pkg/util/instrumentation 0.746s === RUN TestQueryLimiter_AddSeries_ShouldReturnNoErrorOnLimitNotExceeded --- PASS: TestQueryLimiter_AddSeries_ShouldReturnNoErrorOnLimitNotExceeded (0.00s) === RUN TestQueryLimiter_AddSeriers_ShouldReturnErrorOnLimitExceeded --- PASS: TestQueryLimiter_AddSeriers_ShouldReturnErrorOnLimitExceeded (0.00s) === RUN TestQueryLimiter_AddChunkBytes --- PASS: TestQueryLimiter_AddChunkBytes (0.00s) PASS ok github.com/grafana/mimir/pkg/util/limiter 1.127s ? github.com/grafana/mimir/pkg/util/listblocks [no test files] === RUN TestRateLimitedLogger rate_limit_test.go:34: PASS: Log() --- PASS: TestRateLimitedLogger (0.02s) === RUN TestRateLimitedLogger_Burst rate_limit_test.go:60: PASS: Log() --- PASS: TestRateLimitedLogger_Burst (0.01s) PASS ok github.com/grafana/mimir/pkg/util/log 0.824s === RUN TestRate --- PASS: TestRate (0.00s) PASS ok github.com/grafana/mimir/pkg/util/math 0.265s === RUN TestFirewallDialer === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_localhost === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_127.0.0.1 === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_google.com === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_private_addresses === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_localhost === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_127.0.0.1 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_192.168.0.1 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_10.0.0.1 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_google.com === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_fdf8:f53b:82e4::53 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_fe80::200:5aee:feaa:20a2 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_2001:4860:4860::8844 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:192.168.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_localhost === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_127.0.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_192.168.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_10.0.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fdf8:f53b:82e4::53 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fe80::200:5aee:feaa:20a2 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_2001:4860:4860::8844 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:10.0.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:172.217.168.78 --- PASS: TestFirewallDialer (0.63s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config (0.20s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_localhost (0.10s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_127.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_google.com (0.05s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_172.217.168.78 (0.04s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_localhost (0.01s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_127.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_192.168.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_10.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_google.com (0.02s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_172.217.168.78 (0.03s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_fdf8:f53b:82e4::53 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_fe80::200:5aee:feaa:20a2 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_2001:4860:4860::8844 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:172.217.168.78 (0.03s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:192.168.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs (0.32s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_localhost (0.01s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_127.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_192.168.0.1 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_10.0.0.1 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_172.217.168.78 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fdf8:f53b:82e4::53 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fe80::200:5aee:feaa:20a2 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_2001:4860:4860::8844 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:10.0.0.1 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:172.217.168.78 (0.00s) PASS ok github.com/grafana/mimir/pkg/util/net 1.117s ? github.com/grafana/mimir/pkg/util/noauth [no test files] === RUN TestProcessCollector --- PASS: TestProcessCollector (0.05s) === RUN TestProcessCollector_UnsupportedPlatform --- PASS: TestProcessCollector_UnsupportedPlatform (0.01s) PASS ok github.com/grafana/mimir/pkg/util/process 0.573s === RUN TestHandler_remoteWrite --- PASS: TestHandler_remoteWrite (0.01s) === RUN TestHandler_otlpWriteNoCompression --- PASS: TestHandler_otlpWriteNoCompression (0.01s) === RUN TestHandler_otlpDroppedMetricsPanic --- PASS: TestHandler_otlpDroppedMetricsPanic (0.01s) === RUN TestHandler_otlpWriteWithCompression --- PASS: TestHandler_otlpWriteWithCompression (0.02s) === RUN TestHandler_otlpWriteRequestTooBigNoCompression --- PASS: TestHandler_otlpWriteRequestTooBigNoCompression (0.03s) === RUN TestHandler_otlpWriteRequestTooBigWithCompression --- PASS: TestHandler_otlpWriteRequestTooBigWithCompression (0.01s) === RUN TestHandler_otlpWriteRequestWithUnSupportedCompression --- PASS: TestHandler_otlpWriteRequestWithUnSupportedCompression (0.00s) === RUN TestHandler_mimirWriteRequest --- PASS: TestHandler_mimirWriteRequest (0.00s) === RUN TestHandler_contextCanceledRequest --- PASS: TestHandler_contextCanceledRequest (0.00s) === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_false === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_always_false_even_if_write_requests_sets_it_to_true === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_but_write_request_set_to_false_means_SkipLabelNameValidation_is_false === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_means_SkipLabelNameValidation_is_true === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_but_header_not_sent_means_SkipLabelNameValidation_is_false --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour (0.01s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_false (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_always_false_even_if_write_requests_sets_it_to_true (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_but_write_request_set_to_false_means_SkipLabelNameValidation_is_false (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_means_SkipLabelNameValidation_is_true (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_but_header_not_sent_means_SkipLabelNameValidation_is_false (0.00s) === RUN TestNewDistributorMaxWriteMessageSizeErr --- PASS: TestNewDistributorMaxWriteMessageSizeErr (0.00s) PASS ok github.com/grafana/mimir/pkg/util/push 1.641s === RUN TestRingServiceDiscovery_WithoutMaxUsedInstances --- PASS: TestRingServiceDiscovery_WithoutMaxUsedInstances (3.01s) === RUN TestRingServiceDiscovery_WithMaxUsedInstances --- PASS: TestRingServiceDiscovery_WithMaxUsedInstances (3.01s) === RUN TestSelectInUseInstances === RUN TestSelectInUseInstances/should_return_the_input_on_empty_list_of_instances === RUN TestSelectInUseInstances/should_return_the_input_on_a_number_of_instances_<_max_instances === RUN TestSelectInUseInstances/should_return_the_input_on_a_number_of_instances_=_max_instances === RUN TestSelectInUseInstances/should_return_a_subset_of_the_input_on_a_number_of_instances_>_max_instances === RUN TestSelectInUseInstances/should_return_the_input_if_max_instances_is_0 --- PASS: TestSelectInUseInstances (0.00s) --- PASS: TestSelectInUseInstances/should_return_the_input_on_empty_list_of_instances (0.00s) --- PASS: TestSelectInUseInstances/should_return_the_input_on_a_number_of_instances_<_max_instances (0.00s) --- PASS: TestSelectInUseInstances/should_return_the_input_on_a_number_of_instances_=_max_instances (0.00s) --- PASS: TestSelectInUseInstances/should_return_a_subset_of_the_input_on_a_number_of_instances_>_max_instances (0.00s) --- PASS: TestSelectInUseInstances/should_return_the_input_if_max_instances_is_0 (0.00s) PASS ok github.com/grafana/mimir/pkg/util/servicediscovery 6.968s ? github.com/grafana/mimir/pkg/util/spanlogger [no test files] ? github.com/grafana/mimir/pkg/util/test [no test files] ? github.com/grafana/mimir/pkg/util/usage [no test files] === RUN TestNewMetadataMetricNameMissingError --- PASS: TestNewMetadataMetricNameMissingError (0.00s) === RUN TestNewMetadataMetricNameTooLongError --- PASS: TestNewMetadataMetricNameTooLongError (0.00s) === RUN TestNewMetadataUnitTooLongError --- PASS: TestNewMetadataUnitTooLongError (0.00s) === RUN TestNewMaxQueryLengthError --- PASS: TestNewMaxQueryLengthError (0.01s) === RUN TestNewTotalMaxQueryLengthError --- PASS: TestNewTotalMaxQueryLengthError (0.00s) === RUN TestNewRequestRateLimitedError --- PASS: TestNewRequestRateLimitedError (0.00s) === RUN TestNewIngestionRateLimitedError --- PASS: TestNewIngestionRateLimitedError (0.00s) === RUN TestOverridesExporter_noConfig --- PASS: TestOverridesExporter_noConfig (0.01s) === RUN TestOverridesExporter_emptyConfig --- PASS: TestOverridesExporter_emptyConfig (0.00s) === RUN TestOverridesExporter_withConfig --- PASS: TestOverridesExporter_withConfig (0.01s) === RUN TestOverridesManager_GetOverrides --- PASS: TestOverridesManager_GetOverrides (0.00s) === RUN TestLimitsLoadingFromYaml --- PASS: TestLimitsLoadingFromYaml (0.01s) === RUN TestLimitsLoadingFromJson --- PASS: TestLimitsLoadingFromJson (0.06s) === RUN TestLimitsTagsYamlMatchJson --- PASS: TestLimitsTagsYamlMatchJson (0.00s) === RUN TestLimitsStringDurationYamlMatchJson --- PASS: TestLimitsStringDurationYamlMatchJson (0.00s) === RUN TestLimitsAlwaysUsesPromDuration --- PASS: TestLimitsAlwaysUsesPromDuration (0.00s) === RUN TestMetricRelabelConfigLimitsLoadingFromYaml --- PASS: TestMetricRelabelConfigLimitsLoadingFromYaml (0.01s) === RUN TestSmallestPositiveIntPerTenant --- PASS: TestSmallestPositiveIntPerTenant (0.00s) === RUN TestSmallestPositiveNonZeroIntPerTenant --- PASS: TestSmallestPositiveNonZeroIntPerTenant (0.00s) === RUN TestSmallestPositiveNonZeroDurationPerTenant --- PASS: TestSmallestPositiveNonZeroDurationPerTenant (0.00s) === RUN TestMaxTotalQueryLengthWithoutDefault --- PASS: TestMaxTotalQueryLengthWithoutDefault (0.00s) === RUN TestMaxTotalQueryLengthWithDefault --- PASS: TestMaxTotalQueryLengthWithDefault (0.00s) === RUN TestAlertmanagerNotificationLimits === RUN TestAlertmanagerNotificationLimits/positive_limit,_negative_burst === RUN TestAlertmanagerNotificationLimits/infinte_limit === RUN TestAlertmanagerNotificationLimits/no_email_specific_limit === RUN TestAlertmanagerNotificationLimits/zero_limit === RUN TestAlertmanagerNotificationLimits/negative_limit --- PASS: TestAlertmanagerNotificationLimits (0.01s) --- PASS: TestAlertmanagerNotificationLimits/positive_limit,_negative_burst (0.00s) --- PASS: TestAlertmanagerNotificationLimits/infinte_limit (0.00s) --- PASS: TestAlertmanagerNotificationLimits/no_email_specific_limit (0.00s) --- PASS: TestAlertmanagerNotificationLimits/zero_limit (0.00s) --- PASS: TestAlertmanagerNotificationLimits/negative_limit (0.00s) === RUN TestAlertmanagerNotificationLimitsOverrides === RUN TestAlertmanagerNotificationLimitsOverrides/no_overrides,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/no_overrides,_email === RUN TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/different_user_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/partial_email_limit_override === RUN TestAlertmanagerNotificationLimitsOverrides/generic_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/generic_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/different_user_override,_pushover --- PASS: TestAlertmanagerNotificationLimitsOverrides (0.02s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/no_overrides,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/no_overrides,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/different_user_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/partial_email_limit_override (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/different_user_override,_pushover (0.00s) === RUN TestCustomTrackerConfigDeserialize --- PASS: TestCustomTrackerConfigDeserialize (0.00s) === RUN TestNotificationLimitsMap === RUN TestNotificationLimitsMap/basic_test === RUN TestNotificationLimitsMap/unknown_integration === RUN TestNotificationLimitsMap/parsing_error --- PASS: TestNotificationLimitsMap (0.01s) --- PASS: TestNotificationLimitsMap/basic_test (0.00s) --- PASS: TestNotificationLimitsMap/unknown_integration (0.00s) --- PASS: TestNotificationLimitsMap/parsing_error (0.00s) === RUN TestNotificationsLimitMapYaml --- PASS: TestNotificationsLimitMapYaml (0.01s) === RUN TestUnknownIntegrationWhenLoadingYaml --- PASS: TestUnknownIntegrationWhenLoadingYaml (0.00s) === RUN TestWrongYamlStructureWhenLoadingYaml --- PASS: TestWrongYamlStructureWhenLoadingYaml (0.00s) === RUN TestUserLimitsHandler === RUN TestUserLimitsHandler/Authenticated_user_with_override === RUN TestUserLimitsHandler/Authenticated_user_without_override === RUN TestUserLimitsHandler/Unauthenticated_user --- PASS: TestUserLimitsHandler (0.02s) --- PASS: TestUserLimitsHandler/Authenticated_user_with_override (0.01s) --- PASS: TestUserLimitsHandler/Authenticated_user_without_override (0.00s) --- PASS: TestUserLimitsHandler/Unauthenticated_user (0.01s) === RUN TestValidateLabels --- PASS: TestValidateLabels (0.01s) === RUN TestValidateExemplars --- PASS: TestValidateExemplars (0.00s) === RUN TestValidateMetadata === RUN TestValidateMetadata/with_a_valid_config === RUN TestValidateMetadata/with_no_metric_name === RUN TestValidateMetadata/with_a_long_metric_name === RUN TestValidateMetadata/with_a_long_help === RUN TestValidateMetadata/with_a_long_UTF-8_help === RUN TestValidateMetadata/with_invalid_long_UTF-8_help === RUN TestValidateMetadata/with_a_long_unit --- PASS: TestValidateMetadata (0.01s) --- PASS: TestValidateMetadata/with_a_valid_config (0.00s) --- PASS: TestValidateMetadata/with_no_metric_name (0.00s) --- PASS: TestValidateMetadata/with_a_long_metric_name (0.00s) --- PASS: TestValidateMetadata/with_a_long_help (0.00s) --- PASS: TestValidateMetadata/with_a_long_UTF-8_help (0.00s) --- PASS: TestValidateMetadata/with_invalid_long_UTF-8_help (0.00s) --- PASS: TestValidateMetadata/with_a_long_unit (0.00s) === RUN TestValidateLabelOrder --- PASS: TestValidateLabelOrder (0.01s) === RUN TestValidateLabelDuplication --- PASS: TestValidateLabelDuplication (0.00s) PASS ok github.com/grafana/mimir/pkg/util/validation 1.291s === RUN TestBuildInfoHandler --- PASS: TestBuildInfoHandler (0.02s) PASS ok github.com/grafana/mimir/pkg/util/version 0.614s ? github.com/grafana/mimir/tools/add-license [no test files] ? github.com/grafana/mimir/tools/compaction-planner [no test files] === RUN TestConfigDescriptorIsUpToDate --- PASS: TestConfigDescriptorIsUpToDate (0.49s) PASS ok github.com/grafana/mimir/tools/config-inspector 3.755s ? github.com/grafana/mimir/tools/doc-generator [no test files] === RUN Test_findFlagsPrefix --- PASS: Test_findFlagsPrefix (0.00s) PASS ok github.com/grafana/mimir/tools/doc-generator/parse 1.685s ? github.com/grafana/mimir/tools/list-deduplicated-blocks [no test files] ? github.com/grafana/mimir/tools/listblocks [no test files] ? github.com/grafana/mimir/tools/markblocks [no test files] ? github.com/grafana/mimir/tools/pre-pull-images [no test files] ? github.com/grafana/mimir/tools/query-step-alignment-analysis [no test files] === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/no_auth === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_no_auth_it_should_forward_the_request_auth === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_an_username_set_it_should_forward_the_request_password_only === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_NOT_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication (0.03s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/no_auth (0.01s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_no_auth_it_should_forward_the_request_auth (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_an_username_set_it_should_forward_the_request_password_only (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_NOT_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth (0.00s) === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_2nd_response_received_but_only_the_last_one_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_1st_response_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_last_response_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/no_received_response_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_1st_response_received === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received_but_it's_not_successful --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream (0.01s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_2nd_response_received_but_only_the_last_one_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_1st_response_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_last_response_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/no_received_response_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_1st_response_received (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received_but_it's_not_successful (0.00s) === RUN Test_ProxyEndpoint_Requests === RUN Test_ProxyEndpoint_Requests/GET-request === RUN Test_ProxyEndpoint_Requests/GET-filter-accept-encoding === RUN Test_ProxyEndpoint_Requests/POST-request-with-body --- PASS: Test_ProxyEndpoint_Requests (0.08s) --- PASS: Test_ProxyEndpoint_Requests/GET-request (0.05s) --- PASS: Test_ProxyEndpoint_Requests/GET-filter-accept-encoding (0.01s) --- PASS: Test_ProxyEndpoint_Requests/POST-request-with-body (0.01s) === RUN Test_backendResponse_succeeded === RUN Test_backendResponse_succeeded/Error_while_executing_request === RUN Test_backendResponse_succeeded/2xx_response_status_code === RUN Test_backendResponse_succeeded/3xx_response_status_code === RUN Test_backendResponse_succeeded/4xx_response_status_code === RUN Test_backendResponse_succeeded/5xx_response_status_code --- PASS: Test_backendResponse_succeeded (0.00s) --- PASS: Test_backendResponse_succeeded/Error_while_executing_request (0.00s) --- PASS: Test_backendResponse_succeeded/2xx_response_status_code (0.00s) --- PASS: Test_backendResponse_succeeded/3xx_response_status_code (0.00s) --- PASS: Test_backendResponse_succeeded/4xx_response_status_code (0.00s) --- PASS: Test_backendResponse_succeeded/5xx_response_status_code (0.00s) === RUN Test_backendResponse_statusCode === RUN Test_backendResponse_statusCode/200_response_status_code === RUN Test_backendResponse_statusCode/503_response_status_code === RUN Test_backendResponse_statusCode/Error_while_executing_request --- PASS: Test_backendResponse_statusCode (0.00s) --- PASS: Test_backendResponse_statusCode/200_response_status_code (0.00s) --- PASS: Test_backendResponse_statusCode/503_response_status_code (0.00s) --- PASS: Test_backendResponse_statusCode/Error_while_executing_request (0.00s) === RUN Test_NewProxy --- PASS: Test_NewProxy (0.00s) === RUN Test_Proxy_RequestsForwarding === RUN Test_Proxy_RequestsForwarding/one_backend_returning_2xx === RUN Test_Proxy_RequestsForwarding/two_backends_without_path_prefix === RUN Test_Proxy_RequestsForwarding/preferred_backend_returns_4xx === RUN Test_Proxy_RequestsForwarding/preferred_backend_returns_5xx === RUN Test_Proxy_RequestsForwarding/non-preferred_backend_returns_5xx === RUN Test_Proxy_RequestsForwarding/one_backend_returning_5xx === RUN Test_Proxy_RequestsForwarding/two_backends_with_the_same_path_prefix === RUN Test_Proxy_RequestsForwarding/two_backends_with_different_path_prefix === RUN Test_Proxy_RequestsForwarding/all_backends_returns_5xx --- PASS: Test_Proxy_RequestsForwarding (0.59s) --- PASS: Test_Proxy_RequestsForwarding/one_backend_returning_2xx (0.37s) --- PASS: Test_Proxy_RequestsForwarding/two_backends_without_path_prefix (0.07s) --- PASS: Test_Proxy_RequestsForwarding/preferred_backend_returns_4xx (0.02s) --- PASS: Test_Proxy_RequestsForwarding/preferred_backend_returns_5xx (0.02s) --- PASS: Test_Proxy_RequestsForwarding/non-preferred_backend_returns_5xx (0.01s) --- PASS: Test_Proxy_RequestsForwarding/one_backend_returning_5xx (0.02s) --- PASS: Test_Proxy_RequestsForwarding/two_backends_with_the_same_path_prefix (0.01s) --- PASS: Test_Proxy_RequestsForwarding/two_backends_with_different_path_prefix (0.04s) --- PASS: Test_Proxy_RequestsForwarding/all_backends_returns_5xx (0.02s) === RUN TestProxy_Passthrough === RUN TestProxy_Passthrough/first_backend_preferred === RUN TestProxy_Passthrough/second_backend_preferred --- PASS: TestProxy_Passthrough (0.05s) --- PASS: TestProxy_Passthrough/first_backend_preferred (0.03s) --- PASS: TestProxy_Passthrough/second_backend_preferred (0.02s) === RUN TestProxyHTTPGRPC === RUN TestProxyHTTPGRPC/HTTP_proxy_connection === RUN TestProxyHTTPGRPC/gRPC_proxy_connection --- PASS: TestProxyHTTPGRPC (0.60s) --- PASS: TestProxyHTTPGRPC/HTTP_proxy_connection (0.10s) --- PASS: TestProxyHTTPGRPC/gRPC_proxy_connection (0.49s) === RUN TestCompareMatrix === RUN TestCompareMatrix/no_metrics === RUN TestCompareMatrix/no_metrics_in_actual_response === RUN TestCompareMatrix/extra_metric_in_actual_response === RUN TestCompareMatrix/same_number_of_metrics_but_with_different_labels === RUN TestCompareMatrix/difference_in_number_of_samples === RUN TestCompareMatrix/difference_in_sample_timestamp === RUN TestCompareMatrix/difference_in_sample_value === RUN TestCompareMatrix/correct_samples --- PASS: TestCompareMatrix (0.02s) --- PASS: TestCompareMatrix/no_metrics (0.00s) --- PASS: TestCompareMatrix/no_metrics_in_actual_response (0.01s) --- PASS: TestCompareMatrix/extra_metric_in_actual_response (0.00s) --- PASS: TestCompareMatrix/same_number_of_metrics_but_with_different_labels (0.00s) --- PASS: TestCompareMatrix/difference_in_number_of_samples (0.00s) --- PASS: TestCompareMatrix/difference_in_sample_timestamp (0.00s) --- PASS: TestCompareMatrix/difference_in_sample_value (0.00s) --- PASS: TestCompareMatrix/correct_samples (0.00s) === RUN TestCompareVector === RUN TestCompareVector/no_metrics === RUN TestCompareVector/no_metrics_in_actual_response === RUN TestCompareVector/extra_metric_in_actual_response === RUN TestCompareVector/same_number_of_metrics_but_with_different_labels === RUN TestCompareVector/difference_in_sample_timestamp === RUN TestCompareVector/difference_in_sample_value === RUN TestCompareVector/correct_samples --- PASS: TestCompareVector (0.01s) --- PASS: TestCompareVector/no_metrics (0.00s) --- PASS: TestCompareVector/no_metrics_in_actual_response (0.00s) --- PASS: TestCompareVector/extra_metric_in_actual_response (0.00s) --- PASS: TestCompareVector/same_number_of_metrics_but_with_different_labels (0.00s) --- PASS: TestCompareVector/difference_in_sample_timestamp (0.00s) --- PASS: TestCompareVector/difference_in_sample_value (0.00s) --- PASS: TestCompareVector/correct_samples (0.00s) === RUN TestCompareScalar === RUN TestCompareScalar/difference_in_timestamp === RUN TestCompareScalar/difference_in_value === RUN TestCompareScalar/correct_values --- PASS: TestCompareScalar (0.00s) --- PASS: TestCompareScalar/difference_in_timestamp (0.00s) --- PASS: TestCompareScalar/difference_in_value (0.00s) --- PASS: TestCompareScalar/correct_values (0.00s) === RUN TestCompareSamplesResponse === RUN TestCompareSamplesResponse/difference_in_response_status === RUN TestCompareSamplesResponse/difference_in_resultType === RUN TestCompareSamplesResponse/unregistered_resultType === RUN TestCompareSamplesResponse/valid_scalar_response === RUN TestCompareSamplesResponse/should_pass_if_values_are_slightly_different_but_within_the_tolerance === RUN TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_disabled === RUN TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_enabled === RUN TestCompareSamplesResponse/should_correctly_compare_Inf_values === RUN TestCompareSamplesResponse/should_correctly_compare_-Inf_values === RUN TestCompareSamplesResponse/should_correctly_compare_+Inf_values === RUN TestCompareSamplesResponse/should_fail_if_values_are_significantly_different,_over_the_tolerance === RUN TestCompareSamplesResponse/should_fail_if_large_values_are_significantly_different,_over_the_tolerance_without_using_relative_error === RUN TestCompareSamplesResponse/should_not_fail_if_large_values_are_significantly_different,_over_the_tolerance_using_relative_error === RUN TestCompareSamplesResponse/should_not_fail_when_the_sample_is_recent_and_configured_to_skip --- PASS: TestCompareSamplesResponse (0.01s) --- PASS: TestCompareSamplesResponse/difference_in_response_status (0.00s) --- PASS: TestCompareSamplesResponse/difference_in_resultType (0.00s) --- PASS: TestCompareSamplesResponse/unregistered_resultType (0.00s) --- PASS: TestCompareSamplesResponse/valid_scalar_response (0.00s) --- PASS: TestCompareSamplesResponse/should_pass_if_values_are_slightly_different_but_within_the_tolerance (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_disabled (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_enabled (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_Inf_values (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_-Inf_values (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_+Inf_values (0.00s) --- PASS: TestCompareSamplesResponse/should_fail_if_values_are_significantly_different,_over_the_tolerance (0.00s) --- PASS: TestCompareSamplesResponse/should_fail_if_large_values_are_significantly_different,_over_the_tolerance_without_using_relative_error (0.00s) --- PASS: TestCompareSamplesResponse/should_not_fail_if_large_values_are_significantly_different,_over_the_tolerance_using_relative_error (0.00s) --- PASS: TestCompareSamplesResponse/should_not_fail_when_the_sample_is_recent_and_configured_to_skip (0.00s) PASS ok github.com/grafana/mimir/tools/querytee 1.935s ? github.com/grafana/mimir/tools/tenant-injector [no test files] ? github.com/grafana/mimir/tools/trafficdump [no test files] ? github.com/grafana/mimir/tools/tsdb-chunks [no test files] ? github.com/grafana/mimir/tools/tsdb-compact [no test files] ? github.com/grafana/mimir/tools/tsdb-index [no test files] ? github.com/grafana/mimir/tools/tsdb-index-health [no test files] ? github.com/grafana/mimir/tools/tsdb-index-toc [no test files] ? github.com/grafana/mimir/tools/tsdb-print-chunk [no test files] ? github.com/grafana/mimir/tools/tsdb-symbols [no test files] ? github.com/grafana/mimir/tools/ulidtime [no test files] FAIL ==> ERROR: A failure occurred in check().  Aborting... ==> ERROR: Build failed, check /var/lib/archbuild/extra-riscv64/felix0/build receiving incremental file list mimir-2.4.0-1-riscv64-build.log mimir-2.4.0-1-riscv64-check.log mimir-2.4.0-1-riscv64-pkgver.log mimir-2.4.0-1-riscv64-prepare.log sent 100 bytes received 140,358 bytes 56,183.20 bytes/sec total size is 1,826,811 speedup is 13.01