==> Building on p ==> Attempt to run pkgver()... ==> Making package: mimir 2.2.0-1 (Thu 25 Aug 2022 12:14:31 AM EEST) ==> Checking runtime dependencies... ==> Checking buildtime dependencies... ==> Retrieving sources...  -> Updating mimir git repo...  -> Found systemd.service  -> Found sysusers.conf  -> Found tmpfiles.conf  -> Found config.yaml ==> Validating source files with b2sums... ==> Extracting sources...  -> Creating working copy of mimir git repo... ==> Starting prepare()... ==> Starting pkgver()... ==> Sources are ready. ==> Checking for remote environment... ==> Syncing package to remote host... sending incremental file list created directory packages/mimir ./ PKGBUILD 2,252 100% 0.00kB/s 0:00:00 2,252 100% 0.00kB/s 0:00:00 (xfr#1, to-chk=5/7) config.yaml 38 100% 37.11kB/s 0:00:00 38 100% 37.11kB/s 0:00:00 (xfr#2, to-chk=4/7) mimir-2.2.0-1.log 1,217 100% 1.16MB/s 0:00:00 1,217 100% 1.16MB/s 0:00:00 (xfr#3, to-chk=3/7) systemd.service 1,011 100% 987.30kB/s 0:00:00 1,011 100% 987.30kB/s 0:00:00 (xfr#4, to-chk=2/7) sysusers.conf 45 100% 43.95kB/s 0:00:00 45 100% 43.95kB/s 0:00:00 (xfr#5, to-chk=1/7) tmpfiles.conf 34 100% 33.20kB/s 0:00:00 34 100% 33.20kB/s 0:00:00 (xfr#6, to-chk=0/7) sent 2,695 bytes received 170 bytes 1,910.00 bytes/sec total size is 4,429 speedup is 1.55 ==> Patching arch to riscv64... ==> Running extra-riscv64-build -- -d /home/felix/packages/riscv64-pkg-cache:/var/cache/pacman/pkg -l felix20 on remote host... [?25l:: Synchronizing package databases... core downloading... extra downloading... community downloading... :: Starting full system upgrade... there is nothing to do [?25h==> Building in chroot for [extra] (riscv64)... ==> Synchronizing chroot copy [/var/lib/archbuild/extra-riscv64/root] -> [felix20]...done ==> Making package: mimir 2.2.0-1 (Wed Aug 24 23:14:47 2022) ==> Retrieving sources...  -> Cloning mimir git repo... Cloning into bare repository '/home/felix/packages/mimir/mimir'... remote: Enumerating objects: 169419, done. remote: Counting objects: 0% (1/1855) remote: Counting objects: 1% (19/1855) remote: Counting objects: 2% (38/1855) remote: Counting objects: 3% (56/1855) remote: Counting objects: 4% (75/1855) remote: Counting objects: 5% (93/1855) remote: Counting objects: 6% (112/1855) remote: Counting objects: 7% (130/1855) remote: Counting objects: 8% (149/1855) remote: Counting objects: 9% (167/1855) remote: Counting objects: 10% (186/1855) remote: Counting objects: 11% (205/1855) remote: Counting objects: 12% (223/1855) remote: Counting objects: 13% (242/1855) remote: Counting objects: 14% (260/1855) remote: Counting objects: 15% (279/1855) remote: Counting objects: 16% (297/1855) remote: Counting objects: 17% (316/1855) remote: Counting objects: 18% (334/1855) remote: Counting objects: 19% (353/1855) remote: Counting objects: 20% (371/1855) remote: Counting objects: 21% (390/1855) remote: Counting objects: 22% (409/1855) remote: Counting objects: 23% (427/1855) remote: Counting objects: 24% (446/1855) remote: Counting objects: 25% (464/1855) remote: Counting objects: 26% (483/1855) remote: Counting objects: 27% (501/1855) remote: Counting objects: 28% (520/1855) remote: Counting objects: 29% (538/1855) remote: Counting objects: 30% (557/1855) remote: Counting objects: 31% (576/1855) remote: Counting objects: 32% (594/1855) remote: Counting objects: 33% (613/1855) remote: Counting objects: 34% (631/1855) remote: Counting objects: 35% (650/1855) remote: Counting objects: 36% (668/1855) remote: Counting objects: 37% (687/1855) remote: Counting objects: 38% (705/1855) remote: Counting objects: 39% (724/1855) remote: Counting objects: 40% (742/1855) remote: Counting objects: 41% (761/1855) remote: Counting objects: 42% (780/1855) remote: Counting objects: 43% (798/1855) remote: Counting objects: 44% (817/1855) remote: Counting objects: 45% (835/1855) remote: Counting objects: 46% (854/1855) remote: Counting objects: 47% (872/1855) remote: Counting objects: 48% (891/1855) remote: Counting objects: 49% (909/1855) remote: Counting objects: 50% (928/1855) remote: Counting objects: 51% (947/1855) remote: Counting objects: 52% (965/1855) remote: Counting objects: 53% (984/1855) remote: Counting objects: 54% (1002/1855) remote: Counting objects: 55% (1021/1855) remote: Counting objects: 56% (1039/1855) remote: Counting objects: 57% (1058/1855) remote: Counting objects: 58% (1076/1855) remote: Counting objects: 59% (1095/1855) remote: Counting objects: 60% (1113/1855) remote: Counting objects: 61% (1132/1855) remote: Counting objects: 62% (1151/1855) remote: Counting objects: 63% (1169/1855) remote: Counting objects: 64% (1188/1855) remote: Counting objects: 65% (1206/1855) remote: Counting objects: 66% (1225/1855) remote: Counting objects: 67% (1243/1855) remote: Counting objects: 68% (1262/1855) remote: Counting objects: 69% (1280/1855) remote: Counting objects: 70% (1299/1855) remote: Counting objects: 71% (1318/1855) remote: Counting objects: 72% (1336/1855) remote: Counting objects: 73% (1355/1855) remote: Counting objects: 74% (1373/1855) remote: Counting objects: 75% (1392/1855) remote: Counting objects: 76% (1410/1855) remote: Counting objects: 77% (1429/1855) remote: Counting objects: 78% (1447/1855) remote: Counting objects: 79% (1466/1855) remote: Counting objects: 80% (1484/1855) remote: Counting objects: 81% (1503/1855) remote: Counting objects: 82% (1522/1855) remote: Counting objects: 83% (1540/1855) remote: Counting objects: 84% (1559/1855) remote: Counting objects: 85% (1577/1855) remote: Counting objects: 86% (1596/1855) remote: Counting objects: 87% (1614/1855) remote: Counting objects: 88% (1633/1855) remote: Counting objects: 89% (1651/1855) remote: Counting objects: 90% (1670/1855) remote: Counting objects: 91% (1689/1855) remote: Counting objects: 92% (1707/1855) remote: Counting objects: 93% (1726/1855) remote: Counting objects: 94% (1744/1855) remote: Counting objects: 95% (1763/1855) remote: Counting objects: 96% (1781/1855) remote: Counting objects: 97% (1800/1855) remote: Counting objects: 98% (1818/1855) remote: Counting objects: 99% (1837/1855) remote: Counting objects: 100% (1855/1855) remote: Counting objects: 100% (1855/1855), done. remote: Compressing objects: 0% (1/805) remote: Compressing objects: 1% (9/805) remote: Compressing objects: 2% (17/805) remote: Compressing objects: 3% (25/805) remote: Compressing objects: 4% (33/805) remote: Compressing objects: 5% (41/805) remote: Compressing objects: 6% (49/805) remote: Compressing objects: 7% (57/805) remote: Compressing objects: 8% (65/805) remote: Compressing objects: 9% (73/805) remote: Compressing objects: 10% (81/805) remote: Compressing objects: 11% (89/805) remote: Compressing objects: 12% (97/805) remote: Compressing objects: 13% (105/805) remote: Compressing objects: 14% (113/805) remote: Compressing objects: 15% (121/805) remote: Compressing objects: 16% (129/805) remote: Compressing objects: 17% (137/805) remote: Compressing objects: 18% (145/805) remote: Compressing objects: 19% (153/805) remote: Compressing objects: 20% (161/805) remote: Compressing objects: 21% (170/805) remote: Compressing objects: 22% (178/805) remote: Compressing objects: 23% (186/805) remote: Compressing objects: 24% (194/805) remote: Compressing objects: 25% (202/805) remote: Compressing objects: 26% (210/805) remote: Compressing objects: 27% (218/805) remote: Compressing objects: 28% (226/805) remote: Compressing objects: 29% (234/805) remote: Compressing objects: 30% (242/805) remote: Compressing objects: 31% (250/805) remote: Compressing objects: 32% (258/805) remote: Compressing objects: 33% (266/805) remote: Compressing objects: 34% (274/805) remote: Compressing objects: 35% (282/805) remote: Compressing objects: 36% (290/805) remote: Compressing objects: 37% (298/805) remote: Compressing objects: 38% (306/805) remote: Compressing objects: 39% (314/805) remote: Compressing objects: 40% (322/805) remote: Compressing objects: 41% (331/805) remote: Compressing objects: 42% (339/805) remote: Compressing objects: 43% (347/805) remote: Compressing objects: 44% (355/805) remote: Compressing objects: 45% (363/805) remote: Compressing objects: 46% (371/805) remote: Compressing objects: 47% (379/805) remote: Compressing objects: 48% (387/805) remote: Compressing objects: 49% (395/805) remote: Compressing objects: 50% (403/805) remote: Compressing objects: 51% (411/805) remote: Compressing objects: 52% (419/805) remote: Compressing objects: 53% (427/805) remote: Compressing objects: 54% (435/805) remote: Compressing objects: 55% (443/805) remote: Compressing objects: 56% (451/805) remote: Compressing objects: 57% (459/805) remote: Compressing objects: 58% (467/805) remote: Compressing objects: 59% (475/805) remote: Compressing objects: 60% (483/805) remote: Compressing objects: 61% (492/805) remote: Compressing objects: 62% (500/805) remote: Compressing objects: 63% (508/805) remote: Compressing objects: 64% (516/805) remote: Compressing objects: 65% (524/805) remote: Compressing objects: 66% (532/805) remote: Compressing objects: 67% (540/805) remote: Compressing objects: 68% (548/805) remote: Compressing objects: 69% (556/805) remote: Compressing objects: 70% (564/805) remote: Compressing objects: 71% (572/805) remote: Compressing objects: 72% (580/805) remote: Compressing objects: 73% (588/805) remote: Compressing objects: 74% (596/805) remote: Compressing objects: 75% (604/805) remote: Compressing objects: 76% (612/805) remote: Compressing objects: 77% (620/805) remote: Compressing objects: 78% (628/805) remote: Compressing objects: 79% (636/805) remote: Compressing objects: 80% (644/805) remote: Compressing objects: 81% (653/805) remote: Compressing objects: 82% (661/805) remote: Compressing objects: 83% (669/805) remote: Compressing objects: 84% (677/805) remote: Compressing objects: 85% (685/805) remote: Compressing objects: 86% (693/805) remote: Compressing objects: 87% (701/805) remote: Compressing objects: 88% (709/805) remote: Compressing objects: 89% (717/805) remote: Compressing objects: 90% (725/805) remote: Compressing objects: 91% (733/805) remote: Compressing objects: 92% (741/805) remote: Compressing objects: 93% (749/805) remote: Compressing objects: 94% (757/805) remote: Compressing objects: 95% (765/805) remote: Compressing objects: 96% (773/805) remote: Compressing objects: 97% (781/805) remote: Compressing objects: 98% (789/805) remote: Compressing objects: 99% (797/805) remote: Compressing objects: 100% (805/805) remote: Compressing objects: 100% (805/805), done. Receiving objects: 0% (1/169419) Receiving objects: 1% (1695/169419) Receiving objects: 2% (3389/169419) Receiving objects: 3% (5083/169419) Receiving objects: 4% (6777/169419) Receiving objects: 5% (8471/169419) Receiving objects: 6% (10166/169419), 7.51 MiB | 15.00 MiB/s Receiving objects: 7% (11860/169419), 7.51 MiB | 15.00 MiB/s Receiving objects: 8% (13554/169419), 7.51 MiB | 15.00 MiB/s Receiving objects: 9% (15248/169419), 7.51 MiB | 15.00 MiB/s Receiving objects: 9% (16465/169419), 7.51 MiB | 15.00 MiB/s Receiving objects: 10% (16942/169419), 16.58 MiB | 16.57 MiB/s Receiving objects: 11% (18637/169419), 16.58 MiB | 16.57 MiB/s Receiving objects: 12% (20331/169419), 16.58 MiB | 16.57 MiB/s Receiving objects: 13% (22025/169419), 16.58 MiB | 16.57 MiB/s Receiving objects: 14% (23719/169419), 16.58 MiB | 16.57 MiB/s Receiving objects: 15% (25413/169419), 27.58 MiB | 18.38 MiB/s Receiving objects: 16% (27108/169419), 27.58 MiB | 18.38 MiB/s Receiving objects: 17% (28802/169419), 27.58 MiB | 18.38 MiB/s Receiving objects: 18% (30496/169419), 27.58 MiB | 18.38 MiB/s Receiving objects: 19% (32190/169419), 27.58 MiB | 18.38 MiB/s Receiving objects: 20% (33884/169419), 27.58 MiB | 18.38 MiB/s Receiving objects: 21% (35578/169419), 27.58 MiB | 18.38 MiB/s Receiving objects: 22% (37273/169419), 27.58 MiB | 18.38 MiB/s Receiving objects: 22% (38697/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 23% (38967/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 24% (40661/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 25% (42355/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 26% (44049/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 27% (45744/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 28% (47438/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 29% (49132/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 30% (50826/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 31% (52520/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 32% (54215/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 33% (55909/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 34% (57603/169419), 38.48 MiB | 19.24 MiB/s Receiving objects: 35% (59297/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 36% (60991/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 37% (62686/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 38% (64380/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 39% (66074/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 40% (67768/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 41% (69462/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 42% (71156/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 43% (72851/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 43% (74144/169419), 49.41 MiB | 19.36 MiB/s Receiving objects: 44% (74545/169419), 60.79 MiB | 19.92 MiB/s Receiving objects: 45% (76239/169419), 60.79 MiB | 19.92 MiB/s Receiving objects: 46% (77933/169419), 72.26 MiB | 20.30 MiB/s Receiving objects: 47% (79627/169419), 72.26 MiB | 20.30 MiB/s Receiving objects: 47% (81186/169419), 72.26 MiB | 20.30 MiB/s Receiving objects: 48% (81322/169419), 72.26 MiB | 20.30 MiB/s Receiving objects: 49% (83016/169419), 72.26 MiB | 20.30 MiB/s Receiving objects: 50% (84710/169419), 72.26 MiB | 20.30 MiB/s Receiving objects: 51% (86404/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 52% (88098/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 53% (89793/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 54% (91487/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 55% (93181/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 56% (94875/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 57% (96569/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 58% (98264/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 59% (99958/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 60% (101652/169419), 83.93 MiB | 20.68 MiB/s Receiving objects: 61% (103346/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 62% (105040/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 63% (106734/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 64% (108429/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 65% (110123/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 66% (111817/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 67% (113511/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 68% (115205/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 69% (116900/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 70% (118594/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 71% (120288/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 72% (121982/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 72% (122141/169419), 95.42 MiB | 20.93 MiB/s Receiving objects: 73% (123676/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 74% (125371/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 75% (127065/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 76% (128759/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 77% (130453/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 78% (132147/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 79% (133842/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 80% (135536/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 81% (137230/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 82% (138924/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 83% (140618/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 84% (142312/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 85% (144007/169419), 107.12 MiB | 21.64 MiB/s Receiving objects: 86% (145701/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 87% (147395/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 88% (149089/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 89% (150783/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 90% (152478/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 91% (154172/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 92% (155866/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 93% (157560/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 94% (159254/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 95% (160949/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 96% (162643/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 97% (164337/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 98% (166031/169419), 119.10 MiB | 22.27 MiB/s Receiving objects: 98% (167186/169419), 131.04 MiB | 22.47 MiB/s Receiving objects: 98% (167186/169419), 155.86 MiB | 23.39 MiB/s Receiving objects: 98% (167188/169419), 168.69 MiB | 23.70 MiB/s Receiving objects: 99% (167725/169419), 180.94 MiB | 23.91 MiB/s remote: Total 169419 (delta 1190), reused 1504 (delta 968), pack-reused 167564 Receiving objects: 100% (169419/169419), 180.94 MiB | 23.91 MiB/s Receiving objects: 100% (169419/169419), 182.38 MiB | 22.34 MiB/s, done. Resolving deltas: 0% (0/115838) Resolving deltas: 1% (1159/115838) Resolving deltas: 2% (2319/115838) Resolving deltas: 3% (3478/115838) Resolving deltas: 4% (4634/115838) Resolving deltas: 5% (5793/115838) Resolving deltas: 6% (6951/115838) Resolving deltas: 7% (8109/115838) Resolving deltas: 8% (9268/115838) Resolving deltas: 9% (10427/115838) Resolving deltas: 10% (11585/115838) Resolving deltas: 11% (12743/115838) Resolving deltas: 12% (13901/115838) Resolving deltas: 13% (15060/115838) Resolving deltas: 14% (16218/115838) Resolving deltas: 15% (17376/115838) Resolving deltas: 16% (18536/115838) Resolving deltas: 17% (19693/115838) Resolving deltas: 18% (20851/115838) Resolving deltas: 19% (22010/115838) Resolving deltas: 20% (23169/115838) Resolving deltas: 21% (24326/115838) Resolving deltas: 22% (25485/115838) Resolving deltas: 23% (26644/115838) Resolving deltas: 24% (27803/115838) Resolving deltas: 25% (28961/115838) Resolving deltas: 26% (30118/115838) Resolving deltas: 27% (31279/115838) Resolving deltas: 28% (32435/115838) Resolving deltas: 29% (33595/115838) Resolving deltas: 30% (34753/115838) Resolving deltas: 31% (35910/115838) Resolving deltas: 32% (37069/115838) Resolving deltas: 33% (38230/115838) Resolving deltas: 34% (39386/115838) Resolving deltas: 35% (40544/115838) Resolving deltas: 36% (41702/115838) Resolving deltas: 37% (42864/115838) Resolving deltas: 38% (44019/115838) Resolving deltas: 39% (45177/115838) Resolving deltas: 40% (46336/115838) Resolving deltas: 41% (47494/115838) Resolving deltas: 42% (48652/115838) Resolving deltas: 43% (49811/115838) Resolving deltas: 44% (50969/115838) Resolving deltas: 45% (52128/115838) Resolving deltas: 46% (53286/115838) Resolving deltas: 47% (54444/115838) Resolving deltas: 48% (55604/115838) Resolving deltas: 49% (56761/115838) Resolving deltas: 50% (57919/115838) Resolving deltas: 51% (59078/115838) Resolving deltas: 52% (60236/115838) Resolving deltas: 53% (61396/115838) Resolving deltas: 54% (62553/115838) Resolving deltas: 55% (63712/115838) Resolving deltas: 56% (64870/115838) Resolving deltas: 57% (66028/115838) Resolving deltas: 58% (67187/115838) Resolving deltas: 59% (68345/115838) Resolving deltas: 60% (69503/115838) Resolving deltas: 61% (70662/115838) Resolving deltas: 62% (71820/115838) Resolving deltas: 63% (72978/115838) Resolving deltas: 64% (74137/115838) Resolving deltas: 65% (75295/115838) Resolving deltas: 66% (76454/115838) Resolving deltas: 67% (77612/115838) Resolving deltas: 68% (78770/115838) Resolving deltas: 69% (79929/115838) Resolving deltas: 70% (81087/115838) Resolving deltas: 71% (82246/115838) Resolving deltas: 72% (83404/115838) Resolving deltas: 73% (84562/115838) Resolving deltas: 74% (85721/115838) Resolving deltas: 75% (86880/115838) Resolving deltas: 76% (88038/115838) Resolving deltas: 77% (89196/115838) Resolving deltas: 78% (90354/115838) Resolving deltas: 79% (91514/115838) Resolving deltas: 80% (92671/115838) Resolving deltas: 81% (93829/115838) Resolving deltas: 81% (94967/115838) Resolving deltas: 82% (94988/115838) Resolving deltas: 83% (96148/115838) Resolving deltas: 84% (97304/115838) Resolving deltas: 85% (98463/115838) Resolving deltas: 86% (99621/115838) Resolving deltas: 87% (100782/115838) Resolving deltas: 88% (101938/115838) Resolving deltas: 89% (103096/115838) Resolving deltas: 90% (104255/115838) Resolving deltas: 91% (105414/115838) Resolving deltas: 92% (106573/115838) Resolving deltas: 93% (107735/115838) Resolving deltas: 94% (108888/115838) Resolving deltas: 95% (110047/115838) Resolving deltas: 96% (111205/115838) Resolving deltas: 97% (112364/115838) Resolving deltas: 98% (113522/115838) Resolving deltas: 99% (114680/115838) Resolving deltas: 100% (115838/115838) Resolving deltas: 100% (115838/115838), done.  -> Found systemd.service  -> Found sysusers.conf  -> Found tmpfiles.conf  -> Found config.yaml ==> Validating source files with b2sums... mimir ... Skipped systemd.service ... Passed sysusers.conf ... Passed tmpfiles.conf ... Passed config.yaml ... Passed ==> Making package: mimir 2.2.0-1 (Wed Aug 24 23:15:06 2022) ==> Checking runtime dependencies... ==> Checking buildtime dependencies... ==> Installing missing dependencies... [?25lresolving dependencies... looking for conflicting packages... Package (5) New Version Net Change extra/perl-error 0.17029-4 0.04 MiB extra/perl-mailtools 2.21-6 0.11 MiB extra/perl-timedate 2.33-4 0.08 MiB extra/git 2.37.2-1 30.55 MiB community/go 2:1.19-1 434.27 MiB Total Installed Size: 465.05 MiB :: Proceed with installation? [Y/n] checking keyring... checking package integrity... loading package files... checking for file conflicts... :: Processing package changes... installing perl-error... installing perl-timedate... installing perl-mailtools... installing git... Optional dependencies for git tk: gitk and git gui perl-libwww: git svn perl-term-readkey: git svn and interactive.singlekey setting perl-io-socket-ssl: git send-email TLS support perl-authen-sasl: git send-email TLS support perl-mediawiki-api: git mediawiki support perl-datetime-format-iso8601: git mediawiki support perl-lwp-protocol-https: git mediawiki https support perl-cgi: gitweb (web interface) support python: git svn & git p4 subversion: git svn org.freedesktop.secrets: keyring credential helper libsecret: libsecret credential helper [installed] installing go... :: Running post-transaction hooks... (1/1) Warn about old perl modules [?25h==> Retrieving sources...  -> Found systemd.service  -> Found sysusers.conf  -> Found tmpfiles.conf  -> Found config.yaml ==> WARNING: Skipping all source file integrity checks. ==> Extracting sources...  -> Creating working copy of mimir git repo... Cloning into 'mimir'... done. Switched to a new branch 'makepkg' ==> Starting prepare()... ==> Starting pkgver()... ==> Starting build()... all modules verified vendor/golang.org/x/crypto/cryptobyte/asn1 internal/nettrace internal/goos internal/unsafeheader vendor/golang.org/x/crypto/internal/subtle internal/itoa container/list math/bits unicode/utf8 encoding unicode/utf16 google.golang.org/protobuf/internal/flags internal/race internal/goarch crypto/subtle github.com/dennwc/varint go.opencensus.io go.opencensus.io/trace/internal google.golang.org/grpc/attributes google.golang.org/grpc/serviceconfig internal/goexperiment github.com/googleapis/gax-go/v2/internal golang.org/x/sys/internal/unsafeheader go.opentelemetry.io/otel/sdk/instrumentation golang.org/x/xerrors/internal crypto/internal/subtle unicode internal/cpu runtime/internal/syscall runtime/internal/atomic crypto/internal/boring/sig sync/atomic go.opencensus.io/internal/tagencoding github.com/weaveworks/common/errors github.com/uber/jaeger-client-go/internal/baggage github.com/uber/jaeger-client-go/internal/reporterstats internal/abi runtime/internal/math runtime/internal/sys github.com/uber/jaeger-client-go/internal/throttler github.com/aws/aws-sdk-go-v2/internal/sdkio github.com/aws/aws-sdk-go-v2 github.com/dgryski/go-rendezvous golang.org/x/net/internal/iana github.com/aws/aws-sdk-go/aws/client/metadata github.com/prometheus/prometheus/tsdb/goversion github.com/grafana/dskit/internal/math github.com/grafana/dskit/ring/util go.mongodb.org/mongo-driver/bson/bsonoptions go.mongodb.org/mongo-driver/bson/bsontype go.opentelemetry.io/otel/metric/unit github.com/segmentio/fasthash/fnv1a image/color github.com/golang/groupcache/lru google.golang.org/protobuf/internal/set math go.opentelemetry.io/otel/metric/instrument internal/bytealg runtime github.com/aws/aws-sdk-go/internal/sdkmath github.com/prometheus/prometheus/model/value go.opentelemetry.io/otel/internal internal/reflectlite runtime/metrics sync internal/singleflight internal/sysinfo google.golang.org/protobuf/internal/pragma google.golang.org/grpc/internal/grpcsync internal/testlog google.golang.org/grpc/internal/buffer github.com/aws/aws-sdk-go-v2/internal/sync/singleflight github.com/vimeo/galaxycache/singleflight github.com/golang/groupcache/singleflight github.com/josharian/intern github.com/aws/aws-sdk-go/internal/sync/singleflight math/rand runtime/cgo errors sort github.com/go-redis/redis/v8/internal/rand github.com/vimeo/galaxycache/promoter path internal/oserror io github.com/hashicorp/golang-lru/simplelru golang.org/x/crypto/cast5 vendor/golang.org/x/net/dns/dnsmessage strconv crypto/internal/nistec/fiat syscall github.com/gogo/protobuf/sortkeys container/heap github.com/beorn7/perks/quantile hash crypto/internal/randutil github.com/dimchansky/utfbom github.com/aws/smithy-go/transport/http/internal/io text/tabwriter github.com/aws/aws-sdk-go/internal/sdkio bytes strings hash/crc32 hash/fnv hash/adler32 crypto/rc4 github.com/go-redis/redis/v8/internal/util golang.org/x/crypto/openpgp/errors encoding/base32 crypto golang.org/x/crypto/blowfish reflect golang.org/x/text/transform github.com/aws/smithy-go/io vendor/golang.org/x/text/transform golang.org/x/crypto/openpgp/s2k net/http/internal/ascii net/http/internal/testcert github.com/prometheus/common/internal/bitbucket.org/ww/goautoneg google.golang.org/grpc/encoding cloud.google.com/go/internal/version github.com/aws/aws-sdk-go-v2/internal/strings bufio github.com/go-redis/redis/v8/internal/hashtag github.com/aws/aws-sdk-go/internal/sdkuri github.com/thanos-io/thanos/pkg/strutil html github.com/aws/aws-sdk-go/internal/strings github.com/grafana/regexp/syntax github.com/hashicorp/go-immutable-radix regexp/syntax internal/syscall/execenv internal/syscall/unix time golang.org/x/text/width crypto/internal/nistec compress/bzip2 image regexp github.com/grafana/regexp image/internal/imageutil google.golang.org/grpc/backoff google.golang.org/grpc/internal/grpcrand context github.com/aws/aws-sdk-go-v2/internal/timeconv github.com/prometheus/prometheus/model/timestamp google.golang.org/grpc/keepalive github.com/jpillora/backoff github.com/vimeo/galaxycache/lru io/fs github.com/aws/aws-sdk-go/internal/sdkrand github.com/aws/smithy-go/ptr go.uber.org/zap/buffer github.com/weaveworks/common/mtime internal/poll image/jpeg google.golang.org/grpc/internal/backoff go.uber.org/zap/internal/bufferpool github.com/facette/natsort google.golang.org/api/internal/third_party/uritemplates encoding/binary github.com/hashicorp/errwrap internal/fmtsort github.com/modern-go/reflect2 go.opentelemetry.io/otel/internal/baggage google.golang.org/grpc/tap github.com/prometheus/prometheus/util/gate golang.org/x/net/context github.com/aws/aws-sdk-go-v2/internal/sdk golang.org/x/sync/semaphore github.com/go-logr/logr github.com/cenkalti/backoff/v4 embed os crypto/md5 github.com/vimeo/galaxycache/consistenthash vendor/golang.org/x/crypto/internal/poly1305 github.com/cespare/xxhash/v2 encoding/base64 github.com/cespare/xxhash vendor/golang.org/x/crypto/curve25519/internal/field golang.org/x/crypto/blake2b crypto/internal/edwards25519/field github.com/golang/snappy crypto/cipher golang.org/x/sys/unix github.com/grafana/dskit/ring/shard github.com/minio/md5-simd encoding/pem golang.org/x/crypto/openpgp/armor golang.org/x/crypto/argon2 github.com/grafana/dskit/grpcencoding/snappy crypto/internal/edwards25519 crypto/des vendor/golang.org/x/crypto/chacha20 golang.org/x/crypto/pkcs12/internal/rc2 crypto/internal/boring internal/godebug io/ioutil internal/lazyregexp go.uber.org/zap/internal/exit google.golang.org/protobuf/internal/detrand google.golang.org/grpc/internal/envconfig os/signal path/filepath fmt crypto/hmac crypto/sha512 crypto/sha256 crypto/aes crypto/sha1 internal/intern vendor/golang.org/x/crypto/chacha20poly1305 github.com/prometheus/procfs/internal/util vendor/golang.org/x/crypto/hkdf github.com/minio/sha256-simd github.com/grafana/mimir/pkg/util/fs github.com/aws/aws-sdk-go/internal/shareddefaults github.com/spf13/afero/mem os/exec net/netip log flag github.com/pkg/errors encoding/hex github.com/go-logfmt/logfmt vendor/golang.org/x/crypto/curve25519 runtime/trace github.com/prometheus/procfs/internal/fs net/url google.golang.org/protobuf/internal/errors google.golang.org/protobuf/internal/version github.com/prometheus/prometheus/tsdb/errors mime github.com/thanos-io/thanos/pkg/errutil github.com/opentracing/opentracing-go/log net/http/internal mime/quotedprintable go.uber.org/goleak/internal/stack go/token github.com/pmezard/go-difflib/difflib compress/flate encoding/json runtime/debug vendor/golang.org/x/net/http2/hpack vendor/golang.org/x/text/unicode/norm math/big gopkg.in/yaml.v3 text/template/parse google.golang.org/grpc/internal/grpclog google.golang.org/grpc/metadata google.golang.org/grpc/codes golang.org/x/net/http2/hpack github.com/go-logr/logr/funcr golang.org/x/text/unicode/norm os/user net encoding/xml database/sql/driver google.golang.org/protobuf/encoding/protowire github.com/mitchellh/go-homedir github.com/davecgh/go-spew/spew go.uber.org/goleak github.com/prometheus/prometheus/tsdb/chunkenc vendor/golang.org/x/text/unicode/bidi github.com/prometheus/prometheus/tsdb/fileutil github.com/prometheus/prometheus/tsdb/encoding golang.org/x/net/internal/timeseries golang.org/x/text/unicode/bidi cloud.google.com/go/internal/optional gopkg.in/yaml.v2 google.golang.org/grpc/internal/balancerload github.com/grpc-ecosystem/go-grpc-middleware/v2/util/metautils google.golang.org/grpc/internal/grpcutil go.opencensus.io/internal go.opencensus.io/trace/tracestate go.opentelemetry.io/otel/baggage testing google.golang.org/protobuf/reflect/protoreflect golang.org/x/xerrors google.golang.org/api/iterator go.opencensus.io/resource github.com/grafana/dskit/services github.com/uber/jaeger-client-go/log github.com/uber/jaeger-lib/metrics github.com/modern-go/concurrent github.com/aws/smithy-go/logging compress/gzip compress/zlib github.com/aws/smithy-go github.com/aws/aws-sdk-go-v2/aws/ratelimit github.com/go-logr/stdr github.com/aws/aws-sdk-go-v2/feature/ec2/imds/internal/config github.com/aws/smithy-go/encoding github.com/aws/aws-sdk-go-v2/internal/ini gopkg.in/ini.v1 github.com/alecthomas/units go.opencensus.io/metric/metricdata github.com/aws/smithy-go/middleware github.com/go-redis/redis/v8/internal github.com/go-redis/redis/v8/internal/hscan github.com/go-redis/redis/v8/internal/proto golang.org/x/net/bpf github.com/alecthomas/template/parse github.com/go-kit/log text/template github.com/prometheus/common/model github.com/prometheus/prometheus/model/labels go.uber.org/atomic google.golang.org/grpc/grpclog go.opentelemetry.io/otel/attribute go.opentelemetry.io/otel/codes github.com/Azure/go-autorest/autorest/date golang.org/x/text/secure/bidirule vendor/golang.org/x/text/secure/bidirule runtime/pprof github.com/gogo/protobuf/proto go.opencensus.io/metric/metricproducer github.com/sirupsen/logrus github.com/uber/jaeger-client-go/internal/spanlog internal/profile google.golang.org/protobuf/internal/encoding/messageset google.golang.org/protobuf/internal/strs google.golang.org/protobuf/internal/genid google.golang.org/protobuf/internal/order google.golang.org/protobuf/runtime/protoiface vendor/golang.org/x/net/idna google.golang.org/protobuf/internal/descfmt google.golang.org/protobuf/internal/descopts github.com/aws/aws-sdk-go-v2/aws/protocol/restjson github.com/aws/aws-sdk-go-v2/aws/protocol/xml google.golang.org/grpc/connectivity github.com/minio/minio-go/v7/pkg/lifecycle github.com/minio/minio-go/v7/pkg/sse github.com/go-kit/log/level google.golang.org/protobuf/reflect/protoregistry golang.org/x/net/idna crypto/rand crypto/elliptic crypto/internal/boring/bbig encoding/asn1 crypto/dsa github.com/prometheus/prometheus/model/exemplar go.opentelemetry.io/otel/trace github.com/json-iterator/go google.golang.org/protobuf/internal/encoding/text google.golang.org/protobuf/internal/encoding/json github.com/aws/smithy-go/time github.com/aws/smithy-go/document github.com/aws/smithy-go/encoding/xml github.com/minio/minio-go/v7/pkg/tags github.com/stretchr/objx go/scanner github.com/alecthomas/template go/doc/comment golang.org/x/sync/errgroup github.com/thanos-io/thanos/pkg/runutil crypto/ed25519 crypto/rsa go.opencensus.io/trace github.com/aws/aws-sdk-go-v2/internal/rand go.opencensus.io/tag github.com/aws/smithy-go/rand github.com/klauspost/compress/s2 google.golang.org/protobuf/proto github.com/aws/aws-sdk-go-v2/service/sso/types github.com/aws/aws-sdk-go-v2/service/sts/types github.com/rs/xid github.com/thanos-io/thanos/pkg/store/cache/cachekey html/template github.com/grafana/dskit/backoff golang.org/x/time/rate google.golang.org/grpc/encoding/gzip github.com/prometheus/prometheus/model/textparse github.com/edsrzf/mmap-go go/ast go.opentelemetry.io/otel/internal/trace/noop go.opentelemetry.io/otel/bridge/opentracing/migration github.com/prometheus/prometheus/util/strutil encoding/gob google.golang.org/protobuf/internal/encoding/defval github.com/oklog/ulid github.com/aws/aws-sdk-go/aws/awserr github.com/jmespath/go-jmespath vendor/golang.org/x/crypto/cryptobyte crypto/x509/pkix github.com/prometheus/prometheus/discovery/targetgroup go.opencensus.io/stats/internal github.com/prometheus/prometheus/model/relabel golang.org/x/oauth2/jws github.com/grafana/dskit/multierror github.com/grafana/mimir/pkg/storage/sharding github.com/grafana/mimir/pkg/storegateway/indexheader/fileutil github.com/mattn/go-isatty github.com/minio/minio-go/v7/pkg/replication github.com/coreos/go-semver/semver go.uber.org/multierr go.uber.org/zap/internal/color go.opencensus.io/stats compress/lzw github.com/google/btree github.com/hashicorp/go-multierror github.com/sean-/seed github.com/aws/aws-sdk-go/internal/ini github.com/aws/aws-sdk-go/aws/endpoints github.com/grafana/dskit/runutil github.com/mattn/go-colorable github.com/grafana/dskit/modules github.com/grafana/dskit/concurrency github.com/prometheus/alertmanager/pkg/labels github.com/prometheus/alertmanager/timeinterval github.com/mailru/easyjson/jlexer github.com/hashicorp/golang-lru golang.org/x/crypto/bcrypt go.etcd.io/etcd/api/v3/version google.golang.org/protobuf/encoding/prototext google.golang.org/protobuf/internal/filedesc go.opencensus.io/stats/view github.com/oklog/run github.com/go-openapi/analysis/internal/debug github.com/PuerkitoBio/urlesc crypto/ecdsa go.mongodb.org/mongo-driver/bson/primitive go.uber.org/zap/zapcore github.com/go-stack/stack encoding/csv github.com/go-openapi/runtime/logger github.com/docker/go-units github.com/jessevdk/go-flags github.com/fatih/color github.com/google/pprof/profile github.com/grafana/dskit/limiter github.com/grafana/mimir/pkg/util/globalerror github.com/grafana/mimir/pkg/util/math github.com/prometheus/prometheus/util/pool github.com/grafana/mimir/pkg/ingester/activeseries github.com/thanos-io/thanos/pkg/pool github.com/dustin/go-humanize go/doc github.com/prometheus/prometheus/util/logging github.com/aws/aws-sdk-go/aws/awsutil github.com/PuerkitoBio/purell go.opentelemetry.io/otel/metric/instrument/asyncfloat64 go.opentelemetry.io/otel/metric/instrument/asyncint64 go.opentelemetry.io/otel/metric/instrument/syncfloat64 go.opentelemetry.io/otel/metric/instrument/syncint64 github.com/go-openapi/runtime/flagext github.com/aws/aws-sdk-go/aws/credentials github.com/grafana/mimir/pkg/util/fieldcategory database/sql github.com/rainycape/unidecode github.com/dlclark/regexp2/syntax github.com/mitchellh/colorstring github.com/hashicorp/go-hclog github.com/google/go-querystring/query go.mongodb.org/mongo-driver/x/bsonx/bsoncore golang.org/x/crypto/openpgp/elgamal github.com/vimeo/galaxycache go.opentelemetry.io/otel/metric github.com/grafana/mimir/pkg/storage/chunk github.com/minio/minio-go/v7/pkg/set github.com/gosimple/slug golang.org/x/crypto/openpgp/packet github.com/aws/aws-sdk-go/aws/credentials/processcreds github.com/minio/minio-go/v7/pkg/notification google.golang.org/protobuf/internal/encoding/tag google.golang.org/protobuf/encoding/protojson github.com/grafana/mimir/pkg/querier/iterators github.com/grafana/mimir/pkg/querier/batch github.com/grafana/dskit/kv/codec github.com/gogo/protobuf/protoc-gen-gogo/descriptor github.com/gogo/protobuf/types google.golang.org/protobuf/internal/impl go.mongodb.org/mongo-driver/bson/bsonrw github.com/dlclark/regexp2 golang.org/x/crypto/openpgp github.com/gogo/protobuf/gogoproto github.com/alecthomas/chroma github.com/thanos-io/thanos/pkg/store/labelpb github.com/prometheus/alertmanager/cluster/clusterpb github.com/prometheus/prometheus/prompb archive/tar go.mongodb.org/mongo-driver/bson/bsoncodec github.com/grafana/mimir/pkg/alertmanager/alertspb github.com/alecthomas/chroma/lexers/internal github.com/alecthomas/chroma/formatters/html github.com/alecthomas/chroma/formatters/svg github.com/alecthomas/chroma/styles github.com/prometheus/alertmanager/silence/silencepb github.com/prometheus/alertmanager/nflog/nflogpb github.com/gogo/googleapis/google/rpc github.com/alecthomas/chroma/lexers/j github.com/alecthomas/chroma/lexers/e github.com/alecthomas/chroma/lexers/p github.com/alecthomas/chroma/lexers/f github.com/alecthomas/chroma/lexers/a github.com/alecthomas/chroma/lexers/k github.com/alecthomas/chroma/lexers/l github.com/alecthomas/chroma/lexers/n github.com/alecthomas/chroma/lexers/q github.com/alecthomas/chroma/lexers/b github.com/alecthomas/chroma/lexers/i github.com/alecthomas/chroma/lexers/w github.com/alecthomas/chroma/lexers/x github.com/alecthomas/chroma/lexers/z github.com/alecthomas/chroma/lexers/y github.com/alecthomas/chroma/lexers/t github.com/alecthomas/chroma/lexers/r github.com/alecthomas/chroma/lexers/o github.com/alecthomas/chroma/formatters google.golang.org/protobuf/internal/filetype go.mongodb.org/mongo-driver/bson net/textproto vendor/golang.org/x/net/http/httpproxy google.golang.org/grpc/internal/syscall log/syslog google.golang.org/grpc/stats golang.org/x/net/netutil github.com/minio/minio-go/v7/pkg/s3utils github.com/google/uuid github.com/thanos-io/thanos/pkg/discovery/dns/godns github.com/go-redis/redis/v8/internal/pool github.com/bradfitz/gomemcache/memcache github.com/coreos/go-systemd/v22/journal go.etcd.io/etcd/client/pkg/v3/systemd github.com/prometheus/procfs go.etcd.io/etcd/client/v3/internal/endpoint gopkg.in/alecthomas/kingpin.v2 go.etcd.io/etcd/client/pkg/v3/types github.com/grafana/dskit/netutil github.com/coreos/go-systemd/journal github.com/mailru/easyjson/buffer github.com/hashicorp/go-sockaddr github.com/mitchellh/mapstructure crypto/x509 golang.org/x/net/internal/socket github.com/gofrs/uuid github.com/prometheus/prometheus/util/osutil github.com/alecthomas/chroma/lexers/c github.com/alecthomas/chroma/lexers/d github.com/alecthomas/chroma/lexers/v github.com/mailru/easyjson/jwriter vendor/golang.org/x/net/http/httpguts golang.org/x/net/http/httpguts mime/multipart net/mail github.com/coreos/pkg/capnslog google.golang.org/protobuf/runtime/protoimpl golang.org/x/net/ipv6 golang.org/x/net/ipv4 google.golang.org/protobuf/types/known/timestamppb google.golang.org/protobuf/types/descriptorpb google.golang.org/protobuf/types/known/anypb google.golang.org/protobuf/types/known/durationpb google.golang.org/genproto/googleapis/rpc/code google.golang.org/genproto/googleapis/type/expr google.golang.org/protobuf/types/known/fieldmaskpb google.golang.org/protobuf/types/known/emptypb github.com/coreos/etcd/pkg/fileutil github.com/golang/protobuf/ptypes/empty google.golang.org/genproto/googleapis/rpc/errdetails github.com/golang/protobuf/ptypes/duration github.com/golang/protobuf/ptypes/any google.golang.org/genproto/googleapis/rpc/status github.com/googleapis/gax-go/v2/apierror/internal/proto github.com/golang/protobuf/ptypes/timestamp google.golang.org/protobuf/reflect/protodesc google.golang.org/genproto/googleapis/api/annotations golang.org/x/crypto/pkcs12 github.com/asaskevich/govalidator github.com/golang-jwt/jwt/v4 crypto/tls github.com/thanos-io/thanos/pkg/model github.com/alecthomas/chroma/lexers/h github.com/golang/protobuf/proto google.golang.org/grpc/encoding/proto go.etcd.io/etcd/api/v3/authpb github.com/matttproud/golang_protobuf_extensions/pbutil go.etcd.io/etcd/api/v3/mvccpb github.com/golang/protobuf/ptypes github.com/prometheus/client_model/go go.etcd.io/etcd/api/v3/membershippb google.golang.org/grpc/binarylog/grpc_binarylog_v1 github.com/alecthomas/chroma/lexers/circular github.com/alecthomas/chroma/lexers/g github.com/alecthomas/chroma/lexers/m net/http/httptrace google.golang.org/grpc/internal/credentials google.golang.org/api/transport/cert github.com/hashicorp/go-rootcerts github.com/coreos/etcd/pkg/tlsutil net/smtp github.com/uber/jaeger-client-go/thrift github.com/go-redis/redis/v8 github.com/miekg/dns google.golang.org/grpc/internal/status github.com/prometheus/client_golang/prometheus/internal github.com/alecthomas/chroma/lexers/s google.golang.org/grpc/credentials google.golang.org/grpc/status net/http github.com/weaveworks/common/grpc github.com/gogo/status google.golang.org/grpc/internal/binarylog go.etcd.io/etcd/api/v3/v3rpc/rpctypes google.golang.org/grpc/credentials/insecure google.golang.org/grpc/peer google.golang.org/grpc/resolver google.golang.org/grpc/internal/channelz go.etcd.io/etcd/client/v3/credentials google.golang.org/grpc/balancer/grpclb/state google.golang.org/grpc/internal google.golang.org/grpc/internal/resolver/passthrough google.golang.org/grpc/internal/metadata google.golang.org/grpc/resolver/manual google.golang.org/grpc/internal/transport/networktype github.com/uber/jaeger-client-go/thrift-gen/baggage github.com/uber/jaeger-client-go/thrift-gen/sampling github.com/uber/jaeger-client-go/thrift-gen/jaeger github.com/uber/jaeger-client-go/thrift-gen/zipkincore google.golang.org/grpc/internal/resolver/dns google.golang.org/grpc/internal/resolver/unix go.etcd.io/etcd/client/v3/internal/resolver google.golang.org/grpc/balancer google.golang.org/grpc/internal/serviceconfig google.golang.org/grpc/balancer/base github.com/alecthomas/chroma/lexers google.golang.org/grpc/internal/resolver github.com/alecthomas/chroma/quick google.golang.org/grpc/balancer/roundrobin github.com/uber/jaeger-client-go/thrift-gen/agent github.com/thanos-io/thanos/pkg/discovery/dns/miekgdns expvar github.com/Azure/go-autorest/tracing github.com/mattn/go-ieproxy google.golang.org/api/googleapi/transport github.com/Azure/go-autorest/logger golang.org/x/net/context/ctxhttp go.opencensus.io/trace/propagation github.com/opentracing/opentracing-go go.opentelemetry.io/otel/semconv/internal github.com/prometheus/node_exporter/https cloud.google.com/go/compute/metadata net/http/httptest go.opentelemetry.io/otel/propagation google.golang.org/api/googleapi net/http/pprof net/http/httputil golang.org/x/net/trace github.com/minio/minio-go/v7/pkg/encrypt github.com/felixge/httpsnoop net/http/cookiejar github.com/hashicorp/go-cleanhttp github.com/prometheus/common/expfmt github.com/aws/smithy-go/encoding/httpbinding github.com/julienschmidt/httprouter github.com/minio/minio-go/v7/pkg/signer github.com/gorilla/mux github.com/uber/jaeger-client-go/utils github.com/ncw/swift github.com/aws/aws-sdk-go/aws github.com/aws/aws-sdk-go-v2/aws golang.org/x/net/http2 github.com/armon/go-metrics go.uber.org/zap go.opencensus.io/plugin/ochttp/propagation/b3 github.com/Azure/azure-pipeline-go/pipeline golang.org/x/oauth2/internal google.golang.org/api/transport/http/internal/propagation go.etcd.io/etcd/pkg/transport net/rpc github.com/go-openapi/swag github.com/shurcooL/httpfs/vfsutil go.opentelemetry.io/contrib/propagators/ot go.opentelemetry.io/otel/internal/global github.com/opentracing/opentracing-go/ext go.opentelemetry.io/otel/semconv/v1.10.0 github.com/googleapis/gax-go/v2/apierror github.com/Azure/go-autorest/autorest/adal cloud.google.com/go/internal/trace golang.org/x/net/publicsuffix github.com/prometheus/common/route github.com/stretchr/testify/assert github.com/minio/minio-go/v7/pkg/credentials go.opencensus.io/plugin/ochttp github.com/go-openapi/errors github.com/go-openapi/runtime/middleware/denco github.com/aws/smithy-go/transport/http github.com/go-openapi/runtime/middleware/header github.com/shurcooL/vfsgen github.com/aws/aws-sdk-go/aws/request github.com/rs/cors golang.org/x/oauth2 gopkg.in/telebot.v3 github.com/prometheus/client_golang/prometheus github.com/prometheus/client_golang/prometheus/testutil/promlint github.com/aws/aws-sdk-go-v2/credentials github.com/opentracing-contrib/go-stdlib/nethttp go.opentelemetry.io/otel go.opentelemetry.io/otel/sdk/internal/env github.com/uber/jaeger-client-go github.com/Azure/azure-storage-blob-go/azblob github.com/aws/aws-sdk-go-v2/credentials/processcreds github.com/aws/aws-sdk-go-v2/aws/defaults github.com/aws/aws-sdk-go-v2/aws/signer/internal/v4 github.com/aws/aws-sdk-go-v2/internal/configsources github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 github.com/hashicorp/go-msgpack/codec github.com/prometheus/alertmanager/asset github.com/felixge/fgprof github.com/prometheus/client_golang/api go.opentelemetry.io/otel/bridge/opentracing go.opentelemetry.io/otel/sdk/internal golang.org/x/oauth2/authhandler github.com/hashicorp/serf/coordinate golang.org/x/oauth2/google/internal/externalaccount go.opentelemetry.io/otel/sdk/resource golang.org/x/oauth2/jwt google.golang.org/api/internal/impersonate golang.org/x/oauth2/clientcredentials github.com/aws/aws-sdk-go-v2/aws/middleware github.com/aws/aws-sdk-go-v2/aws/protocol/query go.opentelemetry.io/otel/metric/internal/global github.com/go-openapi/strfmt github.com/go-openapi/jsonpointer github.com/Azure/go-autorest/autorest github.com/Azure/go-autorest/autorest/azure/cli github.com/aws/aws-sdk-go-v2/service/sso/internal/endpoints github.com/aws/aws-sdk-go-v2/service/sts/internal/endpoints github.com/minio/minio-go/v7 go.etcd.io/etcd/client/pkg/v3/logutil go.uber.org/zap/zapgrpc github.com/vimeo/galaxycache/http github.com/aws/aws-sdk-go/aws/client github.com/aws/aws-sdk-go/private/protocol github.com/aws/aws-sdk-go/aws/corehandlers github.com/aws/aws-sdk-go/aws/csm github.com/hashicorp/consul/api github.com/prometheus/client_golang/api/prometheus/v1 github.com/stretchr/testify/require github.com/stretchr/testify/mock github.com/spf13/afero github.com/grafana/mimir/pkg/util/gziphandler github.com/grafana-tools/sdk github.com/google/go-github/v32/github github.com/go-openapi/jsonreference github.com/aws/aws-sdk-go-v2/aws/retry github.com/aws/aws-sdk-go-v2/aws/signer/v4 github.com/aws/aws-sdk-go-v2/aws/transport/http go.opentelemetry.io/otel/metric/global golang.org/x/oauth2/google go.opentelemetry.io/otel/sdk/trace github.com/aws/aws-sdk-go/aws/ec2metadata go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp github.com/go-openapi/spec github.com/aws/aws-sdk-go/private/protocol/query/queryutil github.com/aws/aws-sdk-go/private/protocol/rest github.com/aws/aws-sdk-go/private/protocol/json/jsonutil github.com/aws/aws-sdk-go/private/protocol/xml/xmlutil github.com/prometheus/client_golang/prometheus/promauto github.com/prometheus/client_golang/prometheus/testutil github.com/prometheus/prometheus/tsdb/chunks github.com/prometheus/common/version github.com/weaveworks/promrus github.com/uber/jaeger-lib/metrics/prometheus github.com/prometheus/client_golang/prometheus/promhttp github.com/Azure/go-autorest/autorest/azure github.com/uber/jaeger-client-go/internal/baggage/remote github.com/uber/jaeger-client-go/internal/throttler/remote github.com/uber/jaeger-client-go/rpcmetrics github.com/uber/jaeger-client-go/transport github.com/prometheus/prometheus/util/testutil github.com/aws/aws-sdk-go-v2/feature/ec2/imds google.golang.org/grpc/internal/transport github.com/aws/aws-sdk-go-v2/credentials/endpointcreds/internal/client github.com/aws/aws-sdk-go-v2/service/sso github.com/aws/aws-sdk-go-v2/service/internal/presigned-url github.com/weaveworks/common/logging github.com/mwitkow/go-conntrack github.com/grafana/dskit/flagext github.com/sercand/kuberesolver github.com/thanos-io/thanos/pkg/gate github.com/aws/aws-sdk-go/aws/credentials/ec2rolecreds github.com/aws/aws-sdk-go/private/protocol/query github.com/aws/aws-sdk-go/aws/credentials/endpointcreds github.com/prometheus/prometheus/util/stats github.com/aws/aws-sdk-go/aws/signer/v4 github.com/aws/aws-sdk-go/private/protocol/jsonrpc github.com/prometheus/client_golang/prometheus/push github.com/hashicorp/memberlist github.com/grafana/dskit/runtimeconfig github.com/aws/aws-sdk-go-v2/service/sts github.com/prometheus/alertmanager/api/metrics github.com/uber/jaeger-client-go/config github.com/thanos-io/thanos/pkg/tracing/migration github.com/aws/aws-sdk-go-v2/credentials/endpointcreds github.com/prometheus/alertmanager/types github.com/go-openapi/runtime github.com/grafana/mimir/pkg/util/activitytracker github.com/grafana/mimir/pkg/storegateway/threadpool github.com/prometheus/prometheus/discovery/refresh github.com/prometheus/common/config github.com/grafana/mimir/pkg/util/net github.com/aws/aws-sdk-go/private/protocol/restjson github.com/aws/aws-sdk-go/aws/defaults github.com/aws/aws-sdk-go-v2/credentials/ec2rolecreds github.com/grafana/mimir/pkg/util/process github.com/grafana/mimir/pkg/util/usage github.com/armon/go-metrics/prometheus github.com/prometheus/client_golang/prometheus/collectors github.com/weaveworks/common/signals github.com/weaveworks/common/user github.com/aws/aws-sdk-go/service/sts github.com/aws/aws-sdk-go/service/sns github.com/prometheus/prometheus/tsdb/tsdbutil github.com/Azure/go-autorest/autorest/azure/auth github.com/prometheus/alertmanager/store github.com/prometheus/alertmanager/provider github.com/aws/aws-sdk-go-v2/credentials/ssocreds github.com/prometheus/alertmanager/template github.com/go-openapi/analysis/internal/flatten/normalize github.com/go-openapi/analysis/internal/flatten/operations github.com/go-openapi/analysis/internal/flatten/replace github.com/go-openapi/analysis/internal/flatten/schutils github.com/aws/aws-sdk-go/service/sso github.com/prometheus/alertmanager/ui github.com/weaveworks/common/tracing github.com/grafana/dskit/tenant github.com/go-openapi/runtime/security github.com/prometheus/alertmanager/provider/mem github.com/prometheus/exporter-toolkit/web github.com/prometheus/prometheus/discovery github.com/prometheus/prometheus/storage github.com/go-openapi/analysis/internal/flatten/sortref github.com/weaveworks/common/instrument github.com/grafana/dskit/spanlogger github.com/aws/aws-sdk-go/service/sts/stsiface google.golang.org/grpc github.com/aws/aws-sdk-go/service/sso/ssoiface github.com/prometheus/alertmanager/cluster github.com/go-openapi/analysis github.com/grafana/dskit/kv/consul github.com/aws/aws-sdk-go/aws/credentials/stscreds github.com/aws/aws-sdk-go-v2/credentials/stscreds github.com/aws/aws-sdk-go/aws/credentials/ssocreds github.com/aws/aws-sdk-go-v2/config github.com/grafana/mimir/pkg/storage/lazyquery github.com/grafana/mimir/pkg/storage/series github.com/prometheus/prometheus/tsdb/hashcache github.com/prometheus/prometheus/tsdb/tombstones github.com/prometheus/prometheus/promql/parser github.com/aws/aws-sdk-go/aws/session github.com/prometheus/prometheus/tsdb/index github.com/go-openapi/loads github.com/prometheus/alertmanager/nflog github.com/prometheus/alertmanager/silence github.com/prometheus/prometheus/tsdb/record github.com/go-openapi/runtime/middleware/untyped github.com/go-openapi/validate github.com/prometheus/prometheus/tsdb/wal github.com/prometheus/common/sigv4 github.com/grpc-ecosystem/go-grpc-middleware/v2 github.com/grafana/dskit/crypto/tls google.golang.org/api/internal github.com/grpc-ecosystem/go-grpc-middleware/v2/interceptors github.com/grpc-ecosystem/go-grpc-middleware google.golang.org/grpc/health/grpc_health_v1 github.com/googleapis/gax-go/v2 github.com/opentracing-contrib/go-grpc github.com/weaveworks/common/httpgrpc google.golang.org/genproto/googleapis/iam/v1 go.etcd.io/etcd/api/v3/etcdserverpb github.com/grafana/mimir/pkg/frontend/querymiddleware/astmapper github.com/prometheus/prometheus/config github.com/prometheus/alertmanager/config github.com/thanos-io/thanos/pkg/testutil github.com/grafana/dskit/kv/memberlist google.golang.org/api/transport/internal/dca google.golang.org/api/option github.com/grpc-ecosystem/go-grpc-middleware/v2/interceptors/tags cloud.google.com/go/internal google.golang.org/api/internal/gensupport github.com/grafana/mimir/pkg/mimirtool/version github.com/grafana/dskit/grpcutil github.com/prometheus/prometheus/scrape github.com/prometheus/prometheus/tsdb cloud.google.com/go/iam github.com/grafana/mimir/pkg/api/error github.com/grafana/mimir/pkg/util/httpgrpcutil github.com/grafana/dskit/middleware github.com/grafana/mimir/pkg/querier/stats github.com/grafana/mimir/pkg/alertmanager/alertmanagerpb github.com/grafana/mimir/pkg/scheduler/schedulerpb github.com/weaveworks/common/middleware github.com/thanos-io/thanos/pkg/extprom github.com/grpc-ecosystem/go-grpc-middleware/v2/interceptors/tracing google.golang.org/api/option/internaloption google.golang.org/api/transport/http github.com/grafana/mimir/pkg/alertmanager/alertstore/local github.com/prometheus/alertmanager/inhibit github.com/go-openapi/runtime/middleware github.com/prometheus/alertmanager/api/v2/models github.com/thanos-io/thanos/pkg/discovery/dns github.com/thanos-io/thanos/pkg/discovery/memcache github.com/grafana/mimir/pkg/frontend/v2/frontendv2pb github.com/grafana/mimir/pkg/frontend/v1/frontendv1pb google.golang.org/api/storage/v1 github.com/thanos-io/thanos/pkg/tracing github.com/prometheus/alertmanager/notify github.com/weaveworks/common/httpgrpc/server github.com/grafana/dskit/grpcclient github.com/thanos-io/thanos/pkg/cacheutil github.com/prometheus/prometheus/notifier github.com/prometheus/prometheus/storage/remote github.com/thanos-io/thanos/pkg/objstore github.com/weaveworks/common/server github.com/prometheus/alertmanager/api/v2/restapi/operations/general github.com/prometheus/alertmanager/api/v2/restapi/operations/alertgroup github.com/prometheus/alertmanager/api/v2/restapi/operations/receiver github.com/prometheus/alertmanager/api/v2/restapi/operations/alert github.com/prometheus/alertmanager/api/v2/restapi/operations/silence github.com/prometheus/alertmanager/notify/email github.com/prometheus/alertmanager/notify/pagerduty github.com/prometheus/alertmanager/notify/opsgenie github.com/prometheus/alertmanager/notify/pushover github.com/prometheus/alertmanager/notify/wechat github.com/prometheus/alertmanager/notify/telegram github.com/prometheus/alertmanager/notify/webhook github.com/prometheus/alertmanager/notify/slack github.com/prometheus/alertmanager/notify/victorops github.com/prometheus/alertmanager/notify/sns github.com/prometheus/alertmanager/dispatch github.com/thanos-io/thanos/pkg/objstore/filesystem github.com/thanos-io/thanos/pkg/objstore/azure github.com/thanos-io/thanos/pkg/objstore/swift github.com/thanos-io/thanos/pkg/objstore/s3 github.com/prometheus/alertmanager/api/v2/restapi/operations github.com/prometheus/alertmanager/api/v1 github.com/grafana/mimir/pkg/util/noauth github.com/grafana/mimir/pkg/util/log github.com/thanos-io/thanos/pkg/cache github.com/grafana/mimir/pkg/storage/bucket/filesystem github.com/grafana/mimir/pkg/storage/bucket/swift github.com/prometheus/alertmanager/api/v2/restapi github.com/grafana/mimir/pkg/storage/bucket/azure cloud.google.com/go/storage github.com/grafana/mimir/pkg/util/spanlogger github.com/grafana/mimir/pkg/util/instrumentation github.com/grafana/mimir/tools/querytee github.com/grafana/mimir/pkg/util github.com/grafana/mimir/pkg/querier/tenantfederation github.com/grafana/mimir/pkg/storegateway/indexcache github.com/grafana/mimir/pkg/continuoustest github.com/prometheus/alertmanager/api/v2 github.com/grafana/mimir/cmd/query-tee github.com/prometheus/prometheus/util/teststorage github.com/grafana/mimir/pkg/mimirtool/backfill github.com/thanos-io/thanos/pkg/block/metadata github.com/grafana/mimir/pkg/storage/bucket/s3 github.com/grafana/mimir/pkg/util/version github.com/grafana/mimir/pkg/frontend/transport github.com/grafana/mimir/pkg/scheduler/queue github.com/grafana/mimir/pkg/frontend/v2 github.com/grafana/mimir/pkg/cache github.com/grafana/mimir/cmd/mimir-continuous-test github.com/grafana/mimir/pkg/alertmanager/merger github.com/prometheus/alertmanager/api github.com/thanos-io/thanos/pkg/block github.com/prometheus/prometheus/promql go.etcd.io/etcd/client/v3 github.com/thanos-io/thanos/pkg/objstore/gcs github.com/grafana/mimir/pkg/storage/tsdb/bucketcache github.com/grafana/mimir/pkg/storage/bucket/gcs github.com/thanos-io/thanos/pkg/shipper github.com/thanos-io/thanos/pkg/compact/downsample github.com/grafana/mimir/pkg/storegateway/indexheader github.com/grafana/mimir/pkg/storage/bucket github.com/grafana/mimir/pkg/querier/engine github.com/prometheus/prometheus/template github.com/prometheus/prometheus/util/httputil github.com/grafana/mimir/pkg/mimirpb github.com/thanos-io/thanos/pkg/store/storepb/prompb github.com/grafana/mimir/pkg/alertmanager/alertstore/bucketclient github.com/grafana/dskit/kv/etcd github.com/grafana/mimir/pkg/alertmanager/alertstore github.com/prometheus/prometheus/model/rulefmt github.com/grafana/dskit/kv github.com/grafana/mimir/pkg/mimirtool/rules/rwrulefmt github.com/prometheus/prometheus/rules github.com/thanos-io/thanos/pkg/store/storepb github.com/grafana/mimir/pkg/util/extract github.com/grafana/mimir/pkg/distributor/distributorpb github.com/grafana/mimir/pkg/util/push github.com/grafana/mimir/pkg/ruler/rulespb github.com/grafana/mimir/pkg/ingester/client github.com/grafana/mimir/pkg/mimirtool/client github.com/grafana/mimir/pkg/mimirtool/analyze github.com/grafana/mimir/pkg/mimirtool/rules github.com/grafana/mimir/pkg/util/validation github.com/grafana/mimir/pkg/mimirtool/printer github.com/grafana/dskit/ring github.com/grafana/mimir/pkg/ruler/rulestore/local github.com/prometheus/prometheus/web/api/v1 github.com/grafana/mimir/pkg/distributor/forwarding github.com/grafana/mimir/pkg/frontend/v1 github.com/grafana/mimir/pkg/scheduler github.com/grafana/mimir/pkg/frontend/querymiddleware github.com/grafana/mimir/pkg/ruler/rulestore github.com/grafana/mimir/pkg/storegateway/storegatewaypb github.com/thanos-io/thanos/pkg/store/hintspb github.com/grafana/mimir/pkg/ruler/rulestore/bucketclient github.com/grafana/dskit/ring/client github.com/grafana/mimir/pkg/util/chunkcompat github.com/grafana/mimir/pkg/util/limiter github.com/grafana/mimir/pkg/storage/tsdb github.com/grafana/mimir/pkg/querier/worker github.com/grafana/mimir/pkg/distributor github.com/grafana/mimir/pkg/alertmanager github.com/grafana/mimir/pkg/frontend github.com/grafana/mimir/pkg/purger github.com/grafana/mimir/pkg/storage/tsdb/bucketindex github.com/grafana/mimir/cmd/metaconvert github.com/grafana/mimir/pkg/ingester github.com/grafana/mimir/pkg/util/listblocks github.com/grafana/mimir/pkg/compactor github.com/grafana/mimir/pkg/storegateway github.com/grafana/mimir/pkg/flusher github.com/grafana/mimir/pkg/querier github.com/grafana/mimir/pkg/ruler github.com/grafana/mimir/tools/doc-generator/parse github.com/grafana/mimir/pkg/api github.com/grafana/mimir/pkg/mimirtool/config github.com/grafana/mimir/pkg/mimir github.com/grafana/mimir/pkg/mimirtool/commands github.com/grafana/mimir/cmd/mimir github.com/grafana/mimir/cmd/mimirtool ==> Starting check()... === RUN TestConvertTenantBlocks --- PASS: TestConvertTenantBlocks (0.02s) === RUN TestConvertTenantBlocksDryMode --- PASS: TestConvertTenantBlocksDryMode (0.00s) PASS ok github.com/grafana/mimir/cmd/metaconvert 0.637s === RUN TestFlagParsing === RUN TestFlagParsing/user_visible_module_listing_flag_take_precedence_over_target_flag === RUN TestFlagParsing/config === RUN TestFlagParsing/root_level_configuration_option_specified_as_an_empty_node_in_YAML === RUN TestFlagParsing/help === RUN TestFlagParsing/new_flag,_with_config === RUN TestFlagParsing/config_with_expand-env === RUN TestFlagParsing/user_visible_module_listing === RUN TestFlagParsing/default_values === RUN TestFlagParsing/help-short === RUN TestFlagParsing/help-all === RUN TestFlagParsing/unknown_flag === RUN TestFlagParsing/config_with_arguments_override === RUN TestFlagParsing/version --- PASS: TestFlagParsing (0.31s) --- PASS: TestFlagParsing/user_visible_module_listing_flag_take_precedence_over_target_flag (0.03s) --- PASS: TestFlagParsing/config (0.05s) --- PASS: TestFlagParsing/root_level_configuration_option_specified_as_an_empty_node_in_YAML (0.03s) --- PASS: TestFlagParsing/help (0.02s) --- PASS: TestFlagParsing/new_flag,_with_config (0.02s) --- PASS: TestFlagParsing/config_with_expand-env (0.02s) --- PASS: TestFlagParsing/user_visible_module_listing (0.02s) --- PASS: TestFlagParsing/default_values (0.02s) --- PASS: TestFlagParsing/help-short (0.01s) --- PASS: TestFlagParsing/help-all (0.02s) --- PASS: TestFlagParsing/unknown_flag (0.02s) --- PASS: TestFlagParsing/config_with_arguments_override (0.03s) --- PASS: TestFlagParsing/version (0.01s) === RUN TestHelp === RUN TestHelp/basic === RUN TestHelp/all --- PASS: TestHelp (0.09s) --- PASS: TestHelp/basic (0.02s) --- PASS: TestHelp/all (0.06s) === RUN TestExpandEnvironmentVariables === RUN TestExpandEnvironmentVariables/x$y === RUN TestExpandEnvironmentVariables/x${y} === RUN TestExpandEnvironmentVariables/x$Y === RUN TestExpandEnvironmentVariables/x${Y} === RUN TestExpandEnvironmentVariables/x${Z:D} === RUN TestExpandEnvironmentVariables/x${Z:A_B_C_D} === RUN TestExpandEnvironmentVariables/x${Z:} === RUN TestExpandEnvironmentVariables/x$y:D --- PASS: TestExpandEnvironmentVariables (0.00s) --- PASS: TestExpandEnvironmentVariables/x$y (0.00s) --- PASS: TestExpandEnvironmentVariables/x${y} (0.00s) --- PASS: TestExpandEnvironmentVariables/x$Y (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Y} (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Z:D} (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Z:A_B_C_D} (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Z:} (0.00s) --- PASS: TestExpandEnvironmentVariables/x$y:D (0.00s) === RUN TestParseConfigFileParameter === RUN TestParseConfigFileParameter/#00 === RUN TestParseConfigFileParameter/--foo === RUN TestParseConfigFileParameter/-f_-a === RUN TestParseConfigFileParameter/--config.file=foo === RUN TestParseConfigFileParameter/--config.file_foo === RUN TestParseConfigFileParameter/--config.file=foo_--config.expand-env === RUN TestParseConfigFileParameter/--config.expand-env_--config.file=foo === RUN TestParseConfigFileParameter/--opt1_--config.file=foo === RUN TestParseConfigFileParameter/--opt1_--config.file_foo === RUN TestParseConfigFileParameter/--opt1_--config.file=foo_--config.expand-env === RUN TestParseConfigFileParameter/--opt1_--config.expand-env_--config.file=foo === RUN TestParseConfigFileParameter/--config.file=foo_--opt1 === RUN TestParseConfigFileParameter/--config.file_foo_--opt1 === RUN TestParseConfigFileParameter/--config.file=foo_--config.expand-env_--opt1 === RUN TestParseConfigFileParameter/--config.expand-env_--config.file=foo_--opt1 === RUN TestParseConfigFileParameter/--config.file=foo_--opt1_--config.expand-env === RUN TestParseConfigFileParameter/--config.expand-env_--opt1_--config.file=foo --- PASS: TestParseConfigFileParameter (0.00s) --- PASS: TestParseConfigFileParameter/#00 (0.00s) --- PASS: TestParseConfigFileParameter/--foo (0.00s) --- PASS: TestParseConfigFileParameter/-f_-a (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--config.file_foo (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--config.expand-env (0.00s) --- PASS: TestParseConfigFileParameter/--config.expand-env_--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.file_foo (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.file=foo_--config.expand-env (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.expand-env_--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.file_foo_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--config.expand-env_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.expand-env_--config.file=foo_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--opt1_--config.expand-env (0.00s) --- PASS: TestParseConfigFileParameter/--config.expand-env_--opt1_--config.file=foo (0.00s) === RUN TestFieldCategoryOverridesNotStale --- PASS: TestFieldCategoryOverridesNotStale (0.01s) PASS ok github.com/grafana/mimir/cmd/mimir 0.831s ? github.com/grafana/mimir/cmd/mimir-continuous-test [no test files] ? github.com/grafana/mimir/cmd/mimirtool [no test files] === RUN TestMimirReadRoutes --- PASS: TestMimirReadRoutes (0.00s) PASS ok github.com/grafana/mimir/cmd/query-tee 0.387s ? github.com/grafana/mimir/integration [no test files] ? github.com/grafana/mimir/integration/ca [no test files] ? github.com/grafana/mimir/integration/e2emimir [no test files] === RUN TestMultitenantAlertmanager_GetStatusHandler --- PASS: TestMultitenantAlertmanager_GetStatusHandler (0.40s) === RUN TestAlertmanagerMetricsStore --- PASS: TestAlertmanagerMetricsStore (0.04s) === RUN TestAlertmanagerMetricsRemoval --- PASS: TestAlertmanagerMetricsRemoval (0.03s) === RUN TestIsHealthyForAlertmanagerOperations === PAUSE TestIsHealthyForAlertmanagerOperations === RUN TestDispatcherGroupLimits === RUN TestDispatcherGroupLimits/no_limit === RUN TestDispatcherGroupLimits/high_limit === RUN TestDispatcherGroupLimits/low_limit --- PASS: TestDispatcherGroupLimits (0.86s) --- PASS: TestDispatcherGroupLimits/no_limit (0.40s) --- PASS: TestDispatcherGroupLimits/high_limit (0.21s) --- PASS: TestDispatcherGroupLimits/low_limit (0.25s) === RUN TestDispatcherLoggerInsightKey --- PASS: TestDispatcherLoggerInsightKey (0.25s) === RUN TestAlertsLimiterWithNoLimits --- PASS: TestAlertsLimiterWithNoLimits (0.00s) === RUN TestAlertsLimiterWithCountLimit --- PASS: TestAlertsLimiterWithCountLimit (0.00s) === RUN TestAlertsLimiterWithSizeLimit --- PASS: TestAlertsLimiterWithSizeLimit (0.00s) === RUN TestAlertsLimiterWithSizeLimitAndAnnotationUpdate --- PASS: TestAlertsLimiterWithSizeLimitAndAnnotationUpdate (0.00s) === RUN TestAMConfigValidationAPI === RUN TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_contains_no_receivers === RUN TestAMConfigValidationAPI/Should_pass_if_the_alertmanager_config_is_valid === RUN TestAMConfigValidationAPI/Should_return_error_if_the_config_is_empty_due_to_wrong_indentation === RUN TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_is_empty_due_to_wrong_key === RUN TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_an_absolute_path === RUN TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_a_relative_path === RUN TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_is_not_a_valid_filename === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_/ === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_with_repeated_separators_/// === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_an_absolute_path === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_a_relative_path === RUN TestAMConfigValidationAPI/Should_pass_if_the_referenced_template_is_valid_filename === RUN TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_password_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_bearer_token_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_credentials_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_client_secret_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_proxy_url_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_TLS_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_password_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_bearer_token_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_credentials_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_client_secret_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_proxy_url_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_proxy_url_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_slack_api_url_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_Slack_api_url_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_opsgenie_api_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_OpsGenie_api_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_VictorOps_api_key_file_is_set === RUN TestAMConfigValidationAPI/should_return_error_if_template_is_wrong === RUN TestAMConfigValidationAPI/config_too_big === RUN TestAMConfigValidationAPI/config_size_OK === RUN TestAMConfigValidationAPI/templates_limit_reached === RUN TestAMConfigValidationAPI/templates_limit_not_reached === RUN TestAMConfigValidationAPI/template_size_limit_reached === RUN TestAMConfigValidationAPI/template_size_limit_ok --- PASS: TestAMConfigValidationAPI (0.16s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_contains_no_receivers (0.00s) --- PASS: TestAMConfigValidationAPI/Should_pass_if_the_alertmanager_config_is_valid (0.02s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_config_is_empty_due_to_wrong_indentation (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_is_empty_due_to_wrong_key (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_an_absolute_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_a_relative_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_is_not_a_valid_filename (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_/ (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_with_repeated_separators_/// (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_an_absolute_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_a_relative_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_pass_if_the_referenced_template_is_valid_filename (0.02s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_password_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_bearer_token_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_credentials_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_client_secret_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_proxy_url_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_TLS_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_password_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_bearer_token_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_credentials_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_client_secret_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_proxy_url_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_proxy_url_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_slack_api_url_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_Slack_api_url_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_opsgenie_api_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_OpsGenie_api_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_VictorOps_api_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/should_return_error_if_template_is_wrong (0.02s) --- PASS: TestAMConfigValidationAPI/config_too_big (0.00s) --- PASS: TestAMConfigValidationAPI/config_size_OK (0.02s) --- PASS: TestAMConfigValidationAPI/templates_limit_reached (0.00s) --- PASS: TestAMConfigValidationAPI/templates_limit_not_reached (0.02s) --- PASS: TestAMConfigValidationAPI/template_size_limit_reached (0.00s) --- PASS: TestAMConfigValidationAPI/template_size_limit_ok (0.02s) === RUN TestMultitenantAlertmanager_DeleteUserConfig --- PASS: TestMultitenantAlertmanager_DeleteUserConfig (0.00s) === RUN TestAMConfigListUserConfig --- PASS: TestAMConfigListUserConfig (0.78s) === RUN TestValidateAlertmanagerConfig === RUN TestValidateAlertmanagerConfig/TLSConfig === RUN TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child === RUN TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child_within_a_slice === RUN TestValidateAlertmanagerConfig/map_containing_TLSConfig_as_nested_child === RUN TestValidateAlertmanagerConfig/map_containing_*HTTPClientConfig === RUN TestValidateAlertmanagerConfig/*HTTPClientConfig === RUN TestValidateAlertmanagerConfig/HTTPClientConfig === RUN TestValidateAlertmanagerConfig/*TLSConfig === RUN TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_direct_child --- PASS: TestValidateAlertmanagerConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/TLSConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child (0.00s) --- PASS: TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child_within_a_slice (0.00s) --- PASS: TestValidateAlertmanagerConfig/map_containing_TLSConfig_as_nested_child (0.00s) --- PASS: TestValidateAlertmanagerConfig/map_containing_*HTTPClientConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/*HTTPClientConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/HTTPClientConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/*TLSConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_direct_child (0.00s) === RUN TestDistributor_DistributeRequest === RUN TestDistributor_DistributeRequest/Write_/alerts,_Simple_AM_request,_all_AM_healthy === RUN TestDistributor_DistributeRequest/Write_/alerts,_no_healthy_Alertmanagers === RUN TestDistributor_DistributeRequest/Write_/alerts,_1_healthy_Alertmanager_out_of_3 === RUN TestDistributor_DistributeRequest/Write_/alerts,_3_healthy_Alertmanagers_out_of_5 === RUN TestDistributor_DistributeRequest/Read_/v1/alerts_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/alerts_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/alerts/groups_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Write_/alerts/groups_not_supported === RUN TestDistributor_DistributeRequest/Read_/v1/silences_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/silences_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Write_/silences_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Read_/v1/silence/id_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/silence/id_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Write_/silence/id_not_supported === RUN TestDistributor_DistributeRequest/Delete_/silence/id_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Read_/status_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Write_/status_not_supported === RUN TestDistributor_DistributeRequest/Read_/some/place/arbitrary_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Read_/receivers_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Write_/receivers_not_supported --- PASS: TestDistributor_DistributeRequest (0.15s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_Simple_AM_request,_all_AM_healthy (0.04s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_no_healthy_Alertmanagers (0.02s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_1_healthy_Alertmanager_out_of_3 (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_3_healthy_Alertmanagers_out_of_5 (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v1/alerts_is_sent_to_3_AMs (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/alerts_is_sent_to_3_AMs (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/alerts/groups_is_sent_to_3_AMs (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts/groups_not_supported (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/v1/silences_is_sent_to_3_AMs (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/silences_is_sent_to_3_AMs (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/silences_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/v1/silence/id_is_sent_to_3_AMs (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/silence/id_is_sent_to_3_AMs (0.01s) --- PASS: TestDistributor_DistributeRequest/Write_/silence/id_not_supported (0.00s) --- PASS: TestDistributor_DistributeRequest/Delete_/silence/id_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/status_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/status_not_supported (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/some/place/arbitrary_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/receivers_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/receivers_not_supported (0.00s) === RUN TestMultitenantAlertmanagerConfig_Validate === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_negative === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_ends_with_/ === RUN TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_new_storage_store_configuration_given_with_local_type === RUN TestMultitenantAlertmanagerConfig_Validate/should_pass_with_default_config === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_with_empty_external_URL === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_0 === RUN TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_external_URL_does_not_end_with_/ === RUN TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_new_storage_configuration_given_with_bucket_client === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_zone_aware_is_enabled_but_zone_is_not_set --- PASS: TestMultitenantAlertmanagerConfig_Validate (0.02s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_negative (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_ends_with_/ (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_new_storage_store_configuration_given_with_local_type (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_with_empty_external_URL (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_0 (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_external_URL_does_not_end_with_/ (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_new_storage_configuration_given_with_bucket_client (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_zone_aware_is_enabled_but_zone_is_not_set (0.00s) === RUN TestMultitenantAlertmanager_loadAndSyncConfigs --- PASS: TestMultitenantAlertmanager_loadAndSyncConfigs (1.20s) === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=pagerduty integration=pagerduty[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=telegram integration=telegram[0] msg="Notify attempt failed, will retry later" attempts=1 err="telebot: unexpected end of JSON input" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=opsgenie integration=opsgenie[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=error component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="wechat/wechat[0]: notify retry canceled due to unrecoverable error after 1 attempts: EOF" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=slack integration=slack[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://www.google.com\": http: server gave HTTP response to HTTPS client" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=sns msg="SNS message successfully published" message_id=null sequencenumber=null level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=sns integration=sns[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=opsgenie integration=opsgenie[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"http://127.0.0.1:34467/v2/alerts\": dial tcp 127.0.0.1:34467: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://www.google.com\": proxyconnect tcp: dial tcp 127.0.0.1:38693: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=wechat integration=wechat[0] msg="Notify attempt failed, will retry later" attempts=1 err="Get \"\": dial tcp 127.0.0.1:43255: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=pagerduty integration=pagerduty[0] msg="Notify attempt failed, will retry later" attempts=1 err="failed to post message to PagerDuty: Post \"http://127.0.0.1:39125\": dial tcp 127.0.0.1:39125: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=sns integration=sns[0] msg="Notify attempt failed, will retry later" attempts=1 err="RequestError: send request failed\ncaused by: Post \"http://127.0.0.1:44507/\": dial tcp 127.0.0.1:44507: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=slack integration=slack[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:37189: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=telegram integration=telegram[0] msg="Notify attempt failed, will retry later" attempts=1 err="telebot: Post \"http://127.0.0.1:40665/botxxx/sendMessage\": dial tcp 127.0.0.1:40665: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true multitenant_test.go:593: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user-1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"http://127.0.0.1:43381\": dial tcp 127.0.0.1:43381: blocked address" --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled (0.00s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false (0.62s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false (0.65s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false (0.67s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false (0.69s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false (0.73s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false (0.76s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false (0.79s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false (0.80s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true (3.52s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true (3.55s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true (3.57s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true (3.59s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true (3.61s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true (3.64s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true (3.71s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true (3.72s) === RUN TestMultitenantAlertmanager_deleteUnusedLocalUserState --- PASS: TestMultitenantAlertmanager_deleteUnusedLocalUserState (0.44s) === RUN TestMultitenantAlertmanager_zoneAwareSharding level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-1 ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-2 ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-3 ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=3 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user2 level=info component=MultiTenantAlertmanager user=user2 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user2 addr=127.0.0.1-3:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-3:0 user=user2 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-3: no such host\"" level=info component=MultiTenantAlertmanager user=user2 msg="state not settled; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user2 msg="no state for user in storage; proceeding" user=user2 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager user=user1 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user1 addr=127.0.0.1-3:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-3:0 user=user1 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-3: no such host\"" level=info component=MultiTenantAlertmanager user=user1 msg="state not settled; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user1 msg="no state for user in storage; proceeding" user=user1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user3 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user3 level=info component=MultiTenantAlertmanager user=user3 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user3 addr=127.0.0.1-3:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-3:0 user=user3 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-3: no such host\"" level=info component=MultiTenantAlertmanager user=user3 msg="state not settled; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user3 msg="no state for user in storage; proceeding" user=user3 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=3 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager user=user1 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user1 addr=127.0.0.1-1:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-1:0 user=user1 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-1: no such host\"" level=info component=MultiTenantAlertmanager user=user1 msg="state not settled; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user1 msg="no state for user in storage; proceeding" user=user1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user3 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user3 level=info component=MultiTenantAlertmanager user=user3 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user3 addr=127.0.0.1-1:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-1:0 user=user3 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-1: no such host\"" level=info component=MultiTenantAlertmanager user=user3 msg="state not settled; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user3 msg="no state for user in storage; proceeding" user=user3 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user2 level=info component=MultiTenantAlertmanager user=user2 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user2 addr=127.0.0.1-1:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-1:0 user=user2 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-1: no such host\"" level=info component=MultiTenantAlertmanager user=user2 msg="state not settled; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user2 msg="no state for user in storage; proceeding" user=user2 level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Maintenance done" duration=353.444µs size=0 level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Maintenance done" duration=370.757µs size=0 level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Running maintenance" level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Maintenance done" duration=187.102µs size=0 level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Maintenance done" duration=162.015µs size=0 level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Maintenance done" duration=109.415µs size=0 level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Maintenance done" duration=124.574µs size=0 level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Running maintenance" level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Maintenance done" duration=254.057µs size=0 level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Maintenance done" duration=248.587µs size=0 level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Maintenance done" duration=130.364µs size=0 level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Maintenance done" duration=125.276µs size=0 level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Maintenance done" duration=122.45µs size=0 level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Maintenance done" duration=122.349µs size=0 --- PASS: TestMultitenantAlertmanager_zoneAwareSharding (2.14s) === RUN TestMultitenantAlertmanager_deleteUnusedRemoteUserState level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-1 ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-2 ring=alertmanager level=info component=MultiTenantAlertmanager waitinguntilalertmanagerisJOININGinthering=(MISSING) level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager user=user1 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user1 msg="skipping settling (no replicas)" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user2 level=info component=MultiTenantAlertmanager user=user2 msg="Waiting for notification and silences to settle..." level=info component=MultiTenantAlertmanager user=user2 msg="skipping settling (no replicas)" level=debug component=MultiTenantAlertmanager user=user1 msg="persisting state" user=user1 level=debug component=MultiTenantAlertmanager user=user2 msg="persisting state" user=user2 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="deactivating per-tenant alertmanager" user=user1 level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Maintenance done" duration=213.521µs size=0 level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Maintenance done" duration=235.903µs size=0 level=info component=MultiTenantAlertmanager msg="deactivated per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager msg="deleted local directory for user" dir=/tmp/TestMultitenantAlertmanager_deleteUnusedRemoteUserState931018713/001/user1 user=user1 level=info component=MultiTenantAlertmanager msg="deleted remote state for user" user=user1 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Maintenance done" duration=121.288µs size=0 level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Maintenance done" duration=281.279µs size=0 level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager --- PASS: TestMultitenantAlertmanager_deleteUnusedRemoteUserState (1.34s) === RUN TestMultitenantAlertmanager_ServeHTTP --- PASS: TestMultitenantAlertmanager_ServeHTTP (0.48s) === RUN TestMultitenantAlertmanager_ServeHTTPWithFallbackConfig --- PASS: TestMultitenantAlertmanager_ServeHTTPWithFallbackConfig (0.75s) === RUN TestMultitenantAlertmanager_ServeHTTPBeforeSyncFailsIfConfigExists --- PASS: TestMultitenantAlertmanager_ServeHTTPBeforeSyncFailsIfConfigExists (0.46s) === RUN TestMultitenantAlertmanager_InitialSync === RUN TestMultitenantAlertmanager_InitialSync/with_no_instance_in_the_ring === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_PENDING_state_and_no_tokens === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_JOINING_state_and_some_tokens === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_ACTIVE_state_and_all_tokens === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_LEAVING_state_and_all_tokens --- PASS: TestMultitenantAlertmanager_InitialSync (1.41s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_no_instance_in_the_ring (0.34s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_PENDING_state_and_no_tokens (0.36s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_JOINING_state_and_some_tokens (0.15s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_ACTIVE_state_and_all_tokens (0.25s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_LEAVING_state_and_all_tokens (0.30s) === RUN TestMultitenantAlertmanager_PerTenantSharding === RUN TestMultitenantAlertmanager_PerTenantSharding/1_instance,_RF_=_1 === RUN TestMultitenantAlertmanager_PerTenantSharding/2_instances,_RF_=_1 === RUN TestMultitenantAlertmanager_PerTenantSharding/3_instances,_RF_=_2 === RUN TestMultitenantAlertmanager_PerTenantSharding/5_instances,_RF_=_3 --- PASS: TestMultitenantAlertmanager_PerTenantSharding (15.81s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/1_instance,_RF_=_1 (1.54s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/2_instances,_RF_=_1 (3.31s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/3_instances,_RF_=_2 (4.86s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/5_instances,_RF_=_3 (6.11s) === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_added_to_the_ring === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_removed_from_the_ring === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_instance_changes_state === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_healthy_instance_becomes_unhealthy === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_unhealthy_instance_becomes_healthy === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_updates_the_heartbeat === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges (2.75s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_added_to_the_ring (0.48s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_removed_from_the_ring (0.37s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_instance_changes_state (0.43s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_healthy_instance_becomes_unhealthy (0.42s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_unhealthy_instance_becomes_healthy (0.39s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_updates_the_heartbeat (0.32s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state (0.34s) === RUN TestMultitenantAlertmanager_RingLifecyclerShouldAutoForgetUnhealthyInstances --- PASS: TestMultitenantAlertmanager_RingLifecyclerShouldAutoForgetUnhealthyInstances (0.21s) === RUN TestMultitenantAlertmanager_InitialSyncFailure --- PASS: TestMultitenantAlertmanager_InitialSyncFailure (0.01s) === RUN TestAlertmanager_ReplicasPosition --- PASS: TestAlertmanager_ReplicasPosition (1.12s) === RUN TestAlertmanager_StateReplication === RUN TestAlertmanager_StateReplication/RF_=_1,_1_instance === RUN TestAlertmanager_StateReplication/RF_=_2,_2_instances === RUN TestAlertmanager_StateReplication/RF_=_3,_10_instance --- PASS: TestAlertmanager_StateReplication (16.87s) --- PASS: TestAlertmanager_StateReplication/RF_=_1,_1_instance (1.82s) --- PASS: TestAlertmanager_StateReplication/RF_=_2,_2_instances (3.52s) --- PASS: TestAlertmanager_StateReplication/RF_=_3,_10_instance (11.53s) === RUN TestAlertmanager_StateReplication_InitialSyncFromPeers === RUN TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_2 === RUN TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_3 --- PASS: TestAlertmanager_StateReplication_InitialSyncFromPeers (2.62s) --- PASS: TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_2 (1.03s) --- PASS: TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_3 (1.59s) === RUN TestSafeTemplateFilepath === RUN TestSafeTemplateFilepath/template_name_starting_with_/ === RUN TestSafeTemplateFilepath/root_dir === RUN TestSafeTemplateFilepath/root_dir_2 === RUN TestSafeTemplateFilepath/should_fail_if_the_provided_template_is_escaping_the_dir === RUN TestSafeTemplateFilepath/escaping_template_name_that_has_prefix_of_dir_(tmp_is_prefix_of_tmpfile) === RUN TestSafeTemplateFilepath/empty_template_name === RUN TestSafeTemplateFilepath/dot_template_name === RUN TestSafeTemplateFilepath/should_succeed_if_the_provided_template_is_a_filename --- PASS: TestSafeTemplateFilepath (0.00s) --- PASS: TestSafeTemplateFilepath/template_name_starting_with_/ (0.00s) --- PASS: TestSafeTemplateFilepath/root_dir (0.00s) --- PASS: TestSafeTemplateFilepath/root_dir_2 (0.00s) --- PASS: TestSafeTemplateFilepath/should_fail_if_the_provided_template_is_escaping_the_dir (0.00s) --- PASS: TestSafeTemplateFilepath/escaping_template_name_that_has_prefix_of_dir_(tmp_is_prefix_of_tmpfile) (0.00s) --- PASS: TestSafeTemplateFilepath/empty_template_name (0.00s) --- PASS: TestSafeTemplateFilepath/dot_template_name (0.00s) --- PASS: TestSafeTemplateFilepath/should_succeed_if_the_provided_template_is_a_filename (0.00s) === RUN TestStoreTemplateFile --- PASS: TestStoreTemplateFile (0.00s) === RUN TestMultitenantAlertmanager_verifyRateLimitedEmailConfig --- PASS: TestMultitenantAlertmanager_verifyRateLimitedEmailConfig (0.36s) === RUN TestRateLimitedNotifier --- PASS: TestRateLimitedNotifier (1.00s) === RUN TestStatePersister_Position0ShouldWrite --- PASS: TestStatePersister_Position0ShouldWrite (6.10s) === RUN TestStatePersister_Position1ShouldNotWrite --- PASS: TestStatePersister_Position1ShouldNotWrite (5.00s) === RUN TestStateReplication === RUN TestStateReplication/with_a_replication_factor_of_<=_1,_state_is_not_replicated. === RUN TestStateReplication/with_a_replication_factor_of_>_1,_state_is_broadcasted_for_replication. --- PASS: TestStateReplication (0.21s) --- PASS: TestStateReplication/with_a_replication_factor_of_<=_1,_state_is_not_replicated. (0.10s) --- PASS: TestStateReplication/with_a_replication_factor_of_>_1,_state_is_broadcasted_for_replication. (0.10s) === RUN TestStateReplication_Settle === RUN TestStateReplication_Settle/with_a_replication_factor_of_<=_1,_no_state_can_be_read_from_peers. === RUN TestStateReplication_Settle/with_a_replication_factor_of_>_1,_state_is_read_from_all_peers. === RUN TestStateReplication_Settle/with_full_state_having_no_parts,_nothing_is_merged. === RUN TestStateReplication_Settle/with_an_unknown_key,_parts_in_the_same_state_are_merged. === RUN TestStateReplication_Settle/with_an_unknown_key,_parts_in_other_states_are_merged. === RUN TestStateReplication_Settle/when_reading_from_replicas_fails,_state_is_read_from_storage. === RUN TestStateReplication_Settle/when_reading_from_replicas_and_from_storage_fails,_still_become_ready. === RUN TestStateReplication_Settle/when_user_not_found_in_all_replicas_and_storage,_read_not_counted_as_failure_and_still_become_ready. === RUN TestStateReplication_Settle/when_reading_the_full_state_takes_too_long,_hit_timeout_but_become_ready. --- PASS: TestStateReplication_Settle (1.02s) --- PASS: TestStateReplication_Settle/with_a_replication_factor_of_<=_1,_no_state_can_be_read_from_peers. (0.00s) --- PASS: TestStateReplication_Settle/with_a_replication_factor_of_>_1,_state_is_read_from_all_peers. (0.00s) --- PASS: TestStateReplication_Settle/with_full_state_having_no_parts,_nothing_is_merged. (0.00s) --- PASS: TestStateReplication_Settle/with_an_unknown_key,_parts_in_the_same_state_are_merged. (0.00s) --- PASS: TestStateReplication_Settle/with_an_unknown_key,_parts_in_other_states_are_merged. (0.00s) --- PASS: TestStateReplication_Settle/when_reading_from_replicas_fails,_state_is_read_from_storage. (0.00s) --- PASS: TestStateReplication_Settle/when_reading_from_replicas_and_from_storage_fails,_still_become_ready. (0.00s) --- PASS: TestStateReplication_Settle/when_user_not_found_in_all_replicas_and_storage,_read_not_counted_as_failure_and_still_become_ready. (0.00s) --- PASS: TestStateReplication_Settle/when_reading_the_full_state_takes_too_long,_hit_timeout_but_become_ready. (1.00s) === RUN TestStateReplication_GetFullState === RUN TestStateReplication_GetFullState/no_keys === RUN TestStateReplication_GetFullState/zero_length_data === RUN TestStateReplication_GetFullState/keys_with_data --- PASS: TestStateReplication_GetFullState (0.00s) --- PASS: TestStateReplication_GetFullState/no_keys (0.00s) --- PASS: TestStateReplication_GetFullState/zero_length_data (0.00s) --- PASS: TestStateReplication_GetFullState/keys_with_data (0.00s) === CONT TestIsHealthyForAlertmanagerOperations === RUN TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/JOINING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/PENDING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout --- PASS: TestIsHealthyForAlertmanagerOperations (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/JOINING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/PENDING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager 68.458s ? github.com/grafana/mimir/pkg/alertmanager/alertmanagerpb [no test files] ? github.com/grafana/mimir/pkg/alertmanager/alertspb [no test files] === RUN TestAlertStore_ListAllUsers --- PASS: TestAlertStore_ListAllUsers (0.00s) === RUN TestAlertStore_SetAndGetAlertConfig --- PASS: TestAlertStore_SetAndGetAlertConfig (0.00s) === RUN TestStore_GetAlertConfigs --- PASS: TestStore_GetAlertConfigs (0.00s) === RUN TestAlertStore_DeleteAlertConfig --- PASS: TestAlertStore_DeleteAlertConfig (0.00s) === RUN TestBucketAlertStore_GetSetDeleteFullState --- PASS: TestBucketAlertStore_GetSetDeleteFullState (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager/alertstore 0.787s testing: warning: no tests to run PASS ok github.com/grafana/mimir/pkg/alertmanager/alertstore/bucketclient 0.456s [no tests to run] === RUN TestStore_ListAllUsers --- PASS: TestStore_ListAllUsers (0.03s) === RUN TestStore_GetAlertConfig --- PASS: TestStore_GetAlertConfig (0.01s) === RUN TestStore_GetAlertConfigs --- PASS: TestStore_GetAlertConfigs (0.00s) === RUN TestStore_FullState --- PASS: TestStore_FullState (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager/alertstore/local 0.681s === RUN TestV1Alerts --- PASS: TestV1Alerts (0.02s) === RUN TestMergeV1Alerts === RUN TestMergeV1Alerts/no_alerts,_should_return_an_empty_list === RUN TestMergeV1Alerts/one_alert,_should_return_the_alert === RUN TestMergeV1Alerts/two_alerts,_should_return_two_alerts === RUN TestMergeV1Alerts/three_alerts,_should_return_three_alerts === RUN TestMergeV1Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order === RUN TestMergeV1Alerts/two_identical_alerts,_should_return_one_alert === RUN TestMergeV1Alerts/two_identical_alerts_plus_another,_should_return_two_alerts === RUN TestMergeV1Alerts/two_duplicates_out_of_sync_alerts,_should_return_first_seen_alert === RUN TestMergeV1Alerts/two_duplicates_plus_others,_should_return_first_seen_alert_and_others --- PASS: TestMergeV1Alerts (0.00s) --- PASS: TestMergeV1Alerts/no_alerts,_should_return_an_empty_list (0.00s) --- PASS: TestMergeV1Alerts/one_alert,_should_return_the_alert (0.00s) --- PASS: TestMergeV1Alerts/two_alerts,_should_return_two_alerts (0.00s) --- PASS: TestMergeV1Alerts/three_alerts,_should_return_three_alerts (0.00s) --- PASS: TestMergeV1Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order (0.00s) --- PASS: TestMergeV1Alerts/two_identical_alerts,_should_return_one_alert (0.00s) --- PASS: TestMergeV1Alerts/two_identical_alerts_plus_another,_should_return_two_alerts (0.00s) --- PASS: TestMergeV1Alerts/two_duplicates_out_of_sync_alerts,_should_return_first_seen_alert (0.00s) --- PASS: TestMergeV1Alerts/two_duplicates_plus_others,_should_return_first_seen_alert_and_others (0.00s) === RUN TestV1SilenceID_ReturnsNewestSilence --- PASS: TestV1SilenceID_ReturnsNewestSilence (0.00s) === RUN TestV1SilenceID_InvalidDifferentIDs --- PASS: TestV1SilenceID_InvalidDifferentIDs (0.00s) === RUN TestV1Silences --- PASS: TestV1Silences (0.00s) === RUN TestV2AlertGroups --- PASS: TestV2AlertGroups (0.00s) === RUN TestMergeV2AlertGroups === RUN TestMergeV2AlertGroups/no_groups,_should_return_no_groups === RUN TestMergeV2AlertGroups/one_group_with_one_alert,_should_return_one_group === RUN TestMergeV2AlertGroups/two_groups_with_different_labels,_should_return_two_groups === RUN TestMergeV2AlertGroups/two_groups_with_different_receiver,_should_return_two_groups === RUN TestMergeV2AlertGroups/two_identical_groups_with_different_alerts,_should_return_one_group_with_two_alerts === RUN TestMergeV2AlertGroups/two_identical_groups_with_identical_alerts,_should_return_one_group_with_one_alert === RUN TestMergeV2AlertGroups/two_identical_groups_with_diverged_alerts,_should_return_one_group_with_the_newer_alert === RUN TestMergeV2AlertGroups/two_sets_of_identical_groups_with_single_alerts,_should_merge_all_into_two_groups_ === RUN TestMergeV2AlertGroups/many_unordered_groups,_should_return_groups_ordered_by_labels_then_receiver --- PASS: TestMergeV2AlertGroups (0.01s) --- PASS: TestMergeV2AlertGroups/no_groups,_should_return_no_groups (0.00s) --- PASS: TestMergeV2AlertGroups/one_group_with_one_alert,_should_return_one_group (0.00s) --- PASS: TestMergeV2AlertGroups/two_groups_with_different_labels,_should_return_two_groups (0.00s) --- PASS: TestMergeV2AlertGroups/two_groups_with_different_receiver,_should_return_two_groups (0.00s) --- PASS: TestMergeV2AlertGroups/two_identical_groups_with_different_alerts,_should_return_one_group_with_two_alerts (0.00s) --- PASS: TestMergeV2AlertGroups/two_identical_groups_with_identical_alerts,_should_return_one_group_with_one_alert (0.00s) --- PASS: TestMergeV2AlertGroups/two_identical_groups_with_diverged_alerts,_should_return_one_group_with_the_newer_alert (0.00s) --- PASS: TestMergeV2AlertGroups/two_sets_of_identical_groups_with_single_alerts,_should_merge_all_into_two_groups_ (0.00s) --- PASS: TestMergeV2AlertGroups/many_unordered_groups,_should_return_groups_ordered_by_labels_then_receiver (0.00s) === RUN TestV2Alerts --- PASS: TestV2Alerts (0.00s) === RUN TestMergeV2Alerts === RUN TestMergeV2Alerts/no_alerts,_should_return_an_empty_list === RUN TestMergeV2Alerts/one_alert,_should_return_the_alert === RUN TestMergeV2Alerts/two_alerts,_should_return_two_alerts === RUN TestMergeV2Alerts/three_alerts,_should_return_three_alerts === RUN TestMergeV2Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order === RUN TestMergeV2Alerts/two_identical_alerts,_should_return_one_alert === RUN TestMergeV2Alerts/two_identical_alerts_plus_another,_should_return_two_alerts === RUN TestMergeV2Alerts/two_duplicates_out_of_sync_alerts,_should_return_newer_alert === RUN TestMergeV2Alerts/two_duplicates_out_of_sync_alerts_(newer_first),_should_return_newer_alert === RUN TestMergeV2Alerts/two_duplicates_plus_others,_should_return_newer_alert_and_others --- PASS: TestMergeV2Alerts (0.01s) --- PASS: TestMergeV2Alerts/no_alerts,_should_return_an_empty_list (0.00s) --- PASS: TestMergeV2Alerts/one_alert,_should_return_the_alert (0.00s) --- PASS: TestMergeV2Alerts/two_alerts,_should_return_two_alerts (0.00s) --- PASS: TestMergeV2Alerts/three_alerts,_should_return_three_alerts (0.00s) --- PASS: TestMergeV2Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order (0.00s) --- PASS: TestMergeV2Alerts/two_identical_alerts,_should_return_one_alert (0.00s) --- PASS: TestMergeV2Alerts/two_identical_alerts_plus_another,_should_return_two_alerts (0.00s) --- PASS: TestMergeV2Alerts/two_duplicates_out_of_sync_alerts,_should_return_newer_alert (0.00s) --- PASS: TestMergeV2Alerts/two_duplicates_out_of_sync_alerts_(newer_first),_should_return_newer_alert (0.00s) --- PASS: TestMergeV2Alerts/two_duplicates_plus_others,_should_return_newer_alert_and_others (0.00s) === RUN TestV2SilenceId_ReturnsNewestSilence --- PASS: TestV2SilenceId_ReturnsNewestSilence (0.00s) === RUN TestV2SilenceID_InvalidDifferentIDs --- PASS: TestV2SilenceID_InvalidDifferentIDs (0.00s) === RUN TestV2Silences --- PASS: TestV2Silences (0.00s) === RUN TestMergeV2Silences === RUN TestMergeV2Silences/no_silences,_should_return_an_empty_list === RUN TestMergeV2Silences/one_silence,_should_return_the_silence === RUN TestMergeV2Silences/two_silences,_should_return_two_silences === RUN TestMergeV2Silences/three_silences,_should_return_three_silences === RUN TestMergeV2Silences/three_active_silences_out_of_order,_should_return_three_silences_in_expiry_order === RUN TestMergeV2Silences/two_identical_silences,_should_return_one_silence === RUN TestMergeV2Silences/two_identical_silences_plus_another,_should_return_two_silences === RUN TestMergeV2Silences/two_duplicates_out_of_sync_silences,_should_return_newer_silence === RUN TestMergeV2Silences/two_duplicates_out_of_sync_silences_(newer_first),_should_return_newer_silence === RUN TestMergeV2Silences/two_duplicates_plus_others,_should_return_newer_silence_and_others --- PASS: TestMergeV2Silences (0.00s) --- PASS: TestMergeV2Silences/no_silences,_should_return_an_empty_list (0.00s) --- PASS: TestMergeV2Silences/one_silence,_should_return_the_silence (0.00s) --- PASS: TestMergeV2Silences/two_silences,_should_return_two_silences (0.00s) --- PASS: TestMergeV2Silences/three_silences,_should_return_three_silences (0.00s) --- PASS: TestMergeV2Silences/three_active_silences_out_of_order,_should_return_three_silences_in_expiry_order (0.00s) --- PASS: TestMergeV2Silences/two_identical_silences,_should_return_one_silence (0.00s) --- PASS: TestMergeV2Silences/two_identical_silences_plus_another,_should_return_two_silences (0.00s) --- PASS: TestMergeV2Silences/two_duplicates_out_of_sync_silences,_should_return_newer_silence (0.00s) --- PASS: TestMergeV2Silences/two_duplicates_out_of_sync_silences_(newer_first),_should_return_newer_silence (0.00s) --- PASS: TestMergeV2Silences/two_duplicates_plus_others,_should_return_newer_silence_and_others (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager/merger 0.872s === RUN TestNewApiWithoutSourceIPExtractor --- PASS: TestNewApiWithoutSourceIPExtractor (0.01s) === RUN TestNewApiWithSourceIPExtractor --- PASS: TestNewApiWithSourceIPExtractor (0.00s) === RUN TestNewApiWithInvalidSourceIPExtractor --- PASS: TestNewApiWithInvalidSourceIPExtractor (0.00s) === RUN TestApiGzip === RUN TestApiGzip/happy_case_gzip === RUN TestApiGzip/gzip_with_priority_header === RUN TestApiGzip/gzip_because_any_is_accepted === RUN TestApiGzip/no_gzip_because_no_header === RUN TestApiGzip/no_gzip_because_not_accepted === RUN TestApiGzip/no_gzip_because_small_payload === RUN TestApiGzip/forced_gzip_with_small_payload === RUN TestApiGzip/gzip_disabled_endpoint === RUN TestApiGzip/compressed_with_gzip --- PASS: TestApiGzip (0.10s) --- PASS: TestApiGzip/happy_case_gzip (0.03s) --- PASS: TestApiGzip/gzip_with_priority_header (0.01s) --- PASS: TestApiGzip/gzip_because_any_is_accepted (0.00s) --- PASS: TestApiGzip/no_gzip_because_no_header (0.01s) --- PASS: TestApiGzip/no_gzip_because_not_accepted (0.00s) --- PASS: TestApiGzip/no_gzip_because_small_payload (0.00s) --- PASS: TestApiGzip/forced_gzip_with_small_payload (0.00s) --- PASS: TestApiGzip/gzip_disabled_endpoint (0.00s) --- PASS: TestApiGzip/compressed_with_gzip (0.00s) === RUN TestIndexHandlerPrefix --- PASS: TestIndexHandlerPrefix (0.01s) === RUN TestIndexPageContent --- PASS: TestIndexPageContent (0.00s) === RUN TestConfigDiffHandler === RUN TestConfigDiffHandler/no_config_parameters_overridden === RUN TestConfigDiffHandler/slice_changed === RUN TestConfigDiffHandler/string_in_nested_struct_changed === RUN TestConfigDiffHandler/bool_in_nested_struct_changed === RUN TestConfigDiffHandler/test_invalid_input --- PASS: TestConfigDiffHandler (0.02s) --- PASS: TestConfigDiffHandler/no_config_parameters_overridden (0.01s) --- PASS: TestConfigDiffHandler/slice_changed (0.00s) --- PASS: TestConfigDiffHandler/string_in_nested_struct_changed (0.00s) --- PASS: TestConfigDiffHandler/bool_in_nested_struct_changed (0.00s) --- PASS: TestConfigDiffHandler/test_invalid_input (0.00s) === RUN TestConfigOverrideHandler --- PASS: TestConfigOverrideHandler (0.00s) PASS ok github.com/grafana/mimir/pkg/api 0.702s ? github.com/grafana/mimir/pkg/api/error [no test files] === RUN TestCompressionConfig_Validate === RUN TestCompressionConfig_Validate/should_pass_with_default_config === RUN TestCompressionConfig_Validate/should_pass_with_snappy_compression === RUN TestCompressionConfig_Validate/should_fail_with_unsupported_compression --- PASS: TestCompressionConfig_Validate (0.01s) --- PASS: TestCompressionConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestCompressionConfig_Validate/should_pass_with_snappy_compression (0.00s) --- PASS: TestCompressionConfig_Validate/should_fail_with_unsupported_compression (0.00s) === RUN TestSnappyCache === RUN TestSnappyCache/Fetch()_should_return_empty_results_if_no_key_has_been_found === RUN TestSnappyCache/Fetch()_should_return_previously_set_keys === RUN TestSnappyCache/Fetch()_should_skip_entries_failing_to_decode --- PASS: TestSnappyCache (0.00s) --- PASS: TestSnappyCache/Fetch()_should_return_empty_results_if_no_key_has_been_found (0.00s) --- PASS: TestSnappyCache/Fetch()_should_return_previously_set_keys (0.00s) --- PASS: TestSnappyCache/Fetch()_should_skip_entries_failing_to_decode (0.00s) === RUN TestLRUCache_StoreFetch --- PASS: TestLRUCache_StoreFetch (0.01s) === RUN TestLRUCache_Evictions --- PASS: TestLRUCache_Evictions (0.00s) === RUN TestMemcachedIndexCacheConfig_GetAddresses === RUN TestMemcachedIndexCacheConfig_GetAddresses/no_addresses === RUN TestMemcachedIndexCacheConfig_GetAddresses/one_address === RUN TestMemcachedIndexCacheConfig_GetAddresses/two_addresses --- PASS: TestMemcachedIndexCacheConfig_GetAddresses (0.00s) --- PASS: TestMemcachedIndexCacheConfig_GetAddresses/no_addresses (0.00s) --- PASS: TestMemcachedIndexCacheConfig_GetAddresses/one_address (0.00s) --- PASS: TestMemcachedIndexCacheConfig_GetAddresses/two_addresses (0.00s) === RUN TestVersioned === RUN TestVersioned/happy_case:_can_store_and_retrieve === RUN TestVersioned/different_versions_use_different_datasets --- PASS: TestVersioned (0.00s) --- PASS: TestVersioned/happy_case:_can_store_and_retrieve (0.00s) --- PASS: TestVersioned/different_versions_use_different_datasets (0.00s) PASS ok github.com/grafana/mimir/pkg/cache 0.597s === RUN TestMultitenantCompactor_HandleBlockUpload_Create === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_tenant_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_body block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/malformed_body block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_file_path block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_file_size block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_minTime block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_maxTime block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/maxTime_before_minTime block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/block_before_retention_period block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_version block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_==_0 block_upload_test.go:554: PASS: Exists(string,string) block_upload_test.go:554: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_<_0 block_upload_test.go:554: PASS: Exists(string,string) block_upload_test.go:554: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_compactor_shard_ID_label block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/failure_checking_for_complete_block block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/complete_block_already_exists block_upload_test.go:554: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/failure_uploading_meta_file block_upload_test.go:554: PASS: Exists(string,string) block_upload_test.go:554: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/block_upload_disabled === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request block_upload_test.go:554: PASS: Exists(string,string) block_upload_test.go:554: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_empty_compactor_shard_ID_label block_upload_test.go:554: PASS: Exists(string,string) block_upload_test.go:554: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_without_compactor_shard_ID_label block_upload_test.go:554: PASS: Exists(string,string) block_upload_test.go:554: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_different_block_ID_in_meta_file block_upload_test.go:554: PASS: Exists(string,string) block_upload_test.go:554: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_both_in-flight_meta_file_and_complete_meta_file_exist_in_object_storage === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_request_when_in-flight_meta_file_exists_in_object_storage === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_same_in-flight_meta_file_exists_in_object_storage === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_different_in-flight_meta_file_exists_in_object_storage --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create (0.05s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_tenant_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_body (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/malformed_body (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_file_path (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_file_size (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_minTime (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_maxTime (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/maxTime_before_minTime (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/block_before_retention_period (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_version (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_==_0 (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_<_0 (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_compactor_shard_ID_label (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/failure_checking_for_complete_block (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/complete_block_already_exists (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/failure_uploading_meta_file (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/block_upload_disabled (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_empty_compactor_shard_ID_label (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_without_compactor_shard_ID_label (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_different_block_ID_in_meta_file (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_both_in-flight_meta_file_and_complete_meta_file_exist_in_object_storage (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_request_when_in-flight_meta_file_exists_in_object_storage (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_same_in-flight_meta_file_exists_in_object_storage (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_different_in-flight_meta_file_exists_in_object_storage (0.00s) === RUN TestMultitenantCompactor_UploadBlockFile === RUN TestMultitenantCompactor_UploadBlockFile/without_tenant_ID === RUN TestMultitenantCompactor_UploadBlockFile/without_block_ID === RUN TestMultitenantCompactor_UploadBlockFile/invalid_block_ID === RUN TestMultitenantCompactor_UploadBlockFile/without_path === RUN TestMultitenantCompactor_UploadBlockFile/invalid_path === RUN TestMultitenantCompactor_UploadBlockFile/empty_file === RUN TestMultitenantCompactor_UploadBlockFile/attempt_block_metadata_file === RUN TestMultitenantCompactor_UploadBlockFile/attempt_in-flight_block_metadata_file === RUN TestMultitenantCompactor_UploadBlockFile/block_upload_disabled === RUN TestMultitenantCompactor_UploadBlockFile/complete_block_already_exists block_upload_test.go:924: PASS: Exists(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/failure_checking_for_complete_block block_upload_test.go:924: PASS: Exists(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/failure_checking_for_in-flight_meta_file block_upload_test.go:924: PASS: Exists(string,string) block_upload_test.go:924: PASS: Exists(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/missing_in-flight_meta_file block_upload_test.go:924: PASS: Exists(string,string) block_upload_test.go:924: PASS: Exists(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/file_upload_fails block_upload_test.go:924: PASS: Exists(string,string) block_upload_test.go:924: PASS: Exists(string,string) block_upload_test.go:924: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_UploadBlockFile/valid_request block_upload_test.go:924: PASS: Exists(string,string) block_upload_test.go:924: PASS: Exists(string,string) block_upload_test.go:924: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_UploadBlockFile/multiple_sequential_uploads_of_same_file --- PASS: TestMultitenantCompactor_UploadBlockFile (0.01s) --- PASS: TestMultitenantCompactor_UploadBlockFile/without_tenant_ID (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/without_block_ID (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/invalid_block_ID (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/without_path (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/invalid_path (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/empty_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/attempt_block_metadata_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/attempt_in-flight_block_metadata_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/block_upload_disabled (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/complete_block_already_exists (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/failure_checking_for_complete_block (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/failure_checking_for_in-flight_meta_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/missing_in-flight_meta_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/file_upload_fails (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/valid_request (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/multiple_sequential_uploads_of_same_file (0.00s) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/without_tenant_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/without_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/invalid_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/block_upload_disabled === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/complete_block_already_exists block_upload_test.go:1219: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/checking_for_complete_block_fails block_upload_test.go:1219: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/missing_in-flight_meta_file block_upload_test.go:1219: PASS: Exists(string,string) block_upload_test.go:1219: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/downloading_in-flight_meta_file_fails block_upload_test.go:1219: PASS: Exists(string,string) block_upload_test.go:1219: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/corrupt_in-flight_meta_file block_upload_test.go:1219: PASS: Exists(string,string) block_upload_test.go:1219: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/uploading_meta_file_fails block_upload_test.go:1219: PASS: Exists(string,string) block_upload_test.go:1219: PASS: Get(string,string) block_upload_test.go:1219: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/removing_in-flight_meta_file_fails block_upload_test.go:1219: PASS: Exists(string,string) block_upload_test.go:1219: PASS: Get(string,string) block_upload_test.go:1219: PASS: Upload(string,string,string) block_upload_test.go:1219: PASS: Delete(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/valid_request block_upload_test.go:1219: PASS: Exists(string,string) block_upload_test.go:1219: PASS: Get(string,string) block_upload_test.go:1219: PASS: Upload(string,string,string) block_upload_test.go:1219: PASS: Delete(string,string) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/without_tenant_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/without_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/invalid_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/block_upload_disabled (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/complete_block_already_exists (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/checking_for_complete_block_fails (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/missing_in-flight_meta_file (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/downloading_in-flight_meta_file_fails (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/corrupt_in-flight_meta_file (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/uploading_meta_file_fails (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/removing_in-flight_meta_file_fails (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/valid_request (0.00s) === RUN TestBlocksCleaner === RUN TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s === PAUSE TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s === RUN TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s === PAUSE TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s === RUN TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s === PAUSE TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s === RUN TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s === PAUSE TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s === CONT TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s --- PASS: TestBlocksCleaner (0.00s) --- PASS: TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s (2.31s) --- PASS: TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s (2.31s) --- PASS: TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s (2.31s) --- PASS: TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s (2.39s) === RUN TestBlocksCleaner_ShouldContinueOnBlockDeletionFailure --- PASS: TestBlocksCleaner_ShouldContinueOnBlockDeletionFailure (0.87s) === RUN TestBlocksCleaner_ShouldRebuildBucketIndexOnCorruptedOne --- PASS: TestBlocksCleaner_ShouldRebuildBucketIndexOnCorruptedOne (0.64s) === RUN TestBlocksCleaner_ShouldRemoveMetricsForTenantsNotBelongingAnymoreToTheShard --- PASS: TestBlocksCleaner_ShouldRemoveMetricsForTenantsNotBelongingAnymoreToTheShard (0.90s) === RUN TestBlocksCleaner_ShouldNotCleanupUserThatDoesntBelongToShardAnymore --- PASS: TestBlocksCleaner_ShouldNotCleanupUserThatDoesntBelongToShardAnymore (0.36s) === RUN TestBlocksCleaner_ListBlocksOutsideRetentionPeriod --- PASS: TestBlocksCleaner_ListBlocksOutsideRetentionPeriod (0.46s) === RUN TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 1.155281ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 779.695µs logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 9h0m0s logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 1.105076ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 660.461µs logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level info component cleaner user user-1 msg applied retention: marking block for deletion block 01GB8VKHSJ4JHYKZ6D8CYCADP5 maxTime 1661347189000 logger.go:22: level info component cleaner user user-1 msg block has been marked for deletion block 01GB8VKHSJ4JHYKZ6D8CYCADP5 logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 1.531358ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 660.972µs logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 1.317486ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 779.605µs logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GB8VKHSJ4JHYKZ6D8CYCADP5/meta.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GB8VKHSJ4JHYKZ6D8CYCADP5/chunks/000001 bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GB8VKHSJ4JHYKZ6D8CYCADP5/index bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GB8VKHSJ4JHYKZ6D8CYCADP5/tombstones bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GB8VKHSJ4JHYKZ6D8CYCADP5/deletion-mark.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level info component cleaner user user-1 msg deleted block marked for deletion block 01GB8VKHSJ4JHYKZ6D8CYCADP5 logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 1.653837ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 642.297µs logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 933.965µs logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-2 msg applying retention retention 5h0m0s logger.go:22: level info component cleaner user user-2 msg applied retention: marking block for deletion block 01GB8VKJ1YRR7WN4V7FYGT0KV7 maxTime 1661347189000 logger.go:22: level info component cleaner user user-2 msg block has been marked for deletion block 01GB8VKJ1YRR7WN4V7FYGT0KV7 logger.go:22: level info component cleaner user user-2 msg applied retention: marking block for deletion block 01GB8VKJ6MKPEDXXQJN0EQME5C maxTime 1661354389000 logger.go:22: level info component cleaner user user-2 msg block has been marked for deletion block 01GB8VKJ6MKPEDXXQJN0EQME5C logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ1YRR7WN4V7FYGT0KV7/meta.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ1YRR7WN4V7FYGT0KV7/chunks/000001 bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ1YRR7WN4V7FYGT0KV7/index bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ1YRR7WN4V7FYGT0KV7/tombstones bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ1YRR7WN4V7FYGT0KV7/deletion-mark.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level info component cleaner user user-2 msg deleted block marked for deletion block 01GB8VKJ1YRR7WN4V7FYGT0KV7 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ6MKPEDXXQJN0EQME5C/meta.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ6MKPEDXXQJN0EQME5C/chunks/000001 bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ6MKPEDXXQJN0EQME5C/index bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ6MKPEDXXQJN0EQME5C/tombstones bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GB8VKJ6MKPEDXXQJN0EQME5C/deletion-mark.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod3881396371/001 logger.go:22: level info component cleaner user user-2 msg deleted block marked for deletion block 01GB8VKJ6MKPEDXXQJN0EQME5C logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 5.333642ms --- PASS: TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod (0.57s) === RUN TestSyncer_GarbageCollect_e2e === PAUSE TestSyncer_GarbageCollect_e2e === RUN TestGroupCompactE2E === PAUSE TestGroupCompactE2E === RUN TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly === PAUSE TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly === RUN TestGroupKey === RUN TestGroupKey/#00 === RUN TestGroupKey/#01 === RUN TestGroupKey/#02 === RUN TestGroupKey/#03 --- PASS: TestGroupKey (0.00s) --- PASS: TestGroupKey/#00 (0.00s) --- PASS: TestGroupKey/#01 (0.00s) --- PASS: TestGroupKey/#02 (0.00s) --- PASS: TestGroupKey/#03 (0.00s) === RUN TestGroupMaxMinTime --- PASS: TestGroupMaxMinTime (0.00s) === RUN TestFilterOwnJobs === RUN TestFilterOwnJobs/should_return_all_planned_jobs_if_the_compactor_instance_owns_all_of_them === RUN TestFilterOwnJobs/should_return_no_jobs_if_the_compactor_instance_owns_none_of_them === RUN TestFilterOwnJobs/should_return_some_jobs_if_the_compactor_instance_owns_some_of_them --- PASS: TestFilterOwnJobs (0.00s) --- PASS: TestFilterOwnJobs/should_return_all_planned_jobs_if_the_compactor_instance_owns_all_of_them (0.00s) --- PASS: TestFilterOwnJobs/should_return_no_jobs_if_the_compactor_instance_owns_none_of_them (0.00s) --- PASS: TestFilterOwnJobs/should_return_some_jobs_if_the_compactor_instance_owns_some_of_them (0.00s) === RUN TestNoCompactionMarkFilter === RUN TestNoCompactionMarkFilter/filter_with_no_deletion_of_blocks_marked_for_no-compaction === RUN TestNoCompactionMarkFilter/filter_with_deletion_enabled === RUN TestNoCompactionMarkFilter/filter_with_deletion_enabled,_but_canceled_context === RUN TestNoCompactionMarkFilter/filtering_block_with_wrong_marker_version --- PASS: TestNoCompactionMarkFilter (0.01s) --- PASS: TestNoCompactionMarkFilter/filter_with_no_deletion_of_blocks_marked_for_no-compaction (0.01s) --- PASS: TestNoCompactionMarkFilter/filter_with_deletion_enabled (0.00s) --- PASS: TestNoCompactionMarkFilter/filter_with_deletion_enabled,_but_canceled_context (0.00s) --- PASS: TestNoCompactionMarkFilter/filtering_block_with_wrong_marker_version (0.00s) === RUN TestConvertCompactionResultToForEachJobs --- PASS: TestConvertCompactionResultToForEachJobs (0.00s) === RUN TestRingConfig_DefaultConfigToLifecyclerConfig --- PASS: TestRingConfig_DefaultConfigToLifecyclerConfig (0.01s) === RUN TestRingConfig_CustomConfigToLifecyclerConfig --- PASS: TestRingConfig_CustomConfigToLifecyclerConfig (0.00s) === RUN TestConfig_ShouldSupportYamlConfig --- PASS: TestConfig_ShouldSupportYamlConfig (0.01s) === RUN TestConfig_ShouldSupportCliFlags --- PASS: TestConfig_ShouldSupportCliFlags (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_with_only_1_block_range_period === RUN TestConfig_Validate/should_fail_with_non_divisible_block_range_periods === RUN TestConfig_Validate/should_fail_on_unknown_compaction_jobs_order === RUN TestConfig_Validate/should_fail_on_invalid_value_of_max-opening-blocks-concurrency === RUN TestConfig_Validate/should_fail_on_invalid_value_of_max-closing-blocks-concurrency === RUN TestConfig_Validate/should_fail_on_invalid_value_of_symbols-flushers-concurrency === RUN TestConfig_Validate/should_pass_with_the_default_config --- PASS: TestConfig_Validate (0.01s) --- PASS: TestConfig_Validate/should_pass_with_only_1_block_range_period (0.00s) --- PASS: TestConfig_Validate/should_fail_with_non_divisible_block_range_periods (0.00s) --- PASS: TestConfig_Validate/should_fail_on_unknown_compaction_jobs_order (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_value_of_max-opening-blocks-concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_value_of_max-closing-blocks-concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_value_of_symbols-flushers-concurrency (0.00s) --- PASS: TestConfig_Validate/should_pass_with_the_default_config (0.00s) === RUN TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks === PAUSE TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks === RUN TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket === PAUSE TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket === RUN TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant === PAUSE TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant === RUN TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction === PAUSE TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction === RUN TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime === PAUSE TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime === RUN TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion === PAUSE TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion === RUN TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction === PAUSE TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction === RUN TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion === PAUSE TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion === RUN TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning === PAUSE TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning === RUN TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning === PAUSE TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning === RUN TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning === PAUSE TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning === RUN TestMultitenantCompactor_DeleteLocalSyncFiles --- PASS: TestMultitenantCompactor_DeleteLocalSyncFiles (6.57s) === RUN TestMultitenantCompactor_ShouldFailCompactionOnTimeout === PAUSE TestMultitenantCompactor_ShouldFailCompactionOnTimeout === RUN TestOwnUser === RUN TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size === PAUSE TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size === RUN TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes === PAUSE TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes === RUN TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size === PAUSE TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size === CONT TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size === CONT TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size === CONT TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes --- PASS: TestOwnUser (0.00s) --- PASS: TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size (1.44s) --- PASS: TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size (1.86s) --- PASS: TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes (1.91s) === RUN TestMultitenantCompactor_OutOfOrderCompaction --- PASS: TestMultitenantCompactor_OutOfOrderCompaction (0.70s) === RUN TestSortJobsBySmallestRangeOldestBlocksFirst === RUN TestSortJobsBySmallestRangeOldestBlocksFirst/should_do_nothing_on_empty_input === RUN TestSortJobsBySmallestRangeOldestBlocksFirst/should_sort_jobs_by_smallest_range,_oldest_blocks_first === RUN TestSortJobsBySmallestRangeOldestBlocksFirst/split_jobs_are_always_sorted_first --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst (0.00s) --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst/should_do_nothing_on_empty_input (0.00s) --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst/should_sort_jobs_by_smallest_range,_oldest_blocks_first (0.00s) --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst/split_jobs_are_always_sorted_first (0.00s) === RUN TestSortJobsByNewestBlocksFirst === RUN TestSortJobsByNewestBlocksFirst/should_do_nothing_on_empty_input job_sorting_test.go:126: sorted jobs: === RUN TestSortJobsByNewestBlocksFirst/should_sort_jobs_by_newest_blocks_first job_sorting_test.go:126: sorted jobs: job_sorting_test.go:128: - (minTime: 40 maxTime: 80) job_sorting_test.go:128: - (minTime: 10 maxTime: 30) job_sorting_test.go:128: - (minTime: 10 maxTime: 20) === RUN TestSortJobsByNewestBlocksFirst/should_give_precedence_to_smaller_time_ranges_in_case_of_multiple_jobs_with_the_same_max_time job_sorting_test.go:126: sorted jobs: job_sorting_test.go:128: - (minTime: 30 maxTime: 40) job_sorting_test.go:128: - (minTime: 10 maxTime: 40) === RUN TestSortJobsByNewestBlocksFirst/should_give_precedence_to_newest_blocks_over_smaller_time_ranges job_sorting_test.go:126: sorted jobs: job_sorting_test.go:128: - (minTime: 10 maxTime: 40) job_sorting_test.go:128: - (minTime: 10 maxTime: 30) job_sorting_test.go:128: - (minTime: 10 maxTime: 20) --- PASS: TestSortJobsByNewestBlocksFirst (0.00s) --- PASS: TestSortJobsByNewestBlocksFirst/should_do_nothing_on_empty_input (0.00s) --- PASS: TestSortJobsByNewestBlocksFirst/should_sort_jobs_by_newest_blocks_first (0.00s) --- PASS: TestSortJobsByNewestBlocksFirst/should_give_precedence_to_smaller_time_ranges_in_case_of_multiple_jobs_with_the_same_max_time (0.00s) --- PASS: TestSortJobsByNewestBlocksFirst/should_give_precedence_to_newest_blocks_over_smaller_time_ranges (0.00s) === RUN TestLabelRemoverFilter === RUN TestLabelRemoverFilter/should_remove_configured_labels === RUN TestLabelRemoverFilter/should_remove_configured_labels_2 --- PASS: TestLabelRemoverFilter (0.00s) --- PASS: TestLabelRemoverFilter/should_remove_configured_labels (0.00s) --- PASS: TestLabelRemoverFilter/should_remove_configured_labels_2 (0.00s) === RUN TestShardAwareDeduplicateFilter_Filter === RUN TestShardAwareDeduplicateFilter_Filter/3_non_compacted_blocks_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length === RUN TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_single_shard === RUN TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_two_shards === RUN TestShardAwareDeduplicateFilter_Filter/3_compacted_blocks_of_level_2_and_one_compacted_block_of_level_3_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources_and_different_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length_and_different_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/when_invalid_shard_IDs_present,_no_deduplication_happens_for_source_blocks === RUN TestShardAwareDeduplicateFilter_Filter/compacted_block_without_sources_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources === RUN TestShardAwareDeduplicateFilter_Filter/blocks_with_same_sources_and_different_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split_into_two,_one_shard_missing === RUN TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level === RUN TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level,_with_various_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_same_sources === RUN TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_overlapping_sources === RUN TestShardAwareDeduplicateFilter_Filter/4_non_compacted_blocks_and_compacted_block_of_level_2_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_equal_length === RUN TestShardAwareDeduplicateFilter_Filter/block_with_invalid_shardID_cannot_'include'_its_source_blocks === RUN TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards --- PASS: TestShardAwareDeduplicateFilter_Filter (0.02s) --- PASS: TestShardAwareDeduplicateFilter_Filter/3_non_compacted_blocks_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_single_shard (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_two_shards (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/3_compacted_blocks_of_level_2_and_one_compacted_block_of_level_3_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources_and_different_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length_and_different_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/when_invalid_shard_IDs_present,_no_deduplication_happens_for_source_blocks (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_block_without_sources_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/blocks_with_same_sources_and_different_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split_into_two,_one_shard_missing (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level,_with_various_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_same_sources (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_overlapping_sources (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/4_non_compacted_blocks_and_compacted_block_of_level_2_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_equal_length (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/block_with_invalid_shardID_cannot_'include'_its_source_blocks (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards (0.00s) === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.761349ms duration_ms=1 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=2.923854ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GB8VKVD2ZBWKDVSCA1AVQKBV (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GB8VKVK1WASYWRJMR4T6GRRR (min time: 1970-01-01 00:01:00 +0000 UTC, max time: 1970-01-01 00:07:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKVD2ZBWKDVSCA1AVQKBV (min time: 0, max time: 300000) 01GB8VKVK1WASYWRJMR4T6GRRR (min time: 60000, max time: 420000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKVD2ZBWKDVSCA1AVQKBV/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKVK1WASYWRJMR4T6GRRR/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKVD2ZBWKDVSCA1AVQKBV /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKVK1WASYWRJMR4T6GRRR]" duration=3.906991ms duration_ms=3 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=420000 ulid=01GB8VKW4F0GWZ41NAVHJJ589V sources="[01GB8VKVK1WASYWRJMR4T6GRRR 01GB8VKVD2ZBWKDVSCA1AVQKBV]" duration=312.732137ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=420000 ulid=01GB8VKW4FBQNDK5C7CEEGTZ56 sources="[01GB8VKVK1WASYWRJMR4T6GRRR 01GB8VKVD2ZBWKDVSCA1AVQKBV]" duration=313.068609ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="compacted blocks" new="[01GB8VKW4F0GWZ41NAVHJJ589V 01GB8VKW4FBQNDK5C7CEEGTZ56]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKVD2ZBWKDVSCA1AVQKBV /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKVK1WASYWRJMR4T6GRRR]" duration=313.414319ms duration_ms=313 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKW4F0GWZ41NAVHJJ589V/chunks/000001 dst=01GB8VKW4F0GWZ41NAVHJJ589V/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKW4FBQNDK5C7CEEGTZ56/chunks/000001 dst=01GB8VKW4FBQNDK5C7CEEGTZ56/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKW4F0GWZ41NAVHJJ589V/index dst=01GB8VKW4F0GWZ41NAVHJJ589V/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKW4FBQNDK5C7CEEGTZ56/index dst=01GB8VKW4FBQNDK5C7CEEGTZ56/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split3523558074/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKW4FBQNDK5C7CEEGTZ56 duration=2.289622ms duration_ms=2 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKW4F0GWZ41NAVHJJ589V duration=2.282078ms duration_ms=2 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=4.165426ms duration_ms=4 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKVD2ZBWKDVSCA1AVQKBV level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKVD2ZBWKDVSCA1AVQKBV level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKVK1WASYWRJMR4T6GRRR level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKVK1WASYWRJMR4T6GRRR level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="compaction job finished" success=true duration=323.504097ms duration_ms=323 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=2.283851ms duration_ms=2 cached=5 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=4.261207ms duration_ms=4 cached=5 returned=3 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=1.745079ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.388469ms duration_ms=1 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GB8VKWKR0F20W4DD3Y5SD5R8 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GB8VKWS6291VH544TYADSNA4 (min time: 1970-01-01 00:05:00 +0000 UTC, max time: 1970-01-01 00:10:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKWKR0F20W4DD3Y5SD5R8 (min time: 0, max time: 300000) 01GB8VKWS6291VH544TYADSNA4 (min time: 300000, max time: 600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKWKR0F20W4DD3Y5SD5R8/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKWS6291VH544TYADSNA4/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKWKR0F20W4DD3Y5SD5R8 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKWS6291VH544TYADSNA4]" duration=1.661733ms duration_ms=1 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GB8VKX6HG7W518NHSQY1VV6A sources="[01GB8VKWKR0F20W4DD3Y5SD5R8 01GB8VKWS6291VH544TYADSNA4]" duration=195.137933ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GB8VKX6HP2FQ262P744W4MJ4 sources="[01GB8VKWKR0F20W4DD3Y5SD5R8 01GB8VKWS6291VH544TYADSNA4]" duration=195.235276ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compacted blocks" new="[01GB8VKX6HG7W518NHSQY1VV6A 01GB8VKX6HP2FQ262P744W4MJ4]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKWKR0F20W4DD3Y5SD5R8 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKWS6291VH544TYADSNA4]" duration=195.305849ms duration_ms=195 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKX6HG7W518NHSQY1VV6A/chunks/000001 dst=01GB8VKX6HG7W518NHSQY1VV6A/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKX6HG7W518NHSQY1VV6A/index dst=01GB8VKX6HG7W518NHSQY1VV6A/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKX6HG7W518NHSQY1VV6A duration=725.944µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKX6HP2FQ262P744W4MJ4/chunks/000001 dst=01GB8VKX6HP2FQ262P744W4MJ4/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VKX6HP2FQ262P744W4MJ4/index dst=01GB8VKX6HP2FQ262P744W4MJ4/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split2457476268/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKX6HP2FQ262P744W4MJ4 duration=873.391µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=2.088454ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKWKR0F20W4DD3Y5SD5R8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKWKR0F20W4DD3Y5SD5R8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKWS6291VH544TYADSNA4 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKWS6291VH544TYADSNA4 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction job finished" success=true duration=200.04848ms duration_ms=200 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.52209ms duration_ms=1 cached=5 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=3.222315ms duration_ms=3 cached=5 returned=3 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/smaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=2.124101ms duration_ms=2 cached=10 returned=10 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=3.055621ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 1_of_2, blocks: 01GB8VKY0S8J21PSHQX8MC89WP (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GB8VKY91S1T53070Z53MDTDG (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 2_of_2, blocks: 01GB8VKY4XPECS466Q8P39FEBD (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GB8VKYDFRNE9ZJYVRYQ3QY9M (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 job="stage: split, range start: 28800000, range end: 36000000, shard: 1_of_1, blocks: 01GB8VKYHW84KCZ9K1JA6DBSHH (min time: 1970-01-01 08:00:00 +0000 UTC, max time: 1970-01-01 10:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 job="stage: split, range start: 50400000, range end: 57600000, shard: 1_of_1, blocks: 01GB8VKYNP404BP4XZHRPKGPG8 (min time: 1970-01-01 14:00:00 +0000 UTC, max time: 1970-01-01 16:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GB8VKXRRC1ES5X4PTAW3TET2 (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GB8VKXWTT3FRVR2WFM7F9VBB (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKXWTT3FRVR2WFM7F9VBB (min time: 7200000, max time: 14400000) 01GB8VKXRRC1ES5X4PTAW3TET2 (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKXWTT3FRVR2WFM7F9VBB/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKXRRC1ES5X4PTAW3TET2/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VKXWTT3FRVR2WFM7F9VBB /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VKXRRC1ES5X4PTAW3TET2]" duration=1.751371ms duration_ms=1 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GB8VKYZ9TCBKGAHQX62PCRRW sources="[01GB8VKXWTT3FRVR2WFM7F9VBB 01GB8VKXRRC1ES5X4PTAW3TET2]" duration=205.779008ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GB8VKYZ9ZGJVNZA6BFC7QKPJ sources="[01GB8VKXWTT3FRVR2WFM7F9VBB 01GB8VKXRRC1ES5X4PTAW3TET2]" duration=205.867655ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GB8VKYZ9TCBKGAHQX62PCRRW 01GB8VKYZ9ZGJVNZA6BFC7QKPJ]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VKXWTT3FRVR2WFM7F9VBB /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VKXRRC1ES5X4PTAW3TET2]" duration=205.928799ms duration_ms=205 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VKYZ9TCBKGAHQX62PCRRW/chunks/000001 dst=01GB8VKYZ9TCBKGAHQX62PCRRW/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VKYZ9TCBKGAHQX62PCRRW/index dst=01GB8VKYZ9TCBKGAHQX62PCRRW/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKYZ9TCBKGAHQX62PCRRW duration=673.005µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VKYZ9ZGJVNZA6BFC7QKPJ/chunks/000001 dst=01GB8VKYZ9ZGJVNZA6BFC7QKPJ/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VKYZ9ZGJVNZA6BFC7QKPJ/index dst=01GB8VKYZ9ZGJVNZA6BFC7QKPJ/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKYZ9ZGJVNZA6BFC7QKPJ duration=1.004057ms duration_ms=1 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=2.470853ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKXWTT3FRVR2WFM7F9VBB level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKXWTT3FRVR2WFM7F9VBB level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKXRRC1ES5X4PTAW3TET2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKXRRC1ES5X4PTAW3TET2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job finished" success=true duration=211.422692ms duration_ms=211 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=1 plan="[01GB8VKYHW84KCZ9K1JA6DBSHH (min time: 28800000, max time: 36000000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKYHW84KCZ9K1JA6DBSHH/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=1 plan=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GB8VKYHW84KCZ9K1JA6DBSHH] duration=1.791617ms duration_ms=1 level=info component=compactor msg="compact blocks" count=1 mint=28800000 maxt=36000000 ulid=01GB8VKZ5X4MVER1SEYT7F5V4J sources=[01GB8VKYHW84KCZ9K1JA6DBSHH] duration=215.48234ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=1 mint=28800000 maxt=36000000 ulid=01GB8VKZ5X8B3GM80SRY9V42XF sources=[01GB8VKYHW84KCZ9K1JA6DBSHH] duration=215.576537ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="compacted blocks" new="[01GB8VKZ5X4MVER1SEYT7F5V4J 01GB8VKZ5X8B3GM80SRY9V42XF]" blocks=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GB8VKYHW84KCZ9K1JA6DBSHH] duration=215.634576ms duration_ms=215 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GB8VKZ5X4MVER1SEYT7F5V4J/chunks/000001 dst=01GB8VKZ5X4MVER1SEYT7F5V4J/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GB8VKZ5X4MVER1SEYT7F5V4J/index dst=01GB8VKZ5X4MVER1SEYT7F5V4J/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKZ5X4MVER1SEYT7F5V4J duration=706.798µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GB8VKZ5X8B3GM80SRY9V42XF/chunks/000001 dst=01GB8VKZ5X8B3GM80SRY9V42XF/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GB8VKZ5X8B3GM80SRY9V42XF/index dst=01GB8VKZ5X8B3GM80SRY9V42XF/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKZ5X8B3GM80SRY9V42XF duration=1.211036ms duration_ms=1 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=2.674626ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKYHW84KCZ9K1JA6DBSHH level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKYHW84KCZ9K1JA6DBSHH level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="compaction job finished" success=true duration=220.977394ms duration_ms=220 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=1 plan="[01GB8VKYNP404BP4XZHRPKGPG8 (min time: 50400000, max time: 57600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKYNP404BP4XZHRPKGPG8/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=1 plan=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GB8VKYNP404BP4XZHRPKGPG8] duration=2.182841ms duration_ms=2 level=info component=compactor msg="compact blocks" count=1 mint=50400000 maxt=57600000 ulid=01GB8VKZCV41HZ8H1FH3JCMK3P sources=[01GB8VKYNP404BP4XZHRPKGPG8] duration=177.704337ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=1 mint=50400000 maxt=57600000 ulid=01GB8VKZCV21W2RENK8NZKQRMQ sources=[01GB8VKYNP404BP4XZHRPKGPG8] duration=177.781613ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compacted blocks" new="[01GB8VKZCV41HZ8H1FH3JCMK3P 01GB8VKZCV21W2RENK8NZKQRMQ]" blocks=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GB8VKYNP404BP4XZHRPKGPG8] duration=177.842497ms duration_ms=177 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GB8VKZCV41HZ8H1FH3JCMK3P/chunks/000001 dst=01GB8VKZCV41HZ8H1FH3JCMK3P/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GB8VKZCV21W2RENK8NZKQRMQ/chunks/000001 dst=01GB8VKZCV21W2RENK8NZKQRMQ/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GB8VKZCV41HZ8H1FH3JCMK3P/index dst=01GB8VKZCV41HZ8H1FH3JCMK3P/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-split-1_of_1-50400000-57600000/01GB8VKZCV21W2RENK8NZKQRMQ/index dst=01GB8VKZCV21W2RENK8NZKQRMQ/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKZCV41HZ8H1FH3JCMK3P duration=651.875µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKZCV21W2RENK8NZKQRMQ duration=677.172µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=1.503394ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKYNP404BP4XZHRPKGPG8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKYNP404BP4XZHRPKGPG8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 minTime="1970-01-01 14:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction job finished" success=true duration=182.175699ms duration_ms=182 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKY0S8J21PSHQX8MC89WP (min time: 14400000, max time: 21600000) 01GB8VKY91S1T53070Z53MDTDG (min time: 21600000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKY91S1T53070Z53MDTDG/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKY0S8J21PSHQX8MC89WP/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VKY0S8J21PSHQX8MC89WP /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VKY91S1T53070Z53MDTDG]" duration=1.493487ms duration_ms=1 level=info component=compactor msg="compact blocks" count=2 mint=14400000 maxt=28800000 ulid=01GB8VKZJGNDR6A8DKAZC6TTDY sources="[01GB8VKY0S8J21PSHQX8MC89WP 01GB8VKY91S1T53070Z53MDTDG]" duration=108.357758ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VKZJGNDR6A8DKAZC6TTDY] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VKY0S8J21PSHQX8MC89WP /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VKY91S1T53070Z53MDTDG]" duration=108.622105ms duration_ms=108 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VKZJGNDR6A8DKAZC6TTDY/chunks/000001 dst=01GB8VKZJGNDR6A8DKAZC6TTDY/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VKZJGNDR6A8DKAZC6TTDY/index dst=01GB8VKZJGNDR6A8DKAZC6TTDY/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKZJGNDR6A8DKAZC6TTDY duration=688.163µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.791547ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKY0S8J21PSHQX8MC89WP level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKY0S8J21PSHQX8MC89WP level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKY91S1T53070Z53MDTDG level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKY91S1T53070Z53MDTDG level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job finished" success=true duration=112.772423ms duration_ms=112 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKY4XPECS466Q8P39FEBD (min time: 14400000, max time: 21600000) 01GB8VKYDFRNE9ZJYVRYQ3QY9M (min time: 21600000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKYDFRNE9ZJYVRYQ3QY9M/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKY4XPECS466Q8P39FEBD/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VKY4XPECS466Q8P39FEBD /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VKYDFRNE9ZJYVRYQ3QY9M]" duration=2.11264ms duration_ms=2 level=info component=compactor msg="compact blocks" count=2 mint=14400000 maxt=28800000 ulid=01GB8VKZP2S54EE0QKZDXNZV45 sources="[01GB8VKY4XPECS466Q8P39FEBD 01GB8VKYDFRNE9ZJYVRYQ3QY9M]" duration=140.473783ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VKZP2S54EE0QKZDXNZV45] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VKY4XPECS466Q8P39FEBD /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VKYDFRNE9ZJYVRYQ3QY9M]" duration=140.604488ms duration_ms=140 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VKZP2S54EE0QKZDXNZV45/chunks/000001 dst=01GB8VKZP2S54EE0QKZDXNZV45/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VKZP2S54EE0QKZDXNZV45/index dst=01GB8VKZP2S54EE0QKZDXNZV45/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKZP2S54EE0QKZDXNZV45 duration=682.613µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.716385ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKY4XPECS466Q8P39FEBD level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKY4XPECS466Q8P39FEBD level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKYDFRNE9ZJYVRYQ3QY9M level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKYDFRNE9ZJYVRYQ3QY9M level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job finished" success=true duration=145.371125ms duration_ms=145 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=2.988335ms duration_ms=2 cached=18 returned=10 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 job="stage: merge, range start: 0, range end: 14400000, shard: 1_of_2, blocks: 01GB8VKXGQAH9VMF2WRGCN27F8 (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC),01GB8VKYZ9TCBKGAHQX62PCRRW (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 job="stage: merge, range start: 0, range end: 14400000, shard: 2_of_2, blocks: 01GB8VKXMN799ZC4NH7H8SWNVB (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC),01GB8VKYZ9ZGJVNZA6BFC7QKPJ (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 job="stage: merge, range start: 28800000, range end: 57600000, shard: 1_of_2, blocks: 01GB8VKZ5X4MVER1SEYT7F5V4J (min time: 1970-01-01 08:00:00 +0000 UTC, max time: 1970-01-01 10:00:00 +0000 UTC),01GB8VKZCV41HZ8H1FH3JCMK3P (min time: 1970-01-01 14:00:00 +0000 UTC, max time: 1970-01-01 16:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 job="stage: merge, range start: 28800000, range end: 57600000, shard: 2_of_2, blocks: 01GB8VKZ5X8B3GM80SRY9V42XF (min time: 1970-01-01 08:00:00 +0000 UTC, max time: 1970-01-01 10:00:00 +0000 UTC),01GB8VKZCV21W2RENK8NZKQRMQ (min time: 1970-01-01 14:00:00 +0000 UTC, max time: 1970-01-01 16:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKXGQAH9VMF2WRGCN27F8 (min time: 1, max time: 7200000) 01GB8VKYZ9TCBKGAHQX62PCRRW (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKXGQAH9VMF2WRGCN27F8/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKYZ9TCBKGAHQX62PCRRW/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-14400000/01GB8VKXGQAH9VMF2WRGCN27F8 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-14400000/01GB8VKYZ9TCBKGAHQX62PCRRW]" duration=2.397795ms duration_ms=2 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=1 maxt=14400000 ulid=01GB8VKZTRTZQKVJZRXJBRQBER sources="[01GB8VKYZ9TCBKGAHQX62PCRRW 01GB8VKXGQAH9VMF2WRGCN27F8]" duration=116.561843ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VKZTRTZQKVJZRXJBRQBER] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-14400000/01GB8VKXGQAH9VMF2WRGCN27F8 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-14400000/01GB8VKYZ9TCBKGAHQX62PCRRW]" duration=116.686638ms duration_ms=116 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-14400000/01GB8VKZTRTZQKVJZRXJBRQBER/chunks/000001 dst=01GB8VKZTRTZQKVJZRXJBRQBER/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-14400000/01GB8VKZTRTZQKVJZRXJBRQBER/index dst=01GB8VKZTRTZQKVJZRXJBRQBER/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKZTRTZQKVJZRXJBRQBER duration=672.344µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.695055ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKXGQAH9VMF2WRGCN27F8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKXGQAH9VMF2WRGCN27F8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKYZ9TCBKGAHQX62PCRRW level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKYZ9TCBKGAHQX62PCRRW level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job finished" success=true duration=121.71726ms duration_ms=121 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKXMN799ZC4NH7H8SWNVB (min time: 1, max time: 7200000) 01GB8VKYZ9ZGJVNZA6BFC7QKPJ (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKYZ9ZGJVNZA6BFC7QKPJ/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKXMN799ZC4NH7H8SWNVB/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-14400000/01GB8VKXMN799ZC4NH7H8SWNVB /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-14400000/01GB8VKYZ9ZGJVNZA6BFC7QKPJ]" duration=1.539212ms duration_ms=1 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=1 maxt=14400000 ulid=01GB8VKZYGYD6JGH5NXZKZK898 sources="[01GB8VKYZ9ZGJVNZA6BFC7QKPJ 01GB8VKXMN799ZC4NH7H8SWNVB]" duration=117.341168ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VKZYGYD6JGH5NXZKZK898] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-14400000/01GB8VKXMN799ZC4NH7H8SWNVB /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-14400000/01GB8VKYZ9ZGJVNZA6BFC7QKPJ]" duration=117.509294ms duration_ms=117 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-14400000/01GB8VKZYGYD6JGH5NXZKZK898/chunks/000001 dst=01GB8VKZYGYD6JGH5NXZKZK898/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-14400000/01GB8VKZYGYD6JGH5NXZKZK898/index dst=01GB8VKZYGYD6JGH5NXZKZK898/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VKZYGYD6JGH5NXZKZK898 duration=843.775µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=2.296986ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKXMN799ZC4NH7H8SWNVB level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKXMN799ZC4NH7H8SWNVB level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKYZ9ZGJVNZA6BFC7QKPJ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKYZ9ZGJVNZA6BFC7QKPJ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-14400000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job finished" success=true duration=122.248929ms duration_ms=122 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKZ5X4MVER1SEYT7F5V4J (min time: 28800000, max time: 36000000) 01GB8VKZCV41HZ8H1FH3JCMK3P (min time: 50400000, max time: 57600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKZ5X4MVER1SEYT7F5V4J/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKZCV41HZ8H1FH3JCMK3P/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-28800000-57600000/01GB8VKZ5X4MVER1SEYT7F5V4J /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-28800000-57600000/01GB8VKZCV41HZ8H1FH3JCMK3P]" duration=1.571243ms duration_ms=1 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=28800000 maxt=57600000 ulid=01GB8VM02B13JZQM9YM65GQDFF sources="[01GB8VKZCV41HZ8H1FH3JCMK3P 01GB8VKZ5X4MVER1SEYT7F5V4J]" duration=104.860627ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM02B13JZQM9YM65GQDFF] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-28800000-57600000/01GB8VKZ5X4MVER1SEYT7F5V4J /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-28800000-57600000/01GB8VKZCV41HZ8H1FH3JCMK3P]" duration=104.9684ms duration_ms=104 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-28800000-57600000/01GB8VM02B13JZQM9YM65GQDFF/chunks/000001 dst=01GB8VM02B13JZQM9YM65GQDFF/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-28800000-57600000/01GB8VM02B13JZQM9YM65GQDFF/index dst=01GB8VM02B13JZQM9YM65GQDFF/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM02B13JZQM9YM65GQDFF duration=670.881µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.52788ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKZ5X4MVER1SEYT7F5V4J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKZ5X4MVER1SEYT7F5V4J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKZCV41HZ8H1FH3JCMK3P level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKZCV41HZ8H1FH3JCMK3P level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction job finished" success=true duration=108.933921ms duration_ms=108 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKZ5X8B3GM80SRY9V42XF (min time: 28800000, max time: 36000000) 01GB8VKZCV21W2RENK8NZKQRMQ (min time: 50400000, max time: 57600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKZCV21W2RENK8NZKQRMQ/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKZ5X8B3GM80SRY9V42XF/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-28800000-57600000/01GB8VKZ5X8B3GM80SRY9V42XF /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-28800000-57600000/01GB8VKZCV21W2RENK8NZKQRMQ]" duration=1.640533ms duration_ms=1 level=info component=compactor msg="compact blocks" count=2 mint=28800000 maxt=57600000 ulid=01GB8VM05RY0T5KTEQ0NZSR58B sources="[01GB8VKZ5X8B3GM80SRY9V42XF 01GB8VKZCV21W2RENK8NZKQRMQ]" duration=115.672563ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM05RY0T5KTEQ0NZSR58B] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-28800000-57600000/01GB8VKZ5X8B3GM80SRY9V42XF /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-28800000-57600000/01GB8VKZCV21W2RENK8NZKQRMQ]" duration=115.789583ms duration_ms=115 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-28800000-57600000/01GB8VM05RY0T5KTEQ0NZSR58B/chunks/000001 dst=01GB8VM05RY0T5KTEQ0NZSR58B/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-28800000-57600000/01GB8VM05RY0T5KTEQ0NZSR58B/index dst=01GB8VM05RY0T5KTEQ0NZSR58B/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM05RY0T5KTEQ0NZSR58B duration=677.633µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.499748ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKZ5X8B3GM80SRY9V42XF level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKZ5X8B3GM80SRY9V42XF level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKZCV21W2RENK8NZKQRMQ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKZCV21W2RENK8NZKQRMQ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction job finished" success=true duration=119.792333ms duration_ms=119 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=3.321221ms duration_ms=3 cached=22 returned=6 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 job="stage: merge, range start: 0, range end: 28800000, shard: 1_of_2, blocks: 01GB8VKZJGNDR6A8DKAZC6TTDY (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC),01GB8VKZTRTZQKVJZRXJBRQBER (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 job="stage: merge, range start: 0, range end: 28800000, shard: 2_of_2, blocks: 01GB8VKZP2S54EE0QKZDXNZV45 (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC),01GB8VKZYGYD6JGH5NXZKZK898 (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKZTRTZQKVJZRXJBRQBER (min time: 1, max time: 14400000) 01GB8VKZJGNDR6A8DKAZC6TTDY (min time: 14400000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKZJGNDR6A8DKAZC6TTDY/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKZTRTZQKVJZRXJBRQBER/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VKZTRTZQKVJZRXJBRQBER /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VKZJGNDR6A8DKAZC6TTDY]" duration=2.146804ms duration_ms=2 level=info component=compactor msg="compact blocks" count=2 mint=1 maxt=28800000 ulid=01GB8VM09NR3XSNJ31B9J3TDH5 sources="[01GB8VKZTRTZQKVJZRXJBRQBER 01GB8VKZJGNDR6A8DKAZC6TTDY]" duration=117.366315ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM09NR3XSNJ31B9J3TDH5] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VKZTRTZQKVJZRXJBRQBER /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VKZJGNDR6A8DKAZC6TTDY]" duration=117.870603ms duration_ms=117 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VM09NR3XSNJ31B9J3TDH5/chunks/000001 dst=01GB8VM09NR3XSNJ31B9J3TDH5/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VM09NR3XSNJ31B9J3TDH5/index dst=01GB8VM09NR3XSNJ31B9J3TDH5/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM09NR3XSNJ31B9J3TDH5 duration=1.918314ms duration_ms=1 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=7.880647ms duration_ms=7 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKZTRTZQKVJZRXJBRQBER level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKZTRTZQKVJZRXJBRQBER level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKZJGNDR6A8DKAZC6TTDY level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKZJGNDR6A8DKAZC6TTDY level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job finished" success=true duration=129.912619ms duration_ms=129 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VKZYGYD6JGH5NXZKZK898 (min time: 1, max time: 14400000) 01GB8VKZP2S54EE0QKZDXNZV45 (min time: 14400000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKZYGYD6JGH5NXZKZK898/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VKZP2S54EE0QKZDXNZV45/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VKZYGYD6JGH5NXZKZK898 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VKZP2S54EE0QKZDXNZV45]" duration=6.266254ms duration_ms=6 level=info component=compactor msg="compact blocks" count=2 mint=1 maxt=28800000 ulid=01GB8VM0DZADB6F15JNJA5Y10D sources="[01GB8VKZYGYD6JGH5NXZKZK898 01GB8VKZP2S54EE0QKZDXNZV45]" duration=112.435941ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM0DZADB6F15JNJA5Y10D] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VKZYGYD6JGH5NXZKZK898 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VKZP2S54EE0QKZDXNZV45]" duration=112.560475ms duration_ms=112 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VM0DZADB6F15JNJA5Y10D/chunks/000001 dst=01GB8VM0DZADB6F15JNJA5Y10D/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VM0DZADB6F15JNJA5Y10D/index dst=01GB8VM0DZADB6F15JNJA5Y10D/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges3219233187/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM0DZADB6F15JNJA5Y10D duration=675.8µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.742364ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKZYGYD6JGH5NXZKZK898 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKZYGYD6JGH5NXZKZK898 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VKZP2S54EE0QKZDXNZV45 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VKZP2S54EE0QKZDXNZV45 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job finished" success=true duration=121.867061ms duration_ms=121 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=3.346498ms duration_ms=3 cached=24 returned=4 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=7.624746ms duration_ms=7 cached=24 returned=4 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=1.407584ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.397887ms duration_ms=1 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GB8VM0MMNN84KJSVF2J5JQN5 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GB8VM0RNBDRB7NV37AT5YBVE (min time: 1970-01-01 00:01:00 +0000 UTC, max time: 1970-01-01 00:07:00 +0000 UTC),01GB8VM0WG46PRJW2NTFD617YS (min time: 1970-01-01 01:00:00 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=3 plan="[01GB8VM0MMNN84KJSVF2J5JQN5 (min time: 0, max time: 300000) 01GB8VM0RNBDRB7NV37AT5YBVE (min time: 60000, max time: 420000) 01GB8VM0WG46PRJW2NTFD617YS (min time: 3600000, max time: 7200000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM0WG46PRJW2NTFD617YS/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM0MMNN84KJSVF2J5JQN5/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM0RNBDRB7NV37AT5YBVE/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=3 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM0MMNN84KJSVF2J5JQN5 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM0RNBDRB7NV37AT5YBVE /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM0WG46PRJW2NTFD617YS]" duration=1.999367ms duration_ms=1 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GB8VM15QFZHAPY8N17RMWH73 sources="[01GB8VM0WG46PRJW2NTFD617YS 01GB8VM0RNBDRB7NV37AT5YBVE 01GB8VM0MMNN84KJSVF2J5JQN5]" duration=203.966301ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GB8VM15QXVBH31ZT4T46E3P6 sources="[01GB8VM0WG46PRJW2NTFD617YS 01GB8VM0RNBDRB7NV37AT5YBVE 01GB8VM0MMNN84KJSVF2J5JQN5]" duration=204.058284ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compacted blocks" new="[01GB8VM15QFZHAPY8N17RMWH73 01GB8VM15QXVBH31ZT4T46E3P6]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM0MMNN84KJSVF2J5JQN5 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM0RNBDRB7NV37AT5YBVE /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM0WG46PRJW2NTFD617YS]" duration=204.145268ms duration_ms=204 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM15QXVBH31ZT4T46E3P6/chunks/000001 dst=01GB8VM15QXVBH31ZT4T46E3P6/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM15QFZHAPY8N17RMWH73/chunks/000001 dst=01GB8VM15QFZHAPY8N17RMWH73/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM15QXVBH31ZT4T46E3P6/index dst=01GB8VM15QXVBH31ZT4T46E3P6/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM15QFZHAPY8N17RMWH73/index dst=01GB8VM15QFZHAPY8N17RMWH73/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together3483216407/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM15QXVBH31ZT4T46E3P6 duration=672.764µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM15QFZHAPY8N17RMWH73 duration=655.342µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=1.545304ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM0MMNN84KJSVF2J5JQN5 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM0MMNN84KJSVF2J5JQN5 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM0RNBDRB7NV37AT5YBVE level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM0RNBDRB7NV37AT5YBVE level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM0WG46PRJW2NTFD617YS level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM0WG46PRJW2NTFD617YS level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction job finished" success=true duration=208.945999ms duration_ms=208 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.282961ms duration_ms=1 cached=5 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=2.231132ms duration_ms=2 cached=5 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_if_configured_shards_=_0 level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=1.546887ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.405441ms duration_ms=1 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge--0-7200000 job="stage: merge, range start: 0, range end: 7200000, shard: , blocks: 01GB8VM1FP2KSPDPFCZ9YCE4SF (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GB8VM1KRXMRGHFXS5EFT1YYK (min time: 1970-01-01 00:05:00 +0000 UTC, max time: 1970-01-01 00:10:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM1FP2KSPDPFCZ9YCE4SF (min time: 0, max time: 300000) 01GB8VM1KRXMRGHFXS5EFT1YYK (min time: 300000, max time: 600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM1FP2KSPDPFCZ9YCE4SF/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM1KRXMRGHFXS5EFT1YYK/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_0226482243/001/compact/0@17241709254077376921-merge--0-7200000/01GB8VM1FP2KSPDPFCZ9YCE4SF /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_0226482243/001/compact/0@17241709254077376921-merge--0-7200000/01GB8VM1KRXMRGHFXS5EFT1YYK]" duration=1.845868ms duration_ms=1 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GB8VM20W75D8H46BXQD7S4S8 sources="[01GB8VM1FP2KSPDPFCZ9YCE4SF 01GB8VM1KRXMRGHFXS5EFT1YYK]" duration=120.216039ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM20W75D8H46BXQD7S4S8] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_0226482243/001/compact/0@17241709254077376921-merge--0-7200000/01GB8VM1FP2KSPDPFCZ9YCE4SF /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_0226482243/001/compact/0@17241709254077376921-merge--0-7200000/01GB8VM1KRXMRGHFXS5EFT1YYK]" duration=120.336235ms duration_ms=120 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_0226482243/001/compact/0@17241709254077376921-merge--0-7200000/01GB8VM20W75D8H46BXQD7S4S8/chunks/000001" dst=01GB8VM20W75D8H46BXQD7S4S8/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_0226482243/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_0226482243/001/compact/0@17241709254077376921-merge--0-7200000/01GB8VM20W75D8H46BXQD7S4S8/index" dst=01GB8VM20W75D8H46BXQD7S4S8/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_0226482243/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM20W75D8H46BXQD7S4S8 duration=636.536µs duration_ms=0 external_labels={} level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.631625ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM1FP2KSPDPFCZ9YCE4SF level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM1FP2KSPDPFCZ9YCE4SF level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM1KRXMRGHFXS5EFT1YYK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM1KRXMRGHFXS5EFT1YYK level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction job finished" success=true duration=124.791046ms duration_ms=124 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.571072ms duration_ms=1 cached=4 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.959812ms duration_ms=1 cached=4 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=1.276899ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.192931ms duration_ms=1 cached=2 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GB8VM263C0BM525XDC1EJ8KA (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GB8VM2AB6Q5SZRBTKKV9M3XA (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM263C0BM525XDC1EJ8KA (min time: 7200000, max time: 14400000) 01GB8VM2AB6Q5SZRBTKKV9M3XA (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM2AB6Q5SZRBTKKV9M3XA/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM263C0BM525XDC1EJ8KA/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM263C0BM525XDC1EJ8KA /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM2AB6Q5SZRBTKKV9M3XA]" duration=1.70829ms duration_ms=1 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GB8VM2H5FT2067DDQXBZ7T3F sources="[01GB8VM2AB6Q5SZRBTKKV9M3XA 01GB8VM263C0BM525XDC1EJ8KA]" duration=232.466522ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GB8VM2H5XDXR3E1GSX5ZWJW8 sources="[01GB8VM2AB6Q5SZRBTKKV9M3XA 01GB8VM263C0BM525XDC1EJ8KA]" duration=232.560398ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GB8VM2H5FT2067DDQXBZ7T3F 01GB8VM2H5XDXR3E1GSX5ZWJW8]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM263C0BM525XDC1EJ8KA /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM2AB6Q5SZRBTKKV9M3XA]" duration=232.630329ms duration_ms=232 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM2H5FT2067DDQXBZ7T3F/chunks/000001 dst=01GB8VM2H5FT2067DDQXBZ7T3F/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM2H5FT2067DDQXBZ7T3F/index dst=01GB8VM2H5FT2067DDQXBZ7T3F/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM2H5FT2067DDQXBZ7T3F duration=710.716µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM2H5XDXR3E1GSX5ZWJW8/chunks/000001 dst=01GB8VM2H5XDXR3E1GSX5ZWJW8/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM2H5XDXR3E1GSX5ZWJW8/index dst=01GB8VM2H5XDXR3E1GSX5ZWJW8/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split1278727646/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM2H5XDXR3E1GSX5ZWJW8 duration=707.71µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=2.25713ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM263C0BM525XDC1EJ8KA level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM263C0BM525XDC1EJ8KA level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM2AB6Q5SZRBTKKV9M3XA level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM2AB6Q5SZRBTKKV9M3XA level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job finished" success=true duration=237.594547ms duration_ms=237 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.535565ms duration_ms=1 cached=4 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=2.476974ms duration_ms=2 cached=4 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=1.487044ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.371907ms duration_ms=1 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GB8VM2VJYM4X5ZKHS68B246P (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GB8VM30DG6YSAA6TF5VQM5RE (min time: 1970-01-01 00:07:00 +0000 UTC, max time: 1970-01-01 00:10:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM2VJYM4X5ZKHS68B246P (min time: 0, max time: 300000) 01GB8VM30DG6YSAA6TF5VQM5RE (min time: 420000, max time: 600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM2VJYM4X5ZKHS68B246P/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM30DG6YSAA6TF5VQM5RE/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM2VJYM4X5ZKHS68B246P /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM30DG6YSAA6TF5VQM5RE]" duration=1.601309ms duration_ms=1 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GB8VM3E3MJ31B702M244522W sources="[01GB8VM2VJYM4X5ZKHS68B246P 01GB8VM30DG6YSAA6TF5VQM5RE]" duration=228.410721ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GB8VM3E3SX5A0B80CBM83PTG sources="[01GB8VM2VJYM4X5ZKHS68B246P 01GB8VM30DG6YSAA6TF5VQM5RE]" duration=228.501311ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compacted blocks" new="[01GB8VM3E3MJ31B702M244522W 01GB8VM3E3SX5A0B80CBM83PTG]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM2VJYM4X5ZKHS68B246P /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM30DG6YSAA6TF5VQM5RE]" duration=228.568859ms duration_ms=228 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM3E3MJ31B702M244522W/chunks/000001 dst=01GB8VM3E3MJ31B702M244522W/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM3E3MJ31B702M244522W/index dst=01GB8VM3E3MJ31B702M244522W/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM3E3MJ31B702M244522W duration=676.982µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM3E3SX5A0B80CBM83PTG/chunks/000001 dst=01GB8VM3E3SX5A0B80CBM83PTG/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM3E3SX5A0B80CBM83PTG/index dst=01GB8VM3E3SX5A0B80CBM83PTG/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split2441471883/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM3E3SX5A0B80CBM83PTG duration=739.529µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=1.781908ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM2VJYM4X5ZKHS68B246P level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM2VJYM4X5ZKHS68B246P level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM30DG6YSAA6TF5VQM5RE level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM30DG6YSAA6TF5VQM5RE level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction job finished" success=true duration=232.876012ms duration_ms=232 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.480602ms duration_ms=1 cached=5 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=2.370344ms duration_ms=2 cached=5 returned=3 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=1.699073ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.644851ms duration_ms=1 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GB8VM3RCB9JAK84NEHFP1PGN (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GB8VM3W8JMMBR4SMG4CFTZ2N (min time: 1970-01-01 00:01:00 +0000 UTC, max time: 1970-01-01 00:07:00 +0000 UTC),01GB8VM410ZJ3C3W65JYG7R11C (min time: 1970-01-01 01:00:00 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=3 plan="[01GB8VM3RCB9JAK84NEHFP1PGN (min time: 0, max time: 300000) 01GB8VM3W8JMMBR4SMG4CFTZ2N (min time: 60000, max time: 420000) 01GB8VM410ZJ3C3W65JYG7R11C (min time: 3600000, max time: 7200000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM410ZJ3C3W65JYG7R11C/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM3RCB9JAK84NEHFP1PGN/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM3W8JMMBR4SMG4CFTZ2N/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=3 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM3RCB9JAK84NEHFP1PGN /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM3W8JMMBR4SMG4CFTZ2N /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM410ZJ3C3W65JYG7R11C]" duration=2.520305ms duration_ms=2 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GB8VM49B11JJ6SYMNKS8MB8Q sources="[01GB8VM3RCB9JAK84NEHFP1PGN 01GB8VM410ZJ3C3W65JYG7R11C 01GB8VM3W8JMMBR4SMG4CFTZ2N]" duration=251.072161ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GB8VM49BHPBYHZF04V7V2CVH sources="[01GB8VM3RCB9JAK84NEHFP1PGN 01GB8VM410ZJ3C3W65JYG7R11C 01GB8VM3W8JMMBR4SMG4CFTZ2N]" duration=251.173983ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compacted blocks" new="[01GB8VM49B11JJ6SYMNKS8MB8Q 01GB8VM49BHPBYHZF04V7V2CVH]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM3RCB9JAK84NEHFP1PGN /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM3W8JMMBR4SMG4CFTZ2N /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM410ZJ3C3W65JYG7R11C]" duration=251.256167ms duration_ms=251 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM49B11JJ6SYMNKS8MB8Q/chunks/000001 dst=01GB8VM49B11JJ6SYMNKS8MB8Q/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM49B11JJ6SYMNKS8MB8Q/index dst=01GB8VM49B11JJ6SYMNKS8MB8Q/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM49B11JJ6SYMNKS8MB8Q duration=757.093µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM49BHPBYHZF04V7V2CVH/chunks/000001 dst=01GB8VM49BHPBYHZF04V7V2CVH/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GB8VM49BHPBYHZF04V7V2CVH/index dst=01GB8VM49BHPBYHZF04V7V2CVH/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together1515123596/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM49BHPBYHZF04V7V2CVH duration=866.117µs duration_ms=0 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=2.153426ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM3RCB9JAK84NEHFP1PGN level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM3RCB9JAK84NEHFP1PGN level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM3W8JMMBR4SMG4CFTZ2N level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM3W8JMMBR4SMG4CFTZ2N level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM410ZJ3C3W65JYG7R11C level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM410ZJ3C3W65JYG7R11C level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction job finished" success=true duration=257.281699ms duration_ms=257 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.608382ms duration_ms=1 cached=5 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=3.465882ms duration_ms=3 cached=5 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/should_correctly_handle_empty_blocks_generated_in_the_splitting_stage level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=1.341621ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.094427ms duration_ms=1 cached=1 returned=1 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GB8VM4KD3503XSWPDN53QFXQ (min time: 1970-01-01 03:59:59.999 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=1 plan="[01GB8VM4KD3503XSWPDN53QFXQ (min time: 14399999, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM4KD3503XSWPDN53QFXQ/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=1 plan=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage4005465015/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM4KD3503XSWPDN53QFXQ] duration=941.059µs duration_ms=0 level=info component=compactor msg="compact blocks" count=1 mint=14399999 maxt=14400000 ulid=01GB8VM4WW9EM7JEDRD2B2JV8Y sources=[01GB8VM4KD3503XSWPDN53QFXQ] duration=172.493837ms shard=1_of_2 level=info component=compactor msg="compact blocks resulted in empty block" count=1 sources=[01GB8VM4KD3503XSWPDN53QFXQ] duration=172.632708ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GB8VM4WW9EM7JEDRD2B2JV8Y 00000000000000000000000000]" blocks=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage4005465015/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM4KD3503XSWPDN53QFXQ] duration=172.8044ms duration_ms=172 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction produced an empty block" shard_id=2_of_2 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage4005465015/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM4WW9EM7JEDRD2B2JV8Y/chunks/000001 dst=01GB8VM4WW9EM7JEDRD2B2JV8Y/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage4005465015/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage4005465015/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM4WW9EM7JEDRD2B2JV8Y/index dst=01GB8VM4WW9EM7JEDRD2B2JV8Y/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage4005465015/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM4WW9EM7JEDRD2B2JV8Y duration=871.568µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.607841ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM4KD3503XSWPDN53QFXQ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM4KD3503XSWPDN53QFXQ level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job finished" success=true duration=176.027646ms duration_ms=176 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.494428ms duration_ms=1 cached=2 returned=1 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.798409ms duration_ms=1 cached=2 returned=1 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0 level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.958339ms duration_ms=1 cached=10 returned=10 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 1_of_2, blocks: 01GB8VM5SRGW3G9Q23RXMJ1AJS (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GB8VM62M3Z9040ZX59YMSRXT (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=2.824908ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 2_of_2, blocks: 01GB8VM5Y6TT9M8AF0CPFS7XER (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GB8VM67J6W5RE7WRYDHSJ02H (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge--28800000-57600000 job="stage: merge, range start: 28800000, range end: 57600000, shard: , blocks: 01GB8VM6CJDR36JYWT0K0JASVX (min time: 1970-01-01 08:00:00 +0000 UTC, max time: 1970-01-01 10:00:00 +0000 UTC),01GB8VM6HK711T60T1TF9K5PY7 (min time: 1970-01-01 14:00:00 +0000 UTC, max time: 1970-01-01 16:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge--7200000-14400000 job="stage: merge, range start: 7200000, range end: 14400000, shard: , blocks: 01GB8VM5GA887HQTSZGSNEXNZT (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GB8VM5N10QNMZDQ2T3X2B5F8 (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM5GA887HQTSZGSNEXNZT (min time: 7200000, max time: 14400000) 01GB8VM5N10QNMZDQ2T3X2B5F8 (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM5N10QNMZDQ2T3X2B5F8/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM5GA887HQTSZGSNEXNZT/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--7200000-14400000/01GB8VM5GA887HQTSZGSNEXNZT /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--7200000-14400000/01GB8VM5N10QNMZDQ2T3X2B5F8]" duration=1.476414ms duration_ms=1 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GB8VM6W1J1S7GXZNNM311N7X sources="[01GB8VM5N10QNMZDQ2T3X2B5F8 01GB8VM5GA887HQTSZGSNEXNZT]" duration=134.819068ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM6W1J1S7GXZNNM311N7X] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--7200000-14400000/01GB8VM5GA887HQTSZGSNEXNZT /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--7200000-14400000/01GB8VM5N10QNMZDQ2T3X2B5F8]" duration=134.939415ms duration_ms=134 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--7200000-14400000/01GB8VM6W1J1S7GXZNNM311N7X/chunks/000001" dst=01GB8VM6W1J1S7GXZNNM311N7X/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--7200000-14400000/01GB8VM6W1J1S7GXZNNM311N7X/index" dst=01GB8VM6W1J1S7GXZNNM311N7X/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM6W1J1S7GXZNNM311N7X duration=920.109µs duration_ms=0 external_labels={} level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=2.186618ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM5GA887HQTSZGSNEXNZT level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM5GA887HQTSZGSNEXNZT level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM5N10QNMZDQ2T3X2B5F8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM5N10QNMZDQ2T3X2B5F8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job finished" success=true duration=139.572569ms duration_ms=139 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM5SRGW3G9Q23RXMJ1AJS (min time: 14400000, max time: 21600000) 01GB8VM62M3Z9040ZX59YMSRXT (min time: 21600000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM5SRGW3G9Q23RXMJ1AJS/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM62M3Z9040ZX59YMSRXT/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VM5SRGW3G9Q23RXMJ1AJS /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VM62M3Z9040ZX59YMSRXT]" duration=2.110455ms duration_ms=2 level=info component=compactor msg="compact blocks" count=2 mint=14400000 maxt=28800000 ulid=01GB8VM70DWWT6WCB5RCYHQ91J sources="[01GB8VM5SRGW3G9Q23RXMJ1AJS 01GB8VM62M3Z9040ZX59YMSRXT]" duration=129.138966ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM70DWWT6WCB5RCYHQ91J] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VM5SRGW3G9Q23RXMJ1AJS /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VM62M3Z9040ZX59YMSRXT]" duration=129.329374ms duration_ms=129 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VM70DWWT6WCB5RCYHQ91J/chunks/000001" dst=01GB8VM70DWWT6WCB5RCYHQ91J/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GB8VM70DWWT6WCB5RCYHQ91J/index" dst=01GB8VM70DWWT6WCB5RCYHQ91J/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM70DWWT6WCB5RCYHQ91J duration=1.007463ms duration_ms=1 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=2.55441ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM5SRGW3G9Q23RXMJ1AJS level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM5SRGW3G9Q23RXMJ1AJS level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM62M3Z9040ZX59YMSRXT level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM62M3Z9040ZX59YMSRXT level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job finished" success=true duration=135.297376ms duration_ms=135 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM5Y6TT9M8AF0CPFS7XER (min time: 14400000, max time: 21600000) 01GB8VM67J6W5RE7WRYDHSJ02H (min time: 21600000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM5Y6TT9M8AF0CPFS7XER/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM67J6W5RE7WRYDHSJ02H/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VM5Y6TT9M8AF0CPFS7XER /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VM67J6W5RE7WRYDHSJ02H]" duration=2.078966ms duration_ms=2 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=14400000 maxt=28800000 ulid=01GB8VM74N0EEG5EJKR3R32AQW sources="[01GB8VM67J6W5RE7WRYDHSJ02H 01GB8VM5Y6TT9M8AF0CPFS7XER]" duration=148.346445ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM74N0EEG5EJKR3R32AQW] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VM5Y6TT9M8AF0CPFS7XER /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VM67J6W5RE7WRYDHSJ02H]" duration=148.530471ms duration_ms=148 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VM74N0EEG5EJKR3R32AQW/chunks/000001" dst=01GB8VM74N0EEG5EJKR3R32AQW/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GB8VM74N0EEG5EJKR3R32AQW/index" dst=01GB8VM74N0EEG5EJKR3R32AQW/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM74N0EEG5EJKR3R32AQW duration=1.200536ms duration_ms=1 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=3.006158ms duration_ms=3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM5Y6TT9M8AF0CPFS7XER level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM5Y6TT9M8AF0CPFS7XER level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM67J6W5RE7WRYDHSJ02H level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM67J6W5RE7WRYDHSJ02H level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job finished" success=true duration=155.06588ms duration_ms=155 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM6CJDR36JYWT0K0JASVX (min time: 28800000, max time: 36000000) 01GB8VM6HK711T60T1TF9K5PY7 (min time: 50400000, max time: 57600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM6CJDR36JYWT0K0JASVX/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM6HK711T60T1TF9K5PY7/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--28800000-57600000/01GB8VM6CJDR36JYWT0K0JASVX /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--28800000-57600000/01GB8VM6HK711T60T1TF9K5PY7]" duration=2.275685ms duration_ms=2 level=info component=compactor msg="compact blocks" count=2 mint=28800000 maxt=57600000 ulid=01GB8VM79H1ZQ28DE6W5TDJVM9 sources="[01GB8VM6CJDR36JYWT0K0JASVX 01GB8VM6HK711T60T1TF9K5PY7]" duration=132.968722ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM79H1ZQ28DE6W5TDJVM9] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--28800000-57600000/01GB8VM6CJDR36JYWT0K0JASVX /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--28800000-57600000/01GB8VM6HK711T60T1TF9K5PY7]" duration=133.09572ms duration_ms=133 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--28800000-57600000/01GB8VM79H1ZQ28DE6W5TDJVM9/chunks/000001" dst=01GB8VM79H1ZQ28DE6W5TDJVM9/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge--28800000-57600000/01GB8VM79H1ZQ28DE6W5TDJVM9/index" dst=01GB8VM79H1ZQ28DE6W5TDJVM9/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM79H1ZQ28DE6W5TDJVM9 duration=743.366µs duration_ms=0 external_labels={} level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.989157ms duration_ms=1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM6CJDR36JYWT0K0JASVX level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM6CJDR36JYWT0K0JASVX level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM6HK711T60T1TF9K5PY7 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM6HK711T60T1TF9K5PY7 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction job finished" success=true duration=138.361103ms duration_ms=138 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=2.426839ms duration_ms=2 cached=14 returned=6 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 job="stage: merge, range start: 0, range end: 28800000, shard: 1_of_2, blocks: 01GB8VM570XW5SFN25PKWQVAYY (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC),01GB8VM70DWWT6WCB5RCYHQ91J (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 job="stage: merge, range start: 0, range end: 28800000, shard: 2_of_2, blocks: 01GB8VM5B8ZJGWHVRHN609BT4V (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC),01GB8VM74N0EEG5EJKR3R32AQW (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM570XW5SFN25PKWQVAYY (min time: 1, max time: 7200000) 01GB8VM70DWWT6WCB5RCYHQ91J (min time: 14400000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM570XW5SFN25PKWQVAYY/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM70DWWT6WCB5RCYHQ91J/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VM570XW5SFN25PKWQVAYY /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VM70DWWT6WCB5RCYHQ91J]" duration=1.868752ms duration_ms=1 level=info component=compactor msg="compact blocks" count=2 mint=1 maxt=28800000 ulid=01GB8VM7DYDM5D571PW39QVDCX sources="[01GB8VM570XW5SFN25PKWQVAYY 01GB8VM70DWWT6WCB5RCYHQ91J]" duration=134.580991ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM7DYDM5D571PW39QVDCX] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VM570XW5SFN25PKWQVAYY /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VM70DWWT6WCB5RCYHQ91J]" duration=134.778331ms duration_ms=134 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VM7DYDM5D571PW39QVDCX/chunks/000001" dst=01GB8VM7DYDM5D571PW39QVDCX/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GB8VM7DYDM5D571PW39QVDCX/index" dst=01GB8VM7DYDM5D571PW39QVDCX/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM7DYDM5D571PW39QVDCX duration=1.327003ms duration_ms=1 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=3.414996ms duration_ms=3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM570XW5SFN25PKWQVAYY level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM570XW5SFN25PKWQVAYY level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM70DWWT6WCB5RCYHQ91J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM70DWWT6WCB5RCYHQ91J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job finished" success=true duration=141.670462ms duration_ms=141 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM5B8ZJGWHVRHN609BT4V (min time: 1, max time: 7200000) 01GB8VM74N0EEG5EJKR3R32AQW (min time: 14400000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM74N0EEG5EJKR3R32AQW/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM5B8ZJGWHVRHN609BT4V/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VM5B8ZJGWHVRHN609BT4V /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VM74N0EEG5EJKR3R32AQW]" duration=2.028381ms duration_ms=2 level=info component=compactor msg="compact blocks" count=2 mint=1 maxt=28800000 ulid=01GB8VM7JCV5GM299YHSEPT5V8 sources="[01GB8VM5B8ZJGWHVRHN609BT4V 01GB8VM74N0EEG5EJKR3R32AQW]" duration=158.129747ms shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GB8VM7JCV5GM299YHSEPT5V8] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VM5B8ZJGWHVRHN609BT4V /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VM74N0EEG5EJKR3R32AQW]" duration=158.311028ms duration_ms=158 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VM7JCV5GM299YHSEPT5V8/chunks/000001" dst=01GB8VM7JCV5GM299YHSEPT5V8/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/001/compact/0@17241709254077376921-merge-2_of_2-0-28800000/01GB8VM7JCV5GM299YHSEPT5V8/index" dst=01GB8VM7JCV5GM299YHSEPT5V8/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_04164809662/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM7JCV5GM299YHSEPT5V8 duration=1.100348ms duration_ms=1 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=2.815341ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM5B8ZJGWHVRHN609BT4V level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM5B8ZJGWHVRHN609BT4V level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM74N0EEG5EJKR3R32AQW level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM74N0EEG5EJKR3R32AQW level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job finished" success=true duration=164.721903ms duration_ms=164 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=3.770474ms duration_ms=3 cached=16 returned=4 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=10.773784ms duration_ms=10 cached=16 returned=4 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="not loading tokens from file, tokens file path is empty" level=info component=compactor msg="instance not found in ring, adding with no tokens" ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=debug component=compactor msg="JoinAfter expired" ring=compactor level=info component=compactor msg="auto-joining cluster after timeout" ring=compactor level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=1.598914ms level=info component=cleaner msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.515227ms duration_ms=1 cached=2 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GB8VM7SZ37809BEX0GJ5X00J (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GB8VM80ZYHEP2NXJ94YW221J (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM80ZYHEP2NXJ94YW221J (min time: 7200000, max time: 14400000) 01GB8VM7SZ37809BEX0GJ5X00J (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM80ZYHEP2NXJ94YW221J/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM7SZ37809BEX0GJ5X00J/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM80ZYHEP2NXJ94YW221J /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM7SZ37809BEX0GJ5X00J]" duration=1.875294ms duration_ms=1 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GB8VM8B7C65QABH0V8EEPYJP sources="[01GB8VM7SZ37809BEX0GJ5X00J 01GB8VM80ZYHEP2NXJ94YW221J]" duration=203.692488ms shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GB8VM8B76FCZQ35K70XF43BZ sources="[01GB8VM7SZ37809BEX0GJ5X00J 01GB8VM80ZYHEP2NXJ94YW221J]" duration=204.056922ms shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GB8VM8B7C65QABH0V8EEPYJP 01GB8VM8B76FCZQ35K70XF43BZ]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM80ZYHEP2NXJ94YW221J /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM7SZ37809BEX0GJ5X00J]" duration=204.174202ms duration_ms=204 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM8B7C65QABH0V8EEPYJP/chunks/000001 dst=01GB8VM8B7C65QABH0V8EEPYJP/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM8B7C65QABH0V8EEPYJP/index dst=01GB8VM8B7C65QABH0V8EEPYJP/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM8B7C65QABH0V8EEPYJP duration=837.223µs duration_ms=0 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM8B76FCZQ35K70XF43BZ/chunks/000001 dst=01GB8VM8B76FCZQ35K70XF43BZ/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GB8VM8B76FCZQ35K70XF43BZ/index dst=01GB8VM8B76FCZQ35K70XF43BZ/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split352525828/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GB8VM8B76FCZQ35K70XF43BZ duration=1.006792ms duration_ms=1 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=2.279273ms duration_ms=2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM80ZYHEP2NXJ94YW221J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM80ZYHEP2NXJ94YW221J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM7SZ37809BEX0GJ5X00J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM7SZ37809BEX0GJ5X00J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job finished" success=true duration=209.430679ms duration_ms=209 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.920178ms duration_ms=1 cached=4 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=2.083145ms duration_ms=2 cached=4 returned=2 partial=0 level=info component=compactor msg="lifecycler loop() exited gracefully" ring=compactor level=info component=compactor msg="changing instance state from" old_state=ACTIVE new_state=LEAVING ring=compactor level=info component=compactor msg="lifecycler entering final sleep before shutdown" final_sleep=0s level=debug component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the KV store" ring=compactor --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor (13.58s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split (1.23s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split (0.94s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/smaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges (3.19s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together (0.87s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_if_configured_shards_=_0 (0.72s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split (0.68s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split (0.92s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together (0.87s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/should_correctly_handle_empty_blocks_generated_in_the_splitting_stage (0.63s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0 (2.65s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split (0.88s) === RUN TestPlanCompaction === RUN TestPlanCompaction/should_not_split_non-split_blocks_if_they're_>_smallest_compaction_range_(do_not_split_historical_blocks_after_enabling_splitting) split_merge_grouper_test.go:550: got 2 jobs: split_merge_grouper_test.go:552: - stage: merge, range start: 0, range end: 20, shard: 1_of_2, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:552: - stage: merge, range start: 0, range end: 20, shard: 2_of_2, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_be_NOT_considered_for_1st_level_splitting split_merge_grouper_test.go:550: got 2 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 0, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 20, range end: 40, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.03 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) === RUN TestPlanCompaction/a_block_with_time_range_larger_then_the_largest_compaction_range_should_NOT_be_considered_for_compaction split_merge_grouper_test.go:550: got 1 jobs: split_merge_grouper_test.go:552: - stage: merge, range start: 80, range end: 120, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC),00000000050000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC) === RUN TestPlanCompaction/should_not_merge_blocks_within_the_same_time_range_and_with_same_external_labels_but_different_resolution split_merge_grouper_test.go:550: got 3 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_NOT_split_a_single_block_if_==_smallest_compaction_range_but_configured_shards_=_0 split_merge_grouper_test.go:550: got 0 jobs: === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_two_split_groups split_merge_grouper_test.go:550: got 4 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 0, range end: 10, shard: 1_of_2, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 0, range end: 10, shard: 2_of_2, blocks: 00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_2, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 2_of_2, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/input_blocks_match_the_largest_range_but_can_be_compacted_because_overlapping split_merge_grouper_test.go:550: got 1 jobs: split_merge_grouper_test.go:552: - stage: merge, range start: 80, range end: 120, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC) === RUN TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_BE_considered_for_2nd_level_compaction split_merge_grouper_test.go:550: got 1 jobs: split_merge_grouper_test.go:552: - stage: merge, range start: 0, range end: 40, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000030000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_single_split_group split_merge_grouper_test.go:550: got 2 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_but_NOT_split_multiple_1st_level_blocks_in_different_time_ranges_if_configured_shards_=_0 split_merge_grouper_test.go:550: got 2 jobs: split_merge_grouper_test.go:552: - stage: merge, range start: 0, range end: 10, shard: , blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:552: - stage: merge, range start: 10, range end: 20, shard: , blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_not_merge_blocks_within_the_same_time_range_but_with_different_external_labels split_merge_grouper_test.go:550: got 3 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_split_a_single_block_if_==_smallest_compaction_range split_merge_grouper_test.go:550: got 1 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 0, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_split_a_single_block_if_<_smallest_compaction_range split_merge_grouper_test.go:550: got 1 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 0, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges split_merge_grouper_test.go:550: got 2 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_split_blocks_that_can_be_compacted_on_the_2nd_range_only split_merge_grouper_test.go:550: got 3 jobs: split_merge_grouper_test.go:552: - stage: merge, range start: 0, range end: 20, shard: 1_of_2, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:552: - stage: merge, range start: 0, range end: 20, shard: 2_of_2, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:552: - stage: merge, range start: 20, range end: 40, shard: 1_of_2, blocks: 00000000050000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000060000000000000000 (min time: 1970-01-01 00:00:00.03 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) === RUN TestPlanCompaction/input_blocks_can_be_compacted_on_a_mix_of_1st_and_2nd_ranges,_guaranteeing_no_overlaps_and_giving_preference_to_smaller_ranges split_merge_grouper_test.go:550: got 3 jobs: split_merge_grouper_test.go:552: - stage: merge, range start: 20, range end: 40, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000050000000000000000 (min time: 1970-01-01 00:00:00.03 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) split_merge_grouper_test.go:552: - stage: merge, range start: 70, range end: 80, shard: 1_of_1, blocks: 00000000080000000000000000 (min time: 1970-01-01 00:00:00.07 +0000 UTC, max time: 1970-01-01 00:00:00.08 +0000 UTC),00000000090000000000000000 (min time: 1970-01-01 00:00:00.075 +0000 UTC, max time: 1970-01-01 00:00:00.08 +0000 UTC) split_merge_grouper_test.go:552: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.007 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) === RUN TestPlanCompaction/input_blocks_have_already_been_compacted_with_the_largest_range split_merge_grouper_test.go:550: got 0 jobs: === RUN TestPlanCompaction/a_range_containing_the_most_recent_block_shouldn't_be_prematurely_compacted_if_doesn't_cover_the_full_range split_merge_grouper_test.go:550: got 1 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000000000000000000000 (min time: 1970-01-01 00:00:00.005 +0000 UTC, max time: 1970-01-01 00:00:00.008 +0000 UTC),00000000000000000000000000 (min time: 1970-01-01 00:00:00.007 +0000 UTC, max time: 1970-01-01 00:00:00.009 +0000 UTC) === RUN TestPlanCompaction/no_input_blocks split_merge_grouper_test.go:550: got 0 jobs: === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_within_the_same_time_range split_merge_grouper_test.go:550: got 1 jobs: split_merge_grouper_test.go:552: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) --- PASS: TestPlanCompaction (0.01s) --- PASS: TestPlanCompaction/should_not_split_non-split_blocks_if_they're_>_smallest_compaction_range_(do_not_split_historical_blocks_after_enabling_splitting) (0.00s) --- PASS: TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_be_NOT_considered_for_1st_level_splitting (0.00s) --- PASS: TestPlanCompaction/a_block_with_time_range_larger_then_the_largest_compaction_range_should_NOT_be_considered_for_compaction (0.00s) --- PASS: TestPlanCompaction/should_not_merge_blocks_within_the_same_time_range_and_with_same_external_labels_but_different_resolution (0.00s) --- PASS: TestPlanCompaction/should_NOT_split_a_single_block_if_==_smallest_compaction_range_but_configured_shards_=_0 (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_two_split_groups (0.00s) --- PASS: TestPlanCompaction/input_blocks_match_the_largest_range_but_can_be_compacted_because_overlapping (0.00s) --- PASS: TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_BE_considered_for_2nd_level_compaction (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_single_split_group (0.00s) --- PASS: TestPlanCompaction/should_merge_but_NOT_split_multiple_1st_level_blocks_in_different_time_ranges_if_configured_shards_=_0 (0.00s) --- PASS: TestPlanCompaction/should_not_merge_blocks_within_the_same_time_range_but_with_different_external_labels (0.00s) --- PASS: TestPlanCompaction/should_split_a_single_block_if_==_smallest_compaction_range (0.00s) --- PASS: TestPlanCompaction/should_split_a_single_block_if_<_smallest_compaction_range (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges (0.00s) --- PASS: TestPlanCompaction/should_merge_split_blocks_that_can_be_compacted_on_the_2nd_range_only (0.00s) --- PASS: TestPlanCompaction/input_blocks_can_be_compacted_on_a_mix_of_1st_and_2nd_ranges,_guaranteeing_no_overlaps_and_giving_preference_to_smaller_ranges (0.00s) --- PASS: TestPlanCompaction/input_blocks_have_already_been_compacted_with_the_largest_range (0.00s) --- PASS: TestPlanCompaction/a_range_containing_the_most_recent_block_shouldn't_be_prematurely_compacted_if_doesn't_cover_the_full_range (0.00s) --- PASS: TestPlanCompaction/no_input_blocks (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_within_the_same_time_range (0.00s) === RUN TestPlanSplitting === RUN TestPlanSplitting/should_splitGroups_split_jobs_if_the_input_group_contains_multiple_non-sharded_blocks === RUN TestPlanSplitting/should_return_nil_if_the_input_group_is_empty === RUN TestPlanSplitting/should_return_nil_if_the_input_group_contains_no_non-sharded_blocks === RUN TestPlanSplitting/should_return_a_split_job_if_the_input_group_contains_1_non-sharded_block --- PASS: TestPlanSplitting (0.00s) --- PASS: TestPlanSplitting/should_splitGroups_split_jobs_if_the_input_group_contains_multiple_non-sharded_blocks (0.00s) --- PASS: TestPlanSplitting/should_return_nil_if_the_input_group_is_empty (0.00s) --- PASS: TestPlanSplitting/should_return_nil_if_the_input_group_contains_no_non-sharded_blocks (0.00s) --- PASS: TestPlanSplitting/should_return_a_split_job_if_the_input_group_contains_1_non-sharded_block (0.00s) === RUN TestGroupBlocksByShardID === RUN TestGroupBlocksByShardID/no_input_blocks === RUN TestGroupBlocksByShardID/only_1_block_in_input_with_shard_ID === RUN TestGroupBlocksByShardID/only_1_block_in_input_without_shard_ID === RUN TestGroupBlocksByShardID/multiple_blocks_per_shard_ID --- PASS: TestGroupBlocksByShardID (0.00s) --- PASS: TestGroupBlocksByShardID/no_input_blocks (0.00s) --- PASS: TestGroupBlocksByShardID/only_1_block_in_input_with_shard_ID (0.00s) --- PASS: TestGroupBlocksByShardID/only_1_block_in_input_without_shard_ID (0.00s) --- PASS: TestGroupBlocksByShardID/multiple_blocks_per_shard_ID (0.00s) === RUN TestGroupBlocksByRange === RUN TestGroupBlocksByRange/no_input_blocks === RUN TestGroupBlocksByRange/only_1_block_in_input === RUN TestGroupBlocksByRange/only_1_block_per_range === RUN TestGroupBlocksByRange/multiple_blocks_per_range === RUN TestGroupBlocksByRange/a_block_with_time_range_larger_then_the_range_should_be_excluded === RUN TestGroupBlocksByRange/blocks_with_different_time_ranges_but_all_fitting_within_the_input_range --- PASS: TestGroupBlocksByRange (0.00s) --- PASS: TestGroupBlocksByRange/no_input_blocks (0.00s) --- PASS: TestGroupBlocksByRange/only_1_block_in_input (0.00s) --- PASS: TestGroupBlocksByRange/only_1_block_per_range (0.00s) --- PASS: TestGroupBlocksByRange/multiple_blocks_per_range (0.00s) --- PASS: TestGroupBlocksByRange/a_block_with_time_range_larger_then_the_range_should_be_excluded (0.00s) --- PASS: TestGroupBlocksByRange/blocks_with_different_time_ranges_but_all_fitting_within_the_input_range (0.00s) === RUN TestJob_conflicts === RUN TestJob_conflicts/should_NOT_conflict_if_jobs_compact_different_blocks_with_overlapping_time_ranges_but_different_resolution === RUN TestJob_conflicts/should_conflict_between_split_and_merge_jobs_with_overlapping_time_ranges === RUN TestJob_conflicts/should_NOT_conflict_between_split_and_merge_jobs_with_non-overlapping_time_ranges === RUN TestJob_conflicts/should_conflict_if_jobs_compact_different_blocks_but_with_overlapping_time_ranges_and_same_shard === RUN TestJob_conflicts/should_NOT_conflict_if_jobs_compact_different_blocks_with_non-overlapping_time_ranges_and_same_shard === RUN TestJob_conflicts/should_NOT_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_but_different_shard === RUN TestJob_conflicts/should_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_and_different_shard_but_at_a_different_stage --- PASS: TestJob_conflicts (0.00s) --- PASS: TestJob_conflicts/should_NOT_conflict_if_jobs_compact_different_blocks_with_overlapping_time_ranges_but_different_resolution (0.00s) --- PASS: TestJob_conflicts/should_conflict_between_split_and_merge_jobs_with_overlapping_time_ranges (0.00s) --- PASS: TestJob_conflicts/should_NOT_conflict_between_split_and_merge_jobs_with_non-overlapping_time_ranges (0.00s) --- PASS: TestJob_conflicts/should_conflict_if_jobs_compact_different_blocks_but_with_overlapping_time_ranges_and_same_shard (0.00s) --- PASS: TestJob_conflicts/should_NOT_conflict_if_jobs_compact_different_blocks_with_non-overlapping_time_ranges_and_same_shard (0.00s) --- PASS: TestJob_conflicts/should_NOT_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_but_different_shard (0.00s) --- PASS: TestJob_conflicts/should_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_and_different_shard_but_at_a_different_stage (0.00s) === RUN TestBlocksGroup_overlaps --- PASS: TestBlocksGroup_overlaps (0.00s) === RUN TestBlocksGroup_getNonShardedBlocks --- PASS: TestBlocksGroup_getNonShardedBlocks (0.00s) === RUN TestSplitAndMergePlanner_Plan === RUN TestSplitAndMergePlanner_Plan/blocks_fit_within_the_largest_range === RUN TestSplitAndMergePlanner_Plan/no_blocks === RUN TestSplitAndMergePlanner_Plan/a_source_block_is_larger_then_the_largest_range === RUN TestSplitAndMergePlanner_Plan/source_blocks_are_smaller_then_the_largest_range_but_compacted_block_is_larger === RUN TestSplitAndMergePlanner_Plan/source_blocks_and_compacted_block_are_smaller_then_the_largest_range_but_misaligned --- PASS: TestSplitAndMergePlanner_Plan (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/blocks_fit_within_the_largest_range (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/no_blocks (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/a_source_block_is_larger_then_the_largest_range (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/source_blocks_are_smaller_then_the_largest_range_but_compacted_block_is_larger (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/source_blocks_and_compacted_block_are_smaller_then_the_largest_range_but_misaligned (0.00s) === RUN TestSyncerMetrics --- PASS: TestSyncerMetrics (0.00s) === CONT TestSyncer_GarbageCollect_e2e === CONT TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion === CONT TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning === CONT TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket === CONT TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction === CONT TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant === CONT TestMultitenantCompactor_ShouldFailCompactionOnTimeout === CONT TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly === RUN TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/inmem === CONT TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning === CONT TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning === CONT TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks === CONT TestGroupCompactE2E === RUN TestGroupCompactE2E/inmem === CONT TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion === CONT TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime === RUN TestSyncer_GarbageCollect_e2e/inmem === CONT TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction create 00000000000000000000000000 level=info msg="start sync of metas" create 00000000000000000000000000 level=info msg="start of GC" create 00000000010000000000000000 level=info msg="start of compactions" create 00000000340000000000000000 level=info msg="compaction iterations done" create 00000000010000000000000000 create 00000000020000000000000000 create 00000000030000000000000000 create 00000000040000000000000000 create 00000000050000000000000000 create 00000000060000000000000000 create 00000000070000000000000000 create 00000000080000000000000000 create 00000000090000000000000000 create 00000000340000000000000000 create 00000000680000000000000000 create 000000009C0000000000000000 create 00000000CG0000000000000000 create 00000000FM0000000000000000 level=debug msg="deleted file" file=00000000000000000000000000/meta.json bucket=inmem level=debug msg="deleted file" file=00000000000000000000000000/deletion-mark.json bucket=inmem level=debug msg="deleted file" file=00000000010000000000000000/meta.json bucket=inmem level=debug msg="deleted file" file=00000000010000000000000000/deletion-mark.json bucket=inmem === RUN TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem === PAUSE TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem === CONT TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem create 00000000000000000000000000 create 00000000010000000000000000 create 00000000340000000000000000 === RUN TestSyncer_GarbageCollect_e2e/filesystem === PAUSE TestSyncer_GarbageCollect_e2e/filesystem === CONT TestSyncer_GarbageCollect_e2e/filesystem create 00000000000000000000000000 level=debug msg="deleted file" file=00000000000000000000000000/meta.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem2610386013/001" create 00000000010000000000000000 level=debug msg="deleted file" file=00000000000000000000000000/deletion-mark.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem2610386013/001" create 00000000020000000000000000 level=debug msg="deleted file" file=00000000010000000000000000/meta.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem2610386013/001" create 00000000030000000000000000 create 00000000040000000000000000 level=debug msg="deleted file" file=00000000010000000000000000/deletion-mark.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem2610386013/001" create 00000000050000000000000000 create 00000000060000000000000000 create 00000000070000000000000000 create 00000000080000000000000000 create 00000000090000000000000000 create 00000000340000000000000000 --- PASS: TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly (0.01s) --- PASS: TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/inmem (0.01s) --- PASS: TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem (0.00s) create 00000000680000000000000000 create 000000009C0000000000000000 create 00000000CG0000000000000000 create 00000000FM0000000000000000 --- PASS: TestSyncer_GarbageCollect_e2e (0.02s) --- PASS: TestSyncer_GarbageCollect_e2e/inmem (0.01s) --- PASS: TestSyncer_GarbageCollect_e2e/filesystem (0.01s) --- PASS: TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction (0.15s) --- PASS: TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks (0.16s) --- PASS: TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion (0.16s) --- PASS: TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket (0.16s) --- PASS: TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion (0.20s) --- PASS: TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction (0.21s) --- PASS: TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning (0.25s) --- PASS: TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning (0.26s) --- PASS: TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant (0.76s) level=info msg="start sync of metas" level=info msg="start of GC" level=debug msg="grouper found a compactable blocks group" groupKey=124@14251579150387240703-merge--0-1000 job="stage: merge, range start: 0, range end: 1000, shard: , blocks: 01GB8VM8P6XCTX8Q7MNFPBE1JT (min time: 1970-01-01 00:00:00.5 +0000 UTC, max time: 1970-01-01 00:00:01 +0000 UTC),01GB8VM9JSQTDW2RXXVTN64HCX (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.499 +0000 UTC)" level=debug msg="grouper found a compactable blocks group" groupKey=124@8084862141041806226-merge--0-3000 job="stage: merge, range start: 0, range end: 3000, shard: , blocks: 01GB8VM97VCGXJF4Q4XJK2058D (min time: 1970-01-01 00:00:02 +0000 UTC, max time: 1970-01-01 00:00:03 +0000 UTC),01GB8VM9B0HBH85FJQZV67H32D (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:01 +0000 UTC)" level=info msg="start of compactions" level=info groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM9JSQTDW2RXXVTN64HCX (min time: 0, max time: 499) 01GB8VM8P6XCTX8Q7MNFPBE1JT (min time: 500, max time: 1000)]" level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VM9B0HBH85FJQZV67H32D (min time: 0, max time: 1000) 01GB8VM97VCGXJF4Q4XJK2058D (min time: 2000, max time: 3000)]" level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM9B0HBH85FJQZV67H32D/meta.json level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM97VCGXJF4Q4XJK2058D/meta.json level=debug groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM9JSQTDW2RXXVTN64HCX/meta.json level=debug groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM8P6XCTX8Q7MNFPBE1JT/meta.json level=debug groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="found out of order series" labels="{lbl1=\"1\"}" level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestGroupCompactE2Einmem4033272798/001/124@8084862141041806226-merge--0-3000/01GB8VM9B0HBH85FJQZV67H32D /tmp/TestGroupCompactE2Einmem4033272798/001/124@8084862141041806226-merge--0-3000/01GB8VM97VCGXJF4Q4XJK2058D]" duration=1.030396ms duration_ms=1 level=info groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="compaction job finished" success=false duration=1.548019ms duration_ms=1 level=info msg="block has been marked for no compaction" block=01GB8VM9JSQTDW2RXXVTN64HCX level=info msg="compact blocks" count=2 mint=0 maxt=3000 ulid=01GB8VM9P90PZ9D1XDVGR8M200 sources="[01GB8VM9B0HBH85FJQZV67H32D 01GB8VM97VCGXJF4Q4XJK2058D]" duration=101.790689ms shard=1_of_1 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compacted blocks" new=[01GB8VM9P90PZ9D1XDVGR8M200] blocks="[/tmp/TestGroupCompactE2Einmem4033272798/001/124@8084862141041806226-merge--0-3000/01GB8VM9B0HBH85FJQZV67H32D /tmp/TestGroupCompactE2Einmem4033272798/001/124@8084862141041806226-merge--0-3000/01GB8VM97VCGXJF4Q4XJK2058D]" duration=101.948315ms duration_ms=101 level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Einmem4033272798/001/124@8084862141041806226-merge--0-3000/01GB8VM9P90PZ9D1XDVGR8M200/chunks/000001 dst=01GB8VM9P90PZ9D1XDVGR8M200/chunks/000001 bucket=inmem level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Einmem4033272798/001/124@8084862141041806226-merge--0-3000/01GB8VM9P90PZ9D1XDVGR8M200/index dst=01GB8VM9P90PZ9D1XDVGR8M200/index bucket=inmem level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded block" result_block=01GB8VM9P90PZ9D1XDVGR8M200 duration=674.467µs duration_ms=0 external_labels="{e1=\"1\"}" level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.640152ms duration_ms=1 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM9B0HBH85FJQZV67H32D level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM9B0HBH85FJQZV67H32D level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM97VCGXJF4Q4XJK2058D level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM97VCGXJF4Q4XJK2058D level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction job finished" success=true duration=105.570752ms duration_ms=105 level=info msg="start sync of metas" level=info msg="start of GC" level=debug msg="grouper found a compactable blocks group" groupKey=124@14251579150387240703-merge--0-3000 job="stage: merge, range start: 0, range end: 3000, shard: , blocks: 01GB8VM8P6XCTX8Q7MNFPBE1JT (min time: 1970-01-01 00:00:00.5 +0000 UTC, max time: 1970-01-01 00:00:01 +0000 UTC),01GB8VM8SRVHSZSRFKCTX1QC13 (min time: 1970-01-01 00:00:02 +0000 UTC, max time: 1970-01-01 00:00:03 +0000 UTC),01GB8VM8XEMEY14TCP6S7450MR (min time: 1970-01-01 00:00:01 +0000 UTC, max time: 1970-01-01 00:00:02 +0000 UTC)" level=info msg="start of compactions" level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=3 plan="[01GB8VM8P6XCTX8Q7MNFPBE1JT (min time: 500, max time: 1000) 01GB8VM8XEMEY14TCP6S7450MR (min time: 1000, max time: 2000) 01GB8VM8SRVHSZSRFKCTX1QC13 (min time: 2000, max time: 3000)]" level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM8SRVHSZSRFKCTX1QC13/meta.json level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM8XEMEY14TCP6S7450MR/meta.json level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM8P6XCTX8Q7MNFPBE1JT/meta.json level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=3 plan="[/tmp/TestGroupCompactE2Einmem4033272798/001/124@14251579150387240703-merge--0-3000/01GB8VM8P6XCTX8Q7MNFPBE1JT /tmp/TestGroupCompactE2Einmem4033272798/001/124@14251579150387240703-merge--0-3000/01GB8VM8XEMEY14TCP6S7450MR /tmp/TestGroupCompactE2Einmem4033272798/001/124@14251579150387240703-merge--0-3000/01GB8VM8SRVHSZSRFKCTX1QC13]" duration=708.481µs duration_ms=0 --- PASS: TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime (1.21s) level=info msg="compact blocks" count=3 mint=500 maxt=3000 ulid=01GB8VM9SM71WBFJGXY539WMQ1 sources="[01GB8VM8P6XCTX8Q7MNFPBE1JT 01GB8VM8XEMEY14TCP6S7450MR 01GB8VM8SRVHSZSRFKCTX1QC13]" duration=104.61741ms shard=1_of_1 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compacted blocks" new=[01GB8VM9SM71WBFJGXY539WMQ1] blocks="[/tmp/TestGroupCompactE2Einmem4033272798/001/124@14251579150387240703-merge--0-3000/01GB8VM8P6XCTX8Q7MNFPBE1JT /tmp/TestGroupCompactE2Einmem4033272798/001/124@14251579150387240703-merge--0-3000/01GB8VM8XEMEY14TCP6S7450MR /tmp/TestGroupCompactE2Einmem4033272798/001/124@14251579150387240703-merge--0-3000/01GB8VM8SRVHSZSRFKCTX1QC13]" duration=104.731726ms duration_ms=104 level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Einmem4033272798/001/124@14251579150387240703-merge--0-3000/01GB8VM9SM71WBFJGXY539WMQ1/chunks/000001 dst=01GB8VM9SM71WBFJGXY539WMQ1/chunks/000001 bucket=inmem level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Einmem4033272798/001/124@14251579150387240703-merge--0-3000/01GB8VM9SM71WBFJGXY539WMQ1/index dst=01GB8VM9SM71WBFJGXY539WMQ1/index bucket=inmem level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded block" result_block=01GB8VM9SM71WBFJGXY539WMQ1 duration=532.29µs duration_ms=0 external_labels="{e1=\"1/weird\"}" level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.238887ms duration_ms=1 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM8P6XCTX8Q7MNFPBE1JT level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM8P6XCTX8Q7MNFPBE1JT level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM8XEMEY14TCP6S7450MR level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM8XEMEY14TCP6S7450MR level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM8SRVHSZSRFKCTX1QC13 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM8SRVHSZSRFKCTX1QC13 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction job finished" success=true duration=107.601798ms duration_ms=107 level=info msg="start sync of metas" level=info msg="start of GC" level=info msg="start of compactions" level=info msg="compaction iterations done" === RUN TestGroupCompactE2E/filesystem === PAUSE TestGroupCompactE2E/filesystem === CONT TestGroupCompactE2E/filesystem level=info msg="start sync of metas" level=info msg="start of GC" level=info msg="start of compactions" level=info msg="compaction iterations done" level=info msg="start sync of metas" level=info msg="start of GC" level=debug msg="grouper found a compactable blocks group" groupKey=124@14251579150387240703-merge--0-1000 job="stage: merge, range start: 0, range end: 1000, shard: , blocks: 01GB8VM9XG2YBQNM75GN7RAR1V (min time: 1970-01-01 00:00:00.5 +0000 UTC, max time: 1970-01-01 00:00:01 +0000 UTC),01GB8VMATJ47RQQCHVMNVPQ69C (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.499 +0000 UTC)" level=debug msg="grouper found a compactable blocks group" groupKey=124@8084862141041806226-merge--0-3000 job="stage: merge, range start: 0, range end: 3000, shard: , blocks: 01GB8VMAFZZV49ASM56BHEFXMC (min time: 1970-01-01 00:00:02 +0000 UTC, max time: 1970-01-01 00:00:03 +0000 UTC),01GB8VMAK7E9X28VRDT73TXBH1 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:01 +0000 UTC)" level=info msg="start of compactions" level=info groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VMATJ47RQQCHVMNVPQ69C (min time: 0, max time: 499) 01GB8VM9XG2YBQNM75GN7RAR1V (min time: 500, max time: 1000)]" level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GB8VMAK7E9X28VRDT73TXBH1 (min time: 0, max time: 1000) 01GB8VMAFZZV49ASM56BHEFXMC (min time: 2000, max time: 3000)]" level=debug groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VMATJ47RQQCHVMNVPQ69C/meta.json level=debug groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM9XG2YBQNM75GN7RAR1V/meta.json level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VMAFZZV49ASM56BHEFXMC/meta.json level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VMAK7E9X28VRDT73TXBH1/meta.json level=debug groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="found out of order series" labels="{lbl1=\"1\"}" level=info groupKey=124@14251579150387240703-merge--0-1000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:01 +0000 UTC" msg="compaction job finished" success=false duration=1.13881ms duration_ms=1 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestGroupCompactE2Efilesystem4011859457/002/124@8084862141041806226-merge--0-3000/01GB8VMAK7E9X28VRDT73TXBH1 /tmp/TestGroupCompactE2Efilesystem4011859457/002/124@8084862141041806226-merge--0-3000/01GB8VMAFZZV49ASM56BHEFXMC]" duration=929.346µs duration_ms=0 level=info msg="block has been marked for no compaction" block=01GB8VMATJ47RQQCHVMNVPQ69C level=info msg="compact blocks" count=2 mint=0 maxt=3000 ulid=01GB8VMAY6CD7EREFKP9MY3H46 sources="[01GB8VMAK7E9X28VRDT73TXBH1 01GB8VMAFZZV49ASM56BHEFXMC]" duration=120.245616ms shard=1_of_1 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compacted blocks" new=[01GB8VMAY6CD7EREFKP9MY3H46] blocks="[/tmp/TestGroupCompactE2Efilesystem4011859457/002/124@8084862141041806226-merge--0-3000/01GB8VMAK7E9X28VRDT73TXBH1 /tmp/TestGroupCompactE2Efilesystem4011859457/002/124@8084862141041806226-merge--0-3000/01GB8VMAFZZV49ASM56BHEFXMC]" duration=120.350583ms duration_ms=120 level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Efilesystem4011859457/002/124@8084862141041806226-merge--0-3000/01GB8VMAY6CD7EREFKP9MY3H46/chunks/000001 dst=01GB8VMAY6CD7EREFKP9MY3H46/chunks/000001 bucket="fs: /tmp/TestGroupCompactE2Efilesystem4011859457/001" level=debug groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Efilesystem4011859457/002/124@8084862141041806226-merge--0-3000/01GB8VMAY6CD7EREFKP9MY3H46/index dst=01GB8VMAY6CD7EREFKP9MY3H46/index bucket="fs: /tmp/TestGroupCompactE2Efilesystem4011859457/001" level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded block" result_block=01GB8VMAY6CD7EREFKP9MY3H46 duration=568.178µs duration_ms=0 external_labels="{e1=\"1\"}" level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.241784ms duration_ms=1 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VMAK7E9X28VRDT73TXBH1 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VMAK7E9X28VRDT73TXBH1 level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VMAFZZV49ASM56BHEFXMC level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VMAFZZV49ASM56BHEFXMC level=info groupKey=124@8084862141041806226-merge--0-3000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction job finished" success=true duration=123.367201ms duration_ms=123 level=info msg="start sync of metas" level=info msg="start of GC" level=debug msg="grouper found a compactable blocks group" groupKey=124@14251579150387240703-merge--0-3000 job="stage: merge, range start: 0, range end: 3000, shard: , blocks: 01GB8VM9XG2YBQNM75GN7RAR1V (min time: 1970-01-01 00:00:00.5 +0000 UTC, max time: 1970-01-01 00:00:01 +0000 UTC),01GB8VMA17G8RR5MDCH0QE2D5H (min time: 1970-01-01 00:00:02 +0000 UTC, max time: 1970-01-01 00:00:03 +0000 UTC),01GB8VMA4N0TNEAPXRPEM31Z28 (min time: 1970-01-01 00:00:01 +0000 UTC, max time: 1970-01-01 00:00:02 +0000 UTC)" level=info msg="start of compactions" level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=3 plan="[01GB8VM9XG2YBQNM75GN7RAR1V (min time: 500, max time: 1000) 01GB8VMA4N0TNEAPXRPEM31Z28 (min time: 1000, max time: 2000) 01GB8VMA17G8RR5MDCH0QE2D5H (min time: 2000, max time: 3000)]" level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VM9XG2YBQNM75GN7RAR1V/meta.json level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VMA4N0TNEAPXRPEM31Z28/meta.json level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GB8VMA17G8RR5MDCH0QE2D5H/meta.json level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=3 plan="[/tmp/TestGroupCompactE2Efilesystem4011859457/002/124@14251579150387240703-merge--0-3000/01GB8VM9XG2YBQNM75GN7RAR1V /tmp/TestGroupCompactE2Efilesystem4011859457/002/124@14251579150387240703-merge--0-3000/01GB8VMA4N0TNEAPXRPEM31Z28 /tmp/TestGroupCompactE2Efilesystem4011859457/002/124@14251579150387240703-merge--0-3000/01GB8VMA17G8RR5MDCH0QE2D5H]" duration=1.345478ms duration_ms=1 level=info msg="compact blocks" count=3 mint=500 maxt=3000 ulid=01GB8VMB24NPKC100RPSA32YBH sources="[01GB8VM9XG2YBQNM75GN7RAR1V 01GB8VMA4N0TNEAPXRPEM31Z28 01GB8VMA17G8RR5MDCH0QE2D5H]" duration=109.293337ms shard=1_of_1 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compacted blocks" new=[01GB8VMB24NPKC100RPSA32YBH] blocks="[/tmp/TestGroupCompactE2Efilesystem4011859457/002/124@14251579150387240703-merge--0-3000/01GB8VM9XG2YBQNM75GN7RAR1V /tmp/TestGroupCompactE2Efilesystem4011859457/002/124@14251579150387240703-merge--0-3000/01GB8VMA4N0TNEAPXRPEM31Z28 /tmp/TestGroupCompactE2Efilesystem4011859457/002/124@14251579150387240703-merge--0-3000/01GB8VMA17G8RR5MDCH0QE2D5H]" duration=109.408764ms duration_ms=109 level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Efilesystem4011859457/002/124@14251579150387240703-merge--0-3000/01GB8VMB24NPKC100RPSA32YBH/chunks/000001 dst=01GB8VMB24NPKC100RPSA32YBH/chunks/000001 bucket="fs: /tmp/TestGroupCompactE2Efilesystem4011859457/001" level=debug groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded file" from=/tmp/TestGroupCompactE2Efilesystem4011859457/002/124@14251579150387240703-merge--0-3000/01GB8VMB24NPKC100RPSA32YBH/index dst=01GB8VMB24NPKC100RPSA32YBH/index bucket="fs: /tmp/TestGroupCompactE2Efilesystem4011859457/001" level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded block" result_block=01GB8VMB24NPKC100RPSA32YBH duration=556.034µs duration_ms=0 external_labels="{e1=\"1/weird\"}" level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=1.324588ms duration_ms=1 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VM9XG2YBQNM75GN7RAR1V level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VM9XG2YBQNM75GN7RAR1V level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VMA4N0TNEAPXRPEM31Z28 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VMA4N0TNEAPXRPEM31Z28 level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="marking compacted block for deletion" old_block=01GB8VMA17G8RR5MDCH0QE2D5H level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="block has been marked for deletion" block=01GB8VMA17G8RR5MDCH0QE2D5H level=info groupKey=124@14251579150387240703-merge--0-3000 minTime="1970-01-01 00:00:00.5 +0000 UTC" maxTime="1970-01-01 00:00:03 +0000 UTC" msg="compaction job finished" success=true duration=113.065534ms duration_ms=113 level=info msg="start sync of metas" level=info msg="start of GC" level=info msg="start of compactions" level=info msg="compaction iterations done" --- PASS: TestGroupCompactE2E (1.27s) --- PASS: TestGroupCompactE2E/inmem (1.27s) --- PASS: TestGroupCompactE2E/filesystem (1.30s) --- PASS: TestMultitenantCompactor_ShouldFailCompactionOnTimeout (5.01s) --- PASS: TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning (8.91s) PASS ok github.com/grafana/mimir/pkg/compactor 38.526s === RUN TestClient_WriteSeries === RUN TestClient_WriteSeries/write_series_in_a_single_batch === RUN TestClient_WriteSeries/write_series_in_multiple_batches === RUN TestClient_WriteSeries/request_failed_with_4xx_error === RUN TestClient_WriteSeries/request_failed_with_5xx_error --- PASS: TestClient_WriteSeries (0.10s) --- PASS: TestClient_WriteSeries/write_series_in_a_single_batch (0.06s) --- PASS: TestClient_WriteSeries/write_series_in_multiple_batches (0.01s) --- PASS: TestClient_WriteSeries/request_failed_with_4xx_error (0.00s) --- PASS: TestClient_WriteSeries/request_failed_with_5xx_error (0.00s) === RUN TestClient_QueryRange === RUN TestClient_QueryRange/results_cache_not_explicitly_disabled === RUN TestClient_QueryRange/results_cache_disabled --- PASS: TestClient_QueryRange (0.02s) --- PASS: TestClient_QueryRange/results_cache_not_explicitly_disabled (0.02s) --- PASS: TestClient_QueryRange/results_cache_disabled (0.00s) === RUN TestClient_Query === RUN TestClient_Query/results_cache_not_explicitly_disabled === RUN TestClient_Query/results_cache_disabled --- PASS: TestClient_Query (0.01s) --- PASS: TestClient_Query/results_cache_not_explicitly_disabled (0.00s) --- PASS: TestClient_Query/results_cache_disabled (0.00s) === RUN TestManager_PeriodicRun --- PASS: TestManager_PeriodicRun (0.05s) === RUN TestManager_SmokeTest === RUN TestManager_SmokeTest/successful_smoke_test === RUN TestManager_SmokeTest/failed_smoke_test --- PASS: TestManager_SmokeTest (0.00s) --- PASS: TestManager_SmokeTest/successful_smoke_test (0.00s) --- PASS: TestManager_SmokeTest/failed_smoke_test (0.00s) === RUN TestAlignTimestampToInterval --- PASS: TestAlignTimestampToInterval (0.00s) === RUN TestGetQueryStep === RUN TestGetQueryStep/should_return_write_interval_if_expected_number_of_samples_is_<_1000 === RUN TestGetQueryStep/should_align_step_to_write_interval_and_guarantee_no_more_than_1000_samples --- PASS: TestGetQueryStep (0.00s) --- PASS: TestGetQueryStep/should_return_write_interval_if_expected_number_of_samples_is_<_1000 (0.00s) --- PASS: TestGetQueryStep/should_align_step_to_write_interval_and_guarantee_no_more_than_1000_samples (0.00s) === RUN TestVerifySineWaveSamplesSum === RUN TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_series === RUN TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_sample === RUN TestVerifySineWaveSamplesSum/should_return_error_if_the_2nd_last_sample_has_an_unexpected_timestamp === RUN TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(1_series) === RUN TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(multiple_series) --- PASS: TestVerifySineWaveSamplesSum (0.01s) --- PASS: TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_series (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_sample (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_error_if_the_2nd_last_sample_has_an_unexpected_timestamp (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(1_series) (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(multiple_series) (0.00s) === RUN TestMinTime --- PASS: TestMinTime (0.00s) === RUN TestMaxTime --- PASS: TestMaxTime (0.00s) === RUN TestRandTime --- PASS: TestRandTime (0.00s) === RUN TestWriteReadSeriesTest_Run === RUN TestWriteReadSeriesTest_Run/should_write_series_with_current_timestamp_if_it's_already_aligned_to_write_interval === RUN TestWriteReadSeriesTest_Run/should_write_series_with_timestamp_aligned_to_write_interval === RUN TestWriteReadSeriesTest_Run/should_write_series_from_last_written_timestamp_until_now === RUN TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_network_error === RUN TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_5xx_error === RUN TestWriteReadSeriesTest_Run/should_keep_remote_writing_next_intervals_on_4xx_error === RUN TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_no_failure_if_results_match === RUN TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_failure_if_results_don't_match --- PASS: TestWriteReadSeriesTest_Run (4.11s) --- PASS: TestWriteReadSeriesTest_Run/should_write_series_with_current_timestamp_if_it's_already_aligned_to_write_interval (0.05s) --- PASS: TestWriteReadSeriesTest_Run/should_write_series_with_timestamp_aligned_to_write_interval (0.01s) --- PASS: TestWriteReadSeriesTest_Run/should_write_series_from_last_written_timestamp_until_now (2.03s) --- PASS: TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_network_error (0.00s) --- PASS: TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_5xx_error (0.00s) --- PASS: TestWriteReadSeriesTest_Run/should_keep_remote_writing_next_intervals_on_4xx_error (2.00s) --- PASS: TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_no_failure_if_results_match (0.01s) --- PASS: TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_failure_if_results_don't_match (0.01s) === RUN TestWriteReadSeriesTest_Init === RUN TestWriteReadSeriesTest_Init/no_previously_written_samples_found === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-2h,_-1m] === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m] === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m]_but_last_data_point_of_previous_24h_period_is_missing === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-24h,_-1m] === RUN TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_>_24h === RUN TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_<_24h === RUN TestWriteReadSeriesTest_Init/the_most_recent_previously_written_data_point_is_older_than_1h_ago === RUN TestWriteReadSeriesTest_Init/the_first_query_fails === RUN TestWriteReadSeriesTest_Init/a_subsequent_query_fails === RUN TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_last_24h_period === RUN TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_previous_24h_period === RUN TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_exactly_at_the_beginning_of_this_24h_period --- PASS: TestWriteReadSeriesTest_Init (0.15s) --- PASS: TestWriteReadSeriesTest_Init/no_previously_written_samples_found (0.00s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-2h,_-1m] (0.00s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m] (0.01s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m]_but_last_data_point_of_previous_24h_period_is_missing (0.03s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-24h,_-1m] (0.01s) --- PASS: TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_>_24h (0.03s) --- PASS: TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_<_24h (0.00s) --- PASS: TestWriteReadSeriesTest_Init/the_most_recent_previously_written_data_point_is_older_than_1h_ago (0.00s) --- PASS: TestWriteReadSeriesTest_Init/the_first_query_fails (0.00s) --- PASS: TestWriteReadSeriesTest_Init/a_subsequent_query_fails (0.02s) --- PASS: TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_last_24h_period (0.01s) --- PASS: TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_previous_24h_period (0.02s) --- PASS: TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_exactly_at_the_beginning_of_this_24h_period (0.02s) === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_has_not_been_set_yet === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_is_older_than_max_age === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_=_max_query_time === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_1h === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_2h === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/max_query_time_is_older_than_24h_but_more_recent_than_max_query_age === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h_but_max_query_age_is_only_10m --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges (0.01s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_has_not_been_set_yet (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_is_older_than_max_age (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_=_max_query_time (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_1h (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_2h (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/max_query_time_is_older_than_24h_but_more_recent_than_max_query_age (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h_but_max_query_age_is_only_10m (0.00s) PASS ok github.com/grafana/mimir/pkg/continuoustest 4.781s === RUN TestConfig_Validate === RUN TestConfig_Validate/default_config_should_pass === RUN TestConfig_Validate/should_fail_if_the_default_shard_size_is_negative === RUN TestConfig_Validate/should_pass_if_the_default_shard_size_>=_0 --- PASS: TestConfig_Validate (0.02s) --- PASS: TestConfig_Validate/default_config_should_pass (0.01s) --- PASS: TestConfig_Validate/should_fail_if_the_default_shard_size_is_negative (0.00s) --- PASS: TestConfig_Validate/should_pass_if_the_default_shard_size_>=_0 (0.00s) === RUN TestDistributor_Push === RUN TestDistributor_Push/A_push_to_3_happy_ingesters_should_succeed === RUN TestDistributor_Push/A_push_to_ingesters_with_an_old_sample_should_report_the_correct_metrics_with_no_metadata === RUN TestDistributor_Push/A_push_to_ingesters_with_a_current_sample_should_report_the_correct_metrics_with_no_metadata === RUN TestDistributor_Push/A_push_to_ingesters_without_samples_should_report_the_correct_metrics === RUN TestDistributor_Push/A_push_of_no_samples_shouldn't_block_or_return_error,_even_if_ingesters_are_sad === RUN TestDistributor_Push/A_push_to_2_happy_ingesters_should_succeed === RUN TestDistributor_Push/A_push_to_1_happy_ingesters_should_fail === RUN TestDistributor_Push/A_push_to_0_happy_ingesters_should_fail === RUN TestDistributor_Push/A_push_exceeding_burst_size_should_fail --- PASS: TestDistributor_Push (1.34s) --- PASS: TestDistributor_Push/A_push_to_3_happy_ingesters_should_succeed (0.16s) --- PASS: TestDistributor_Push/A_push_to_ingesters_with_an_old_sample_should_report_the_correct_metrics_with_no_metadata (0.11s) --- PASS: TestDistributor_Push/A_push_to_ingesters_with_a_current_sample_should_report_the_correct_metrics_with_no_metadata (0.20s) --- PASS: TestDistributor_Push/A_push_to_ingesters_without_samples_should_report_the_correct_metrics (0.12s) --- PASS: TestDistributor_Push/A_push_of_no_samples_shouldn't_block_or_return_error,_even_if_ingesters_are_sad (0.11s) --- PASS: TestDistributor_Push/A_push_to_2_happy_ingesters_should_succeed (0.16s) --- PASS: TestDistributor_Push/A_push_to_1_happy_ingesters_should_fail (0.11s) --- PASS: TestDistributor_Push/A_push_to_0_happy_ingesters_should_fail (0.20s) --- PASS: TestDistributor_Push/A_push_exceeding_burst_size_should_fail (0.16s) === RUN TestDistributor_ContextCanceledRequest --- PASS: TestDistributor_ContextCanceledRequest (0.11s) === RUN TestDistributor_MetricsCleanup --- PASS: TestDistributor_MetricsCleanup (0.12s) === RUN TestDistributor_PushRequestRateLimiter === RUN TestDistributor_PushRequestRateLimiter/request_limit_should_be_evenly_shared_across_distributors === RUN TestDistributor_PushRequestRateLimiter/request_limit_is_disabled_when_set_to_0 === RUN TestDistributor_PushRequestRateLimiter/request_burst_should_set_to_each_distributor --- PASS: TestDistributor_PushRequestRateLimiter (0.85s) --- PASS: TestDistributor_PushRequestRateLimiter/request_limit_should_be_evenly_shared_across_distributors (0.32s) --- PASS: TestDistributor_PushRequestRateLimiter/request_limit_is_disabled_when_set_to_0 (0.20s) --- PASS: TestDistributor_PushRequestRateLimiter/request_burst_should_set_to_each_distributor (0.33s) === RUN TestDistributor_PushIngestionRateLimiter === RUN TestDistributor_PushIngestionRateLimiter/evenly_share_the_ingestion_limit_across_distributors === RUN TestDistributor_PushIngestionRateLimiter/for_each_distributor,_set_an_ingestion_burst_limit. --- PASS: TestDistributor_PushIngestionRateLimiter (0.34s) --- PASS: TestDistributor_PushIngestionRateLimiter/evenly_share_the_ingestion_limit_across_distributors (0.22s) --- PASS: TestDistributor_PushIngestionRateLimiter/for_each_distributor,_set_an_ingestion_burst_limit. (0.12s) === RUN TestDistributor_PushInstanceLimits === RUN TestDistributor_PushInstanceLimits/hits_inflight_limit === RUN TestDistributor_PushInstanceLimits/below_ingestion_rate_limit === RUN TestDistributor_PushInstanceLimits/hits_rate_limit_on_first_request,_but_second_request_can_proceed === RUN TestDistributor_PushInstanceLimits/below_rate_limit_on_first_request,_but_hits_the_rate_limit_afterwards === RUN TestDistributor_PushInstanceLimits/no_limits_limit === RUN TestDistributor_PushInstanceLimits/below_inflight_limit --- PASS: TestDistributor_PushInstanceLimits (1.15s) --- PASS: TestDistributor_PushInstanceLimits/hits_inflight_limit (0.15s) --- PASS: TestDistributor_PushInstanceLimits/below_ingestion_rate_limit (0.13s) --- PASS: TestDistributor_PushInstanceLimits/hits_rate_limit_on_first_request,_but_second_request_can_proceed (0.15s) --- PASS: TestDistributor_PushInstanceLimits/below_rate_limit_on_first_request,_but_hits_the_rate_limit_afterwards (0.39s) --- PASS: TestDistributor_PushInstanceLimits/no_limits_limit (0.17s) --- PASS: TestDistributor_PushInstanceLimits/below_inflight_limit (0.15s) === RUN TestDistributor_PushHAInstances === RUN TestDistributor_PushHAInstances/0 === RUN TestDistributor_PushHAInstances/1 === RUN TestDistributor_PushHAInstances/2 === RUN TestDistributor_PushHAInstances/3 --- PASS: TestDistributor_PushHAInstances (6.21s) --- PASS: TestDistributor_PushHAInstances/0 (2.00s) --- PASS: TestDistributor_PushHAInstances/1 (2.00s) --- PASS: TestDistributor_PushHAInstances/2 (0.20s) --- PASS: TestDistributor_PushHAInstances/3 (2.00s) === RUN TestDistributor_PushQuery === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) --- PASS: TestDistributor_PushQuery (65.94s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) (0.20s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) (0.20s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) (0.20s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) (0.17s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) (0.11s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) (0.11s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) (0.17s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) (0.20s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) (0.20s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) (0.11s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) (0.20s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) (0.20s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) (0.15s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) (0.18s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) (0.21s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) (0.20s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) (0.20s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) (0.11s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) (0.20s) === RUN TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunksPerQueryLimitIsReached --- PASS: TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunksPerQueryLimitIsReached (0.11s) === RUN TestDistributor_QueryStream_ShouldReturnErrorIfMaxSeriesPerQueryLimitIsReached --- PASS: TestDistributor_QueryStream_ShouldReturnErrorIfMaxSeriesPerQueryLimitIsReached (0.20s) === RUN TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunkBytesPerQueryLimitIsReached --- PASS: TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunkBytesPerQueryLimitIsReached (0.20s) === RUN TestDistributor_Push_LabelRemoval --- PASS: TestDistributor_Push_LabelRemoval (0.39s) === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_label_due_to_config === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_HA_replica_label === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_2_with_value_1 === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_2 === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1 --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime (0.75s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_label_due_to_config (0.15s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_HA_replica_label (0.17s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_2_with_value_1 (0.15s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_2 (0.15s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1 (0.13s) === RUN TestDistributor_Push_LabelNameValidation === RUN TestDistributor_Push_LabelNameValidation/label_name_validation_is_on_by_default === RUN TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_config === RUN TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_WriteRequest_parameter --- PASS: TestDistributor_Push_LabelNameValidation (0.44s) --- PASS: TestDistributor_Push_LabelNameValidation/label_name_validation_is_on_by_default (0.12s) --- PASS: TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_config (0.15s) --- PASS: TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_WriteRequest_parameter (0.17s) === RUN TestDistributor_Push_ExemplarValidation === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_timestamp === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_long_labelset === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_many_series_labels === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_duplicate_series_labels === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_empty_series_label_name === RUN TestDistributor_Push_ExemplarValidation/valid_exemplar === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_labels --- PASS: TestDistributor_Push_ExemplarValidation (1.04s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_timestamp (0.13s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_long_labelset (0.19s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_many_series_labels (0.15s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_duplicate_series_labels (0.15s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_empty_series_label_name (0.18s) --- PASS: TestDistributor_Push_ExemplarValidation/valid_exemplar (0.11s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_labels (0.14s) === RUN TestDistributor_ExemplarValidation === RUN TestDistributor_ExemplarValidation/one_old,_one_new,_same_series === RUN TestDistributor_ExemplarValidation/valid_exemplars === RUN TestDistributor_ExemplarValidation/one_old,_one_new,_separate_series === RUN TestDistributor_ExemplarValidation/multi_exemplars --- PASS: TestDistributor_ExemplarValidation (0.20s) --- PASS: TestDistributor_ExemplarValidation/one_old,_one_new,_same_series (0.00s) --- PASS: TestDistributor_ExemplarValidation/valid_exemplars (0.00s) --- PASS: TestDistributor_ExemplarValidation/one_old,_one_new,_separate_series (0.00s) --- PASS: TestDistributor_ExemplarValidation/multi_exemplars (0.00s) === RUN TestSlowQueries === RUN TestSlowQueries/0 === RUN TestSlowQueries/1 === RUN TestSlowQueries/2 === RUN TestSlowQueries/3 --- PASS: TestSlowQueries (1.06s) --- PASS: TestSlowQueries/0 (0.26s) --- PASS: TestSlowQueries/1 (0.27s) --- PASS: TestSlowQueries/2 (0.30s) --- PASS: TestSlowQueries/3 (0.24s) === RUN TestDistributor_MetricsForLabelMatchers === RUN TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher === RUN TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers === RUN TestDistributor_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide === RUN TestDistributor_MetricsForLabelMatchers/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_shard_size_is_set === RUN TestDistributor_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match --- PASS: TestDistributor_MetricsForLabelMatchers (0.74s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher (0.13s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers (0.18s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide (0.17s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_shard_size_is_set (0.12s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match (0.14s) === RUN TestDistributor_LabelNames === RUN TestDistributor_LabelNames/should_return_an_empty_response_if_no_metric_match === RUN TestDistributor_LabelNames/should_filter_metrics_by_single_matcher === RUN TestDistributor_LabelNames/should_filter_metrics_by_multiple_matchers === RUN TestDistributor_LabelNames/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled --- PASS: TestDistributor_LabelNames (0.59s) --- PASS: TestDistributor_LabelNames/should_return_an_empty_response_if_no_metric_match (0.13s) --- PASS: TestDistributor_LabelNames/should_filter_metrics_by_single_matcher (0.17s) --- PASS: TestDistributor_LabelNames/should_filter_metrics_by_multiple_matchers (0.13s) --- PASS: TestDistributor_LabelNames/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled (0.17s) === RUN TestDistributor_MetricsMetadata === RUN TestDistributor_MetricsMetadata/should_query_all_ingesters_if_shuffle_sharding_is_enabled_but_shard_size_is_0 === RUN TestDistributor_MetricsMetadata/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled --- PASS: TestDistributor_MetricsMetadata (0.31s) --- PASS: TestDistributor_MetricsMetadata/should_query_all_ingesters_if_shuffle_sharding_is_enabled_but_shard_size_is_0 (0.13s) --- PASS: TestDistributor_MetricsMetadata/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled (0.19s) === RUN TestDistributor_LabelNamesAndValuesLimitTest === RUN TestDistributor_LabelNamesAndValuesLimitTest/expected_error_if_sizeLimit_is_reached === RUN TestDistributor_LabelNamesAndValuesLimitTest/expected_no_error_if_sizeLimit_is_not_reached --- PASS: TestDistributor_LabelNamesAndValuesLimitTest (0.30s) --- PASS: TestDistributor_LabelNamesAndValuesLimitTest/expected_error_if_sizeLimit_is_reached (0.15s) --- PASS: TestDistributor_LabelNamesAndValuesLimitTest/expected_no_error_if_sizeLimit_is_not_reached (0.15s) === RUN TestDistributor_LabelNamesAndValues === RUN TestDistributor_LabelNamesAndValues/should_group_values_of_labels_by_label_name_and_return_only_distinct_label_values === RUN TestDistributor_LabelNamesAndValues/should_return_the_results_if_zone_awareness_is_enabled_and_only_2_zones_return_the_results --- PASS: TestDistributor_LabelNamesAndValues (0.26s) --- PASS: TestDistributor_LabelNamesAndValues/should_group_values_of_labels_by_label_name_and_return_only_distinct_label_values (0.12s) --- PASS: TestDistributor_LabelNamesAndValues/should_return_the_results_if_zone_awareness_is_enabled_and_only_2_zones_return_the_results (0.13s) === RUN TestDistributor_LabelValuesCardinality_ExpectedAllIngestersResponsesToBeCompleted --- PASS: TestDistributor_LabelValuesCardinality_ExpectedAllIngestersResponsesToBeCompleted (1.97s) === RUN TestDistributor_LabelNamesAndValues_ExpectedAllPossibleLabelNamesAndValuesToBeReturned --- PASS: TestDistributor_LabelNamesAndValues_ExpectedAllPossibleLabelNamesAndValuesToBeReturned (4.04s) === RUN TestDistributor_IngestionIsControlledByForwarder === RUN TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_only_samples === RUN TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_only_samples === RUN TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_metadata === RUN TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_metadata === RUN TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_exemplars === RUN TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_exemplars --- PASS: TestDistributor_IngestionIsControlledByForwarder (1.08s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_only_samples (0.16s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_only_samples (0.20s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_metadata (0.20s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_metadata (0.16s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_exemplars (0.16s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_exemplars (0.20s) === RUN TestDistributor_LabelValuesCardinality === RUN TestDistributor_LabelValuesCardinality/should_return_an_empty_map_if_no_label_names === RUN TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_a_single_label_name === RUN TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_all_the_label_names --- PASS: TestDistributor_LabelValuesCardinality (0.48s) --- PASS: TestDistributor_LabelValuesCardinality/should_return_an_empty_map_if_no_label_names (0.13s) --- PASS: TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_a_single_label_name (0.16s) --- PASS: TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_all_the_label_names (0.19s) === RUN TestDistributor_LabelValuesCardinalityLimit === RUN TestDistributor_LabelValuesCardinalityLimit/should_return_a_httpgrpc_error_if_the_maximum_number_of_label_names_per_request_is_reached === RUN TestDistributor_LabelValuesCardinalityLimit/should_succeed_if_the_maximum_number_of_label_names_per_request_is_not_reached --- PASS: TestDistributor_LabelValuesCardinalityLimit (0.28s) --- PASS: TestDistributor_LabelValuesCardinalityLimit/should_return_a_httpgrpc_error_if_the_maximum_number_of_label_names_per_request_is_reached (0.13s) --- PASS: TestDistributor_LabelValuesCardinalityLimit/should_succeed_if_the_maximum_number_of_label_names_per_request_is_not_reached (0.14s) === RUN TestDistributor_LabelValuesCardinality_Concurrency === RUN TestDistributor_LabelValuesCardinality_Concurrency/should_fail_with_an_error_if_at_least_one_ingester's_LabelValuesCardinality_and/or_UserStats_operations_fails --- PASS: TestDistributor_LabelValuesCardinality_Concurrency (0.13s) --- PASS: TestDistributor_LabelValuesCardinality_Concurrency/should_fail_with_an_error_if_at_least_one_ingester's_LabelValuesCardinality_and/or_UserStats_operations_fails (0.13s) === RUN TestDistributorValidation === RUN TestDistributorValidation/0 === RUN TestDistributorValidation/1 === RUN TestDistributorValidation/2 === RUN TestDistributorValidation/3 === RUN TestDistributorValidation/4 === RUN TestDistributorValidation/5 --- PASS: TestDistributorValidation (0.76s) --- PASS: TestDistributorValidation/0 (0.11s) --- PASS: TestDistributorValidation/1 (0.11s) --- PASS: TestDistributorValidation/2 (0.16s) --- PASS: TestDistributorValidation/3 (0.12s) --- PASS: TestDistributorValidation/4 (0.11s) --- PASS: TestDistributorValidation/5 (0.15s) === RUN TestRemoveReplicaLabel --- PASS: TestRemoveReplicaLabel (0.00s) === RUN TestShardByAllLabelsReturnsWrongResultsForUnsortedLabels --- PASS: TestShardByAllLabelsReturnsWrongResultsForUnsortedLabels (0.00s) === RUN TestSortLabels --- PASS: TestSortLabels (0.01s) === RUN TestDistributor_Push_Relabel --- PASS: TestDistributor_Push_Relabel (0.34s) === RUN TestHATrackerConfig_Validate === PAUSE TestHATrackerConfig_Validate === RUN TestWatchPrefixAssignment --- PASS: TestWatchPrefixAssignment (1.00s) === RUN TestCheckReplicaOverwriteTimeout --- PASS: TestCheckReplicaOverwriteTimeout (2.00s) === RUN TestCheckReplicaMultiCluster --- PASS: TestCheckReplicaMultiCluster (2.00s) === RUN TestCheckReplicaMultiClusterTimeout --- PASS: TestCheckReplicaMultiClusterTimeout (2.00s) === RUN TestCheckReplicaUpdateTimeout --- PASS: TestCheckReplicaUpdateTimeout (2.00s) === RUN TestCheckReplicaMultiUser --- PASS: TestCheckReplicaMultiUser (2.00s) === RUN TestCheckReplicaUpdateTimeoutJitter === PAUSE TestCheckReplicaUpdateTimeoutJitter === RUN TestFindHALabels --- PASS: TestFindHALabels (0.00s) === RUN TestHATrackerConfig_ShouldCustomizePrefixDefaultValue --- PASS: TestHATrackerConfig_ShouldCustomizePrefixDefaultValue (0.00s) === RUN TestHAClustersLimit --- PASS: TestHAClustersLimit (0.05s) === RUN TestTooManyClustersError --- PASS: TestTooManyClustersError (0.00s) === RUN TestReplicasNotMatchError --- PASS: TestReplicasNotMatchError (0.00s) === RUN TestHATracker_MetricsCleanup --- PASS: TestHATracker_MetricsCleanup (0.00s) === RUN TestCheckReplicaCleanup --- PASS: TestCheckReplicaCleanup (2.00s) === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_and_active === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_not_all_instances_active === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_all_instances_active === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_but_timeout_disabled_all_instances_active --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_and_active (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_not_all_instances_active (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_all_instances_active (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_but_timeout_disabled_all_instances_active (0.00s) === RUN TestMergeSamplesIntoFirstDuplicates --- PASS: TestMergeSamplesIntoFirstDuplicates (0.00s) === RUN TestMergeSamplesIntoFirst --- PASS: TestMergeSamplesIntoFirst (0.00s) === RUN TestMergeSamplesIntoFirstNilA --- PASS: TestMergeSamplesIntoFirstNilA (0.00s) === RUN TestMergeSamplesIntoFirstNilB --- PASS: TestMergeSamplesIntoFirstNilB (0.00s) === RUN TestMergeExemplars === RUN TestMergeExemplars/test0 === RUN TestMergeExemplars/test1 === RUN TestMergeExemplars/test2 === RUN TestMergeExemplars/test3 === RUN TestMergeExemplars/test4 === RUN TestMergeExemplars/test5 === RUN TestMergeExemplars/test6 --- PASS: TestMergeExemplars (0.00s) --- PASS: TestMergeExemplars/test0 (0.00s) --- PASS: TestMergeExemplars/test1 (0.00s) --- PASS: TestMergeExemplars/test2 (0.00s) --- PASS: TestMergeExemplars/test3 (0.00s) --- PASS: TestMergeExemplars/test4 (0.00s) --- PASS: TestMergeExemplars/test5 (0.00s) --- PASS: TestMergeExemplars/test6 (0.00s) === RUN TestIngestionRateStrategy === RUN TestIngestionRateStrategy/rate_limiter_should_share_the_limit_across_the_number_of_distributors === RUN TestIngestionRateStrategy/infinite_rate_limiter_should_return_unlimited_settings --- PASS: TestIngestionRateStrategy (0.00s) --- PASS: TestIngestionRateStrategy/rate_limiter_should_share_the_limit_across_the_number_of_distributors (0.00s) --- PASS: TestIngestionRateStrategy/infinite_rate_limiter_should_return_unlimited_settings (0.00s) === CONT TestCheckReplicaUpdateTimeoutJitter === CONT TestHATrackerConfig_Validate === RUN TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(without_jitter) === RUN TestHATrackerConfig_Validate/should_pass_with_default_config === RUN TestHATrackerConfig_Validate/should_fail_if_max_update_timeout_jitter_is_negative === RUN TestHATrackerConfig_Validate/should_fail_if_failover_timeout_is_<_update_timeout_+_jitter_+_1_sec === RUN TestHATrackerConfig_Validate/should_pass_if_failover_timeout_is_>=_update_timeout_+_jitter_+_1_sec === RUN TestHATrackerConfig_Validate/should_fail_if_KV_backend_is_set_to_memberlist --- PASS: TestHATrackerConfig_Validate (0.00s) --- PASS: TestHATrackerConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestHATrackerConfig_Validate/should_fail_if_max_update_timeout_jitter_is_negative (0.00s) --- PASS: TestHATrackerConfig_Validate/should_fail_if_failover_timeout_is_<_update_timeout_+_jitter_+_1_sec (0.00s) --- PASS: TestHATrackerConfig_Validate/should_pass_if_failover_timeout_is_>=_update_timeout_+_jitter_+_1_sec (0.00s) --- PASS: TestHATrackerConfig_Validate/should_fail_if_KV_backend_is_set_to_memberlist (0.00s) === RUN TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(without_jitter) === RUN TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(with_jitter) === RUN TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(with_jitter) --- PASS: TestCheckReplicaUpdateTimeoutJitter (4.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(without_jitter) (1.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(without_jitter) (1.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(with_jitter) (0.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(with_jitter) (2.00s) PASS ok github.com/grafana/mimir/pkg/distributor 109.746s ? github.com/grafana/mimir/pkg/distributor/distributorpb [no test files] === RUN TestForwardingSamplesSuccessfully --- PASS: TestForwardingSamplesSuccessfully (0.10s) === RUN TestForwardingSamplesWithDifferentErrorsWithPropagation === RUN TestForwardingSamplesWithDifferentErrorsWithPropagation/non-recoverable_and_successful_codes_should_result_in_non-recoverable === RUN TestForwardingSamplesWithDifferentErrorsWithPropagation/recoverable,_non-recoverable_and_successful_codes_should_result_in_recoverable_(1) === RUN TestForwardingSamplesWithDifferentErrorsWithPropagation/recoverable,_non-recoverable_and_successful_codes_should_result_in_recoverable_(2) === RUN TestForwardingSamplesWithDifferentErrorsWithPropagation/successful_codes_should_result_in_no_error === RUN TestForwardingSamplesWithDifferentErrorsWithPropagation/codes_which_are_not_divisible_by_100_(1) === RUN TestForwardingSamplesWithDifferentErrorsWithPropagation/codes_which_are_not_divisible_by_100_(2) === RUN TestForwardingSamplesWithDifferentErrorsWithPropagation/codes_which_are_not_divisible_by_100_(3) === RUN TestForwardingSamplesWithDifferentErrorsWithPropagation/errors_dont_get_propagated --- PASS: TestForwardingSamplesWithDifferentErrorsWithPropagation (0.09s) --- PASS: TestForwardingSamplesWithDifferentErrorsWithPropagation/non-recoverable_and_successful_codes_should_result_in_non-recoverable (0.05s) --- PASS: TestForwardingSamplesWithDifferentErrorsWithPropagation/recoverable,_non-recoverable_and_successful_codes_should_result_in_recoverable_(1) (0.01s) --- PASS: TestForwardingSamplesWithDifferentErrorsWithPropagation/recoverable,_non-recoverable_and_successful_codes_should_result_in_recoverable_(2) (0.01s) --- PASS: TestForwardingSamplesWithDifferentErrorsWithPropagation/successful_codes_should_result_in_no_error (0.00s) --- PASS: TestForwardingSamplesWithDifferentErrorsWithPropagation/codes_which_are_not_divisible_by_100_(1) (0.01s) --- PASS: TestForwardingSamplesWithDifferentErrorsWithPropagation/codes_which_are_not_divisible_by_100_(2) (0.01s) --- PASS: TestForwardingSamplesWithDifferentErrorsWithPropagation/codes_which_are_not_divisible_by_100_(3) (0.01s) --- PASS: TestForwardingSamplesWithDifferentErrorsWithPropagation/errors_dont_get_propagated (0.01s) PASS ok github.com/grafana/mimir/pkg/distributor/forwarding 0.954s ? github.com/grafana/mimir/pkg/flusher [no test files] === RUN TestFrontend_RequestHostHeaderWhenDownstreamURLIsConfigured --- PASS: TestFrontend_RequestHostHeaderWhenDownstreamURLIsConfigured (0.19s) === RUN TestFrontend_LogsSlowQueriesFormValues --- PASS: TestFrontend_LogsSlowQueriesFormValues (0.02s) === RUN TestFrontend_ReturnsRequestBodyTooLargeError --- PASS: TestFrontend_ReturnsRequestBodyTooLargeError (0.02s) PASS ok github.com/grafana/mimir/pkg/frontend 0.771s === RUN TestRequest === RUN TestRequest/0 === RUN TestRequest/1 === RUN TestRequest/2 === RUN TestRequest/3 === RUN TestRequest/4 === RUN TestRequest/5 === RUN TestRequest/6 === RUN TestRequest/7 --- PASS: TestRequest (0.03s) --- PASS: TestRequest/0 (0.01s) --- PASS: TestRequest/1 (0.00s) --- PASS: TestRequest/2 (0.02s) --- PASS: TestRequest/3 (0.00s) --- PASS: TestRequest/4 (0.00s) --- PASS: TestRequest/5 (0.00s) --- PASS: TestRequest/6 (0.00s) --- PASS: TestRequest/7 (0.00s) === RUN TestResponseRoundtrip === RUN TestResponseRoundtrip/successful_string_response === RUN TestResponseRoundtrip/successful_scalar_response === RUN TestResponseRoundtrip/successful_instant_response === RUN TestResponseRoundtrip/successful_range_response === RUN TestResponseRoundtrip/successful_empty_matrix_response === RUN TestResponseRoundtrip/error_response --- PASS: TestResponseRoundtrip (0.04s) --- PASS: TestResponseRoundtrip/successful_string_response (0.02s) --- PASS: TestResponseRoundtrip/successful_scalar_response (0.00s) --- PASS: TestResponseRoundtrip/successful_instant_response (0.01s) --- PASS: TestResponseRoundtrip/successful_range_response (0.01s) --- PASS: TestResponseRoundtrip/successful_empty_matrix_response (0.00s) --- PASS: TestResponseRoundtrip/error_response (0.00s) === RUN TestMergeAPIResponses === RUN TestMergeAPIResponses/No_responses_shouldn't_panic_and_return_a_non-null_result_and_result_type. === RUN TestMergeAPIResponses/A_single_empty_response_shouldn't_panic. === RUN TestMergeAPIResponses/Multiple_empty_responses_shouldn't_panic. === RUN TestMergeAPIResponses/Basic_merging_of_two_responses. === RUN TestMergeAPIResponses/Merging_of_responses_when_labels_are_in_different_order. === RUN TestMergeAPIResponses/Merging_of_samples_where_there_is_single_overlap. === RUN TestMergeAPIResponses/Merging_of_samples_where_there_is_multiple_partial_overlaps. === RUN TestMergeAPIResponses/Merging_of_samples_where_there_is_complete_overlap. === RUN TestMergeAPIResponses/shouldn't_merge_unsuccessful_responses === RUN TestMergeAPIResponses/shouldn't_merge_nil_data === RUN TestMergeAPIResponses/shouldn't_merge_non-matrix_data --- PASS: TestMergeAPIResponses (0.01s) --- PASS: TestMergeAPIResponses/No_responses_shouldn't_panic_and_return_a_non-null_result_and_result_type. (0.00s) --- PASS: TestMergeAPIResponses/A_single_empty_response_shouldn't_panic. (0.00s) --- PASS: TestMergeAPIResponses/Multiple_empty_responses_shouldn't_panic. (0.00s) --- PASS: TestMergeAPIResponses/Basic_merging_of_two_responses. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_responses_when_labels_are_in_different_order. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_samples_where_there_is_single_overlap. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_samples_where_there_is_multiple_partial_overlaps. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_samples_where_there_is_complete_overlap. (0.00s) --- PASS: TestMergeAPIResponses/shouldn't_merge_unsuccessful_responses (0.00s) --- PASS: TestMergeAPIResponses/shouldn't_merge_nil_data (0.00s) --- PASS: TestMergeAPIResponses/shouldn't_merge_non-matrix_data (0.00s) === RUN Test_DecodeOptions === RUN Test_DecodeOptions/default === PAUSE Test_DecodeOptions/default === RUN Test_DecodeOptions/disable_cache === PAUSE Test_DecodeOptions/disable_cache === RUN Test_DecodeOptions/custom_sharding === PAUSE Test_DecodeOptions/custom_sharding === RUN Test_DecodeOptions/disable_sharding === PAUSE Test_DecodeOptions/disable_sharding === CONT Test_DecodeOptions/default === CONT Test_DecodeOptions/custom_sharding === CONT Test_DecodeOptions/disable_sharding === CONT Test_DecodeOptions/disable_cache --- PASS: Test_DecodeOptions (0.00s) --- PASS: Test_DecodeOptions/default (0.00s) --- PASS: Test_DecodeOptions/custom_sharding (0.00s) --- PASS: Test_DecodeOptions/disable_sharding (0.00s) --- PASS: Test_DecodeOptions/disable_cache (0.00s) === RUN TestLimitsMiddleware_MaxQueryLookback === RUN TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit === RUN TestLimitsMiddleware_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range === RUN TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_if_max_lookback_is_disabled === RUN TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range === RUN TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit --- PASS: TestLimitsMiddleware_MaxQueryLookback (0.01s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit (0.01s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_if_max_lookback_is_disabled (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit (0.00s) === RUN TestLimitsMiddleware_MaxQueryLength === RUN TestLimitsMiddleware_MaxQueryLength/should_skip_validation_if_max_length_is_disabled === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_now === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_in_the_past === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_large_time_range_close_to_the_limit,_ending_now === RUN TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_now === RUN TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_in_the_past --- PASS: TestLimitsMiddleware_MaxQueryLength (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_skip_validation_if_max_length_is_disabled (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_now (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_in_the_past (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_large_time_range_close_to_the_limit,_ending_now (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_now (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_in_the_past (0.00s) === RUN TestLimitedRoundTripper_MaxQueryParallelism --- PASS: TestLimitedRoundTripper_MaxQueryParallelism (0.25s) === RUN TestLimitedRoundTripper_MaxQueryParallelismLateScheduling --- PASS: TestLimitedRoundTripper_MaxQueryParallelismLateScheduling (0.02s) === RUN TestLimitedRoundTripper_OriginalRequestContextCancellation --- PASS: TestLimitedRoundTripper_OriginalRequestContextCancellation (0.10s) === RUN TestQueryShardingCorrectness === RUN TestQueryShardingCorrectness/and === PAUSE TestQueryShardingCorrectness/and === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 === PAUSE TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 === RUN TestQueryShardingCorrectness/string_literal === PAUSE TestQueryShardingCorrectness/string_literal === RUN TestQueryShardingCorrectness/month(sum(metric_counter)) === PAUSE TestQueryShardingCorrectness/month(sum(metric_counter)) === RUN TestQueryShardingCorrectness/or === PAUSE TestQueryShardingCorrectness/or === RUN TestQueryShardingCorrectness/label_replace === PAUSE TestQueryShardingCorrectness/label_replace === RUN TestQueryShardingCorrectness/stdvar() === PAUSE TestQueryShardingCorrectness/stdvar() === RUN TestQueryShardingCorrectness/time() === PAUSE TestQueryShardingCorrectness/time() === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) === PAUSE TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) === RUN TestQueryShardingCorrectness/triple_subquery === PAUSE TestQueryShardingCorrectness/triple_subquery === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order === PAUSE TestQueryShardingCorrectness/query_with_sort()_expects_specific_order === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) === PAUSE TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/sum()_grouping_'by' === PAUSE TestQueryShardingCorrectness/sum()_grouping_'by' === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand === PAUSE TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr === PAUSE TestQueryShardingCorrectness/subquery_min_over_time_with_aggr === RUN TestQueryShardingCorrectness/sum(max_over_time()) === PAUSE TestQueryShardingCorrectness/sum(max_over_time()) === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg === PAUSE TestQueryShardingCorrectness/outer_subquery_on_top_of_avg === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by' === PAUSE TestQueryShardingCorrectness/sum(rate())_grouping_'by' === RUN TestQueryShardingCorrectness/min()_no_grouping === PAUSE TestQueryShardingCorrectness/min()_no_grouping === RUN TestQueryShardingCorrectness/subquery_max === PAUSE TestQueryShardingCorrectness/subquery_max === RUN TestQueryShardingCorrectness/@_modifier === PAUSE TestQueryShardingCorrectness/@_modifier === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children === PAUSE TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping === PAUSE TestQueryShardingCorrectness/histogram_quantile()_no_grouping === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar === PAUSE TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar === RUN TestQueryShardingCorrectness/sum()_no_grouping === PAUSE TestQueryShardingCorrectness/sum()_no_grouping === RUN TestQueryShardingCorrectness/sum()_grouping_'without' === PAUSE TestQueryShardingCorrectness/sum()_grouping_'without' === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without' === PAUSE TestQueryShardingCorrectness/sum(rate())_grouping_'without' === RUN TestQueryShardingCorrectness/min()_grouping_'by' === PAUSE TestQueryShardingCorrectness/min()_grouping_'by' === RUN TestQueryShardingCorrectness/double_subquery_deriv === PAUSE TestQueryShardingCorrectness/double_subquery_deriv === RUN TestQueryShardingCorrectness/label_join === PAUSE TestQueryShardingCorrectness/label_join === RUN TestQueryShardingCorrectness/scalar(aggregation) === PAUSE TestQueryShardingCorrectness/scalar(aggregation) === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand === PAUSE TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand === RUN TestQueryShardingCorrectness/@_modifier_and_offset === PAUSE TestQueryShardingCorrectness/@_modifier_and_offset === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand === PAUSE TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand === RUN TestQueryShardingCorrectness/bottomk() === PAUSE TestQueryShardingCorrectness/bottomk() === RUN TestQueryShardingCorrectness/month()_>=_1_and_month() === PAUSE TestQueryShardingCorrectness/month()_>=_1_and_month() === RUN TestQueryShardingCorrectness/max()_grouping_'by' === PAUSE TestQueryShardingCorrectness/max()_grouping_'by' === RUN TestQueryShardingCorrectness/count()_grouping_'by' === PAUSE TestQueryShardingCorrectness/count()_grouping_'by' === RUN TestQueryShardingCorrectness/count()_grouping_'without' === PAUSE TestQueryShardingCorrectness/count()_grouping_'without' === RUN TestQueryShardingCorrectness/sum(min_over_time()) === PAUSE TestQueryShardingCorrectness/sum(min_over_time()) === RUN TestQueryShardingCorrectness/sum_of_subquery_min === PAUSE TestQueryShardingCorrectness/sum_of_subquery_min === RUN TestQueryShardingCorrectness/topk() === PAUSE TestQueryShardingCorrectness/topk() === RUN TestQueryShardingCorrectness/scalar(single_metric) === PAUSE TestQueryShardingCorrectness/scalar(single_metric) === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' === PAUSE TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum === PAUSE TestQueryShardingCorrectness/outer_subquery_on_top_of_sum === RUN TestQueryShardingCorrectness/vector() === PAUSE TestQueryShardingCorrectness/vector() === RUN TestQueryShardingCorrectness/vector(1) === PAUSE TestQueryShardingCorrectness/vector(1) === RUN TestQueryShardingCorrectness/min()_grouping_'without' === PAUSE TestQueryShardingCorrectness/min()_grouping_'without' === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 === PAUSE TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation === PAUSE TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' === PAUSE TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' === RUN TestQueryShardingCorrectness/max()_no_grouping === PAUSE TestQueryShardingCorrectness/max()_no_grouping === RUN TestQueryShardingCorrectness/avg()_grouping_'by' === PAUSE TestQueryShardingCorrectness/avg()_grouping_'by' === RUN TestQueryShardingCorrectness/sum(avg_over_time()) === PAUSE TestQueryShardingCorrectness/sum(avg_over_time()) === RUN TestQueryShardingCorrectness/subquery_min === PAUSE TestQueryShardingCorrectness/subquery_min === RUN TestQueryShardingCorrectness/stddev() === PAUSE TestQueryShardingCorrectness/stddev() === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) === PAUSE TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/sum(count()) === PAUSE TestQueryShardingCorrectness/sum(count()) === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1) === PAUSE TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1) === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() === PAUSE TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping === PAUSE TestQueryShardingCorrectness/sum(rate())_no_grouping === RUN TestQueryShardingCorrectness/count()_no_grouping === PAUSE TestQueryShardingCorrectness/count()_no_grouping === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) === PAUSE TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant === PAUSE TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() === PAUSE TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le === PAUSE TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le === RUN TestQueryShardingCorrectness/avg()_no_grouping === PAUSE TestQueryShardingCorrectness/avg()_no_grouping === RUN TestQueryShardingCorrectness/nested_count() === PAUSE TestQueryShardingCorrectness/nested_count() === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar === PAUSE TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar === RUN TestQueryShardingCorrectness/max()_grouping_'without' === PAUSE TestQueryShardingCorrectness/max()_grouping_'without' === RUN TestQueryShardingCorrectness/avg()_grouping_'without' === PAUSE TestQueryShardingCorrectness/avg()_grouping_'without' === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation === PAUSE TestQueryShardingCorrectness/histogram_quantile_without_aggregation === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) === PAUSE TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) === CONT TestQueryShardingCorrectness/max()_grouping_'without' === CONT TestQueryShardingCorrectness/bottomk() === CONT TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' === CONT TestQueryShardingCorrectness/avg()_grouping_'without' === CONT TestQueryShardingCorrectness/count()_no_grouping === CONT TestQueryShardingCorrectness/sum(max_over_time()) === CONT TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant === CONT TestQueryShardingCorrectness/@_modifier_and_offset === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum()_no_grouping === CONT TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand === CONT TestQueryShardingCorrectness/and === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/avg()_grouping_'by' === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/double_subquery_deriv === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) === CONT TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) === CONT TestQueryShardingCorrectness/sum(min_over_time()) === CONT TestQueryShardingCorrectness/count()_grouping_'without' === CONT TestQueryShardingCorrectness/scalar(single_metric) === CONT TestQueryShardingCorrectness/max()_grouping_'by' === CONT TestQueryShardingCorrectness/month()_>=_1_and_month() === CONT TestQueryShardingCorrectness/count()_grouping_'by' === CONT TestQueryShardingCorrectness/@_modifier === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/avg()_no_grouping === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/histogram_quantile_without_aggregation === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/label_join === CONT TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le === CONT TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar === CONT TestQueryShardingCorrectness/nested_count() === CONT TestQueryShardingCorrectness/min()_grouping_'by' === CONT TestQueryShardingCorrectness/scalar(aggregation) === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/sum(rate())_no_grouping === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1) === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum(count()) === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/stddev() === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/subquery_min === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/sum(avg_over_time()) === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/histogram_quantile()_no_grouping === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/min()_no_grouping === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/subquery_max === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/label_replace === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/time() === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/stdvar() === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/min()_grouping_'without' === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/max()_no_grouping === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/subquery_min_over_time_with_aggr === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/sum()_grouping_'by' === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/query_with_sort()_expects_specific_order === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/triple_subquery === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum()_grouping_'without' === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum(rate())_grouping_'without' === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/string_literal === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/or === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/month(sum(metric_counter)) === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/topk() === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum_of_subquery_min === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/vector(1) === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/vector() === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/outer_subquery_on_top_of_sum === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum(rate())_grouping_'by' === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/outer_subquery_on_top_of_avg === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 --- PASS: TestQueryShardingCorrectness (0.30s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month() (0.28s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest (0.18s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest (0.06s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() (0.31s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest (0.29s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest (0.02s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric) (0.36s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest (0.33s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.21s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by' (1.00s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.45s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.15s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (0.55s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.06s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.38s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping (1.24s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.74s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.38s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.48s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.14s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.06s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.12s) --- PASS: TestQueryShardingCorrectness/bottomk() (1.35s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest (0.27s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest (1.06s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.31s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.40s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand (1.37s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest (0.28s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest (1.09s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.18s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.52s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by' (1.46s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.43s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (1.03s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.70s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping (1.50s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.69s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.28s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.05s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.78s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.18s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) (1.53s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.73s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.40s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.80s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.32s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.10s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.18s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand (1.69s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest (0.51s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest (0.96s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.21s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.18s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping (1.48s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.24s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (1.24s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.29s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.32s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.23s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.23s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping (0.36s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.18s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.08s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.18s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/label_join (2.06s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest (0.68s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.30s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.05s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest (1.37s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.46s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.23s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.32s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset (2.11s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest (0.85s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.40s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest (1.26s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.26s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.26s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.12s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by' (2.14s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.54s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (1.57s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.29s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.49s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.37s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.33s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping (2.15s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.75s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.29s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.07s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (1.40s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.23s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.17s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.25s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.38s) --- PASS: TestQueryShardingCorrectness/@_modifier (2.15s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.08s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest (1.57s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.24s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.37s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.34s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.49s) --- PASS: TestQueryShardingCorrectness/time() (0.09s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest (0.03s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.03s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest (0.06s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without' (2.19s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.61s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.03s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (1.57s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.64s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.37s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation) (2.25s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest (0.56s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.35s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest (1.68s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.23s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.60s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.21s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.54s) --- PASS: TestQueryShardingCorrectness/nested_count() (2.27s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest (0.76s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.11s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.27s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.05s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest (1.51s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.34s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.29s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.44s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.33s) --- PASS: TestQueryShardingCorrectness/sum(count()) (1.30s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest (0.24s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.06s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.11s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest (1.06s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.32s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.20s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.18s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) (1.07s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.36s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.11s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.71s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.18s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.11s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping (0.95s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.36s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.08s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.11s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.59s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.07s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.08s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by' (2.48s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.70s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.11s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.29s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (1.76s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.77s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.49s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() (2.38s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest (0.30s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.03s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest (2.07s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.81s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.52s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.23s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping (0.54s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.20s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.30s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/stddev() (1.40s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest (0.37s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.06s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest (1.03s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.22s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.25s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) (0.28s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.16s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.13s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without' (0.96s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.32s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.08s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (0.64s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/string_literal (0.08s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest (0.08s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/and (3.42s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest (1.26s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.43s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.28s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.36s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest (2.15s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.39s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.34s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.38s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.52s) --- PASS: TestQueryShardingCorrectness/stdvar() (1.30s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest (0.20s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.05s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest (1.10s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.18s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.26s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.27s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.23s) --- PASS: TestQueryShardingCorrectness/label_replace (1.92s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest (0.77s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.08s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest (1.12s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.15s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.27s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.29s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) (3.71s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest (0.82s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.22s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.29s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.09s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest (2.86s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.46s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.37s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time()) (3.76s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest (1.23s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.25s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.66s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest (2.50s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.47s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.39s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.53s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.46s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without' (3.76s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.56s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.23s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (3.16s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.55s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.34s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.61s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.71s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by' (1.47s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.08s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (1.09s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.23s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.24s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/vector(1) (0.27s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.06s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.21s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.03s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/or (1.04s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest (0.45s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.07s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.16s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest (0.58s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/vector() (0.03s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest (0.02s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest (0.01s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum (0.09s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest (0.09s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter)) (0.93s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest (0.49s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.23s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest (0.44s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.17s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.08s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time()) (4.37s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest (0.58s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.22s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.08s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest (3.79s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.01s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.52s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.62s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.70s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar (4.53s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest (4.15s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.73s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.73s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.43s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.65s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg (0.29s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest (0.29s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.04s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr (2.52s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest (0.89s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.17s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.19s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest (1.64s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.51s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.46s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.19s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.28s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 (2.65s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest (0.49s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.17s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest (2.14s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.42s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.34s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.55s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.33s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without' (4.90s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.98s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.29s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.29s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (3.92s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.13s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.85s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.68s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.91s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without' (2.18s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.65s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.28s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (1.53s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.50s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.30s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.32s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series (3.41s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.23s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.03s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.05s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest (3.18s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.97s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.85s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.53s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.51s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 (1.56s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest (0.47s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.18s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest (1.09s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.28s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.22s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.17s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time()) (3.85s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest (1.15s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.47s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.26s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest (2.69s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.67s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.61s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.36s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.35s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without' (2.78s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.48s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (2.30s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.61s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.44s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.33s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.33s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation (5.76s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest (0.66s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.21s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.03s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest (5.10s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.05s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.37s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.83s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.99s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min (2.08s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest (0.86s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.42s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.11s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest (1.22s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.21s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.18s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.17s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by' (1.58s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.41s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.10s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (1.18s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.25s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.29s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children (2.58s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest (1.48s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.25s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.49s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.23s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest (1.09s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.24s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.27s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.18s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le (6.25s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest (1.83s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.32s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.29s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.28s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.28s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest (4.42s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.03s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.48s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.27s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order (3.61s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest (1.27s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.23s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.26s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.25s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest (2.34s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.45s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.30s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.27s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/topk() (2.75s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest (2.54s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.47s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.39s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.28s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.48s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) (4.68s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest (0.79s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.18s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest (3.87s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.64s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.38s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.29s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' (7.03s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (1.66s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.30s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.47s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.18s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.42s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (5.36s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.13s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.66s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.49s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.48s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' (5.01s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (1.39s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.28s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.28s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.23s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.29s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (3.62s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.78s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.42s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.32s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series (6.38s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.78s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.13s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.17s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest (5.59s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.55s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.01s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.67s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.55s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv (11.54s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest (1.96s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.37s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.38s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.33s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.50s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest (9.58s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (4.41s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.66s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.44s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.36s) --- PASS: TestQueryShardingCorrectness/subquery_min (10.32s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest (1.56s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.46s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.28s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.37s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.29s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest (8.76s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (3.86s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.55s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.46s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.37s) --- PASS: TestQueryShardingCorrectness/subquery_max (10.04s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest (1.96s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.52s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.40s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.34s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.51s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest (8.07s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (3.17s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.63s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.43s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.33s) --- PASS: TestQueryShardingCorrectness/triple_subquery (9.50s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest (2.41s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.47s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.40s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.38s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.33s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest (7.09s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (2.29s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.43s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.45s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.26s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar (9.16s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest (1.55s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.60s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.34s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.21s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest (7.62s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (2.16s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.45s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.50s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.46s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant (13.30s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest (1.77s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.45s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.35s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.25s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.54s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest (11.50s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (4.12s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.84s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.88s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.92s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand (12.52s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest (1.35s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.22s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.30s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.34s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.38s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest (11.14s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (3.12s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (2.35s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.99s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.75s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation (13.08s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest (2.07s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.40s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.37s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.49s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.48s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest (11.01s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.97s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (2.04s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.76s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.67s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1) (19.60s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest (2.62s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.28s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.46s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.75s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.70s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest (16.98s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (4.14s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (3.23s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (3.11s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_on_(unique)_group_left_(group_1)_*_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (2.70s) === RUN TestQueryshardingDeterminism --- PASS: TestQueryshardingDeterminism (0.20s) === RUN TestQuerySharding_FunctionCorrectness === RUN TestQuerySharding_FunctionCorrectness/(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/sum(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/count(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/sum(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/count(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/sum(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/count(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/sum(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/count(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/sum(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/count(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/sum(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/count(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) --- PASS: TestQuerySharding_FunctionCorrectness (3.19s) --- PASS: TestQuerySharding_FunctionCorrectness/(abs(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(abs(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(abs(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(abs(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(abs(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(avg_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(avg_over_time(bar1{}[1m])) (0.00s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(avg_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(avg_over_time(bar1{}[1m])) (0.00s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(avg_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(ceil(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(ceil(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ceil(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(ceil(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(ceil(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(changes(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(changes(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(changes(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(changes(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(changes(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(count_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(count_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(count_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(count_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(count_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(days_in_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(days_in_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(days_in_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(days_in_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(days_in_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(day_of_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(day_of_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(day_of_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(day_of_week(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(day_of_week(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_week(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(day_of_week(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_week(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(day_of_year(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(day_of_year(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_year(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(day_of_year(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_year(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(delta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(delta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(delta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(delta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(delta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(deriv(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(deriv(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deriv(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(deriv(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(deriv(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(exp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(exp(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(exp(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(exp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(exp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(hour(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(hour(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(hour(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(hour(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(hour(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(idelta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(idelta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(idelta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(idelta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(idelta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(increase(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(increase(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(increase(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(increase(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(increase(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(irate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(irate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(irate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(irate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(irate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(ln(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(ln(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ln(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(ln(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(ln(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(log10(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(log10(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log10(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(log10(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(log10(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(log2(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(log2(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log2(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(log2(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(log2(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(max_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(max_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(max_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(max_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(max_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(min_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(min_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(min_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(min_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(min_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(minute(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(minute(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(minute(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(minute(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(minute(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(month(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(rate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(rate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(rate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(rate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(resets(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(resets(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(resets(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(resets(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(resets(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(sort(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sort(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sort(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(sort_desc(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sort_desc(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort_desc(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sort_desc(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort_desc(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(sqrt(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sqrt(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sqrt(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sqrt(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sqrt(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(deg(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(deg(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deg(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(deg(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(deg(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(asinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(asinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(asinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(asinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(rad(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(rad(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rad(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(rad(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(rad(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(cosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(cosh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cosh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(cosh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(cosh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(atan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(atan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(atan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(atan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(atanh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(atanh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atanh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(atanh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(atanh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(asin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(asin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(asin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(asin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(sinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sinh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(cos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(cos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(cos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(cos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(acosh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(acosh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acosh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(acosh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(acosh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(sin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sin(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(tanh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(tanh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tanh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(tanh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(tanh(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(tan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(tan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(tan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(tan(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(acos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(acos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(acos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(acos(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(stddev_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(stddev_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stddev_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(stddev_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(stddev_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(stdvar_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(stdvar_over_time(bar1{}[1m])) (0.00s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stdvar_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(stdvar_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(stdvar_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(last_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(last_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(last_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(last_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(last_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(present_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(present_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(present_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(present_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(present_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.5,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.5,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.5,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.99,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.99,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.99,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(timestamp(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(timestamp(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(timestamp(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(timestamp(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(timestamp(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(year(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(year(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(year(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(year(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(year(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(sgn(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sgn(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sgn(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sgn(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sgn(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(clamp(bar1{},5,10)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(clamp(bar1{},5,10)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp(bar1{},5,10)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(clamp(bar1{},5,10)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp(bar1{},5,10)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(clamp_max(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(clamp_max(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_max(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(clamp_max(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_max(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(clamp_min(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(clamp_min(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_min(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(clamp_min(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_min(bar1{},5)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(predict_linear(bar1{}[1m],1)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(predict_linear(bar1{}[1m],1)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(predict_linear(bar1{}[1m],1)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(predict_linear(bar1{}[1m],1)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(predict_linear(bar1{}[1m],1)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(round(bar1{},20)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(round(bar1{},20)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(round(bar1{},20)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(round(bar1{},20)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(round(bar1{},20)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(holt_winters(bar1{}[1m],0.5,0.7)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(holt_winters(bar1{}[1m],0.5,0.7)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(holt_winters(bar1{}[1m],0.5,0.7)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/(label_join(bar1{},"fuzz",",","foo","bar")) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(label_join(bar1{},"fuzz",",","foo","bar")) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count(label_join(bar1{},"fuzz",",","foo","bar")) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) (0.01s) === RUN TestQuerySharding_ShouldFallbackToDownstreamHandlerOnMappingFailure --- PASS: TestQuerySharding_ShouldFallbackToDownstreamHandlerOnMappingFailure (0.00s) === RUN TestQuerySharding_ShouldSkipShardingViaOption --- PASS: TestQuerySharding_ShouldSkipShardingViaOption (0.00s) === RUN TestQuerySharding_ShouldOverrideShardingSizeViaOption --- PASS: TestQuerySharding_ShouldOverrideShardingSizeViaOption (0.05s) === RUN TestQuerySharding_ShouldSupportMaxShardedQueries === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_3_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_4_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_10_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/query_sharding_is_disabled === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_1_shardable_leg === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_many_shardable_legs === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_1_shardable_leg === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_no_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/query_is_not_shardable === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_11_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_14_compactor_shards --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries (0.08s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_3_compactor_shards (0.01s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_4_compactor_shards (0.01s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_10_compactor_shards (0.01s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/query_sharding_is_disabled (0.00s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_1_shardable_leg (0.01s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_many_shardable_legs (0.01s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_1_shardable_leg (0.00s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_no_compactor_shards (0.01s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/query_is_not_shardable (0.00s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs (0.00s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_11_compactor_shards (0.01s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_14_compactor_shards (0.01s) === RUN TestQuerySharding_ShouldReturnErrorOnDownstreamHandlerFailure --- PASS: TestQuerySharding_ShouldReturnErrorOnDownstreamHandlerFailure (0.00s) === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_timeout === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_sample_limit === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_timeout === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_internal_error === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_prometheus_execution_error --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat (0.68s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_timeout (0.34s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_sample_limit (0.00s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_timeout (0.34s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_internal_error (0.00s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_prometheus_execution_error (0.00s) === RUN TestQuerySharding_EngineErrorMapping --- PASS: TestQuerySharding_EngineErrorMapping (0.03s) === RUN TestQuerySharding_WrapMultipleTime --- PASS: TestQuerySharding_WrapMultipleTime (0.00s) === RUN TestPromqlResultToSampleStreams === RUN TestPromqlResultToSampleStreams/[0] === RUN TestPromqlResultToSampleStreams/[1] === RUN TestPromqlResultToSampleStreams/[2] === RUN TestPromqlResultToSampleStreams/[3] === RUN TestPromqlResultToSampleStreams/[4] --- PASS: TestPromqlResultToSampleStreams (0.00s) --- PASS: TestPromqlResultToSampleStreams/[0] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[1] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[2] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[3] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[4] (0.00s) === RUN TestGenLabelsCorrectness --- PASS: TestGenLabelsCorrectness (0.00s) === RUN TestGenLabelsSize --- PASS: TestGenLabelsSize (0.00s) === RUN TestNewMockShardedqueryable --- PASS: TestNewMockShardedqueryable (0.00s) === RUN TestResultsCacheConfig_Validate === RUN TestResultsCacheConfig_Validate/should_pass_with_memcached_backend === RUN TestResultsCacheConfig_Validate/should_pass_with_default_config === RUN TestResultsCacheConfig_Validate/should_fail_with_invalid_memcached_config === RUN TestResultsCacheConfig_Validate/should_fail_with_unsupported_backend --- PASS: TestResultsCacheConfig_Validate (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_pass_with_memcached_backend (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_fail_with_invalid_memcached_config (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_fail_with_unsupported_backend (0.00s) === RUN TestIsRequestCachable === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector_with_start()_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector_with_end()_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector_with_start()_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector_with_end()_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries_with_start()_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries_with_end()_after_maxCacheTime === RUN TestIsRequestCachable/request_that_is_step_aligned === RUN TestIsRequestCachable/request_that_is_NOT_step_aligned,_with_cacheStepUnaligned=false === RUN TestIsRequestCachable/request_that_is_NOT_step_aligned --- PASS: TestIsRequestCachable (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector_with_start()_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector_with_end()_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector_with_start()_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector_with_end()_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries_with_start()_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries_with_end()_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/request_that_is_step_aligned (0.00s) --- PASS: TestIsRequestCachable/request_that_is_NOT_step_aligned,_with_cacheStepUnaligned=false (0.00s) --- PASS: TestIsRequestCachable/request_that_is_NOT_step_aligned (0.00s) === RUN TestIsResponseCachable === RUN TestIsResponseCachable/does_not_contain_the_cacheControl_header === RUN TestIsResponseCachable/does_contain_the_cacheControl_header_which_has_the_value === RUN TestIsResponseCachable/cacheControl_header_contains_extra_values_but_still_good === RUN TestIsResponseCachable/broken_response === RUN TestIsResponseCachable/nil_headers === RUN TestIsResponseCachable/had_cacheControl_header_but_no_values --- PASS: TestIsResponseCachable (0.00s) --- PASS: TestIsResponseCachable/does_not_contain_the_cacheControl_header (0.00s) --- PASS: TestIsResponseCachable/does_contain_the_cacheControl_header_which_has_the_value (0.00s) --- PASS: TestIsResponseCachable/cacheControl_header_contains_extra_values_but_still_good (0.00s) --- PASS: TestIsResponseCachable/broken_response (0.00s) --- PASS: TestIsResponseCachable/nil_headers (0.00s) --- PASS: TestIsResponseCachable/had_cacheControl_header_but_no_values (0.00s) === RUN TestPartitionCacheExtents === RUN TestPartitionCacheExtents/Test_a_complete_hit. === RUN TestPartitionCacheExtents/Test_with_a_complete_miss. === RUN TestPartitionCacheExtents/Test_a_partial_hit. === RUN TestPartitionCacheExtents/Test_multiple_partial_hits. === RUN TestPartitionCacheExtents/Partial_hits_with_tiny_gap. === RUN TestPartitionCacheExtents/Extent_is_outside_the_range_and_the_request_has_a_single_step_(same_start_and_end). === RUN TestPartitionCacheExtents/Test_when_hit_has_a_large_step_and_only_a_single_sample_extent. === RUN TestPartitionCacheExtents/Start_time_of_all_requests_must_have_the_same_offset_into_the_step. --- PASS: TestPartitionCacheExtents (0.00s) --- PASS: TestPartitionCacheExtents/Test_a_complete_hit. (0.00s) --- PASS: TestPartitionCacheExtents/Test_with_a_complete_miss. (0.00s) --- PASS: TestPartitionCacheExtents/Test_a_partial_hit. (0.00s) --- PASS: TestPartitionCacheExtents/Test_multiple_partial_hits. (0.00s) --- PASS: TestPartitionCacheExtents/Partial_hits_with_tiny_gap. (0.00s) --- PASS: TestPartitionCacheExtents/Extent_is_outside_the_range_and_the_request_has_a_single_step_(same_start_and_end). (0.00s) --- PASS: TestPartitionCacheExtents/Test_when_hit_has_a_large_step_and_only_a_single_sample_extent. (0.00s) --- PASS: TestPartitionCacheExtents/Start_time_of_all_requests_must_have_the_same_offset_into_the_step. (0.00s) === RUN TestConstSplitter_generateCacheKey === PAUSE TestConstSplitter_generateCacheKey === RUN TestRetry === RUN TestRetry/retry_failures === RUN TestRetry/don't_retry_400s === RUN TestRetry/retry_500s === RUN TestRetry/last_error --- PASS: TestRetry (0.00s) --- PASS: TestRetry/retry_failures (0.00s) --- PASS: TestRetry/don't_retry_400s (0.00s) --- PASS: TestRetry/retry_500s (0.00s) --- PASS: TestRetry/last_error (0.00s) === RUN Test_RetryMiddlewareCancel --- PASS: Test_RetryMiddlewareCancel (0.00s) === RUN TestRangeTripperware === RUN TestRangeTripperware/0 === RUN TestRangeTripperware/1 --- PASS: TestRangeTripperware (0.03s) --- PASS: TestRangeTripperware/0 (0.02s) --- PASS: TestRangeTripperware/1 (0.00s) === RUN TestInstantTripperware === RUN TestInstantTripperware/happy_case_roundtrip === RUN TestInstantTripperware/default_time_param --- PASS: TestInstantTripperware (0.02s) --- PASS: TestInstantTripperware/happy_case_roundtrip (0.01s) --- PASS: TestInstantTripperware/default_time_param (0.01s) === RUN TestTripperware_Metrics === RUN TestTripperware_Metrics/start/end_is_aligned_to_step === RUN TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_disabled === RUN TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_enabled --- PASS: TestTripperware_Metrics (0.01s) --- PASS: TestTripperware_Metrics/start/end_is_aligned_to_step (0.00s) --- PASS: TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_disabled (0.00s) --- PASS: TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_enabled (0.00s) === RUN TestShardedQuerier_Select === RUN TestShardedQuerier_Select/errors_non_embedded_query === RUN TestShardedQuerier_Select/replaces_query === RUN TestShardedQuerier_Select/propagates_response_error === RUN TestShardedQuerier_Select/returns_SeriesSet --- PASS: TestShardedQuerier_Select (0.00s) --- PASS: TestShardedQuerier_Select/errors_non_embedded_query (0.00s) --- PASS: TestShardedQuerier_Select/replaces_query (0.00s) --- PASS: TestShardedQuerier_Select/propagates_response_error (0.00s) --- PASS: TestShardedQuerier_Select/returns_SeriesSet (0.00s) === RUN TestShardedQuerier_Select_ShouldConcurrentlyRunEmbeddedQueries --- PASS: TestShardedQuerier_Select_ShouldConcurrentlyRunEmbeddedQueries (0.00s) === RUN TestShardedQueryable_GetResponseHeaders --- PASS: TestShardedQueryable_GetResponseHeaders (0.00s) === RUN TestNewSeriesSetFromEmbeddedQueriesResults === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_add_a_stale_marker_at_the_end_even_if_if_input_samples_have_no_gaps === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_add_stale_markers_at_the_beginning_of_each_gap_and_one_at_the_end_of_the_series === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_hints_is_not_passed === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_step_==_0 --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_add_a_stale_marker_at_the_end_even_if_if_input_samples_have_no_gaps (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_add_stale_markers_at_the_beginning_of_each_gap_and_one_at_the_end_of_the_series (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_hints_is_not_passed (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_step_==_0 (0.00s) === RUN TestResponseToSamples --- PASS: TestResponseToSamples (0.00s) === RUN TestSplitAndCacheMiddleware_SplitByInterval --- PASS: TestSplitAndCacheMiddleware_SplitByInterval (0.01s) === RUN TestSplitAndCacheMiddleware_ResultsCache --- PASS: TestSplitAndCacheMiddleware_ResultsCache (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotLookupCacheIfStepIsNotAligned --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotLookupCacheIfStepIsNotAligned (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCache_EnabledCachingOfStepUnalignedRequest --- PASS: TestSplitAndCacheMiddleware_ResultsCache_EnabledCachingOfStepUnalignedRequest (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_not_cache_a_response_if_query_time_range_is_earlier_than_max_cache_freshness === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_cache_a_response_up_until_max_cache_freshness_time_ago --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_not_cache_a_response_if_query_time_range_is_earlier_than_max_cache_freshness (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_cache_a_response_up_until_max_cache_freshness_time_ago (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy split_and_cache_test.go:541: random generator seed: 1661375994717441610 === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy (1.91s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) (2.40s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) (2.57s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) (2.64s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) (2.67s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) (2.73s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) (3.57s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) (3.81s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) (4.54s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) (4.55s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) (4.55s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) (4.61s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) (4.62s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) (5.75s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) (5.78s) === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_drop_tiny_extent_that_overlaps_with_non-tiny_request_only === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_replace_tiny_extents_that_are_cover_by_bigger_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_merge_fragmented_extents_if_request_fills_the_hole === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_left-extend_extent_if_request_starts_earlier_than_extent_in_cache === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_completely_overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_center-overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_left-overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_right-overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_right-extend_extent_if_request_ends_later_than_extent_in_cache === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_throw_error_if_complete-overlapped_smaller_Extent_is_erroneous --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases (0.01s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_drop_tiny_extent_that_overlaps_with_non-tiny_request_only (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_replace_tiny_extents_that_are_cover_by_bigger_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_merge_fragmented_extents_if_request_fills_the_hole (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_left-extend_extent_if_request_starts_earlier_than_extent_in_cache (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_completely_overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_center-overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_left-overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_right-overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_right-extend_extent_if_request_ends_later_than_extent_in_cache (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_throw_error_if_complete-overlapped_smaller_Extent_is_erroneous (0.00s) === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_but_empty_extents_on_cache_miss === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_and_some_extends_filled_up_on_partial_cache_hit === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_not_return_an_extent_if_its_key_doesn't_match_the_requested_one_(hash_collision) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents (0.00s) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_but_empty_extents_on_cache_miss (0.00s) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_and_some_extends_filled_up_on_partial_cache_hit (0.00s) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_not_return_an_extent_if_its_key_doesn't_match_the_requested_one_(hash_collision) (0.00s) === RUN TestSplitAndCacheMiddleware_WrapMultipleTimes --- PASS: TestSplitAndCacheMiddleware_WrapMultipleTimes (0.00s) === RUN TestSplitRequests_prepareDownstreamRequests === RUN TestSplitRequests_prepareDownstreamRequests/should_return_an_empty_slice_on_no_downstream_requests === RUN TestSplitRequests_prepareDownstreamRequests/should_inject_ID_and_hints_on_downstream_requests_and_return_them --- PASS: TestSplitRequests_prepareDownstreamRequests (0.00s) --- PASS: TestSplitRequests_prepareDownstreamRequests/should_return_an_empty_slice_on_no_downstream_requests (0.00s) --- PASS: TestSplitRequests_prepareDownstreamRequests/should_inject_ID_and_hints_on_downstream_requests_and_return_them (0.00s) === RUN TestSplitRequests_storeDownstreamResponses === RUN TestSplitRequests_storeDownstreamResponses/should_do_nothing_on_no_downstream_requests === RUN TestSplitRequests_storeDownstreamResponses/should_associate_downstream_responses_to_requests === RUN TestSplitRequests_storeDownstreamResponses/should_return_error_if_a_downstream_response_is_missing === RUN TestSplitRequests_storeDownstreamResponses/should_return_error_if_multiple_downstream_responses_have_the_same_ID === RUN TestSplitRequests_storeDownstreamResponses/should_return_error_if_extra_downstream_responses_are_requested_to_be_stored --- PASS: TestSplitRequests_storeDownstreamResponses (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_do_nothing_on_no_downstream_requests (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_associate_downstream_responses_to_requests (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_return_error_if_a_downstream_response_is_missing (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_return_error_if_multiple_downstream_responses_have_the_same_ID (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_return_error_if_extra_downstream_responses_are_requested_to_be_stored (0.00s) === RUN TestNextIntervalBoundary === RUN TestNextIntervalBoundary/0 === RUN TestNextIntervalBoundary/1 === RUN TestNextIntervalBoundary/2 === RUN TestNextIntervalBoundary/3 === RUN TestNextIntervalBoundary/4 === RUN TestNextIntervalBoundary/5 === RUN TestNextIntervalBoundary/6 === RUN TestNextIntervalBoundary/7 === RUN TestNextIntervalBoundary/8 === RUN TestNextIntervalBoundary/9 === RUN TestNextIntervalBoundary/10 === RUN TestNextIntervalBoundary/11 === RUN TestNextIntervalBoundary/12 === RUN TestNextIntervalBoundary/13 === RUN TestNextIntervalBoundary/14 === RUN TestNextIntervalBoundary/15 --- PASS: TestNextIntervalBoundary (0.00s) --- PASS: TestNextIntervalBoundary/0 (0.00s) --- PASS: TestNextIntervalBoundary/1 (0.00s) --- PASS: TestNextIntervalBoundary/2 (0.00s) --- PASS: TestNextIntervalBoundary/3 (0.00s) --- PASS: TestNextIntervalBoundary/4 (0.00s) --- PASS: TestNextIntervalBoundary/5 (0.00s) --- PASS: TestNextIntervalBoundary/6 (0.00s) --- PASS: TestNextIntervalBoundary/7 (0.00s) --- PASS: TestNextIntervalBoundary/8 (0.00s) --- PASS: TestNextIntervalBoundary/9 (0.00s) --- PASS: TestNextIntervalBoundary/10 (0.00s) --- PASS: TestNextIntervalBoundary/11 (0.00s) --- PASS: TestNextIntervalBoundary/12 (0.00s) --- PASS: TestNextIntervalBoundary/13 (0.00s) --- PASS: TestNextIntervalBoundary/14 (0.00s) --- PASS: TestNextIntervalBoundary/15 (0.00s) === RUN TestSplitQueryByInterval === RUN TestSplitQueryByInterval/0:_start:_0,_end:_3600000,_step:_15000 === RUN TestSplitQueryByInterval/1:_start:_0,_end:_3600000,_step:_15000 === RUN TestSplitQueryByInterval/2:_start:_0,_end:_86400000,_step:_15000 === RUN TestSplitQueryByInterval/3:_start:_0,_end:_10800000,_step:_15000 === RUN TestSplitQueryByInterval/4:_start:_0,_end:_172800000,_step:_15000 === RUN TestSplitQueryByInterval/5:_start:_0,_end:_21600000,_step:_15000 === RUN TestSplitQueryByInterval/6:_start:_10800000,_end:_259200000,_step:_15000 === RUN TestSplitQueryByInterval/7:_start:_7200000,_end:_32400000,_step:_15000 === RUN TestSplitQueryByInterval/8:_start:_1634255280000,_end:_1634256180000,_step:_300000 === RUN TestSplitQueryByInterval/9:_start:_1634255280000,_end:_1634256000000,_step:_360000 === RUN TestSplitQueryByInterval/10:_start:_1634248800000,_end:_1634508000000,_step:_86400000 === RUN TestSplitQueryByInterval/11:_start:_1634256000000,_end:_1634515200000,_step:_86400000 === RUN TestSplitQueryByInterval/12:_start:_1634335200000,_end:_1634875200000,_step:_108000000 === RUN TestSplitQueryByInterval/13:_start:_1634277600000,_end:_1634479200000,_step:_43200000 === RUN TestSplitQueryByInterval/14:_start:_1634277600000,_end:_1634493600000,_step:_43200000 === RUN TestSplitQueryByInterval/15:_start:_1634277600000,_end:_1634493600000,_step:_36000000 === RUN TestSplitQueryByInterval/16:_start:_1634277600000,_end:_1634457600000,_step:_36000000 --- PASS: TestSplitQueryByInterval (0.00s) --- PASS: TestSplitQueryByInterval/0:_start:_0,_end:_3600000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/1:_start:_0,_end:_3600000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/2:_start:_0,_end:_86400000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/3:_start:_0,_end:_10800000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/4:_start:_0,_end:_172800000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/5:_start:_0,_end:_21600000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/6:_start:_10800000,_end:_259200000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/7:_start:_7200000,_end:_32400000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/8:_start:_1634255280000,_end:_1634256180000,_step:_300000 (0.00s) --- PASS: TestSplitQueryByInterval/9:_start:_1634255280000,_end:_1634256000000,_step:_360000 (0.00s) --- PASS: TestSplitQueryByInterval/10:_start:_1634248800000,_end:_1634508000000,_step:_86400000 (0.00s) --- PASS: TestSplitQueryByInterval/11:_start:_1634256000000,_end:_1634515200000,_step:_86400000 (0.00s) --- PASS: TestSplitQueryByInterval/12:_start:_1634335200000,_end:_1634875200000,_step:_108000000 (0.00s) --- PASS: TestSplitQueryByInterval/13:_start:_1634277600000,_end:_1634479200000,_step:_43200000 (0.00s) --- PASS: TestSplitQueryByInterval/14:_start:_1634277600000,_end:_1634493600000,_step:_43200000 (0.00s) --- PASS: TestSplitQueryByInterval/15:_start:_1634277600000,_end:_1634493600000,_step:_36000000 (0.00s) --- PASS: TestSplitQueryByInterval/16:_start:_1634277600000,_end:_1634457600000,_step:_36000000 (0.00s) === RUN Test_evaluateAtModifier === RUN Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) === PAUSE Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) === RUN Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) === PAUSE Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) === RUN Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 === PAUSE Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 === RUN Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) === PAUSE Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) === RUN Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) === PAUSE Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) === CONT Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) === CONT Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) === CONT Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 === CONT Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) === CONT Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) --- PASS: Test_evaluateAtModifier (0.00s) --- PASS: Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) (0.00s) --- PASS: Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) (0.00s) --- PASS: Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 (0.00s) --- PASS: Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) (0.00s) --- PASS: Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) (0.00s) === RUN TestStepAlignMiddleware === RUN TestStepAlignMiddleware/0 === RUN TestStepAlignMiddleware/1 --- PASS: TestStepAlignMiddleware (0.00s) --- PASS: TestStepAlignMiddleware/0 (0.00s) --- PASS: TestStepAlignMiddleware/1 (0.00s) === RUN TestIsRequestStepAligned === RUN TestIsRequestStepAligned/should_return_true_if_start_and_end_are_aligned_to_step === RUN TestIsRequestStepAligned/should_return_false_if_start_is_not_aligned_to_step === RUN TestIsRequestStepAligned/should_return_false_if_end_is_not_aligned_to_step === RUN TestIsRequestStepAligned/should_return_true_if_step_is_0 --- PASS: TestIsRequestStepAligned (0.00s) --- PASS: TestIsRequestStepAligned/should_return_true_if_start_and_end_are_aligned_to_step (0.00s) --- PASS: TestIsRequestStepAligned/should_return_false_if_start_is_not_aligned_to_step (0.00s) --- PASS: TestIsRequestStepAligned/should_return_false_if_end_is_not_aligned_to_step (0.00s) --- PASS: TestIsRequestStepAligned/should_return_true_if_step_is_0 (0.00s) === CONT TestConstSplitter_generateCacheKey === RUN TestConstSplitter_generateCacheKey/0_-_30m0s === RUN TestConstSplitter_generateCacheKey/<30m_-_30m0s === RUN TestConstSplitter_generateCacheKey/30m_-_30m0s === RUN TestConstSplitter_generateCacheKey/91m_-_30m0s === RUN TestConstSplitter_generateCacheKey/91m_5m_-_30m0s === RUN TestConstSplitter_generateCacheKey/0_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/<1d_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/4d_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/3d5h_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/1111m_-_1h0m0s --- PASS: TestConstSplitter_generateCacheKey (0.00s) --- PASS: TestConstSplitter_generateCacheKey/0_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/<30m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/30m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/91m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/91m_5m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/0_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/<1d_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/4d_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/3d5h_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/1111m_-_1h0m0s (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/querymiddleware 33.232s === RUN TestCloneNode === RUN TestCloneNode/[0] === RUN TestCloneNode/[1] --- PASS: TestCloneNode (0.01s) --- PASS: TestCloneNode/[0] (0.01s) --- PASS: TestCloneNode/[1] (0.00s) === RUN TestCloneNode_String === RUN TestCloneNode_String/[0] === RUN TestCloneNode_String/[1] --- PASS: TestCloneNode_String (0.01s) --- PASS: TestCloneNode_String/[0] (0.01s) --- PASS: TestCloneNode_String/[1] (0.00s) === RUN TestCanParallel === RUN TestCanParallel/[0] === RUN TestCanParallel/[1] === RUN TestCanParallel/[2] --- PASS: TestCanParallel (0.00s) --- PASS: TestCanParallel/[0] (0.00s) --- PASS: TestCanParallel/[1] (0.00s) --- PASS: TestCanParallel/[2] (0.00s) === RUN TestCanParallel_String === RUN TestCanParallel_String/[0] === RUN TestCanParallel_String/[1] === RUN TestCanParallel_String/[2] === RUN TestCanParallel_String/[3] === RUN TestCanParallel_String/[4] === RUN TestCanParallel_String/[5] === RUN TestCanParallel_String/[6] === RUN TestCanParallel_String/[7] === RUN TestCanParallel_String/[8] === RUN TestCanParallel_String/[9] === RUN TestCanParallel_String/[10] --- PASS: TestCanParallel_String (0.01s) --- PASS: TestCanParallel_String/[0] (0.00s) --- PASS: TestCanParallel_String/[1] (0.00s) --- PASS: TestCanParallel_String/[2] (0.00s) --- PASS: TestCanParallel_String/[3] (0.00s) --- PASS: TestCanParallel_String/[4] (0.00s) --- PASS: TestCanParallel_String/[5] (0.00s) --- PASS: TestCanParallel_String/[6] (0.00s) --- PASS: TestCanParallel_String/[7] (0.00s) --- PASS: TestCanParallel_String/[8] (0.00s) --- PASS: TestCanParallel_String/[9] (0.00s) --- PASS: TestCanParallel_String/[10] (0.00s) === RUN TestFunctionsWithDefaultsIsUpToDate === RUN TestFunctionsWithDefaultsIsUpToDate/month === RUN TestFunctionsWithDefaultsIsUpToDate/sgn === RUN TestFunctionsWithDefaultsIsUpToDate/sqrt === RUN TestFunctionsWithDefaultsIsUpToDate/time === RUN TestFunctionsWithDefaultsIsUpToDate/day_of_year === RUN TestFunctionsWithDefaultsIsUpToDate/hour === RUN TestFunctionsWithDefaultsIsUpToDate/last_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/max_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/year === RUN TestFunctionsWithDefaultsIsUpToDate/asin === RUN TestFunctionsWithDefaultsIsUpToDate/changes === RUN TestFunctionsWithDefaultsIsUpToDate/cosh === RUN TestFunctionsWithDefaultsIsUpToDate/log2 === RUN TestFunctionsWithDefaultsIsUpToDate/quantile_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/sin === RUN TestFunctionsWithDefaultsIsUpToDate/tanh === RUN TestFunctionsWithDefaultsIsUpToDate/atanh === RUN TestFunctionsWithDefaultsIsUpToDate/floor === RUN TestFunctionsWithDefaultsIsUpToDate/irate === RUN TestFunctionsWithDefaultsIsUpToDate/present_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/exp === RUN TestFunctionsWithDefaultsIsUpToDate/label_replace === RUN TestFunctionsWithDefaultsIsUpToDate/minute === RUN TestFunctionsWithDefaultsIsUpToDate/histogram_quantile === RUN TestFunctionsWithDefaultsIsUpToDate/avg_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/scalar === RUN TestFunctionsWithDefaultsIsUpToDate/tan === RUN TestFunctionsWithDefaultsIsUpToDate/delta === RUN TestFunctionsWithDefaultsIsUpToDate/increase === RUN TestFunctionsWithDefaultsIsUpToDate/stddev_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/acosh === RUN TestFunctionsWithDefaultsIsUpToDate/clamp_min === RUN TestFunctionsWithDefaultsIsUpToDate/day_of_month === RUN TestFunctionsWithDefaultsIsUpToDate/days_in_month === RUN TestFunctionsWithDefaultsIsUpToDate/ln === RUN TestFunctionsWithDefaultsIsUpToDate/round === RUN TestFunctionsWithDefaultsIsUpToDate/ceil === RUN TestFunctionsWithDefaultsIsUpToDate/predict_linear === RUN TestFunctionsWithDefaultsIsUpToDate/resets === RUN TestFunctionsWithDefaultsIsUpToDate/cos === RUN TestFunctionsWithDefaultsIsUpToDate/day_of_week === RUN TestFunctionsWithDefaultsIsUpToDate/min_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/clamp === RUN TestFunctionsWithDefaultsIsUpToDate/timestamp === RUN TestFunctionsWithDefaultsIsUpToDate/holt_winters === RUN TestFunctionsWithDefaultsIsUpToDate/rate === RUN TestFunctionsWithDefaultsIsUpToDate/sort_desc === RUN TestFunctionsWithDefaultsIsUpToDate/stdvar_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/vector === RUN TestFunctionsWithDefaultsIsUpToDate/abs === RUN TestFunctionsWithDefaultsIsUpToDate/absent === RUN TestFunctionsWithDefaultsIsUpToDate/absent_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/sum_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/acos === RUN TestFunctionsWithDefaultsIsUpToDate/count_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/deg === RUN TestFunctionsWithDefaultsIsUpToDate/idelta === RUN TestFunctionsWithDefaultsIsUpToDate/rad === RUN TestFunctionsWithDefaultsIsUpToDate/sinh === RUN TestFunctionsWithDefaultsIsUpToDate/sort === RUN TestFunctionsWithDefaultsIsUpToDate/asinh === RUN TestFunctionsWithDefaultsIsUpToDate/clamp_max === RUN TestFunctionsWithDefaultsIsUpToDate/deriv === RUN TestFunctionsWithDefaultsIsUpToDate/pi === RUN TestFunctionsWithDefaultsIsUpToDate/atan === RUN TestFunctionsWithDefaultsIsUpToDate/label_join === RUN TestFunctionsWithDefaultsIsUpToDate/log10 --- PASS: TestFunctionsWithDefaultsIsUpToDate (0.01s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/month (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sgn (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sqrt (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/day_of_year (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/hour (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/last_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/max_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/year (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/asin (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/changes (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/cosh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/log2 (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/quantile_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sin (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/tanh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/atanh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/floor (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/irate (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/present_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/exp (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/label_replace (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/minute (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/histogram_quantile (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/avg_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/scalar (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/tan (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/delta (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/increase (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/stddev_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/acosh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/clamp_min (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/day_of_month (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/days_in_month (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/ln (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/round (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/ceil (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/predict_linear (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/resets (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/cos (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/day_of_week (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/min_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/clamp (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/timestamp (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/holt_winters (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/rate (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sort_desc (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/stdvar_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/vector (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/abs (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/absent (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/absent_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sum_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/acos (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/count_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/deg (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/idelta (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/rad (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sinh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sort (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/asinh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/clamp_max (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/deriv (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/pi (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/atan (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/label_join (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/log10 (0.00s) === RUN TestShardSummer === RUN TestShardSummer/quantile(0.9,foo) === RUN TestShardSummer/absent(foo) === RUN TestShardSummer/absent_over_time(foo[1m]) === RUN TestShardSummer/histogram_quantile(0.5,_rate(bar1{baz="blip"}[30s])) === RUN TestShardSummer/sum_by_(foo)_(histogram_quantile(0.9,_rate(http_request_duration_seconds_bucket[10m]))) === RUN TestShardSummer/sum_by_(foo,bar)_(min_over_time(bar1{baz="blip"}[1m])) === RUN TestShardSummer/sum(rate(bar1[1m]))_or_rate(bar2[1m]) === RUN TestShardSummer/sum(rate(bar1[1m]))_or_sum(rate(bar2[1m])) === RUN TestShardSummer/histogram_quantile(0.5,_sum(rate(cortex_cache_value_size_bytes_bucket[5m]))_by_(le)) === RUN TestShardSummer/sum(_______count(_________count(___________bar1_________)__by_(drive,instance)_______)__by_(instance)_____) === RUN TestShardSummer/sum(rate(foo[1m])) === RUN TestShardSummer/count(rate(foo[1m])) === RUN TestShardSummer/count(up) === RUN TestShardSummer/avg(count(test)) === RUN TestShardSummer/count_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/count_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/max(rate(foo[1m])) === RUN TestShardSummer/max_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/max_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/sum_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/sum_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/avg_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/avg_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/avg(rate(foo[1m])) === RUN TestShardSummer/topk(10,avg_by_(foo)(rate(foo[1m]))) === RUN TestShardSummer/min_over_time(metric_counter[5m]) === RUN TestShardSummer/sum_by_(user,_cluster,_namespace)_(quantile_over_time(0.99,_cortex_ingester_active_series[7d])) === RUN TestShardSummer/min_over_time(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:2m]____) === RUN TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:]) === RUN TestShardSummer/rate(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:]____) === RUN TestShardSummer/absent_over_time(rate(metric_counter[5m])[10m:]) === RUN TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______sort(metric_counter)______[5m:1m])_____[2m:])____[10m:]) === RUN TestShardSummer/max_over_time(_____absent_over_time(______deriv(_______rate(metric_counter[1m])______[5m:1m])_____[2m:])____[10m:]) === RUN TestShardSummer/quantile_over_time(0.99,_cortex_ingester_active_series[1w]) === RUN TestShardSummer/ceil(sum_by_(foo)_(rate(cortex_ingester_active_series[1w]))) === RUN TestShardSummer/ln(bar)_-_resets(foo[1d]) === RUN TestShardSummer/predict_linear(foo[10m],3600) === RUN TestShardSummer/label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*") === RUN TestShardSummer/ln(exp(label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*"))) === RUN TestShardSummer/ln(_____label_replace(______sum_by_(cluster)_(up{job="api-server",service="a:c"})_____,_"foo",_"$1",_"service",_"(.*):.*")____) === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_@_end())) === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10)) === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2 === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2_^_2 === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m])_/_time()_*_2) === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time()_*2 === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time() === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_vector(3)_^_month() === RUN TestShardSummer/vector(3)_^_month() === RUN TestShardSummer/sum(rate(metric_counter[1m]))_/_vector(3)_^_year(foo) === RUN TestShardSummer/foo_>_bar === RUN TestShardSummer/foo_*_2 === RUN TestShardSummer/foo_>_0 === RUN TestShardSummer/0_<=_foo === RUN TestShardSummer/foo_>_(2_*_2) === RUN TestShardSummer/sum_by_(label)_(foo_>_0) === RUN TestShardSummer/sum_by_(label)_(foo_>_0)_>_0 === RUN TestShardSummer/sum_over_time(foo[1m])_>_(2_*_2) === RUN TestShardSummer/foo_>_sum(bar) === RUN TestShardSummer/foo_>_scalar(sum(bar)) === RUN TestShardSummer/scalar(min(foo))_>_bool_scalar(sum(bar)) === RUN TestShardSummer/foo_*_on(a,_b)_group_left(c)_avg_by(a,_b,_c)_(bar) === RUN TestShardSummer/vector(1)_>_0_and_vector(1) === RUN TestShardSummer/sum(foo)_>_0_and_vector(1) --- PASS: TestShardSummer (0.10s) --- PASS: TestShardSummer/quantile(0.9,foo) (0.00s) --- PASS: TestShardSummer/absent(foo) (0.00s) --- PASS: TestShardSummer/absent_over_time(foo[1m]) (0.00s) --- PASS: TestShardSummer/histogram_quantile(0.5,_rate(bar1{baz="blip"}[30s])) (0.00s) --- PASS: TestShardSummer/sum_by_(foo)_(histogram_quantile(0.9,_rate(http_request_duration_seconds_bucket[10m]))) (0.00s) --- PASS: TestShardSummer/sum_by_(foo,bar)_(min_over_time(bar1{baz="blip"}[1m])) (0.00s) --- PASS: TestShardSummer/sum(rate(bar1[1m]))_or_rate(bar2[1m]) (0.00s) --- PASS: TestShardSummer/sum(rate(bar1[1m]))_or_sum(rate(bar2[1m])) (0.00s) --- PASS: TestShardSummer/histogram_quantile(0.5,_sum(rate(cortex_cache_value_size_bytes_bucket[5m]))_by_(le)) (0.00s) --- PASS: TestShardSummer/sum(_______count(_________count(___________bar1_________)__by_(drive,instance)_______)__by_(instance)_____) (0.00s) --- PASS: TestShardSummer/sum(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/count(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/count(up) (0.00s) --- PASS: TestShardSummer/avg(count(test)) (0.00s) --- PASS: TestShardSummer/count_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/count_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/max(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/max_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/max_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/sum_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/sum_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/avg_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/avg_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/avg(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/topk(10,avg_by_(foo)(rate(foo[1m]))) (0.00s) --- PASS: TestShardSummer/min_over_time(metric_counter[5m]) (0.00s) --- PASS: TestShardSummer/sum_by_(user,_cluster,_namespace)_(quantile_over_time(0.99,_cortex_ingester_active_series[7d])) (0.00s) --- PASS: TestShardSummer/min_over_time(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:2m]____) (0.00s) --- PASS: TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: TestShardSummer/rate(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:]____) (0.00s) --- PASS: TestShardSummer/absent_over_time(rate(metric_counter[5m])[10m:]) (0.00s) --- PASS: TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______sort(metric_counter)______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: TestShardSummer/max_over_time(_____absent_over_time(______deriv(_______rate(metric_counter[1m])______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: TestShardSummer/quantile_over_time(0.99,_cortex_ingester_active_series[1w]) (0.00s) --- PASS: TestShardSummer/ceil(sum_by_(foo)_(rate(cortex_ingester_active_series[1w]))) (0.00s) --- PASS: TestShardSummer/ln(bar)_-_resets(foo[1d]) (0.00s) --- PASS: TestShardSummer/predict_linear(foo[10m],3600) (0.00s) --- PASS: TestShardSummer/label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*") (0.00s) --- PASS: TestShardSummer/ln(exp(label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*"))) (0.00s) --- PASS: TestShardSummer/ln(_____label_replace(______sum_by_(cluster)_(up{job="api-server",service="a:c"})_____,_"foo",_"$1",_"service",_"(.*):.*")____) (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_@_end())) (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10)) (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2 (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2_^_2 (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m])_/_time()_*_2) (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time()_*2 (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time() (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_vector(3)_^_month() (0.00s) --- PASS: TestShardSummer/vector(3)_^_month() (0.00s) --- PASS: TestShardSummer/sum(rate(metric_counter[1m]))_/_vector(3)_^_year(foo) (0.00s) --- PASS: TestShardSummer/foo_>_bar (0.00s) --- PASS: TestShardSummer/foo_*_2 (0.00s) --- PASS: TestShardSummer/foo_>_0 (0.00s) --- PASS: TestShardSummer/0_<=_foo (0.00s) --- PASS: TestShardSummer/foo_>_(2_*_2) (0.00s) --- PASS: TestShardSummer/sum_by_(label)_(foo_>_0) (0.00s) --- PASS: TestShardSummer/sum_by_(label)_(foo_>_0)_>_0 (0.00s) --- PASS: TestShardSummer/sum_over_time(foo[1m])_>_(2_*_2) (0.00s) --- PASS: TestShardSummer/foo_>_sum(bar) (0.00s) --- PASS: TestShardSummer/foo_>_scalar(sum(bar)) (0.00s) --- PASS: TestShardSummer/scalar(min(foo))_>_bool_scalar(sum(bar)) (0.00s) --- PASS: TestShardSummer/foo_*_on(a,_b)_group_left(c)_avg_by(a,_b,_c)_(bar) (0.00s) --- PASS: TestShardSummer/vector(1)_>_0_and_vector(1) (0.00s) --- PASS: TestShardSummer/sum(foo)_>_0_and_vector(1) (0.00s) === RUN TestShardSummerWithEncoding === RUN TestShardSummerWithEncoding/[0] --- PASS: TestShardSummerWithEncoding (0.00s) --- PASS: TestShardSummerWithEncoding/[0] (0.00s) === RUN TestEvalPredicate === RUN TestEvalPredicate/should_return_error_if_the_predicate_returns_error === RUN TestEvalPredicate/should_return_false_if_the_predicate_returns_false_for_all_nodes_in_the_subtree === RUN TestEvalPredicate/should_return_true_if_the_predicate_returns_true_for_at_least_1_node_in_the_subtree === RUN TestEvalPredicate/hasEmbeddedQueries() --- PASS: TestEvalPredicate (0.00s) --- PASS: TestEvalPredicate/should_return_error_if_the_predicate_returns_error (0.00s) --- PASS: TestEvalPredicate/should_return_false_if_the_predicate_returns_false_for_all_nodes_in_the_subtree (0.00s) --- PASS: TestEvalPredicate/should_return_true_if_the_predicate_returns_true_for_at_least_1_node_in_the_subtree (0.00s) --- PASS: TestEvalPredicate/hasEmbeddedQueries() (0.00s) === RUN TestSubtreeFolder === RUN TestSubtreeFolder/embed_one_out_of_two_legs_of_the_query_(right_leg_has_already_been_embedded) === RUN TestSubtreeFolder/should_not_embed_scalars === RUN TestSubtreeFolder/embed_an_entire_histogram === RUN TestSubtreeFolder/embed_a_binary_expression_across_two_functions --- PASS: TestSubtreeFolder (0.00s) --- PASS: TestSubtreeFolder/embed_one_out_of_two_legs_of_the_query_(right_leg_has_already_been_embedded) (0.00s) --- PASS: TestSubtreeFolder/should_not_embed_scalars (0.00s) --- PASS: TestSubtreeFolder/embed_an_entire_histogram (0.00s) --- PASS: TestSubtreeFolder/embed_a_binary_expression_across_two_functions (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/querymiddleware/astmapper 0.407s === RUN TestWriteError === RUN TestWriteError/unknown === RUN TestWriteError/context_deadline_exceeded === RUN TestWriteError/context_canceled === RUN TestWriteError/rpc_error:_code_=_Code(400)_desc_=_ --- PASS: TestWriteError (0.02s) --- PASS: TestWriteError/unknown (0.00s) --- PASS: TestWriteError/context_deadline_exceeded (0.01s) --- PASS: TestWriteError/context_canceled (0.00s) --- PASS: TestWriteError/rpc_error:_code_=_Code(400)_desc_=_ (0.00s) === RUN TestHandler_ServeHTTP === RUN TestHandler_ServeHTTP/test_handler_with_stats_enabled === RUN TestHandler_ServeHTTP/test_handler_with_stats_disabled --- PASS: TestHandler_ServeHTTP (0.03s) --- PASS: TestHandler_ServeHTTP/test_handler_with_stats_enabled (0.03s) --- PASS: TestHandler_ServeHTTP/test_handler_with_stats_disabled (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/transport 0.437s === RUN TestFrontend --- PASS: TestFrontend (0.20s) === RUN TestFrontendPropagateTrace --- PASS: TestFrontendPropagateTrace (0.03s) === RUN TestFrontendCheckReady === RUN TestFrontendCheckReady/connected_clients_are_ready === RUN TestFrontendCheckReady/no_url,_no_clients_is_not_ready --- PASS: TestFrontendCheckReady (0.00s) --- PASS: TestFrontendCheckReady/connected_clients_are_ready (0.00s) --- PASS: TestFrontendCheckReady/no_url,_no_clients_is_not_ready (0.00s) === RUN TestFrontendCancel --- PASS: TestFrontendCancel (0.21s) === RUN TestFrontendMetricsCleanup --- PASS: TestFrontendMetricsCleanup (0.02s) === RUN TestDequeuesExpiredRequests --- PASS: TestDequeuesExpiredRequests (1.00s) === RUN TestRoundRobinQueues --- PASS: TestRoundRobinQueues (1.01s) PASS ok github.com/grafana/mimir/pkg/frontend/v1 3.042s ? github.com/grafana/mimir/pkg/frontend/v1/frontendv1pb [no test files] === RUN TestFrontendBasicWorkflow --- PASS: TestFrontendBasicWorkflow (0.24s) === RUN TestFrontendRequestsPerWorkerMetric --- PASS: TestFrontendRequestsPerWorkerMetric (0.16s) === RUN TestFrontendRetryEnqueue --- PASS: TestFrontendRetryEnqueue (0.12s) === RUN TestFrontendEnqueueFailure --- PASS: TestFrontendEnqueueFailure (0.08s) === RUN TestFrontendCancellation --- PASS: TestFrontendCancellation (0.23s) === RUN TestFrontendWorkerCancellation --- PASS: TestFrontendWorkerCancellation (0.22s) === RUN TestFrontendFailedCancellation --- PASS: TestFrontendFailedCancellation (0.22s) PASS ok github.com/grafana/mimir/pkg/frontend/v2 1.698s ? github.com/grafana/mimir/pkg/frontend/v2/frontendv2pb [no test files] === RUN TestRequestActivity --- PASS: TestRequestActivity (0.00s) === RUN TestRingConfig_DefaultConfigToLifecyclerConfig --- PASS: TestRingConfig_DefaultConfigToLifecyclerConfig (0.01s) === RUN TestRingConfig_CustomConfigToLifecyclerConfig --- PASS: TestRingConfig_CustomConfigToLifecyclerConfig (0.00s) === RUN TestIngester_Push === RUN TestIngester_Push/should_soft_fail_on_two_different_sample_values_at_the_same_timestamp === RUN TestIngester_Push/should_soft_fail_on_exemplar_with_unknown_series === RUN TestIngester_Push/should_succeed_with_a_request_containing_only_metadata === RUN TestIngester_Push/should_discard_metadata_when_max_metadata_per_user_exceeded === RUN TestIngester_Push/should_succeed_on_valid_series_and_metadata === RUN TestIngester_Push/should_soft_fail_on_all_samples_out_of_bound_in_a_write_request === RUN TestIngester_Push/should_soft_fail_on_some_samples_out_of_bound_in_a_write_request === RUN TestIngester_Push/should_discard_metadata_when_max_metadata_per_metric_exceeded === RUN TestIngester_Push/should_succeed_on_valid_series_with_exemplars === RUN TestIngester_Push/successful_push,_active_series_disabled === RUN TestIngester_Push/should_soft_fail_on_sample_out-of-order --- PASS: TestIngester_Push (0.48s) --- PASS: TestIngester_Push/should_soft_fail_on_two_different_sample_values_at_the_same_timestamp (0.14s) --- PASS: TestIngester_Push/should_soft_fail_on_exemplar_with_unknown_series (0.05s) --- PASS: TestIngester_Push/should_succeed_with_a_request_containing_only_metadata (0.02s) --- PASS: TestIngester_Push/should_discard_metadata_when_max_metadata_per_user_exceeded (0.01s) --- PASS: TestIngester_Push/should_succeed_on_valid_series_and_metadata (0.04s) --- PASS: TestIngester_Push/should_soft_fail_on_all_samples_out_of_bound_in_a_write_request (0.04s) --- PASS: TestIngester_Push/should_soft_fail_on_some_samples_out_of_bound_in_a_write_request (0.04s) --- PASS: TestIngester_Push/should_discard_metadata_when_max_metadata_per_metric_exceeded (0.01s) --- PASS: TestIngester_Push/should_succeed_on_valid_series_with_exemplars (0.04s) --- PASS: TestIngester_Push/successful_push,_active_series_disabled (0.04s) --- PASS: TestIngester_Push/should_soft_fail_on_sample_out-of-order (0.04s) === RUN TestIngester_Push_ShouldCorrectlyTrackMetricsInMultiTenantScenario --- PASS: TestIngester_Push_ShouldCorrectlyTrackMetricsInMultiTenantScenario (0.06s) === RUN TestIngester_Push_DecreaseInactiveSeries --- PASS: TestIngester_Push_DecreaseInactiveSeries (0.08s) === RUN Test_Ingester_LabelNames === RUN Test_Ingester_LabelNames/without_matchers === RUN Test_Ingester_LabelNames/with_matchers --- PASS: Test_Ingester_LabelNames (0.05s) --- PASS: Test_Ingester_LabelNames/without_matchers (0.00s) --- PASS: Test_Ingester_LabelNames/with_matchers (0.00s) === RUN Test_Ingester_LabelValues --- PASS: Test_Ingester_LabelValues (0.04s) === RUN Test_Ingester_Query === RUN Test_Ingester_Query/should_filter_series_by_matcher_and_time_range === RUN Test_Ingester_Query/should_return_an_empty_response_if_no_metric_matches === RUN Test_Ingester_Query/should_filter_series_by_==_matcher === RUN Test_Ingester_Query/should_filter_series_by_!=_matcher === RUN Test_Ingester_Query/should_filter_series_by_=~_matcher === RUN Test_Ingester_Query/should_filter_series_by_!~_matcher === RUN Test_Ingester_Query/should_filter_series_by_multiple_matchers --- PASS: Test_Ingester_Query (0.05s) --- PASS: Test_Ingester_Query/should_filter_series_by_matcher_and_time_range (0.00s) --- PASS: Test_Ingester_Query/should_return_an_empty_response_if_no_metric_matches (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_==_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_!=_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_=~_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_!~_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_multiple_matchers (0.00s) === RUN TestIngester_LabelNamesCardinality === RUN TestIngester_LabelNamesCardinality/expected_all_label_with_values === RUN TestIngester_LabelNamesCardinality/expected_label_values_only_from_`metric_0` --- PASS: TestIngester_LabelNamesCardinality (0.05s) --- PASS: TestIngester_LabelNamesCardinality/expected_all_label_with_values (0.00s) --- PASS: TestIngester_LabelNamesCardinality/expected_label_values_only_from_`metric_0` (0.00s) === RUN TestIngester_LabelValuesCardinality === RUN TestIngester_LabelValuesCardinality/expected_all_label_values_cardinality === RUN TestIngester_LabelValuesCardinality/expected_status_values_cardinality_applying_matchers === RUN TestIngester_LabelValuesCardinality/empty_response_is_returned_when_no_matchers_match_the_requested_labels --- PASS: TestIngester_LabelValuesCardinality (0.05s) --- PASS: TestIngester_LabelValuesCardinality/expected_all_label_values_cardinality (0.01s) --- PASS: TestIngester_LabelValuesCardinality/expected_status_values_cardinality_applying_matchers (0.00s) --- PASS: TestIngester_LabelValuesCardinality/empty_response_is_returned_when_no_matchers_match_the_requested_labels (0.00s) === RUN TestIngester_Query_QuerySharding --- PASS: TestIngester_Query_QuerySharding (0.36s) === RUN TestIngester_Query_ShouldNotCreateTSDBIfDoesNotExists --- PASS: TestIngester_Query_ShouldNotCreateTSDBIfDoesNotExists (0.00s) === RUN TestIngester_LabelValues_ShouldNotCreateTSDBIfDoesNotExists --- PASS: TestIngester_LabelValues_ShouldNotCreateTSDBIfDoesNotExists (0.00s) === RUN TestIngester_LabelNames_ShouldNotCreateTSDBIfDoesNotExists --- PASS: TestIngester_LabelNames_ShouldNotCreateTSDBIfDoesNotExists (0.01s) === RUN TestIngester_Push_ShouldNotCreateTSDBIfNotInActiveState --- PASS: TestIngester_Push_ShouldNotCreateTSDBIfNotInActiveState (0.01s) === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/allow_to_create_TSDB_if_in_ACTIVE_state === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_PENDING_state === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_JOINING_state === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_LEAVING_state --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive (0.04s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/allow_to_create_TSDB_if_in_ACTIVE_state (0.02s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_PENDING_state (0.01s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_JOINING_state (0.01s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_LEAVING_state (0.01s) === RUN Test_Ingester_MetricsForLabelMatchers === RUN Test_Ingester_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide === RUN Test_Ingester_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match === RUN Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher === RUN Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers === RUN Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_time_range_to_return_nothing_when_queried_for_older_time_ranges === RUN Test_Ingester_MetricsForLabelMatchers/should_not_return_duplicated_metrics_on_overlapping_matchers --- PASS: Test_Ingester_MetricsForLabelMatchers (0.06s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_time_range_to_return_nothing_when_queried_for_older_time_ranges (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_not_return_duplicated_metrics_on_overlapping_matchers (0.00s) === RUN Test_Ingester_MetricsForLabelMatchers_Deduplication --- PASS: Test_Ingester_MetricsForLabelMatchers_Deduplication (5.46s) === RUN TestIngester_QueryStream === RUN TestIngester_QueryStream/should_query_chunks_by_default === RUN TestIngester_QueryStream/should_query_samples_when_configured_with_QueryStreamSamples === RUN TestIngester_QueryStream/should_query_chunks_when_configured_with_QueryStreamChunks === RUN TestIngester_QueryStream/should_support_sharding_when_query_samples === RUN TestIngester_QueryStream/should_support_sharding_when_query_chunks --- PASS: TestIngester_QueryStream (0.64s) --- PASS: TestIngester_QueryStream/should_query_chunks_by_default (0.08s) --- PASS: TestIngester_QueryStream/should_query_samples_when_configured_with_QueryStreamSamples (0.04s) --- PASS: TestIngester_QueryStream/should_query_chunks_when_configured_with_QueryStreamChunks (0.03s) --- PASS: TestIngester_QueryStream/should_support_sharding_when_query_samples (0.06s) --- PASS: TestIngester_QueryStream/should_support_sharding_when_query_chunks (0.07s) === RUN TestIngester_QueryStreamManySamples --- PASS: TestIngester_QueryStreamManySamples (0.26s) === RUN TestIngester_QueryStreamManySamplesChunks --- PASS: TestIngester_QueryStreamManySamplesChunks (1.70s) === RUN TestIngester_OpenExistingTSDBOnStartup === PAUSE TestIngester_OpenExistingTSDBOnStartup === RUN TestIngester_shipBlocks --- PASS: TestIngester_shipBlocks (0.07s) === RUN TestIngester_dontShipBlocksWhenTenantDeletionMarkerIsPresent --- PASS: TestIngester_dontShipBlocksWhenTenantDeletionMarkerIsPresent (0.30s) === RUN TestIngester_seriesCountIsCorrectAfterClosingTSDBForDeletedTenant --- PASS: TestIngester_seriesCountIsCorrectAfterClosingTSDBForDeletedTenant (0.03s) === RUN TestIngester_closeAndDeleteUserTSDBIfIdle_shouldNotCloseTSDBIfShippingIsInProgress --- PASS: TestIngester_closeAndDeleteUserTSDBIfIdle_shouldNotCloseTSDBIfShippingIsInProgress (0.05s) === RUN TestIngester_closingAndOpeningTsdbConcurrently --- PASS: TestIngester_closingAndOpeningTsdbConcurrently (0.28s) === RUN TestIngester_idleCloseEmptyTSDB --- PASS: TestIngester_idleCloseEmptyTSDB (0.04s) === RUN TestIngester_invalidSamplesDontChangeLastUpdateTime --- PASS: TestIngester_invalidSamplesDontChangeLastUpdateTime (0.58s) === RUN TestIngester_flushing === RUN TestIngester_flushing/shutdownHandler === RUN TestIngester_flushing/flushHandler === RUN TestIngester_flushing/flushHandlerWithListOfTenants === RUN TestIngester_flushing/flushMultipleBlocksWithDataSpanning3Days === RUN TestIngester_flushing/ingesterShutdown --- PASS: TestIngester_flushing (1.16s) --- PASS: TestIngester_flushing/shutdownHandler (0.18s) --- PASS: TestIngester_flushing/flushHandler (0.19s) --- PASS: TestIngester_flushing/flushHandlerWithListOfTenants (0.17s) --- PASS: TestIngester_flushing/flushMultipleBlocksWithDataSpanning3Days (0.45s) --- PASS: TestIngester_flushing/ingesterShutdown (0.18s) === RUN TestIngester_ForFlush --- PASS: TestIngester_ForFlush (0.18s) === RUN Test_Ingester_UserStats --- PASS: Test_Ingester_UserStats (0.03s) === RUN Test_Ingester_AllUserStats --- PASS: Test_Ingester_AllUserStats (0.06s) === RUN TestIngesterCompactIdleBlock --- PASS: TestIngesterCompactIdleBlock (1.46s) === RUN TestIngesterCompactAndCloseIdleTSDB --- PASS: TestIngesterCompactAndCloseIdleTSDB (1.08s) === RUN TestHeadCompactionOnStartup --- PASS: TestHeadCompactionOnStartup (2.71s) === RUN TestIngester_CloseTSDBsOnShutdown --- PASS: TestIngester_CloseTSDBsOnShutdown (0.04s) === RUN TestIngesterNotDeleteUnshippedBlocks --- PASS: TestIngesterNotDeleteUnshippedBlocks (0.91s) === RUN TestIngesterPushErrorDuringForcedCompaction --- PASS: TestIngesterPushErrorDuringForcedCompaction (0.04s) === RUN TestIngesterNoFlushWithInFlightRequest --- PASS: TestIngesterNoFlushWithInFlightRequest (5.24s) === RUN TestIngester_PushInstanceLimits === RUN TestIngester_PushInstanceLimits/should_succeed_creating_one_user_and_series === RUN TestIngester_PushInstanceLimits/should_fail_creating_two_series === RUN TestIngester_PushInstanceLimits/should_fail_creating_two_users === RUN TestIngester_PushInstanceLimits/should_fail_pushing_samples_in_two_requests_due_to_rate_limit --- PASS: TestIngester_PushInstanceLimits (0.09s) --- PASS: TestIngester_PushInstanceLimits/should_succeed_creating_one_user_and_series (0.02s) --- PASS: TestIngester_PushInstanceLimits/should_fail_creating_two_series (0.02s) --- PASS: TestIngester_PushInstanceLimits/should_fail_creating_two_users (0.03s) --- PASS: TestIngester_PushInstanceLimits/should_fail_pushing_samples_in_two_requests_due_to_rate_limit (0.02s) === RUN TestIngester_instanceLimitsMetrics --- PASS: TestIngester_instanceLimitsMetrics (0.01s) === RUN TestIngester_inflightPushRequests ingester_test.go:4591: 1 100000 455.04748ms ingester_test.go:4591: 1 300000 1.29385275s --- PASS: TestIngester_inflightPushRequests (3.82s) === RUN TestIngesterPurgeMetadata --- PASS: TestIngesterPurgeMetadata (0.05s) === RUN TestIngesterMetadataMetrics --- PASS: TestIngesterMetadataMetrics (0.05s) === RUN TestIngesterSendsOnlySeriesWithData --- PASS: TestIngesterSendsOnlySeriesWithData (0.25s) === RUN TestIngester_Push_SeriesWithBlankLabel --- PASS: TestIngester_Push_SeriesWithBlankLabel (0.02s) === RUN TestIngesterUserLimitExceeded --- PASS: TestIngesterUserLimitExceeded (0.06s) === RUN TestIngesterMetricLimitExceeded --- PASS: TestIngesterMetricLimitExceeded (0.07s) === RUN TestIngesterActiveSeries === RUN TestIngesterActiveSeries/successful_push,_should_count_active_series === RUN TestIngesterActiveSeries/should_cleanup_metrics_when_tsdb_closed === RUN TestIngesterActiveSeries/should_track_custom_matchers,_removing_when_zero === RUN TestIngesterActiveSeries/successful_push,_active_series_disabled --- PASS: TestIngesterActiveSeries (0.25s) --- PASS: TestIngesterActiveSeries/successful_push,_should_count_active_series (0.06s) --- PASS: TestIngesterActiveSeries/should_cleanup_metrics_when_tsdb_closed (0.06s) --- PASS: TestIngesterActiveSeries/should_track_custom_matchers,_removing_when_zero (0.07s) --- PASS: TestIngesterActiveSeries/successful_push,_active_series_disabled (0.06s) === RUN TestIngesterActiveSeriesConfigChanges === RUN TestIngesterActiveSeriesConfigChanges/override_flag_based_config_with_runtime_overwrite === RUN TestIngesterActiveSeriesConfigChanges/remove_runtime_overwrite_and_revert_to_flag_based_config === RUN TestIngesterActiveSeriesConfigChanges/changing_runtime_override_should_result_in_new_metrics === RUN TestIngesterActiveSeriesConfigChanges/should_cleanup_loading_metric_at_close --- PASS: TestIngesterActiveSeriesConfigChanges (0.24s) --- PASS: TestIngesterActiveSeriesConfigChanges/override_flag_based_config_with_runtime_overwrite (0.05s) --- PASS: TestIngesterActiveSeriesConfigChanges/remove_runtime_overwrite_and_revert_to_flag_based_config (0.07s) --- PASS: TestIngesterActiveSeriesConfigChanges/changing_runtime_override_should_result_in_new_metrics (0.06s) --- PASS: TestIngesterActiveSeriesConfigChanges/should_cleanup_loading_metric_at_close (0.06s) === RUN TestGetIgnoreSeriesLimitForMetricNamesMap --- PASS: TestGetIgnoreSeriesLimitForMetricNamesMap (0.00s) === RUN Test_Ingester_OutOfOrder --- PASS: Test_Ingester_OutOfOrder (4.55s) === RUN TestNewIngestErrMsgs === RUN TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld === RUN TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld_out_of_order_enabled === RUN TestNewIngestErrMsgs/newIngestErrSampleOutOfOrder === RUN TestNewIngestErrMsgs/newIngestErrSampleDuplicateTimestamp === RUN TestNewIngestErrMsgs/newIngestErrExemplarMissingSeries --- PASS: TestNewIngestErrMsgs (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld_out_of_order_enabled (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleOutOfOrder (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleDuplicateTimestamp (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrExemplarMissingSeries (0.00s) === RUN TestInstanceLimitsUnmarshal --- PASS: TestInstanceLimitsUnmarshal (0.01s) === RUN TestLabelNamesAndValuesAreSentInBatches --- PASS: TestLabelNamesAndValuesAreSentInBatches (0.00s) === RUN TestExpectedAllLabelNamesAndValuesToBeReturnedInSingleMessage === RUN TestExpectedAllLabelNamesAndValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_even_if_only_one_label === RUN TestExpectedAllLabelNamesAndValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_if_label_values_count_less_then_batch_size --- PASS: TestExpectedAllLabelNamesAndValuesToBeReturnedInSingleMessage (0.00s) --- PASS: TestExpectedAllLabelNamesAndValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_even_if_only_one_label (0.00s) --- PASS: TestExpectedAllLabelNamesAndValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_if_label_values_count_less_then_batch_size (0.00s) === RUN TestLabelValues_CardinalityReportSentInBatches --- PASS: TestLabelValues_CardinalityReportSentInBatches (0.00s) === RUN TestLabelValues_ExpectedAllValuesToBeReturnedInSingleMessage === RUN TestLabelValues_ExpectedAllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message === RUN TestLabelValues_ExpectedAllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_if_response_size_is_less_then_batch_size === RUN TestLabelValues_ExpectedAllValuesToBeReturnedInSingleMessage/empty_response_is_returned_when_no_labels_are_provided --- PASS: TestLabelValues_ExpectedAllValuesToBeReturnedInSingleMessage (0.00s) --- PASS: TestLabelValues_ExpectedAllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message (0.00s) --- PASS: TestLabelValues_ExpectedAllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_if_response_size_is_less_then_batch_size (0.00s) --- PASS: TestLabelValues_ExpectedAllValuesToBeReturnedInSingleMessage/empty_response_is_returned_when_no_labels_are_provided (0.00s) === RUN TestLabelNamesAndValues_ContextCancellation --- PASS: TestLabelNamesAndValues_ContextCancellation (0.10s) === RUN TestLabelValuesCardinality_ContextCancellation --- PASS: TestLabelValuesCardinality_ContextCancellation (0.00s) === RUN TestIngesterRestart --- PASS: TestIngesterRestart (0.41s) === RUN TestIngester_ShutdownHandler === RUN TestIngester_ShutdownHandler/unregister=false === RUN TestIngester_ShutdownHandler/unregister=true --- PASS: TestIngester_ShutdownHandler (0.02s) --- PASS: TestIngester_ShutdownHandler/unregister=false (0.01s) --- PASS: TestIngester_ShutdownHandler/unregister=true (0.01s) === RUN TestLimiter_maxSeriesPerMetric === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxSeriesPerMetric/limit_is_disabled === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters --- PASS: TestLimiter_maxSeriesPerMetric (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) === RUN TestLimiter_maxMetadataPerMetric === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerMetric/limit_is_disabled === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters --- PASS: TestLimiter_maxMetadataPerMetric (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) === RUN TestLimiter_maxSeriesPerUser === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters === RUN TestLimiter_maxSeriesPerUser/limit_is_disabled === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 --- PASS: TestLimiter_maxSeriesPerUser (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) === RUN TestLimiter_maxMetadataPerUser === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerUser/limit_is_disabled === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 --- PASS: TestLimiter_maxMetadataPerUser (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) === RUN TestLimiter_AssertMaxSeriesPerMetric === RUN TestLimiter_AssertMaxSeriesPerMetric/limit_is_disabled === RUN TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_below_the_limit === RUN TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_above_the_limit --- PASS: TestLimiter_AssertMaxSeriesPerMetric (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_above_the_limit (0.00s) === RUN TestLimiter_AssertMaxMetadataPerMetric === RUN TestLimiter_AssertMaxMetadataPerMetric/limit_is_disabled === RUN TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_below_the_limit === RUN TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_above_the_limit --- PASS: TestLimiter_AssertMaxMetadataPerMetric (0.00s) --- PASS: TestLimiter_AssertMaxMetadataPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_above_the_limit (0.00s) === RUN TestLimiter_AssertMaxSeriesPerUser === RUN TestLimiter_AssertMaxSeriesPerUser/limit_is_disabled === RUN TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_below_the_limit === RUN TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_above_the_limit --- PASS: TestLimiter_AssertMaxSeriesPerUser (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_above_the_limit (0.00s) === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser/limit_is_disabled === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_below_the_limit === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_above_the_limit --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser (0.00s) --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_above_the_limit (0.00s) === RUN TestLimiter_FormatError --- PASS: TestLimiter_FormatError (0.00s) === RUN TestTSDBMetrics --- PASS: TestTSDBMetrics (0.01s) === RUN TestTSDBMetricsWithRemoval --- PASS: TestTSDBMetricsWithRemoval (0.01s) === RUN TestShipper === RUN TestShipper/no_shipper_file_yet === RUN TestShipper/sync_first_block === RUN TestShipper/sync_without_any_new_block === RUN TestShipper/sync_block_without_external_labels === RUN TestShipper/sync_block_with_0_samples === RUN TestShipper/check_if_uploaded_block_has_files_set === CONT TestShipper shipper_test.go:146: level=warn msg="reading meta file failed, will override it" err="failed to read /tmp/TestShipper490326899/001/thanos.shipper.json: open /tmp/TestShipper490326899/001/thanos.shipper.json: no such file or directory" level=info msg="upload new block" id=00000000010000000000000000 level=debug msg="uploaded file" from=/tmp/TestShipper490326899/001/00000000010000000000000000/index dst=00000000010000000000000000/index bucket="fs: /tmp/TestShipper490326899/002" level=info msg="upload new block" id=00000000020000000000000000 level=debug msg="uploaded file" from=/tmp/TestShipper490326899/001/00000000020000000000000000/index dst=00000000020000000000000000/index bucket="fs: /tmp/TestShipper490326899/002" level=debug msg="ignoring empty block" block=00000000030000000000000000 --- PASS: TestShipper (0.01s) --- PASS: TestShipper/no_shipper_file_yet (0.00s) --- PASS: TestShipper/sync_first_block (0.01s) --- PASS: TestShipper/sync_without_any_new_block (0.00s) --- PASS: TestShipper/sync_block_without_external_labels (0.00s) --- PASS: TestShipper/sync_block_with_0_samples (0.00s) --- PASS: TestShipper/check_if_uploaded_block_has_files_set (0.00s) === RUN TestUserMetricsMetadata === RUN TestUserMetricsMetadata/should_succeed_for_multiple_metadata_per_metric === RUN TestUserMetricsMetadata/should_fail_when_metadata_per_user_limit_reached === RUN TestUserMetricsMetadata/should_fail_when_metadata_per_metric_limit_reached --- PASS: TestUserMetricsMetadata (0.01s) --- PASS: TestUserMetricsMetadata/should_succeed_for_multiple_metadata_per_metric (0.00s) --- PASS: TestUserMetricsMetadata/should_fail_when_metadata_per_user_limit_reached (0.00s) --- PASS: TestUserMetricsMetadata/should_fail_when_metadata_per_metric_limit_reached (0.00s) === CONT TestIngester_OpenExistingTSDBOnStartup === RUN TestIngester_OpenExistingTSDBOnStartup/should_not_load_TSDB_if_the_user_directory_is_empty === RUN TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_if_the_root_directory_is_empty === RUN TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_is_the_root_directory_is_missing === RUN TestIngester_OpenExistingTSDBOnStartup/should_load_TSDB_for_any_non-empty_user_directory === RUN TestIngester_OpenExistingTSDBOnStartup/should_load_all_TSDBs_on_concurrency_<_number_of_TSDBs === RUN TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_>_number_of_TSDBs === RUN TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_<_number_of_TSDBs --- PASS: TestIngester_OpenExistingTSDBOnStartup (0.15s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_not_load_TSDB_if_the_user_directory_is_empty (0.01s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_if_the_root_directory_is_empty (0.00s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_is_the_root_directory_is_missing (0.00s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_load_TSDB_for_any_non-empty_user_directory (0.03s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_load_all_TSDBs_on_concurrency_<_number_of_TSDBs (0.05s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_>_number_of_TSDBs (0.02s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_<_number_of_TSDBs (0.04s) PASS ok github.com/grafana/mimir/pkg/ingester 34.429s === RUN TestActiveSeries_UpdateSeries_NoMatchers --- PASS: TestActiveSeries_UpdateSeries_NoMatchers (0.00s) === RUN TestActiveSeries_UpdateSeries_WithMatchers --- PASS: TestActiveSeries_UpdateSeries_WithMatchers (0.01s) === RUN TestActiveSeries_ShouldCorrectlyHandleFingerprintCollisions --- PASS: TestActiveSeries_ShouldCorrectlyHandleFingerprintCollisions (0.00s) === RUN TestActiveSeries_Purge_NoMatchers === RUN TestActiveSeries_Purge_NoMatchers/ttl:_1 === RUN TestActiveSeries_Purge_NoMatchers/ttl:_2 === RUN TestActiveSeries_Purge_NoMatchers/ttl:_3 === RUN TestActiveSeries_Purge_NoMatchers/ttl:_4 --- PASS: TestActiveSeries_Purge_NoMatchers (0.01s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_1 (0.00s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_2 (0.00s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_3 (0.00s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_4 (0.00s) === RUN TestActiveSeries_Purge_WithMatchers === RUN TestActiveSeries_Purge_WithMatchers/ttl=1 === RUN TestActiveSeries_Purge_WithMatchers/ttl=2 === RUN TestActiveSeries_Purge_WithMatchers/ttl=3 === RUN TestActiveSeries_Purge_WithMatchers/ttl=4 --- PASS: TestActiveSeries_Purge_WithMatchers (0.01s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=1 (0.00s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=2 (0.00s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=3 (0.01s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=4 (0.00s) === RUN TestActiveSeries_PurgeOpt --- PASS: TestActiveSeries_PurgeOpt (0.00s) === RUN TestActiveSeries_ReloadSeriesMatchers --- PASS: TestActiveSeries_ReloadSeriesMatchers (0.00s) === RUN TestActiveSeries_ReloadSeriesMatchers_LessMatchers --- PASS: TestActiveSeries_ReloadSeriesMatchers_LessMatchers (0.00s) === RUN TestActiveSeries_ReloadSeriesMatchers_SameSizeNewLabels --- PASS: TestActiveSeries_ReloadSeriesMatchers_SameSizeNewLabels (0.00s) === RUN TestCustomTrackersConfigs === RUN TestCustomTrackersConfigs/empty_flag_value_produces_empty_config === RUN TestCustomTrackersConfigs/empty_matcher_fails invalid value "foo:" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: "foo:" Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/empty_whitespace-only_matcher_fails invalid value "foo: " for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: "foo: " Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/second_empty_whitespace-only_matcher_fails invalid value "foo: ;bar:{}" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: "foo: " Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/empty_name_fails invalid value ":{}" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: ":{}" Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/empty_whitespace-only_name_fails invalid value " :{}" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: " :{}" Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/one_matcher === RUN TestCustomTrackersConfigs/whitespaces_are_trimmed_from_name_and_matcher === RUN TestCustomTrackersConfigs/two_matchers_in_one_flag_value === RUN TestCustomTrackersConfigs/two_matchers_in_two_flag_values === RUN TestCustomTrackersConfigs/two_matchers_with_same_name_in_same_flag invalid value "foo:{foo=\"bar\"};foo:{boo=\"bam\"}" for flag -ingester.active-series-custom-trackers: matcher "foo" for active series custom trackers is provided twice Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/two_matchers_with_same_name_in_separate_flags invalid value "foo:{boo=\"bam\"}" for flag -ingester.active-series-custom-trackers: matcher "foo" for active series custom trackers is provided more than once Usage of test: -ingester.active-series-custom-trackers value ...usage docs... --- PASS: TestCustomTrackersConfigs (0.01s) --- PASS: TestCustomTrackersConfigs/empty_flag_value_produces_empty_config (0.00s) --- PASS: TestCustomTrackersConfigs/empty_matcher_fails (0.00s) --- PASS: TestCustomTrackersConfigs/empty_whitespace-only_matcher_fails (0.00s) --- PASS: TestCustomTrackersConfigs/second_empty_whitespace-only_matcher_fails (0.00s) --- PASS: TestCustomTrackersConfigs/empty_name_fails (0.00s) --- PASS: TestCustomTrackersConfigs/empty_whitespace-only_name_fails (0.00s) --- PASS: TestCustomTrackersConfigs/one_matcher (0.00s) --- PASS: TestCustomTrackersConfigs/whitespaces_are_trimmed_from_name_and_matcher (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_in_one_flag_value (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_in_two_flag_values (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_with_same_name_in_same_flag (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_with_same_name_in_separate_flags (0.00s) === RUN TestCustomTrackerConfig_Equality === RUN TestCustomTrackerConfig_Equality/EqualityBetweenSet === RUN TestCustomTrackerConfig_Equality/EqualityBetweenSet#01 === RUN TestCustomTrackerConfig_Equality/EqualityBetweenSet#02 === RUN TestCustomTrackerConfig_Equality/NotEqualsAcrossSets --- PASS: TestCustomTrackerConfig_Equality (0.01s) --- PASS: TestCustomTrackerConfig_Equality/EqualityBetweenSet (0.00s) --- PASS: TestCustomTrackerConfig_Equality/EqualityBetweenSet#01 (0.00s) --- PASS: TestCustomTrackerConfig_Equality/EqualityBetweenSet#02 (0.00s) --- PASS: TestCustomTrackerConfig_Equality/NotEqualsAcrossSets (0.00s) === RUN TestTrackersConfigs_Deserialization === RUN TestTrackersConfigs_Deserialization/ShouldDeserializeCorrectInput === RUN TestTrackersConfigs_Deserialization/ShouldErrorOnMalformedInput --- PASS: TestTrackersConfigs_Deserialization (0.00s) --- PASS: TestTrackersConfigs_Deserialization/ShouldDeserializeCorrectInput (0.00s) --- PASS: TestTrackersConfigs_Deserialization/ShouldErrorOnMalformedInput (0.00s) === RUN TestTrackersConfigs_SerializeDeserialize === RUN TestTrackersConfigs_SerializeDeserialize/ShouldSerializeDeserializeResultsTheSame --- PASS: TestTrackersConfigs_SerializeDeserialize (0.01s) --- PASS: TestTrackersConfigs_SerializeDeserialize/ShouldSerializeDeserializeResultsTheSame (0.01s) === RUN TestMatcher_MatchesSeries === RUN TestMatcher_MatchesSeries/{foo="true",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{foo="true",_bar="100",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{foo="true",_bar="200",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{bar="200",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{bar="100",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{baz="unrelated"} --- PASS: TestMatcher_MatchesSeries (0.00s) --- PASS: TestMatcher_MatchesSeries/{foo="true",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{foo="true",_bar="100",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{foo="true",_bar="200",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{bar="200",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{bar="100",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{baz="unrelated"} (0.00s) === RUN TestCustomTrackersConfigs_MalformedMatcher === RUN TestCustomTrackersConfigs_MalformedMatcher/{foo} === RUN TestCustomTrackersConfigs_MalformedMatcher/{foo=~"} --- PASS: TestCustomTrackersConfigs_MalformedMatcher (0.00s) --- PASS: TestCustomTrackersConfigs_MalformedMatcher/{foo} (0.00s) --- PASS: TestCustomTrackersConfigs_MalformedMatcher/{foo=~"} (0.00s) === RUN TestAmlabelMatchersToProm_HappyCase --- PASS: TestAmlabelMatchersToProm_HappyCase (0.00s) === RUN TestAmlabelMatchersToProm_MatchTypeValues --- PASS: TestAmlabelMatchersToProm_MatchTypeValues (0.00s) PASS ok github.com/grafana/mimir/pkg/ingester/activeseries 0.621s === RUN TestMarshall --- PASS: TestMarshall (0.01s) === RUN TestQueryRequest --- PASS: TestQueryRequest (0.00s) === RUN TestLabelNamesRequest --- PASS: TestLabelNamesRequest (0.00s) === RUN TestFingerprintCollisions --- PASS: TestFingerprintCollisions (0.00s) === RUN TestSendQueryStream --- PASS: TestSendQueryStream (0.11s) PASS ok github.com/grafana/mimir/pkg/ingester/client 0.527s === RUN TestMimir --- PASS: TestMimir (0.29s) === RUN TestMimirServerShutdownWithActivityTrackerEnabled level=warn ts=2022-08-24T21:19:58.380721808Z caller=mimir.go:433 msg="selected target is an internal module, is this intended?" target=api mimir_test.go:203: Got error when checking /ready: Get "http://127.0.0.1:35889/ready": dial tcp 127.0.0.1:35889: connect: connection refused level=info ts=2022-08-24T21:19:58.414026836Z caller=server.go:285 http=127.0.0.1:35889 grpc=127.0.0.1:36537 msg="server listening on addresses" level=debug ts=2022-08-24T21:19:58.417638622Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.418905232Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.420601339Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.42256006Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.423749815Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.432864842Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.434735376Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.435405325Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:58.438237046Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:58.438721977Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:58.438876738Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:58.439070632Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:19:58.43942048Z caller=api.go:157 msg="api: registering route" methods=GET path=/services auth=false gzip=true level=debug ts=2022-08-24T21:19:58.441089365Z caller=module_service.go:72 msg="module waiting for initialization" module=server waiting_for=activity-tracker level=info ts=2022-08-24T21:19:58.44374211Z caller=module_service.go:82 msg=initialising module=sanity-check level=info ts=2022-08-24T21:19:58.444529219Z caller=sanity_check.go:33 msg="Checking directories read/write access" level=info ts=2022-08-24T21:19:58.445339501Z caller=sanity_check.go:38 msg="Directories read/write access successfully checked" level=info ts=2022-08-24T21:19:58.445482439Z caller=sanity_check.go:40 msg="Checking object storage config" level=info ts=2022-08-24T21:19:58.446179279Z caller=sanity_check.go:45 msg="Object storage config successfully checked" level=info ts=2022-08-24T21:19:58.447358474Z caller=module_service.go:82 msg=initialising module=activity-tracker level=debug ts=2022-08-24T21:19:58.447758065Z caller=module_service.go:72 msg="module waiting for initialization" module=server waiting_for=sanity-check level=info ts=2022-08-24T21:19:58.447858254Z caller=module_service.go:82 msg=initialising module=server level=info ts=2022-08-24T21:19:58.449046066Z caller=mimir.go:471 msg="Application started" level=debug ts=2022-08-24T21:19:58.536992332Z caller=logging.go:67 msg="GET /ready (200) 5.148825ms" level=info ts=2022-08-24T21:19:58.5611429Z caller=signals.go:55 msg="=== received SIGINT/SIGTERM ===\n*** exiting" level=debug ts=2022-08-24T21:19:58.56460785Z caller=module_service.go:127 msg="module waiting for" module=activity-tracker waiting_for=server level=debug ts=2022-08-24T21:19:58.565064127Z caller=module_service.go:127 msg="module waiting for" module=sanity-check waiting_for=server level=debug ts=2022-08-24T21:19:58.565533138Z caller=module_service.go:104 msg=stopping module=server level=info ts=2022-08-24T21:19:58.570250683Z caller=server_service.go:55 msg="server stopped" level=info ts=2022-08-24T21:19:58.570658729Z caller=module_service.go:114 msg="module stopped" module=server level=debug ts=2022-08-24T21:19:58.571034365Z caller=module_service.go:104 msg=stopping module=sanity-check level=info ts=2022-08-24T21:19:58.57118585Z caller=module_service.go:114 msg="module stopped" module=sanity-check level=debug ts=2022-08-24T21:19:58.571315153Z caller=module_service.go:104 msg=stopping module=activity-tracker level=info ts=2022-08-24T21:19:58.592318717Z caller=module_service.go:114 msg="module stopped" module=activity-tracker level=info ts=2022-08-24T21:19:58.592954021Z caller=mimir.go:472 msg="Application stopped" --- PASS: TestMimirServerShutdownWithActivityTrackerEnabled (0.34s) === RUN TestConfigValidation === RUN TestConfigValidation/should_pass_validation_if_the_http_prefix_is_empty level=debug ts=2022-08-24T21:19:58.599516371Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.601722105Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.617619756Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.620131055Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.62149605Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.622606386Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.624728053Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestConfigValidation/S3:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-08-24T21:19:58.657992334Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.665013126Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.666945577Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.671000997Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.672118226Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.680261978Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.682370429Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestConfigValidation/GCS:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-08-24T21:19:58.713964062Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.71532545Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.71679939Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.722368604Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.72358003Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.724645642Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.726232825Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestConfigValidation/Azure:_should_fail_if_container_and_account_names_are_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-08-24T21:19:58.78354996Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.784873096Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.786360221Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.78960079Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.791755378Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.79348101Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.796322659Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestConfigValidation/Azure:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-08-24T21:19:58.844081697Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.846083057Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.849355285Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.85174774Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.853100232Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.854268096Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.855922364Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestConfigValidation/Swift:_should_fail_if_container_and_project_names_are_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-08-24T21:19:58.880010795Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.881235907Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.882548063Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.884296337Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.885369965Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.886398197Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.887803607Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestConfigValidation/Swift:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage level=debug ts=2022-08-24T21:19:58.909258851Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.910596444Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.912181813Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.914015538Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.915211986Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.916382746Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.917901931Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestConfigValidation/Alertmanager:_should_ignore_invalid_alertmanager_configuration_when_alertmanager_is_not_running level=debug ts=2022-08-24T21:19:58.940804784Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.942111399Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.943567474Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.945311401Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.946350985Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.948504441Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.950005091Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestConfigValidation/Alertmanager:_should_fail_with_invalid_alertmanager_configuration_when_alertmanager_is_not_running level=debug ts=2022-08-24T21:19:58.961397677Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.962569108Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.963902293Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.965488764Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.966460129Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.967389555Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.968627631Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestConfigValidation/S3:_should_pass_if_bucket_name_is_shared_between_alertmanager_and_ruler_storage_because_they_already_use_separate_prefixes_(rules/_and_alerts/) level=debug ts=2022-08-24T21:19:58.984991278Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:58.986140667Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.004489193Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.006894743Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.008275858Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.009398267Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.010880763Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" --- PASS: TestConfigValidation (0.43s) --- PASS: TestConfigValidation/should_pass_validation_if_the_http_prefix_is_empty (0.06s) --- PASS: TestConfigValidation/S3:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage (0.06s) --- PASS: TestConfigValidation/GCS:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage (0.07s) --- PASS: TestConfigValidation/Azure:_should_fail_if_container_and_account_names_are_shared_between_alertmanager_and_blocks_storage (0.06s) --- PASS: TestConfigValidation/Azure:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage (0.04s) --- PASS: TestConfigValidation/Swift:_should_fail_if_container_and_project_names_are_shared_between_alertmanager_and_blocks_storage (0.03s) --- PASS: TestConfigValidation/Swift:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage (0.03s) --- PASS: TestConfigValidation/Alertmanager:_should_ignore_invalid_alertmanager_configuration_when_alertmanager_is_not_running (0.02s) --- PASS: TestConfigValidation/Alertmanager:_should_fail_with_invalid_alertmanager_configuration_when_alertmanager_is_not_running (0.02s) --- PASS: TestConfigValidation/S3:_should_pass_if_bucket_name_is_shared_between_alertmanager_and_ruler_storage_because_they_already_use_separate_prefixes_(rules/_and_alerts/) (0.04s) === RUN TestGrpcAuthMiddleware level=info ts=2022-08-24T21:19:59.105187821Z caller=server_service.go:55 msg="server stopped" --- PASS: TestGrpcAuthMiddleware (0.08s) === RUN TestFlagDefaults --- PASS: TestFlagDefaults (0.03s) === RUN TestActiveSeriesDeprecationDefaultOverrideWithSomeRuntimeOverrides level=info ts=2022-08-24T21:19:59.15594464Z caller=server.go:285 http=127.0.0.1:35757 grpc=127.0.0.1:43547 msg="server listening on addresses" level=debug ts=2022-08-24T21:19:59.15888246Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.160107241Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.161486062Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.162742372Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.163431227Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.164030553Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.165783006Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.16714205Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.172334857Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.172529753Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.172674355Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.172860464Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=warn ts=2022-08-24T21:19:59.173138667Z caller=modules.go:223 msg="active_series_custom_trackers is defined as an ingester config, this location is deprecated, please move it to the limits config" level=debug ts=2022-08-24T21:19:59.174102488Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.177074592Z caller=api.go:157 msg="api: registering route" methods=GET path=/services auth=false gzip=true level=debug ts=2022-08-24T21:19:59.177561096Z caller=module_service.go:72 msg="module waiting for initialization" module=test waiting_for=runtime-config level=info ts=2022-08-24T21:19:59.177612202Z caller=module_service.go:82 msg=initialising module=sanity-check level=debug ts=2022-08-24T21:19:59.177707351Z caller=module_service.go:72 msg="module waiting for initialization" module=server waiting_for=activity-tracker level=info ts=2022-08-24T21:19:59.177832055Z caller=sanity_check.go:33 msg="Checking directories read/write access" level=debug ts=2022-08-24T21:19:59.177877741Z caller=module_service.go:72 msg="module waiting for initialization" module=runtime-config waiting_for=activity-tracker level=info ts=2022-08-24T21:19:59.177911184Z caller=sanity_check.go:38 msg="Directories read/write access successfully checked" level=info ts=2022-08-24T21:19:59.177963863Z caller=sanity_check.go:40 msg="Checking object storage config" level=info ts=2022-08-24T21:19:59.178031119Z caller=sanity_check.go:45 msg="Object storage config successfully checked" level=info ts=2022-08-24T21:19:59.178115338Z caller=module_service.go:82 msg=initialising module=activity-tracker level=debug ts=2022-08-24T21:19:59.178317447Z caller=module_service.go:72 msg="module waiting for initialization" module=runtime-config waiting_for=sanity-check level=debug ts=2022-08-24T21:19:59.17840398Z caller=module_service.go:72 msg="module waiting for initialization" module=runtime-config waiting_for=server level=debug ts=2022-08-24T21:19:59.178481606Z caller=module_service.go:72 msg="module waiting for initialization" module=server waiting_for=sanity-check level=info ts=2022-08-24T21:19:59.178555515Z caller=module_service.go:82 msg=initialising module=server level=info ts=2022-08-24T21:19:59.178818649Z caller=module_service.go:82 msg=initialising module=runtime-config level=debug ts=2022-08-24T21:19:59.192051894Z caller=module_service.go:72 msg="module waiting for initialization" module=test waiting_for=sanity-check level=debug ts=2022-08-24T21:19:59.192151781Z caller=module_service.go:72 msg="module waiting for initialization" module=test waiting_for=server level=debug ts=2022-08-24T21:19:59.192209129Z caller=module_service.go:72 msg="module waiting for initialization" module=test waiting_for=activity-tracker level=info ts=2022-08-24T21:19:59.192261067Z caller=module_service.go:82 msg=initialising module=test level=info ts=2022-08-24T21:19:59.192394197Z caller=mimir.go:471 msg="Application started" level=info ts=2022-08-24T21:19:59.293901294Z caller=module_service.go:114 msg="module stopped" module=test level=debug ts=2022-08-24T21:19:59.294649018Z caller=module_service.go:127 msg="module waiting for" module=sanity-check waiting_for=runtime-config level=info ts=2022-08-24T21:19:59.294758284Z caller=mimir.go:481 msg="received stop signal via return error" module=test err="stop process" level=debug ts=2022-08-24T21:19:59.294906101Z caller=module_service.go:127 msg="module waiting for" module=activity-tracker waiting_for=test level=debug ts=2022-08-24T21:19:59.295013513Z caller=module_service.go:127 msg="module waiting for" module=server waiting_for=test level=debug ts=2022-08-24T21:19:59.295128389Z caller=module_service.go:127 msg="module waiting for" module=activity-tracker waiting_for=runtime-config level=debug ts=2022-08-24T21:19:59.295143477Z caller=module_service.go:127 msg="module waiting for" module=server waiting_for=runtime-config level=debug ts=2022-08-24T21:19:59.295237023Z caller=module_service.go:127 msg="module waiting for" module=runtime-config waiting_for=test level=debug ts=2022-08-24T21:19:59.295349805Z caller=module_service.go:104 msg=stopping module=runtime-config level=info ts=2022-08-24T21:19:59.295744547Z caller=module_service.go:114 msg="module stopped" module=runtime-config level=debug ts=2022-08-24T21:19:59.29584221Z caller=module_service.go:127 msg="module waiting for" module=sanity-check waiting_for=server level=debug ts=2022-08-24T21:19:59.29586355Z caller=module_service.go:104 msg=stopping module=server level=debug ts=2022-08-24T21:19:59.295866466Z caller=module_service.go:127 msg="module waiting for" module=activity-tracker waiting_for=server level=info ts=2022-08-24T21:19:59.296537927Z caller=server_service.go:55 msg="server stopped" level=info ts=2022-08-24T21:19:59.296618068Z caller=module_service.go:114 msg="module stopped" module=server level=debug ts=2022-08-24T21:19:59.296715221Z caller=module_service.go:127 msg="module waiting for" module=sanity-check waiting_for=test level=debug ts=2022-08-24T21:19:59.296733385Z caller=module_service.go:104 msg=stopping module=activity-tracker level=debug ts=2022-08-24T21:19:59.29681629Z caller=module_service.go:104 msg=stopping module=sanity-check level=info ts=2022-08-24T21:19:59.296897733Z caller=module_service.go:114 msg="module stopped" module=sanity-check level=info ts=2022-08-24T21:19:59.301463262Z caller=module_service.go:114 msg="module stopped" module=activity-tracker level=info ts=2022-08-24T21:19:59.301649331Z caller=mimir.go:472 msg="Application stopped" --- PASS: TestActiveSeriesDeprecationDefaultOverrideWithSomeRuntimeOverrides (0.16s) === RUN TestAPIConfig level=debug ts=2022-08-24T21:19:59.303892777Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.305202438Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.307374378Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.310938024Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.312008355Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.312968119Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.313972596Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestAPIConfig/running_with_default_config level=debug ts=2022-08-24T21:19:59.315653685Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.316508812Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.317411969Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.318506054Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.319208755Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.319883633Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.320747546Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.321068429Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.322464592Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.322620535Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.322768243Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.322984519Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/defaults_with_default_config level=debug ts=2022-08-24T21:19:59.354932598Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.355829303Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.356756064Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.357937915Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.358812979Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.359864986Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.361259766Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.361795673Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.363446044Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.363658002Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.363788337Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.36394409Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/diff_with_default_config level=debug ts=2022-08-24T21:19:59.384288786Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.385391819Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.386640445Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.388253015Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.389222146Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.390172011Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.391410989Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.391907141Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.39310373Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.393259783Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.393392913Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.393558103Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/running_with_changed_target_config level=debug ts=2022-08-24T21:19:59.491571936Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.492759186Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.494034022Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.495705843Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.49664597Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.497569405Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.498882532Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.499416826Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.501179548Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.501408969Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.501548772Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.501719312Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/defaults_with_changed_target_config level=debug ts=2022-08-24T21:19:59.520994529Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.522070341Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.523253093Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.524971081Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.525881893Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.526773979Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.527957512Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.528421204Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.529990602Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.530212659Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.530341181Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.530496503Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true === RUN TestAPIConfig/diff_with_changed_target_config level=debug ts=2022-08-24T21:19:59.555242369Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.556525981Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.557892919Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.559598875Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.560597021Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.561625653Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.562931106Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.5634709Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.565201903Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.565532083Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.565668379Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.565829031Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true --- PASS: TestAPIConfig (0.34s) --- PASS: TestAPIConfig/running_with_default_config (0.04s) --- PASS: TestAPIConfig/defaults_with_default_config (0.03s) --- PASS: TestAPIConfig/diff_with_default_config (0.11s) --- PASS: TestAPIConfig/running_with_changed_target_config (0.03s) --- PASS: TestAPIConfig/defaults_with_changed_target_config (0.03s) --- PASS: TestAPIConfig/diff_with_changed_target_config (0.09s) === RUN TestMimir_InitRulerStorage level=debug ts=2022-08-24T21:19:59.641144455Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.642043193Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.642927996Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.643934287Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.64455857Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.645151514Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.645956316Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.647056904Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.647942027Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.649084283Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.650586526Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.65135474Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.651964906Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.652744771Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.653922554Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.654589487Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.655328145Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.656260857Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.656875572Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.657452717Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.658195673Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" === RUN TestMimir_InitRulerStorage/should_init_the_ruler_storage_with_target=ruler === RUN TestMimir_InitRulerStorage/should_not_init_the_ruler_storage_on_default_config_with_target=all level=info ts=2022-08-24T21:19:59.659279981Z caller=modules.go:562 msg="The ruler is not being started because you need to configure the ruler storage." === RUN TestMimir_InitRulerStorage/should_init_the_ruler_storage_on_ruler_storage_config_with_target=all --- PASS: TestMimir_InitRulerStorage (0.02s) --- PASS: TestMimir_InitRulerStorage/should_init_the_ruler_storage_with_target=ruler (0.00s) --- PASS: TestMimir_InitRulerStorage/should_not_init_the_ruler_storage_on_default_config_with_target=all (0.00s) --- PASS: TestMimir_InitRulerStorage/should_init_the_ruler_storage_on_ruler_storage_config_with_target=all (0.00s) === RUN TestMultiKVSetup === RUN TestMultiKVSetup/compactor time="2022-08-24T23:19:59+02:00" level=info msg="server listening on addresses" grpc="[::]:35369" http="[::]:42615" level=debug ts=2022-08-24T21:19:59.679709376Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.680642449Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.68141476Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.682361379Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.682963831Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.683569569Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.684333885Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.684617458Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.685780574Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.685889408Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.685969349Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.686059408Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:19:59.690498538Z caller=api.go:157 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=debug ts=2022-08-24T21:19:59.692538241Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.694765606Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/compactor/ring auth=false gzip=true level=debug ts=2022-08-24T21:19:59.695069016Z caller=api.go:157 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block} auth=true gzip=false level=debug ts=2022-08-24T21:19:59.695469148Z caller=api.go:157 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/files auth=true gzip=false === RUN TestMultiKVSetup/all time="2022-08-24T23:19:59+02:00" level=info msg="server listening on addresses" grpc="[::]:37471" http="[::]:34801" level=debug ts=2022-08-24T21:19:59.713632215Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.714522979Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.715553866Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.716816669Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.717545558Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.718258568Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.71915885Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.719515289Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.720516811Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.720774405Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.720960535Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.721194264Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:19:59.721679476Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.726313222Z caller=api.go:157 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=info ts=2022-08-24T21:19:59.729294163Z caller=memberlist_client.go:407 msg="Using memberlist cluster node name" name=felix20-bb2a5c21 ts=2022-08-24T21:19:59.729582745Z caller=memberlist_logger.go:74 level=debug msg="configured Transport is not a NodeAwareTransport and some features may not work as desired" level=warn ts=2022-08-24T21:19:59.736134977Z caller=ingester.go:233 msg="-blocks-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" level=info ts=2022-08-24T21:19:59.742966463Z caller=ingester.go:303 msg="TSDB idle compaction timeout set" timeout=1h13m14.396396295s level=debug ts=2022-08-24T21:19:59.745415995Z caller=api.go:157 msg="api: registering route" methods=POST path=/purger/delete_tenant auth=true gzip=true level=debug ts=2022-08-24T21:19:59.745675623Z caller=api.go:157 msg="api: registering route" methods=GET path=/purger/delete_tenant_status auth=true gzip=true level=info ts=2022-08-24T21:19:59.747296709Z caller=modules.go:562 msg="The ruler is not being started because you need to configure the ruler storage." level=info ts=2022-08-24T21:19:59.758522883Z caller=inmemory.go:173 msg="created in-memory index cache" maxItemSizeBytes=134217728 maxSizeBytes=1073741824 maxItems=maxInt level=debug ts=2022-08-24T21:19:59.759205716Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/store-gateway/ring auth=false gzip=true level=debug ts=2022-08-24T21:19:59.759486393Z caller=api.go:157 msg="api: registering route" methods=GET path=/store-gateway/tenants auth=false gzip=true level=debug ts=2022-08-24T21:19:59.759678264Z caller=api.go:157 msg="api: registering route" methods=GET path=/store-gateway/tenant/{tenant}/blocks auth=false gzip=true level=debug ts=2022-08-24T21:19:59.764583951Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/compactor/ring auth=false gzip=true level=debug ts=2022-08-24T21:19:59.76492414Z caller=api.go:157 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block} auth=true gzip=false level=debug ts=2022-08-24T21:19:59.765219545Z caller=api.go:157 msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/files auth=true gzip=false level=debug ts=2022-08-24T21:19:59.784661606Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/ingester/flush auth=false gzip=true level=debug ts=2022-08-24T21:19:59.78504731Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/ingester/shutdown auth=false gzip=true level=debug ts=2022-08-24T21:19:59.785237438Z caller=api.go:157 msg="api: registering route" methods=POST path=/ingester/push auth=true gzip=false level=debug ts=2022-08-24T21:19:59.78526001Z caller=tcp_transport.go:393 component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=172.17.0.1 advertisePort=7946 level=debug ts=2022-08-24T21:19:59.786307839Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/user_stats auth=true gzip=true level=debug ts=2022-08-24T21:19:59.787414087Z caller=api.go:157 msg="api: registering route" methods=POST path=/prometheus/api/v1/read auth=true gzip=true level=debug ts=2022-08-24T21:19:59.787637337Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query auth=true gzip=true level=debug ts=2022-08-24T21:19:59.787824899Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_range auth=true gzip=true level=debug ts=2022-08-24T21:19:59.78804856Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_exemplars auth=true gzip=true level=debug ts=2022-08-24T21:19:59.788257763Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/labels auth=true gzip=true level=debug ts=2022-08-24T21:19:59.788441107Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/api/v1/label/{name}/values auth=true gzip=true level=debug ts=2022-08-24T21:19:59.788787348Z caller=api.go:157 msg="api: registering route" methods=GET,POST,DELETE path=/prometheus/api/v1/series auth=true gzip=true level=debug ts=2022-08-24T21:19:59.788971444Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:19:59.789287718Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/api/v1/metadata auth=true gzip=true level=debug ts=2022-08-24T21:19:59.789506549Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_names auth=true gzip=true level=debug ts=2022-08-24T21:19:59.789756228Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_values auth=true gzip=true level=debug ts=2022-08-24T21:19:59.791141211Z caller=api.go:157 msg="api: registering route" methods=POST path=/api/v1/push auth=true gzip=false level=debug ts=2022-08-24T21:19:59.791331498Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/distributor/ring auth=false gzip=true level=debug ts=2022-08-24T21:19:59.791514692Z caller=api.go:157 msg="api: registering route" methods=GET path=/distributor/all_user_stats auth=false gzip=true level=debug ts=2022-08-24T21:19:59.791706803Z caller=api.go:157 msg="api: registering route" methods=GET path=/distributor/ha_tracker auth=false gzip=true level=info ts=2022-08-24T21:19:59.791968926Z caller=modules.go:572 msg="RulerStorage is nil. Not starting the ruler." level=info ts=2022-08-24T21:19:59.800351747Z caller=modules.go:416 msg="The querier worker has not been configured with either the query-frontend or query-scheduler address. Because Mimir is running in monolithic mode, it's attempting an automatic worker configuration. If queries are unresponsive, consider explicitly configuring the query-frontend or query-scheduler address for querier worker." address=127.0.0.1:0 level=info ts=2022-08-24T21:19:59.802613927Z caller=worker.go:110 msg="Starting querier worker connected to query-frontend" frontend=127.0.0.1:0 === RUN TestMultiKVSetup/ruler level=debug ts=2022-08-24T21:19:59.832910112Z caller=tcp_transport.go:393 component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=172.17.0.1 advertisePort=7946 time="2022-08-24T23:19:59+02:00" level=info msg="server listening on addresses" grpc="[::]:36637" http="[::]:45963" level=debug ts=2022-08-24T21:19:59.836140262Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.838575537Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.84207348Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.843910221Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.844906363Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.845844846Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.847170346Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.847775523Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.849443157Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.849601584Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.849776643Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.849992789Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:19:59.850617734Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.855903646Z caller=api.go:157 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=warn ts=2022-08-24T21:19:59.865426489Z caller=storage.go:29 msg="-ruler-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" level=info ts=2022-08-24T21:19:59.868151639Z caller=mapper.go:52 msg="cleaning up mapped rules directory" path=./data-ruler/ level=debug ts=2022-08-24T21:19:59.870452302Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/ruler/ring auth=false gzip=true level=debug ts=2022-08-24T21:19:59.870770901Z caller=api.go:157 msg="api: registering route" methods=POST path=/ruler/delete_tenant_config auth=true gzip=true level=debug ts=2022-08-24T21:19:59.870992477Z caller=api.go:157 msg="api: registering route" methods=GET path=/ruler/rule_groups auth=false gzip=true level=debug ts=2022-08-24T21:19:59.871235674Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/api/v1/rules auth=true gzip=true level=debug ts=2022-08-24T21:19:59.871445208Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/api/v1/alerts auth=true gzip=true level=debug ts=2022-08-24T21:19:59.871736325Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/config/v1/rules auth=true gzip=true level=debug ts=2022-08-24T21:19:59.87199445Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/config/v1/rules/{namespace} auth=true gzip=true level=debug ts=2022-08-24T21:19:59.872407205Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/config/v1/rules/{namespace}/{groupName} auth=true gzip=true level=debug ts=2022-08-24T21:19:59.872839778Z caller=api.go:157 msg="api: registering route" methods=POST path=/prometheus/config/v1/rules/{namespace} auth=true gzip=true level=debug ts=2022-08-24T21:19:59.873206016Z caller=api.go:157 msg="api: registering route" methods=DELETE path=/prometheus/config/v1/rules/{namespace}/{groupName} auth=true gzip=true level=debug ts=2022-08-24T21:19:59.873657504Z caller=api.go:157 msg="api: registering route" methods=DELETE path=/prometheus/config/v1/rules/{namespace} auth=true gzip=true === RUN TestMultiKVSetup/alertmanager time="2022-08-24T23:19:59+02:00" level=info msg="server listening on addresses" grpc="[::]:43857" http="[::]:45575" level=debug ts=2022-08-24T21:19:59.898917466Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.900200377Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.901530636Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.903190876Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.904230419Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.905202967Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.90650833Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.907216781Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.908884795Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.90924412Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.909376358Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.909602613Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:19:59.910109987Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.915173911Z caller=api.go:157 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=warn ts=2022-08-24T21:19:59.916159754Z caller=store.go:63 msg="-alertmanager-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" level=debug ts=2022-08-24T21:19:59.919322056Z caller=api.go:157 msg="api: registering route" methods=GET path=/multitenant_alertmanager/status auth=false gzip=true level=debug ts=2022-08-24T21:19:59.919517102Z caller=api.go:157 msg="api: registering route" methods=GET path=/multitenant_alertmanager/configs auth=false gzip=true level=debug ts=2022-08-24T21:19:59.919657696Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/multitenant_alertmanager/ring auth=false gzip=true level=debug ts=2022-08-24T21:19:59.919791488Z caller=api.go:157 msg="api: registering route" methods=POST path=/multitenant_alertmanager/delete_tenant_config auth=true gzip=true level=debug ts=2022-08-24T21:19:59.919964453Z caller=api.go:157 msg="api: registering route" methods=GET path=/alertmanager/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:19:59.920113653Z caller=api.go:162 msg="api: registering route" methods= prefix=/alertmanager auth=true gzip=true level=debug ts=2022-08-24T21:19:59.920209403Z caller=api.go:204 msg="api: registering alertmanager" path_prefix=/alertmanager level=debug ts=2022-08-24T21:19:59.920296717Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/alerts auth=true gzip=true level=debug ts=2022-08-24T21:19:59.920440477Z caller=api.go:157 msg="api: registering route" methods=POST path=/api/v1/alerts auth=true gzip=true level=debug ts=2022-08-24T21:19:59.920582774Z caller=api.go:157 msg="api: registering route" methods=DELETE path=/api/v1/alerts auth=true gzip=true === RUN TestMultiKVSetup/distributor time="2022-08-24T23:19:59+02:00" level=info msg="server listening on addresses" grpc="[::]:33661" http="[::]:34767" level=debug ts=2022-08-24T21:19:59.941218618Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.942384399Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.943707966Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.945295458Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.946243109Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.947151275Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.948522051Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.949129081Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.950721944Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.950892755Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.95102328Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.951177761Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:19:59.951653976Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.9576436Z caller=api.go:157 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=debug ts=2022-08-24T21:19:59.965879024Z caller=api.go:157 msg="api: registering route" methods=POST path=/api/v1/push auth=true gzip=false level=debug ts=2022-08-24T21:19:59.966098376Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/distributor/ring auth=false gzip=true level=debug ts=2022-08-24T21:19:59.966269728Z caller=api.go:157 msg="api: registering route" methods=GET path=/distributor/all_user_stats auth=false gzip=true level=debug ts=2022-08-24T21:19:59.966459685Z caller=api.go:157 msg="api: registering route" methods=GET path=/distributor/ha_tracker auth=false gzip=true === RUN TestMultiKVSetup/ingester time="2022-08-24T23:19:59+02:00" level=info msg="server listening on addresses" grpc="[::]:32899" http="[::]:33897" level=debug ts=2022-08-24T21:19:59.987061114Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.98812355Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.989282758Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.990799999Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.991722903Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.992784488Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.993995703Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:19:59.994603185Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:19:59.996061585Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.996271379Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:19:59.996409118Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:19:59.99659126Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:19:59.99706507Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-08-24T21:20:00.003225365Z caller=api.go:157 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=warn ts=2022-08-24T21:20:00.004883491Z caller=ingester.go:233 msg="-blocks-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" level=info ts=2022-08-24T21:20:00.010885899Z caller=ingester.go:303 msg="TSDB idle compaction timeout set" timeout=1h6m38.7923495s level=debug ts=2022-08-24T21:20:00.012182055Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/ingester/flush auth=false gzip=true level=debug ts=2022-08-24T21:20:00.01237663Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/ingester/shutdown auth=false gzip=true level=debug ts=2022-08-24T21:20:00.012548643Z caller=api.go:157 msg="api: registering route" methods=POST path=/ingester/push auth=true gzip=false === RUN TestMultiKVSetup/store-gateway time="2022-08-24T23:20:00+02:00" level=info msg="server listening on addresses" grpc="[::]:36581" http="[::]:35961" level=debug ts=2022-08-24T21:20:00.040023808Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.041433667Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.043098725Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.044965813Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.046126504Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.047196735Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.04867886Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.049259491Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:20:00.050974984Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:20:00.051179539Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:20:00.051318239Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:20:00.051478681Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:20:00.055668353Z caller=api.go:157 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=debug ts=2022-08-24T21:20:00.057388866Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=info ts=2022-08-24T21:20:00.066586798Z caller=inmemory.go:173 msg="created in-memory index cache" maxItemSizeBytes=134217728 maxSizeBytes=1073741824 maxItems=maxInt level=debug ts=2022-08-24T21:20:00.067122885Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/store-gateway/ring auth=false gzip=true level=debug ts=2022-08-24T21:20:00.06732782Z caller=api.go:157 msg="api: registering route" methods=GET path=/store-gateway/tenants auth=false gzip=true level=debug ts=2022-08-24T21:20:00.067509091Z caller=api.go:157 msg="api: registering route" methods=GET path=/store-gateway/tenant/{tenant}/blocks auth=false gzip=true === RUN TestMultiKVSetup/querier time="2022-08-24T23:20:00+02:00" level=info msg="server listening on addresses" grpc="[::]:39785" http="[::]:42189" level=debug ts=2022-08-24T21:20:00.088933216Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.089996785Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.091267151Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.092759425Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.093702387Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.094589363Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.095730007Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.096212102Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:20:00.097415544Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:20:00.097608867Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:20:00.097734443Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:20:00.097875999Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:20:00.098317238Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true level=debug ts=2022-08-24T21:20:00.104759262Z caller=api.go:157 msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true level=debug ts=2022-08-24T21:20:00.115729745Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/user_stats auth=true gzip=true level=debug ts=2022-08-24T21:20:00.118060595Z caller=api.go:157 msg="api: registering route" methods=POST path=/prometheus/api/v1/read auth=true gzip=true level=debug ts=2022-08-24T21:20:00.118269447Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query auth=true gzip=true level=debug ts=2022-08-24T21:20:00.11845186Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_range auth=true gzip=true level=debug ts=2022-08-24T21:20:00.11863312Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_exemplars auth=true gzip=true level=debug ts=2022-08-24T21:20:00.118834248Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/labels auth=true gzip=true level=debug ts=2022-08-24T21:20:00.11906394Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/api/v1/label/{name}/values auth=true gzip=true level=debug ts=2022-08-24T21:20:00.119395102Z caller=api.go:157 msg="api: registering route" methods=GET,POST,DELETE path=/prometheus/api/v1/series auth=true gzip=true level=debug ts=2022-08-24T21:20:00.119583857Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true level=debug ts=2022-08-24T21:20:00.119775667Z caller=api.go:157 msg="api: registering route" methods=GET path=/prometheus/api/v1/metadata auth=true gzip=true level=debug ts=2022-08-24T21:20:00.119962308Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_names auth=true gzip=true level=debug ts=2022-08-24T21:20:00.120171832Z caller=api.go:157 msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_values auth=true gzip=true --- PASS: TestMultiKVSetup (0.46s) --- PASS: TestMultiKVSetup/compactor (0.04s) --- PASS: TestMultiKVSetup/all (0.11s) --- PASS: TestMultiKVSetup/ruler (0.07s) --- PASS: TestMultiKVSetup/alertmanager (0.05s) --- PASS: TestMultiKVSetup/distributor (0.05s) --- PASS: TestMultiKVSetup/ingester (0.05s) --- PASS: TestMultiKVSetup/store-gateway (0.06s) --- PASS: TestMultiKVSetup/querier (0.05s) === RUN TestActiveSeriesOverrides === RUN TestActiveSeriesOverrides/Override_without_runtime_path_specified time="2022-08-24T23:20:00+02:00" level=info msg="server listening on addresses" grpc="[::]:45037" http="[::]:46485" level=debug ts=2022-08-24T21:20:00.148326623Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.149124703Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.150018442Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.15110306Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.151759433Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.152389787Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.153225267Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.153549757Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:20:00.154547762Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:20:00.154648932Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:20:00.154718944Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:20:00.154805867Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=warn ts=2022-08-24T21:20:00.154913319Z caller=modules.go:223 msg="active_series_custom_trackers is defined as an ingester config, this location is deprecated, please move it to the limits config" === RUN TestActiveSeriesOverrides/Override_with_runtime_path_specified time="2022-08-24T23:20:00+02:00" level=info msg="server listening on addresses" grpc="[::]:39357" http="[::]:35265" level=debug ts=2022-08-24T21:20:00.162007549Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.162770092Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.163703015Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.164718422Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.16535024Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.16599991Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.166803159Z caller=netutil.go:56 msg="found network interfaces with private IP addresses assigned" interfaces="docker0 tap0 virbr0" level=debug ts=2022-08-24T21:20:00.167128541Z caller=api.go:157 msg="api: registering route" methods=GET path=/config auth=false gzip=true level=debug ts=2022-08-24T21:20:00.168487995Z caller=api.go:157 msg="api: registering route" methods=GET path=/ auth=false gzip=true level=debug ts=2022-08-24T21:20:00.168883969Z caller=api.go:162 msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true level=debug ts=2022-08-24T21:20:00.169026998Z caller=api.go:157 msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true level=debug ts=2022-08-24T21:20:00.169200263Z caller=api.go:157 msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true level=warn ts=2022-08-24T21:20:00.169413614Z caller=modules.go:223 msg="active_series_custom_trackers is defined as an ingester config, this location is deprecated, please move it to the limits config" level=debug ts=2022-08-24T21:20:00.169847239Z caller=api.go:157 msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true --- PASS: TestActiveSeriesOverrides (0.05s) --- PASS: TestActiveSeriesOverrides/Override_without_runtime_path_specified (0.01s) --- PASS: TestActiveSeriesOverrides/Override_with_runtime_path_specified (0.02s) === RUN TestLoadRuntimeConfig_ShouldLoadAnchoredYAML --- PASS: TestLoadRuntimeConfig_ShouldLoadAnchoredYAML (0.00s) === RUN TestLoadRuntimeConfig_ShouldLoadEmptyFile --- PASS: TestLoadRuntimeConfig_ShouldLoadEmptyFile (0.00s) === RUN TestLoadRuntimeConfig_MissingPointerFieldsAreNil --- PASS: TestLoadRuntimeConfig_MissingPointerFieldsAreNil (0.00s) === RUN TestLoadRuntimeConfig_ShouldReturnErrorOnMultipleDocumentsInTheConfig --- PASS: TestLoadRuntimeConfig_ShouldReturnErrorOnMultipleDocumentsInTheConfig (0.00s) === RUN TestCheckObjectStoresConfig === RUN TestCheckObjectStoresConfig/should_succeed_with_the_default_config === PAUSE TestCheckObjectStoresConfig/should_succeed_with_the_default_config === RUN TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester === PAUSE TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester === RUN TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager === PAUSE TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config === RUN TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all === PAUSE TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all === RUN TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) === PAUSE TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) === RUN TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler === PAUSE TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config === CONT TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config === CONT TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config === CONT TestCheckObjectStoresConfig/should_succeed_with_the_default_config === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config === CONT TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester === CONT TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) === CONT TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler --- PASS: TestCheckObjectStoresConfig (0.00s) --- PASS: TestCheckObjectStoresConfig/should_succeed_with_the_default_config (0.06s) --- PASS: TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler (0.07s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config (0.07s) --- PASS: TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) (0.07s) --- PASS: TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester (0.07s) --- PASS: TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager (0.08s) --- PASS: TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all (0.08s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config (0.08s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config (0.09s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config (1.57s) === RUN TestCheckDirectoryReadWriteAccess === RUN TestCheckDirectoryReadWriteAccess/ruler === RUN TestCheckDirectoryReadWriteAccess/ruler/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/ruler/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ruler/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ruler/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ingester === RUN TestCheckDirectoryReadWriteAccess/ingester/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ingester/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/ingester/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ingester/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/compactor === RUN TestCheckDirectoryReadWriteAccess/compactor/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/compactor/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/compactor/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/compactor/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access --- PASS: TestCheckDirectoryReadWriteAccess (0.11s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_fail_on_directory_without_write_access (0.01s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_pass_on_directory_with_read-write_access (0.01s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.01s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.01s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager (0.02s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_on_directory_without_write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_on_directory_with_read-write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester (0.02s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.01s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_fail_on_directory_without_write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_pass_on_directory_with_read-write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway (0.02s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_on_directory_without_write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_on_directory_with_read-write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor (0.02s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_fail_on_directory_without_write_access (0.01s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_pass_on_directory_with_read-write_access (0.01s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.00s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.01s) === RUN TestServerStopViaContext level=info ts=2022-08-24T21:20:02.358750161Z caller=server_service.go:55 msg="server stopped" --- PASS: TestServerStopViaContext (0.50s) === RUN TestServerStopViaShutdown level=info ts=2022-08-24T21:20:02.360742154Z caller=server_service.go:55 msg="server stopped" --- PASS: TestServerStopViaShutdown (0.00s) === RUN TestServerStopViaStop level=info ts=2022-08-24T21:20:02.362565429Z caller=server_service.go:55 msg="server stopped" --- PASS: TestServerStopViaStop (0.00s) PASS ok github.com/grafana/mimir/pkg/mimir 5.361s === RUN TestJsoniterMarshalForSample --- PASS: TestJsoniterMarshalForSample (0.00s) === RUN TestStdlibJsonMarshalForSample --- PASS: TestStdlibJsonMarshalForSample (0.01s) === RUN TestJsoniterUnmarshalForSample --- PASS: TestJsoniterUnmarshalForSample (0.00s) === RUN TestStdlibJsonUnmarshalForSample --- PASS: TestStdlibJsonUnmarshalForSample (0.00s) === RUN TestMetricMetadataToMetricTypeToMetricType === RUN TestMetricMetadataToMetricTypeToMetricType/with_a_single-word_metric === RUN TestMetricMetadataToMetricTypeToMetricType/with_a_two-word_metric === RUN TestMetricMetadataToMetricTypeToMetricType/with_an_unknown_metric --- PASS: TestMetricMetadataToMetricTypeToMetricType (0.00s) --- PASS: TestMetricMetadataToMetricTypeToMetricType/with_a_single-word_metric (0.00s) --- PASS: TestMetricMetadataToMetricTypeToMetricType/with_a_two-word_metric (0.00s) --- PASS: TestMetricMetadataToMetricTypeToMetricType/with_an_unknown_metric (0.00s) === RUN TestFromLabelAdaptersToLabels --- PASS: TestFromLabelAdaptersToLabels (0.00s) === RUN TestFromLabelAdaptersToLabelsWithCopy --- PASS: TestFromLabelAdaptersToLabelsWithCopy (0.00s) === RUN TestFromPointsToSamples --- PASS: TestFromPointsToSamples (0.00s) === RUN TestLabelAdapter_Marshal === RUN TestLabelAdapter_Marshal/foo === RUN TestLabelAdapter_Marshal/very_long_label_name === RUN TestLabelAdapter_Marshal/#00 === RUN TestLabelAdapter_Marshal/#01 --- PASS: TestLabelAdapter_Marshal (0.00s) --- PASS: TestLabelAdapter_Marshal/foo (0.00s) --- PASS: TestLabelAdapter_Marshal/very_long_label_name (0.00s) --- PASS: TestLabelAdapter_Marshal/#00 (0.00s) --- PASS: TestLabelAdapter_Marshal/#01 (0.00s) === RUN TestPreallocTimeseriesSliceFromPool === RUN TestPreallocTimeseriesSliceFromPool/new_instance_is_provided_when_not_available_to_reuse === RUN TestPreallocTimeseriesSliceFromPool/instance_is_cleaned_before_reusing --- PASS: TestPreallocTimeseriesSliceFromPool (0.00s) --- PASS: TestPreallocTimeseriesSliceFromPool/new_instance_is_provided_when_not_available_to_reuse (0.00s) --- PASS: TestPreallocTimeseriesSliceFromPool/instance_is_cleaned_before_reusing (0.00s) === RUN TestTimeseriesFromPool === RUN TestTimeseriesFromPool/new_instance_is_provided_when_not_available_to_reuse === RUN TestTimeseriesFromPool/instance_is_cleaned_before_reusing --- PASS: TestTimeseriesFromPool (0.00s) --- PASS: TestTimeseriesFromPool/new_instance_is_provided_when_not_available_to_reuse (0.00s) --- PASS: TestTimeseriesFromPool/instance_is_cleaned_before_reusing (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirpb 0.658s ? github.com/grafana/mimir/pkg/mimirtool/analyze [no test files] ? github.com/grafana/mimir/pkg/mimirtool/backfill [no test files] === RUN TestBuildURL === RUN TestBuildURL/builds_the_correct_URL_with_a_trailing_slash === RUN TestBuildURL/builds_the_correct_URL_without_a_trailing_slash === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_with_trailing_slash === RUN TestBuildURL/builds_the_correct_URL_with_a_trailing_slash_and_the_target_path_contains_special_characters === RUN TestBuildURL/builds_the_correct_URL_without_a_trailing_slash_and_the_target_path_contains_special_characters === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_contains_special_characters === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_starts_with_a_escaped_slash === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_ends_with_a_escaped_slash --- PASS: TestBuildURL (0.01s) --- PASS: TestBuildURL/builds_the_correct_URL_with_a_trailing_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_without_a_trailing_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_with_trailing_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_with_a_trailing_slash_and_the_target_path_contains_special_characters (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_without_a_trailing_slash_and_the_target_path_contains_special_characters (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_contains_special_characters (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_starts_with_a_escaped_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_ends_with_a_escaped_slash (0.00s) === RUN TestMimirClient_X === RUN TestMimirClient_X/regular-characters === RUN TestMimirClient_X/special-characters-spaces === RUN TestMimirClient_X/special-characters-slashes === RUN TestMimirClient_X/special-characters-slash-first === RUN TestMimirClient_X/special-characters-slash-first#01 --- PASS: TestMimirClient_X (0.06s) --- PASS: TestMimirClient_X/regular-characters (0.03s) --- PASS: TestMimirClient_X/special-characters-spaces (0.00s) --- PASS: TestMimirClient_X/special-characters-slashes (0.00s) --- PASS: TestMimirClient_X/special-characters-slash-first (0.00s) --- PASS: TestMimirClient_X/special-characters-slash-first#01 (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/client 0.763s === RUN TestParseMetricsInBoard --- PASS: TestParseMetricsInBoard (0.03s) === RUN TestParseMetricsInBoardWithTimeseriesPanel --- PASS: TestParseMetricsInBoardWithTimeseriesPanel (0.00s) === RUN TestParseMetricsInRuleFile --- PASS: TestParseMetricsInRuleFile (0.06s) === RUN TestNewEnvVarsWithPrefix === RUN TestNewEnvVarsWithPrefix/PREFIX === RUN TestNewEnvVarsWithPrefix/PREFIX/Address === RUN TestNewEnvVarsWithPrefix/PREFIX/APIKey === RUN TestNewEnvVarsWithPrefix/PREFIX/APIUser === RUN TestNewEnvVarsWithPrefix/PREFIX/TLSCAPath === RUN TestNewEnvVarsWithPrefix/PREFIX/TLSCertPath === RUN TestNewEnvVarsWithPrefix/PREFIX/TLSKeyPath === RUN TestNewEnvVarsWithPrefix/PREFIX/TenantID === RUN TestNewEnvVarsWithPrefix/PREFIX/UseLegacyRoutes === RUN TestNewEnvVarsWithPrefix/PREFIX/AuthToken === RUN TestNewEnvVarsWithPrefix/PREFIX_ === RUN TestNewEnvVarsWithPrefix/PREFIX_/Address === RUN TestNewEnvVarsWithPrefix/PREFIX_/APIKey === RUN TestNewEnvVarsWithPrefix/PREFIX_/APIUser === RUN TestNewEnvVarsWithPrefix/PREFIX_/TLSCAPath === RUN TestNewEnvVarsWithPrefix/PREFIX_/TLSCertPath === RUN TestNewEnvVarsWithPrefix/PREFIX_/TLSKeyPath === RUN TestNewEnvVarsWithPrefix/PREFIX_/TenantID === RUN TestNewEnvVarsWithPrefix/PREFIX_/UseLegacyRoutes === RUN TestNewEnvVarsWithPrefix/PREFIX_/AuthToken === RUN TestNewEnvVarsWithPrefix/#00 === RUN TestNewEnvVarsWithPrefix/#00/Address === RUN TestNewEnvVarsWithPrefix/#00/APIKey === RUN TestNewEnvVarsWithPrefix/#00/APIUser === RUN TestNewEnvVarsWithPrefix/#00/TLSCAPath === RUN TestNewEnvVarsWithPrefix/#00/TLSCertPath === RUN TestNewEnvVarsWithPrefix/#00/TLSKeyPath === RUN TestNewEnvVarsWithPrefix/#00/TenantID === RUN TestNewEnvVarsWithPrefix/#00/UseLegacyRoutes === RUN TestNewEnvVarsWithPrefix/#00/AuthToken --- PASS: TestNewEnvVarsWithPrefix (0.01s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/Address (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/APIKey (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/APIUser (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TLSCAPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TLSCertPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TLSKeyPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TenantID (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/UseLegacyRoutes (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/AuthToken (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_ (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/Address (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/APIKey (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/APIUser (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TLSCAPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TLSCertPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TLSKeyPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TenantID (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/UseLegacyRoutes (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/AuthToken (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00 (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/Address (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/APIKey (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/APIUser (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TLSCAPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TLSCertPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TLSKeyPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TenantID (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/UseLegacyRoutes (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/AuthToken (0.00s) === RUN TestTimeSeriesIterator === RUN TestTimeSeriesIterator/empty_time_series === RUN TestTimeSeriesIterator/simple === RUN TestTimeSeriesIterator/edge-cases --- PASS: TestTimeSeriesIterator (0.00s) --- PASS: TestTimeSeriesIterator/empty_time_series (0.00s) --- PASS: TestTimeSeriesIterator/simple (0.00s) --- PASS: TestTimeSeriesIterator/edge-cases (0.00s) === RUN TestCheckDuplicates === RUN TestCheckDuplicates/no_duplicates === RUN TestCheckDuplicates/with_duplicates --- PASS: TestCheckDuplicates (0.00s) --- PASS: TestCheckDuplicates/no_duplicates (0.00s) --- PASS: TestCheckDuplicates/with_duplicates (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/commands 1.434s === RUN TestConvert_Cortex === RUN TestConvert_Cortex/shouldn't_need_any_conversion === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion === RUN TestConvert_Cortex/shouldn't_need_any_conversion_with_flags === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion_with_flags === RUN TestConvert_Cortex/simple_rename === PAUSE TestConvert_Cortex/simple_rename === RUN TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ === PAUSE TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ === RUN TestConvert_Cortex/query_range_cache_params_are_renamed === PAUSE TestConvert_Cortex/query_range_cache_params_are_renamed === RUN TestConvert_Cortex/with_non-primitive_flags === PAUSE TestConvert_Cortex/with_non-primitive_flags === RUN TestConvert_Cortex/with_renamed_flags === PAUSE TestConvert_Cortex/with_renamed_flags === RUN TestConvert_Cortex/config_flags_have_precedence === PAUSE TestConvert_Cortex/config_flags_have_precedence === RUN TestConvert_Cortex/ruler.storage_maps_to_ruler_storage === PAUSE TestConvert_Cortex/ruler.storage_maps_to_ruler_storage === RUN TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage === PAUSE TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage === RUN TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage === PAUSE TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage === RUN TestConvert_Cortex/ruler_S3_SSE_conversion_work === PAUSE TestConvert_Cortex/ruler_S3_SSE_conversion_work === RUN TestConvert_Cortex/alertmanager_S3_SSE_conversion_work === PAUSE TestConvert_Cortex/alertmanager_S3_SSE_conversion_work === RUN TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values === PAUSE TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values === RUN TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service === PAUSE TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service === RUN TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service === PAUSE TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service === RUN TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML === PAUSE TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML === RUN TestConvert_Cortex/ingester_ring_config === PAUSE TestConvert_Cortex/ingester_ring_config === RUN TestConvert_Cortex/sharding_with_consul_enabled === PAUSE TestConvert_Cortex/sharding_with_consul_enabled === RUN TestConvert_Cortex/sharding_disabled === PAUSE TestConvert_Cortex/sharding_disabled === RUN TestConvert_Cortex/ruler_S3_URL === PAUSE TestConvert_Cortex/ruler_S3_URL === RUN TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence === PAUSE TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 === RUN TestConvert_Cortex/alertmanager_S3_URL === PAUSE TestConvert_Cortex/alertmanager_S3_URL === RUN TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten === PAUSE TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten === RUN TestConvert_Cortex/CSV_string_slice_with_single_value === PAUSE TestConvert_Cortex/CSV_string_slice_with_single_value === RUN TestConvert_Cortex/CSV_string_slice === PAUSE TestConvert_Cortex/CSV_string_slice === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === RUN TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped === PAUSE TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped === RUN TestConvert_Cortex/duration_list_flags === PAUSE TestConvert_Cortex/duration_list_flags === RUN TestConvert_Cortex/duration_list_YAML === PAUSE TestConvert_Cortex/duration_list_YAML === RUN TestConvert_Cortex/instance_id_is_preserved === PAUSE TestConvert_Cortex/instance_id_is_preserved === RUN TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true === PAUSE TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true === CONT TestConvert_Cortex/shouldn't_need_any_conversion === CONT TestConvert_Cortex/ruler_S3_URL === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === CONT TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values === CONT TestConvert_Cortex/with_non-primitive_flags === CONT TestConvert_Cortex/alertmanager_S3_SSE_conversion_work === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 === CONT TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 === CONT TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service === CONT TestConvert_Cortex/duration_list_YAML === CONT TestConvert_Cortex/ruler_S3_SSE_conversion_work === CONT TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === CONT TestConvert_Cortex/duration_list_flags === CONT TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML === CONT TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage === CONT TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ === CONT TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped === CONT TestConvert_Cortex/ingester_ring_config === CONT TestConvert_Cortex/simple_rename === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === CONT TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence === CONT TestConvert_Cortex/alertmanager_S3_URL === CONT TestConvert_Cortex/shouldn't_need_any_conversion_with_flags === CONT TestConvert_Cortex/sharding_disabled === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir === RUN TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir === RUN TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir === PAUSE TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir === RUN TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir === RUN TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir === RUN TestConvert_Cortex/duration_list_YAML/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir === CONT TestConvert_Cortex/config_flags_have_precedence === RUN TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir === RUN TestConvert_Cortex/ingester_ring_config/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir === PAUSE TestConvert_Cortex/duration_list_YAML/cortex->mimir === RUN TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir === RUN TestConvert_Cortex/duration_list_flags/cortex->mimir === PAUSE TestConvert_Cortex/duration_list_flags/cortex->mimir === RUN TestConvert_Cortex/simple_rename/cortex->mimir === RUN TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_Cortex/simple_rename/cortex->mimir === PAUSE TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir === CONT TestConvert_Cortex/CSV_string_slice === PAUSE TestConvert_Cortex/ingester_ring_config/cortex->mimir === RUN TestConvert_Cortex/with_non-primitive_flags/cortex->mimir === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir === RUN TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL/cortex->mimir === PAUSE TestConvert_Cortex/with_non-primitive_flags/cortex->mimir === RUN TestConvert_Cortex/CSV_string_slice/cortex->mimir === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir === PAUSE TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned === PAUSE TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir === PAUSE TestConvert_Cortex/CSV_string_slice/cortex->mimir === RUN TestConvert_Cortex/sharding_disabled/cortex->mimir === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir === RUN TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem200 === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem200 === RUN TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem200 === RUN TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem200 === RUN TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem200 === RUN TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem200 === RUN TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir === RUN TestConvert_Cortex/duration_list_YAML/gem170->gem200 === PAUSE TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir === RUN TestConvert_Cortex/simple_rename/gem170->gem200 === RUN TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir === RUN TestConvert_Cortex/with_non-primitive_flags/gem170->gem200 === PAUSE TestConvert_Cortex/sharding_disabled/cortex->mimir === RUN TestConvert_Cortex/CSV_string_slice/gem170->gem200 === RUN TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem200 === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir === RUN TestConvert_Cortex/sharding_disabled/gem170->gem200 === PAUSE TestConvert_Cortex/simple_rename/gem170->gem200 === RUN TestConvert_Cortex/config_flags_have_precedence/cortex->mimir === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_Cortex/config_flags_have_precedence/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem200 === PAUSE TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem200 === PAUSE TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem200 === PAUSE TestConvert_Cortex/duration_list_YAML/gem170->gem200 === PAUSE TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem200 === CONT TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem200 === RUN TestConvert_Cortex/ingester_ring_config/gem170->gem200 === CONT TestConvert_Cortex/sharding_with_consul_enabled === CONT TestConvert_Cortex/query_range_cache_params_are_renamed === RUN TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem200 === CONT TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service === CONT TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir === CONT TestConvert_Cortex/config_flags_have_precedence/cortex->mimir === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem200 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir === RUN TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir === CONT TestConvert_Cortex/with_renamed_flags === RUN TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem200 === PAUSE TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem200 === RUN TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir === RUN TestConvert_Cortex/alertmanager_S3_URL/gem170->gem200 === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem200 === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays === RUN TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir === PAUSE TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir === RUN TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_S3_URL/gem170->gem200 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL/cortex->mimir === RUN TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir === CONT TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem200 === PAUSE TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir === RUN TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem200 === RUN TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem200 === PAUSE TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem200 === PAUSE TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem200 === RUN TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem200 === PAUSE TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem200 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem200 === PAUSE TestConvert_Cortex/sharding_disabled/gem170->gem200 === PAUSE TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem200 === CONT TestConvert_Cortex/duration_list_YAML/gem170->gem200 === CONT TestConvert_Cortex/simple_rename/cortex->mimir === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem200 === PAUSE TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem200 === CONT TestConvert_Cortex/CSV_string_slice_with_single_value === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem200 === RUN TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem200 === CONT TestConvert_Cortex/simple_rename/gem170->gem200 === PAUSE TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem200 === CONT TestConvert_Cortex/instance_id_is_preserved === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir === RUN TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem200 === RUN TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir === PAUSE TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem200 === CONT TestConvert_Cortex/ruler.storage_maps_to_ruler_storage === PAUSE TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir === PAUSE TestConvert_Cortex/ingester_ring_config/gem170->gem200 === CONT TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem200 === CONT TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir === RUN TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir === PAUSE TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir === RUN TestConvert_Cortex/duration_list_flags/gem170->gem200 === RUN TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem200 === PAUSE TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem200 === PAUSE TestConvert_Cortex/duration_list_flags/gem170->gem200 === CONT TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir === RUN TestConvert_Cortex/with_renamed_flags/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem200 === PAUSE TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir === RUN TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem200 === RUN TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem200 === PAUSE TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem200 === PAUSE TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem200 === CONT TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem200 === CONT TestConvert_Cortex/duration_list_YAML/cortex->mimir === CONT TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem200 === PAUSE TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem200 === CONT TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir === RUN TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem200 === CONT TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem200 === CONT TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem200 === RUN TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir === PAUSE TestConvert_Cortex/with_non-primitive_flags/gem170->gem200 === RUN TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem200 === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem200 === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir === RUN TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem200 === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir === PAUSE TestConvert_Cortex/with_renamed_flags/cortex->mimir === PAUSE TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem200 === RUN TestConvert_Cortex/instance_id_is_preserved/cortex->mimir === RUN TestConvert_Cortex/with_renamed_flags/gem170->gem200 === PAUSE TestConvert_Cortex/instance_id_is_preserved/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem200 === PAUSE TestConvert_Cortex/with_renamed_flags/gem170->gem200 === PAUSE TestConvert_Cortex/CSV_string_slice/gem170->gem200 === RUN TestConvert_Cortex/instance_id_is_preserved/gem170->gem200 === RUN TestConvert_Cortex/ruler_S3_URL/gem170->gem200 === PAUSE TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem200 === PAUSE TestConvert_Cortex/instance_id_is_preserved/gem170->gem200 === CONT TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem200 === CONT TestConvert_Cortex/sharding_disabled/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_URL/gem170->gem200 === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem200 === CONT TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem200 === CONT TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir === CONT TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem200 === PAUSE TestConvert_Cortex/ruler_S3_URL/gem170->gem200 === CONT TestConvert_Cortex/sharding_disabled/gem170->gem200 === CONT TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem200 === CONT TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem200 === CONT TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem200 === CONT TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir === CONT TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem200 === CONT TestConvert_Cortex/ingester_ring_config/cortex->mimir === CONT TestConvert_Cortex/ingester_ring_config/gem170->gem200 === CONT TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir === CONT TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem200 === CONT TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem200 === CONT TestConvert_Cortex/duration_list_flags/cortex->mimir === CONT TestConvert_Cortex/duration_list_flags/gem170->gem200 === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem200 === CONT TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir === CONT TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem200 === CONT TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir === CONT TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir === CONT TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem200 === CONT TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem200 === CONT TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem200 === CONT TestConvert_Cortex/with_non-primitive_flags/cortex->mimir === CONT TestConvert_Cortex/with_non-primitive_flags/gem170->gem200 === CONT TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir === CONT TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem200 === CONT TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir === CONT TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem200 === CONT TestConvert_Cortex/with_renamed_flags/cortex->mimir === CONT TestConvert_Cortex/with_renamed_flags/gem170->gem200 === CONT TestConvert_Cortex/CSV_string_slice/cortex->mimir === CONT TestConvert_Cortex/CSV_string_slice/gem170->gem200 === CONT TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir === CONT TestConvert_Cortex/instance_id_is_preserved/cortex->mimir === CONT TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem200 === CONT TestConvert_Cortex/instance_id_is_preserved/gem170->gem200 === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem200 === CONT TestConvert_Cortex/ruler_S3_URL/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL/gem170->gem200 --- PASS: TestConvert_Cortex (0.00s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true (0.01s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir (0.20s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default (0.01s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir (0.19s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false (0.01s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir (0.19s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false (0.01s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir (0.19s) --- PASS: TestConvert_Cortex/config_flags_have_precedence (0.00s) --- PASS: TestConvert_Cortex/config_flags_have_precedence/cortex->mimir (0.25s) --- PASS: TestConvert_Cortex/simple_rename (0.01s) --- PASS: TestConvert_Cortex/simple_rename/cortex->mimir (0.24s) --- PASS: TestConvert_Cortex/simple_rename/gem170->gem200 (0.29s) --- PASS: TestConvert_Cortex/ruler_S3_SSE_conversion_work (0.01s) --- PASS: TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir (0.28s) --- PASS: TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem200 (0.30s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL (0.01s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir (0.24s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL/gem170->gem200 (0.30s) --- PASS: TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ (0.01s) --- PASS: TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir (0.28s) --- PASS: TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem200 (0.30s) --- PASS: TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service (0.01s) --- PASS: TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir (0.23s) --- PASS: TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem200 (0.31s) --- PASS: TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML (0.01s) --- PASS: TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir (0.29s) --- PASS: TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem200 (0.31s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned (0.00s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir (0.24s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem200 (0.31s) --- PASS: TestConvert_Cortex/alertmanager_S3_SSE_conversion_work (0.01s) --- PASS: TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir (0.24s) --- PASS: TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem200 (0.32s) --- PASS: TestConvert_Cortex/duration_list_YAML (0.01s) --- PASS: TestConvert_Cortex/duration_list_YAML/cortex->mimir (0.28s) --- PASS: TestConvert_Cortex/duration_list_YAML/gem170->gem200 (0.32s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir (0.23s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem200 (0.32s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion (0.01s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir (0.24s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem200 (0.34s) --- PASS: TestConvert_Cortex/sharding_disabled (0.00s) --- PASS: TestConvert_Cortex/sharding_disabled/cortex->mimir (0.29s) --- PASS: TestConvert_Cortex/sharding_disabled/gem170->gem200 (0.36s) --- PASS: TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values (0.01s) --- PASS: TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir (0.20s) --- PASS: TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem200 (0.20s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 (0.01s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir (0.25s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem200 (0.22s) --- PASS: TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true (0.00s) --- PASS: TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir (0.27s) --- PASS: TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem200 (0.47s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 (0.01s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir (0.25s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem200 (0.25s) --- PASS: TestConvert_Cortex/ingester_ring_config (0.01s) --- PASS: TestConvert_Cortex/ingester_ring_config/cortex->mimir (0.17s) --- PASS: TestConvert_Cortex/ingester_ring_config/gem170->gem200 (0.23s) --- PASS: TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage (0.01s) --- PASS: TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir (0.17s) --- PASS: TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem200 (0.25s) --- PASS: TestConvert_Cortex/sharding_with_consul_enabled (0.00s) --- PASS: TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir (0.24s) --- PASS: TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem200 (0.27s) --- PASS: TestConvert_Cortex/duration_list_flags (0.01s) --- PASS: TestConvert_Cortex/duration_list_flags/cortex->mimir (0.24s) --- PASS: TestConvert_Cortex/duration_list_flags/gem170->gem200 (0.24s) --- PASS: TestConvert_Cortex/ruler.storage_maps_to_ruler_storage (0.00s) --- PASS: TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir (0.23s) --- PASS: TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem200 (0.28s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten (0.01s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir (0.14s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem200 (0.22s) --- PASS: TestConvert_Cortex/with_non-primitive_flags (0.01s) --- PASS: TestConvert_Cortex/with_non-primitive_flags/cortex->mimir (0.19s) --- PASS: TestConvert_Cortex/with_non-primitive_flags/gem170->gem200 (0.22s) --- PASS: TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service (0.00s) --- PASS: TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir (0.23s) --- PASS: TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem200 (0.25s) --- PASS: TestConvert_Cortex/query_range_cache_params_are_renamed (0.00s) --- PASS: TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir (0.21s) --- PASS: TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem200 (0.24s) --- PASS: TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage (0.01s) --- PASS: TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir (0.23s) --- PASS: TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem200 (0.25s) --- PASS: TestConvert_Cortex/CSV_string_slice_with_single_value (0.00s) --- PASS: TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir (0.17s) --- PASS: TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem200 (0.20s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 (0.01s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir (0.23s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem200 (0.27s) --- PASS: TestConvert_Cortex/with_renamed_flags (0.00s) --- PASS: TestConvert_Cortex/with_renamed_flags/cortex->mimir (0.15s) --- PASS: TestConvert_Cortex/with_renamed_flags/gem170->gem200 (0.16s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion_with_flags (0.01s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir (0.20s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem200 (0.24s) --- PASS: TestConvert_Cortex/CSV_string_slice (0.01s) --- PASS: TestConvert_Cortex/CSV_string_slice/cortex->mimir (0.16s) --- PASS: TestConvert_Cortex/CSV_string_slice/gem170->gem200 (0.16s) --- PASS: TestConvert_Cortex/instance_id_is_preserved (0.00s) --- PASS: TestConvert_Cortex/instance_id_is_preserved/cortex->mimir (0.13s) --- PASS: TestConvert_Cortex/instance_id_is_preserved/gem170->gem200 (0.14s) --- PASS: TestConvert_Cortex/ruler_S3_URL (0.01s) --- PASS: TestConvert_Cortex/ruler_S3_URL/cortex->mimir (0.11s) --- PASS: TestConvert_Cortex/ruler_S3_URL/gem170->gem200 (0.13s) --- PASS: TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped (0.01s) --- PASS: TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir (0.14s) --- PASS: TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem200 (0.17s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays (0.00s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir (0.14s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem200 (0.14s) === RUN TestConvert_GEM === RUN TestConvert_GEM/proxy_targets_get_translated === PAUSE TestConvert_GEM/proxy_targets_get_translated === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/instance_id_is_preserved === PAUSE TestConvert_GEM/instance_id_is_preserved === CONT TestConvert_GEM/proxy_targets_get_translated === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === CONT TestConvert_GEM/instance_id_is_preserved === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem200 === RUN TestConvert_GEM/instance_id_is_preserved/gem170->gem200 === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem200 === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem200 === PAUSE TestConvert_GEM/instance_id_is_preserved/gem170->gem200 === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem200 === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem200 === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem200 === RUN TestConvert_GEM/proxy_targets_get_translated/gem170->gem200 === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem200 === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem200 === CONT TestConvert_GEM/instance_id_is_preserved/gem170->gem200 === PAUSE TestConvert_GEM/proxy_targets_get_translated/gem170->gem200 === CONT TestConvert_GEM/proxy_targets_get_translated/gem170->gem200 === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem200 === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem200 === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem200 === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem200 --- PASS: TestConvert_GEM (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem200 (0.07s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem200 (0.07s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem200 (0.07s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem200 (0.07s) --- PASS: TestConvert_GEM/instance_id_is_preserved (0.00s) --- PASS: TestConvert_GEM/instance_id_is_preserved/gem170->gem200 (0.09s) --- PASS: TestConvert_GEM/proxy_targets_get_translated (0.00s) --- PASS: TestConvert_GEM/proxy_targets_get_translated/gem170->gem200 (0.09s) === RUN TestConvert_InvalidConfigs === RUN TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory === RUN TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets === CONT TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory === CONT TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets === RUN TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir === RUN TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir === RUN TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem200 === RUN TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem200 === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem200 === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem200 === CONT TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir === CONT TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem200 === CONT TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir === CONT TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem200 --- PASS: TestConvert_InvalidConfigs (0.00s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory (0.00s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir (0.02s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem200 (0.02s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets (0.00s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem200 (0.02s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir (0.02s) === RUN TestReportDeletedFlags === RUN TestReportDeletedFlags/no_unsupported_options === RUN TestReportDeletedFlags/unsupported_config_option === RUN TestReportDeletedFlags/unsupported_CLI_flag === RUN TestReportDeletedFlags/unsupported_config_options_and_flags === RUN TestReportDeletedFlags/flags_without_YAML_equivalents --- PASS: TestReportDeletedFlags (0.04s) --- PASS: TestReportDeletedFlags/no_unsupported_options (0.01s) --- PASS: TestReportDeletedFlags/unsupported_config_option (0.01s) --- PASS: TestReportDeletedFlags/unsupported_CLI_flag (0.01s) --- PASS: TestReportDeletedFlags/unsupported_config_options_and_flags (0.01s) --- PASS: TestReportDeletedFlags/flags_without_YAML_equivalents (0.01s) === RUN TestChangedCortexDefaults === RUN TestChangedCortexDefaults/cortex->mimir === PAUSE TestChangedCortexDefaults/cortex->mimir === CONT TestChangedCortexDefaults/cortex->mimir --- PASS: TestChangedCortexDefaults (0.03s) --- PASS: TestChangedCortexDefaults/cortex->mimir (0.10s) === RUN TestChangedGEMDefaults === RUN TestChangedGEMDefaults/gem170->gem200 === PAUSE TestChangedGEMDefaults/gem170->gem200 === CONT TestChangedGEMDefaults/gem170->gem200 --- PASS: TestChangedGEMDefaults (0.05s) --- PASS: TestChangedGEMDefaults/gem170->gem200 (0.14s) === RUN TestConvert_UseNewDefaults === RUN TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true === PAUSE TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true === CONT TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir === RUN TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem200 === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem200 === RUN TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem200 === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem200 === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem200 === CONT TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir === CONT TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem200 === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem200 === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem200 === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem200 --- PASS: TestConvert_UseNewDefaults (0.00s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true (0.00s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir (0.07s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem200 (0.09s) --- PASS: TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true (0.00s) --- PASS: TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir (0.07s) --- PASS: TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem200 (0.09s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false (0.00s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir (0.08s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem200 (0.09s) === RUN TestConvert_NotInYAMLIsNotPrinted === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem200 === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem200 === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem200 === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem200 === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem200 === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem200 === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem200 === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem200 === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem200 === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem200 === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem200 === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem200 --- PASS: TestConvert_NotInYAMLIsNotPrinted (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir (0.06s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem200 (0.06s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem200 (0.06s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir (0.06s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir (0.06s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem200 (0.08s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir (0.06s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem200 (0.09s) === RUN TestConvert_PassingOnlyYAMLReturnsOnlyYAML === RUN TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir === PAUSE TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir === RUN TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem200 === PAUSE TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem200 === CONT TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir === CONT TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem200 --- PASS: TestConvert_PassingOnlyYAMLReturnsOnlyYAML (0.00s) --- PASS: TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir (0.05s) --- PASS: TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem200 (0.06s) === RUN TestConvert_PassingOnlyFlagsReturnsOnlyFlags === RUN TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir === PAUSE TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir === RUN TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem200 === PAUSE TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem200 === CONT TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir === CONT TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem200 --- PASS: TestConvert_PassingOnlyFlagsReturnsOnlyFlags (0.00s) --- PASS: TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir (0.05s) --- PASS: TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem200 (0.09s) === RUN TestInspectedEntry_SetThenGet === RUN TestInspectedEntry_SetThenGet/a_simple_field === RUN TestInspectedEntry_SetThenGet/a_field_within_a_struct === RUN TestInspectedEntry_SetThenGet/fails_with_a_non-existent_field === RUN TestInspectedEntry_SetThenGet/a_field_within_an_inlined_struct --- PASS: TestInspectedEntry_SetThenGet (0.01s) --- PASS: TestInspectedEntry_SetThenGet/a_simple_field (0.00s) --- PASS: TestInspectedEntry_SetThenGet/a_field_within_a_struct (0.00s) --- PASS: TestInspectedEntry_SetThenGet/fails_with_a_non-existent_field (0.00s) --- PASS: TestInspectedEntry_SetThenGet/a_field_within_an_inlined_struct (0.00s) === RUN TestInspectedEntry_Walk === RUN TestInspectedEntry_Walk/no_recursion === RUN TestInspectedEntry_Walk/with_an_inlined_field === RUN TestInspectedEntry_Walk/with_a_skipped_struct === RUN TestInspectedEntry_Walk/with_a_skipped_field --- PASS: TestInspectedEntry_Walk (0.00s) --- PASS: TestInspectedEntry_Walk/no_recursion (0.00s) --- PASS: TestInspectedEntry_Walk/with_an_inlined_field (0.00s) --- PASS: TestInspectedEntry_Walk/with_a_skipped_struct (0.00s) --- PASS: TestInspectedEntry_Walk/with_a_skipped_field (0.00s) === RUN TestInspectedEntry_Delete === RUN TestInspectedEntry_Delete/deletes_a_path === RUN TestInspectedEntry_Delete/fails_to_delete_a_non-existent_path === RUN TestInspectedEntry_Delete/cleans_up_empty_fields === RUN TestInspectedEntry_Delete/deletes_subtree --- PASS: TestInspectedEntry_Delete (0.00s) --- PASS: TestInspectedEntry_Delete/deletes_a_path (0.00s) --- PASS: TestInspectedEntry_Delete/fails_to_delete_a_non-existent_path (0.00s) --- PASS: TestInspectedEntry_Delete/cleans_up_empty_fields (0.00s) --- PASS: TestInspectedEntry_Delete/deletes_subtree (0.00s) === RUN TestInspectedConfig_MarshalThenUnmarshalRetainsTypeInformation --- PASS: TestInspectedConfig_MarshalThenUnmarshalRetainsTypeInformation (0.07s) === RUN TestInspectedEntry_MarshalYAML --- PASS: TestInspectedEntry_MarshalYAML (0.03s) === RUN TestInspectConfig_HasDefaultValues --- PASS: TestInspectConfig_HasDefaultValues (0.03s) === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/int === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/[]string === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/duration === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/bool === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/float === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/string === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/time === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/url --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/int (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/[]string (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/duration (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/bool (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/float (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/string (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/time (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/url (0.00s) === RUN TestDecodeDurationInVariousFormats === RUN TestDecodeDurationInVariousFormats/model.Duration === RUN TestDecodeDurationInVariousFormats/number === RUN TestDecodeDurationInVariousFormats/time.Duration --- PASS: TestDecodeDurationInVariousFormats (0.09s) --- PASS: TestDecodeDurationInVariousFormats/model.Duration (0.03s) --- PASS: TestDecodeDurationInVariousFormats/number (0.03s) --- PASS: TestDecodeDurationInVariousFormats/time.Duration (0.03s) PASS ok github.com/grafana/mimir/pkg/mimirtool/config 2.958s === RUN TestPrintRuleSet === RUN TestPrintRuleSet/prints_colorless_json === RUN TestPrintRuleSet/prints_colorful_json === RUN TestPrintRuleSet/prints_colorless_yaml === RUN TestPrintRuleSet/prints_colorful_yaml === RUN TestPrintRuleSet/defaults_to_tabwriter --- PASS: TestPrintRuleSet (0.09s) --- PASS: TestPrintRuleSet/prints_colorless_json (0.01s) --- PASS: TestPrintRuleSet/prints_colorful_json (0.00s) --- PASS: TestPrintRuleSet/prints_colorless_yaml (0.01s) --- PASS: TestPrintRuleSet/prints_colorful_yaml (0.00s) --- PASS: TestPrintRuleSet/defaults_to_tabwriter (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/printer 0.891s === RUN Test_rulesEqual === RUN Test_rulesEqual/rule_node_identical === RUN Test_rulesEqual/rule_node_diff === RUN Test_rulesEqual/rule_node_annotations_diff === RUN Test_rulesEqual/rule_node_annotations_nil_diff === RUN Test_rulesEqual/rule_node_yaml_diff --- PASS: Test_rulesEqual (0.01s) --- PASS: Test_rulesEqual/rule_node_identical (0.00s) --- PASS: Test_rulesEqual/rule_node_diff (0.00s) --- PASS: Test_rulesEqual/rule_node_annotations_diff (0.00s) --- PASS: Test_rulesEqual/rule_node_annotations_nil_diff (0.00s) --- PASS: Test_rulesEqual/rule_node_yaml_diff (0.00s) === RUN TestCompareGroups === RUN TestCompareGroups/identical_configs === RUN TestCompareGroups/differently_ordered_source_tenants_(should_still_be_equivalent) === RUN TestCompareGroups/different_rule_length === RUN TestCompareGroups/identical_rw_configs === RUN TestCompareGroups/different_rw_config_lengths === RUN TestCompareGroups/different_rw_configs === RUN TestCompareGroups/different_source_tenants === RUN TestCompareGroups/repeated_subset_of_source_tenants === RUN TestCompareGroups/repeated_single_tenant_(tenants_should_be_deduplicated) --- PASS: TestCompareGroups (0.00s) --- PASS: TestCompareGroups/identical_configs (0.00s) --- PASS: TestCompareGroups/differently_ordered_source_tenants_(should_still_be_equivalent) (0.00s) --- PASS: TestCompareGroups/different_rule_length (0.00s) --- PASS: TestCompareGroups/identical_rw_configs (0.00s) --- PASS: TestCompareGroups/different_rw_config_lengths (0.00s) --- PASS: TestCompareGroups/different_rw_configs (0.00s) --- PASS: TestCompareGroups/different_source_tenants (0.00s) --- PASS: TestCompareGroups/repeated_subset_of_source_tenants (0.00s) --- PASS: TestCompareGroups/repeated_single_tenant_(tenants_should_be_deduplicated) (0.00s) === RUN TestParseFiles === RUN TestParseFiles/basic_file === RUN TestParseFiles/file_namespace_overlap time="2022-08-24T23:19:13+02:00" level=error msg="repeated namespace attempted to be loaded" file=testdata/basic_namespace_repeated.yaml namespace=example_namespace === RUN TestParseFiles/multiple_namespace_file === RUN TestParseFiles/federated_rule_groups --- PASS: TestParseFiles (0.04s) --- PASS: TestParseFiles/basic_file (0.03s) --- PASS: TestParseFiles/file_namespace_overlap (0.01s) --- PASS: TestParseFiles/multiple_namespace_file (0.00s) --- PASS: TestParseFiles/federated_rule_groups (0.00s) === RUN TestAggregateBy === RUN TestAggregateBy/with_no_rules === RUN TestAggregateBy/no_modification === RUN TestAggregateBy/no_change_in_the_query_but_lints_with_'without'_in_the_aggregation === RUN TestAggregateBy/with_an_aggregation_modification === RUN TestAggregateBy/with_'count'_as_the_aggregation === RUN TestAggregateBy/with_vector_matching_in_binary_operations === RUN TestAggregateBy/with_a_query_skipped --- PASS: TestAggregateBy (0.02s) --- PASS: TestAggregateBy/with_no_rules (0.00s) --- PASS: TestAggregateBy/no_modification (0.00s) --- PASS: TestAggregateBy/no_change_in_the_query_but_lints_with_'without'_in_the_aggregation (0.01s) --- PASS: TestAggregateBy/with_an_aggregation_modification (0.00s) --- PASS: TestAggregateBy/with_'count'_as_the_aggregation (0.00s) --- PASS: TestAggregateBy/with_vector_matching_in_binary_operations (0.00s) --- PASS: TestAggregateBy/with_a_query_skipped (0.00s) === RUN TestLintExpressions === RUN TestLintExpressions/it_lints_simple_expressions === RUN TestLintExpressions/it_lints_aggregations_expressions === RUN TestLintExpressions/with_no_opinion === RUN TestLintExpressions/with_a_complex_expression === RUN TestLintExpressions/with_an_invalid_expression --- PASS: TestLintExpressions (0.01s) --- PASS: TestLintExpressions/it_lints_simple_expressions (0.00s) --- PASS: TestLintExpressions/it_lints_aggregations_expressions (0.00s) --- PASS: TestLintExpressions/with_no_opinion (0.00s) --- PASS: TestLintExpressions/with_a_complex_expression (0.00s) --- PASS: TestLintExpressions/with_an_invalid_expression (0.00s) === RUN TestCheckRecordingRules === RUN TestCheckRecordingRules/follows_rule_name_conventions === RUN TestCheckRecordingRules/doesn't_follow_rule_name_conventions time="2022-08-24T23:19:13+02:00" level=error msg="bad recording rule name" error="recording rule name does not match level:metric:operation format, must contain at least one colon" file= rule=level_metric_operation ruleGroup= === RUN TestCheckRecordingRules/almost_follows_rule_name_conventions time="2022-08-24T23:19:13+02:00" level=error msg="bad recording rule name" error="recording rule name does not match level:metric:operation format, must contain at least one colon" file= rule="level:metric_operation" ruleGroup= === RUN TestCheckRecordingRules/almost_follows_rule_name_conventions#01 === RUN TestCheckRecordingRules/follows_rule_name_conventions_extra --- PASS: TestCheckRecordingRules (0.00s) --- PASS: TestCheckRecordingRules/follows_rule_name_conventions (0.00s) --- PASS: TestCheckRecordingRules/doesn't_follow_rule_name_conventions (0.00s) --- PASS: TestCheckRecordingRules/almost_follows_rule_name_conventions (0.00s) --- PASS: TestCheckRecordingRules/almost_follows_rule_name_conventions#01 (0.00s) --- PASS: TestCheckRecordingRules/follows_rule_name_conventions_extra (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/rules 0.771s ? github.com/grafana/mimir/pkg/mimirtool/rules/rwrulefmt [no test files] ? github.com/grafana/mimir/pkg/mimirtool/version [no test files] === RUN TestDeleteTenant --- PASS: TestDeleteTenant (0.00s) === RUN TestDeleteTenantStatus === RUN TestDeleteTenantStatus/empty === RUN TestDeleteTenantStatus/no_user_objects === RUN TestDeleteTenantStatus/non-block_files === RUN TestDeleteTenantStatus/block_files --- PASS: TestDeleteTenantStatus (0.00s) --- PASS: TestDeleteTenantStatus/empty (0.00s) --- PASS: TestDeleteTenantStatus/no_user_objects (0.00s) --- PASS: TestDeleteTenantStatus/non-block_files (0.00s) --- PASS: TestDeleteTenantStatus/block_files (0.00s) PASS ok github.com/grafana/mimir/pkg/purger 0.549s === RUN TestBlockQuerierSeries === PAUSE TestBlockQuerierSeries === RUN TestBlockQuerierSeriesSet === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() --- PASS: TestBlockQuerierSeriesSet (0.00s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() (0.95s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() (1.00s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() (1.01s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() (1.02s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() (1.03s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() (1.03s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() (1.05s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() (1.06s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() (1.06s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() (1.61s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() (1.79s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() (1.80s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() (3.05s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() (3.16s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() (3.33s) === RUN TestBlocksConsistencyChecker_Check === RUN TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_multiple_store-gateway === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_more_blocks_than_expected === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected,_but_the_missing_block_has_been_recently_uploaded === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_recently_marked_for_deletion === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_marked_for_deletion_long_time_ago === RUN TestBlocksConsistencyChecker_Check/no_known_blocks === RUN TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_a_single_store-gateway --- PASS: TestBlocksConsistencyChecker_Check (0.01s) --- PASS: TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_multiple_store-gateway (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_more_blocks_than_expected (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected,_but_the_missing_block_has_been_recently_uploaded (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_recently_marked_for_deletion (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_marked_for_deletion_long_time_ago (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/no_known_blocks (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_a_single_store-gateway (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_within_a_single_block === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_within_multiple_blocks === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block === RUN TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low === RUN TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high === RUN TestBucketIndexBlocksFinder_GetBlocks/matching_all_blocks --- PASS: TestBucketIndexBlocksFinder_GetBlocks (0.02s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT (0.01s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_within_a_single_block (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_within_multiple_blocks (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/matching_all_blocks (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks_BucketIndexDoesNotExist --- PASS: TestBucketIndexBlocksFinder_GetBlocks_BucketIndexDoesNotExist (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsCorrupted --- PASS: TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsCorrupted (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsTooOld --- PASS: TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsTooOld (0.00s) === RUN TestBlocksFinderBucketIndexErrMsgs === RUN TestBlocksFinderBucketIndexErrMsgs/newBucketIndexTooOldError --- PASS: TestBlocksFinderBucketIndexErrMsgs (0.00s) --- PASS: TestBlocksFinderBucketIndexErrMsgs/newBucketIndexTooOldError (0.00s) === RUN TestBucketScanBlocksFinder_InitialScan --- PASS: TestBucketScanBlocksFinder_InitialScan (0.04s) === RUN TestBucketScanBlocksFinder_InitialScanFailure --- PASS: TestBucketScanBlocksFinder_InitialScanFailure (3.98s) === RUN TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyTenants level=debug user=1 component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info user=1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.002872514s duration_ms=1002 cached=0 returned=0 partial=0 level=error msg="unable to run the initial blocks scan" err="context canceled" --- PASS: TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyTenants (1.01s) === RUN TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyBlocks level=error msg="unable to run the initial blocks scan" err="context canceled" --- PASS: TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyBlocks (1.00s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsNewUser --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsNewUser (0.01s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsNewBlock --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsNewBlock (0.01s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsBlockMarkedForDeletion --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsBlockMarkedForDeletion (0.00s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsDeletedBlock --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsDeletedBlock (0.01s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsDeletedUser --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsDeletedUser (0.00s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsUserWhichWasPreviouslyDeleted --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsUserWhichWasPreviouslyDeleted (0.01s) === RUN TestBucketScanBlocksFinder_GetBlocks === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_within_a_single_block === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_within_multiple_blocks === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block === RUN TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low === RUN TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high === RUN TestBucketScanBlocksFinder_GetBlocks/matching_all_blocks --- PASS: TestBucketScanBlocksFinder_GetBlocks (0.01s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_within_a_single_block (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_within_multiple_blocks (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/matching_all_blocks (0.00s) === RUN TestBlocksStoreQuerier_Select === RUN TestBlocksStoreQuerier_Select/blocks_with_non-matching_shard_are_filtered_out === RUN TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(single_returned_series) === RUN TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts_-_global === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt_-_global_limit === RUN TestBlocksStoreQuerier_Select/max_chunk_bytes_per_query_limit_hit_while_fetching_chunks === RUN TestBlocksStoreQuerier_Select/all_blocks_are_queried_if_shards_don't_match === RUN TestBlocksStoreQuerier_Select/error_while_finding_blocks_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) === RUN TestBlocksStoreQuerier_Select/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_greater_then_the_number_of_chunks_fetched === RUN TestBlocksStoreQuerier_Select/max_series_per_query_limit_hit_while_fetching_chunks === RUN TestBlocksStoreQuerier_Select/error_while_getting_clients_to_query_the_store-gateway === RUN TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(multiple_returned_series) === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Select/no_block_in_the_storage_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series_(single_returned_series) === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts --- PASS: TestBlocksStoreQuerier_Select (0.79s) --- PASS: TestBlocksStoreQuerier_Select/blocks_with_non-matching_shard_are_filtered_out (0.05s) --- PASS: TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(single_returned_series) (0.04s) --- PASS: TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) (0.04s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts_-_global (0.07s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts (0.10s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt (0.02s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt_-_global_limit (0.02s) --- PASS: TestBlocksStoreQuerier_Select/max_chunk_bytes_per_query_limit_hit_while_fetching_chunks (0.01s) --- PASS: TestBlocksStoreQuerier_Select/all_blocks_are_queried_if_shards_don't_match (0.04s) --- PASS: TestBlocksStoreQuerier_Select/error_while_finding_blocks_matching_the_query_time_range (0.00s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) (0.04s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) (0.04s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return (0.03s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_greater_then_the_number_of_chunks_fetched (0.04s) --- PASS: TestBlocksStoreQuerier_Select/max_series_per_query_limit_hit_while_fetching_chunks (0.02s) --- PASS: TestBlocksStoreQuerier_Select/error_while_getting_clients_to_query_the_store-gateway (0.00s) --- PASS: TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(multiple_returned_series) (0.05s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) (0.03s) --- PASS: TestBlocksStoreQuerier_Select/no_block_in_the_storage_matching_the_query_time_range (0.00s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series_(single_returned_series) (0.03s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts (0.07s) === RUN TestBlocksStoreQuerier_Labels === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return === RUN TestBlocksStoreQuerier_Labels/no_block_in_the_storage_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_holds_the_required_blocks === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series === RUN TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts === RUN TestBlocksStoreQuerier_Labels/error_while_finding_blocks_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Labels/error_while_getting_clients_to_query_the_store-gateway === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) --- PASS: TestBlocksStoreQuerier_Labels (0.04s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/no_block_in_the_storage_matching_the_query_time_range (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_holds_the_required_blocks (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/error_while_finding_blocks_matching_the_query_time_range (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/error_while_getting_clients_to_query_the_store-gateway (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) (0.00s) === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_disabled === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_enabled_but_query_max_time_is_older === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_manipulate_query_time_range_if_queryStoreAfter_is_enabled_and_query_max_time_is_recent === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_skip_the_query_if_the_query_min_time_is_more_recent_than_queryStoreAfter --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_disabled (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_enabled_but_query_max_time_is_older (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_manipulate_query_time_range_if_queryStoreAfter_is_enabled_and_query_max_time_is_recent (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_skip_the_query_if_the_query_min_time_is_more_recent_than_queryStoreAfter (0.00s) === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_disabled === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_but_query_fits_within === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange/should_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_and_query_overlaps --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange (0.00s) --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_disabled (0.00s) --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_but_query_fits_within (0.00s) --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange/should_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_and_query_overlaps (0.00s) === RUN TestBlocksStoreQuerier_PromQLExecution === RUN TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_chunks_in_the_right_order === RUN TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_out-of-order_chunks --- PASS: TestBlocksStoreQuerier_PromQLExecution (0.10s) --- PASS: TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_chunks_in_the_right_order (0.06s) --- PASS: TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_out-of-order_chunks (0.05s) === RUN TestCanBlockWithCompactorShardIdContainQueryShard --- PASS: TestCanBlockWithCompactorShardIdContainQueryShard (2.52s) === RUN TestFilterBlocksByShard === RUN TestFilterBlocksByShard/less_query_shards_than_compactor_shards_1 === RUN TestFilterBlocksByShard/less_query_shards_than_compactor_shards_2 === RUN TestFilterBlocksByShard/double_the_equal_number_of_query_shards_2 === RUN TestFilterBlocksByShard/non-divisible_number_of_shards_(less_than_compactor_shards) === RUN TestFilterBlocksByShard/non-divisible_number_of_shards_(higher_than_compactor_shards) === RUN TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2_(2nd_test) === RUN TestFilterBlocksByShard/equal_number_of_query_shards === RUN TestFilterBlocksByShard/double_the_equal_number_of_query_shards_1 === RUN TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2 --- PASS: TestFilterBlocksByShard (0.00s) --- PASS: TestFilterBlocksByShard/less_query_shards_than_compactor_shards_1 (0.00s) --- PASS: TestFilterBlocksByShard/less_query_shards_than_compactor_shards_2 (0.00s) --- PASS: TestFilterBlocksByShard/double_the_equal_number_of_query_shards_2 (0.00s) --- PASS: TestFilterBlocksByShard/non-divisible_number_of_shards_(less_than_compactor_shards) (0.00s) --- PASS: TestFilterBlocksByShard/non-divisible_number_of_shards_(higher_than_compactor_shards) (0.00s) --- PASS: TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2_(2nd_test) (0.00s) --- PASS: TestFilterBlocksByShard/equal_number_of_query_shards (0.00s) --- PASS: TestFilterBlocksByShard/double_the_equal_number_of_query_shards_1 (0.00s) --- PASS: TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2 (0.00s) === RUN TestBlocksStoreQueryableErrMsgs === RUN TestBlocksStoreQueryableErrMsgs/newStoreConsistencyCheckFailedError --- PASS: TestBlocksStoreQueryableErrMsgs (0.00s) --- PASS: TestBlocksStoreQueryableErrMsgs/newStoreConsistencyCheckFailedError (0.00s) === RUN TestBlocksStoreReplicationSet_GetClientsFor === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded --- PASS: TestBlocksStoreReplicationSet_GetClientsFor (0.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 (1.03s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 (2.02s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available (2.01s) === RUN TestBlocksStoreReplicationSet_GetClientsFor_ShouldSupportRandomLoadBalancingStrategy --- PASS: TestBlocksStoreReplicationSet_GetClientsFor_ShouldSupportRandomLoadBalancingStrategy (2.00s) === RUN TestLabelNamesCardinalityHandler --- PASS: TestLabelNamesCardinalityHandler (0.00s) === RUN TestLabelNamesCardinalityHandler_MatchersTest === RUN TestLabelNamesCardinalityHandler_MatchersTest/expected_selector_to_be_parsed === RUN TestLabelNamesCardinalityHandler_MatchersTest/expected_no_error_if_selector_is_missed === RUN TestLabelNamesCardinalityHandler_MatchersTest/selector_with_metric_name_to_be_parse === RUN TestLabelNamesCardinalityHandler_MatchersTest/selector_with_two_matchers_to_be_parse --- PASS: TestLabelNamesCardinalityHandler_MatchersTest (0.00s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/expected_selector_to_be_parsed (0.00s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/expected_no_error_if_selector_is_missed (0.00s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/selector_with_metric_name_to_be_parse (0.00s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/selector_with_two_matchers_to_be_parse (0.00s) === RUN TestLabelNamesCardinalityHandler_LimitTest === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_10_labels_in_response_if_limit_param_is_10 === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_default_limit_20_to_be_applied_if_limit_param_is_not_defined === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_all_items_in_response_if_limit_param_is_greater_than_count_of_items === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_empty_items_list_in_response_if_limit_param_is_0 --- PASS: TestLabelNamesCardinalityHandler_LimitTest (0.00s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_10_labels_in_response_if_limit_param_is_10 (0.00s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_default_limit_20_to_be_applied_if_limit_param_is_not_defined (0.00s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_all_items_in_response_if_limit_param_is_greater_than_count_of_items (0.00s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_empty_items_list_in_response_if_limit_param_is_0 (0.00s) === RUN TestLabelNamesCardinalityHandler_DistributorError === RUN TestLabelNamesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor === RUN TestLabelNamesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error --- PASS: TestLabelNamesCardinalityHandler_DistributorError (0.01s) --- PASS: TestLabelNamesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor (0.01s) --- PASS: TestLabelNamesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error (0.00s) === RUN TestLabelNamesCardinalityHandler_NegativeTests === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative#01 === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_tenantId_is_not_defined === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_multiple_limits_are_sent === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_that_cardinality_analysis_feature_is_disabled --- PASS: TestLabelNamesCardinalityHandler_NegativeTests (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative#01 (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_tenantId_is_not_defined (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_multiple_limits_are_sent (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_that_cardinality_analysis_feature_is_disabled (0.00s) === RUN TestLabelValuesCardinalityHandler_Success === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit --- PASS: TestLabelValuesCardinalityHandler_Success (0.01s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit (0.00s) === RUN TestLabelValuesCardinalityHandler_FeatureFlag === RUN TestLabelValuesCardinalityHandler_FeatureFlag/should_return_an_error_if_the_cardinality_analysis_feature_is_disabled_by_default === RUN TestLabelValuesCardinalityHandler_FeatureFlag/should_succeed_if_the_cardinality_analysis_feature_is_enabled_by_default --- PASS: TestLabelValuesCardinalityHandler_FeatureFlag (0.00s) --- PASS: TestLabelValuesCardinalityHandler_FeatureFlag/should_return_an_error_if_the_cardinality_analysis_feature_is_disabled_by_default (0.00s) --- PASS: TestLabelValuesCardinalityHandler_FeatureFlag/should_succeed_if_the_cardinality_analysis_feature_is_enabled_by_default (0.00s) === RUN TestLabelValuesCardinalityHandler_ParseError === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_no_tenant_id_is_provided === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_ === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_exceeds_the_maximum_limit_parameter === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_empty === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_invalid === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/multiple_selector_params_are_provided === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_not_a_number === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_a_negative_number --- PASS: TestLabelValuesCardinalityHandler_ParseError (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_no_tenant_id_is_provided (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_ (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_exceeds_the_maximum_limit_parameter (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_empty (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_invalid (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/multiple_selector_params_are_provided (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_not_a_number (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_a_negative_number (0.00s) === RUN TestLabelValuesCardinalityHandler_DistributorError === RUN TestLabelValuesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor === RUN TestLabelValuesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error --- PASS: TestLabelValuesCardinalityHandler_DistributorError (0.00s) --- PASS: TestLabelValuesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor (0.00s) --- PASS: TestLabelValuesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error (0.00s) === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_disabled === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_but_query_min_time_is_newer === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_min_time_is_older === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_skip_the_query_if_the_query_max_time_is_older_than_queryIngestersWithin === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_max_time_is_older,_but_the_query_is_for_/series --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_disabled (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_but_query_min_time_is_newer (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_min_time_is_older (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_skip_the_query_if_the_query_max_time_is_older_than_queryIngestersWithin (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_max_time_is_older,_but_the_query_is_for_/series (0.00s) === RUN TestDistributorQueryableFilter --- PASS: TestDistributorQueryableFilter (0.00s) === RUN TestIngesterStreaming --- PASS: TestIngesterStreaming (0.00s) === RUN TestIngesterStreamingMixedResults --- PASS: TestIngesterStreamingMixedResults (0.00s) === RUN TestDistributorQuerier_LabelNames === RUN TestDistributorQuerier_LabelNames/with_matchers === RUN TestDistributorQuerier_LabelNames/with_matchers/queryLabelNamesWithMatchers=true --- PASS: TestDistributorQuerier_LabelNames (0.00s) --- PASS: TestDistributorQuerier_LabelNames/with_matchers (0.00s) --- PASS: TestDistributorQuerier_LabelNames/with_matchers/queryLabelNamesWithMatchers=true (0.00s) === RUN TestDuplicatesSamples --- PASS: TestDuplicatesSamples (0.00s) === RUN TestApiStatusCodes === RUN TestApiStatusCodes/error_from_queryable/0 === RUN TestApiStatusCodes/error_from_querier/0 === RUN TestApiStatusCodes/error_from_seriesset/0 === RUN TestApiStatusCodes/error_from_queryable/1 === RUN TestApiStatusCodes/error_from_querier/1 === RUN TestApiStatusCodes/error_from_seriesset/1 === RUN TestApiStatusCodes/error_from_queryable/2 === RUN TestApiStatusCodes/error_from_querier/2 === RUN TestApiStatusCodes/error_from_seriesset/2 === RUN TestApiStatusCodes/error_from_seriesset/3 === RUN TestApiStatusCodes/error_from_queryable/3 === RUN TestApiStatusCodes/error_from_querier/3 === RUN TestApiStatusCodes/error_from_queryable/4 === RUN TestApiStatusCodes/error_from_querier/4 === RUN TestApiStatusCodes/error_from_seriesset/4 === RUN TestApiStatusCodes/error_from_seriesset/5 === RUN TestApiStatusCodes/error_from_queryable/5 === RUN TestApiStatusCodes/error_from_querier/5 === RUN TestApiStatusCodes/error_from_queryable/6 === RUN TestApiStatusCodes/error_from_querier/6 === RUN TestApiStatusCodes/error_from_seriesset/6 === RUN TestApiStatusCodes/error_from_queryable/7 === RUN TestApiStatusCodes/error_from_querier/7 === RUN TestApiStatusCodes/error_from_seriesset/7 === RUN TestApiStatusCodes/error_from_queryable/8 === RUN TestApiStatusCodes/error_from_querier/8 === RUN TestApiStatusCodes/error_from_seriesset/8 === RUN TestApiStatusCodes/error_from_queryable/9 === RUN TestApiStatusCodes/error_from_querier/9 === RUN TestApiStatusCodes/error_from_seriesset/9 === RUN TestApiStatusCodes/error_from_queryable/10 === RUN TestApiStatusCodes/error_from_querier/10 === RUN TestApiStatusCodes/error_from_seriesset/10 --- PASS: TestApiStatusCodes (0.04s) --- PASS: TestApiStatusCodes/error_from_queryable/0 (0.01s) --- PASS: TestApiStatusCodes/error_from_querier/0 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/0 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/1 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/1 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/1 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/2 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/2 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/2 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/3 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/3 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/3 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/4 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/4 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/4 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/5 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/5 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/5 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/6 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/6 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/6 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/7 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/7 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/7 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/8 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/8 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/8 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/9 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/9 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/9 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/10 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/10 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/10 (0.00s) === RUN TestMetadataHandler_Success --- PASS: TestMetadataHandler_Success (0.00s) === RUN TestMetadataHandler_Error --- PASS: TestMetadataHandler_Error (0.00s) === RUN TestPartitionChunksOutputIsSortedByLabels --- PASS: TestPartitionChunksOutputIsSortedByLabels (0.54s) === RUN TestQuerier === RUN TestQuerier/rate(foo[1m])/iterators=false === RUN TestQuerier/rate(foo[1m])/iterators=true === RUN TestQuerier/foo/iterators=false === RUN TestQuerier/foo/iterators=true === RUN TestQuerier/rate(foo[1m])/iterators=false#01 === RUN TestQuerier/rate(foo[1m])/iterators=true#01 === RUN TestQuerier/foo/iterators=false#01 === RUN TestQuerier/foo/iterators=true#01 --- PASS: TestQuerier (0.21s) --- PASS: TestQuerier/rate(foo[1m])/iterators=false (0.03s) --- PASS: TestQuerier/rate(foo[1m])/iterators=true (0.02s) --- PASS: TestQuerier/foo/iterators=false (0.02s) --- PASS: TestQuerier/foo/iterators=true (0.02s) --- PASS: TestQuerier/rate(foo[1m])/iterators=false#01 (0.01s) --- PASS: TestQuerier/rate(foo[1m])/iterators=true#01 (0.01s) --- PASS: TestQuerier/foo/iterators=false#01 (0.01s) --- PASS: TestQuerier/foo/iterators=true#01 (0.01s) === RUN TestQuerier_QueryableReturnsChunksOutsideQueriedRange --- PASS: TestQuerier_QueryableReturnsChunksOutsideQueriedRange (0.01s) === RUN TestQuerier_QueryIngestersWithinConfig === RUN TestQuerier_QueryIngestersWithinConfig/hit-test1 === RUN TestQuerier_QueryIngestersWithinConfig/hit-test2 === RUN TestQuerier_QueryIngestersWithinConfig/hit-test2#01 === RUN TestQuerier_QueryIngestersWithinConfig/dont-hit-test1 === RUN TestQuerier_QueryIngestersWithinConfig/dont-hit-test2 --- PASS: TestQuerier_QueryIngestersWithinConfig (0.01s) --- PASS: TestQuerier_QueryIngestersWithinConfig/hit-test1 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/hit-test2 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/hit-test2#01 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/dont-hit-test1 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/dont-hit-test2 (0.00s) === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_manipulate_query_if_end_time_is_after_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_far_in_the_future_but_limit_is_disabled === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_in_the_future_but_below_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_skip_executing_a_query_outside_the_allowed_time_range --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_manipulate_query_if_end_time_is_after_the_limit (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_far_in_the_future_but_limit_is_disabled (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_in_the_future_but_below_the_limit (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_skip_executing_a_query_outside_the_allowed_time_range (0.00s) === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_short_time_range_and_rate_time_window_close_to_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_short_time_range_and_rate_time_window_over_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_large_time_range_over_the_limit_and_short_rate_time_window --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_short_time_range_and_rate_time_window_close_to_the_limit (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_short_time_range_and_rate_time_window_over_the_limit (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_large_time_range_over_the_limit_and_short_rate_time_window (0.00s) === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_values --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_values (0.00s) === RUN TestQuerier_MaxLabelsQueryRange === RUN TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit === RUN TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit/series --- PASS: TestQuerier_MaxLabelsQueryRange (0.00s) --- PASS: TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit (0.00s) --- PASS: TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit/series (0.00s) === RUN TestQuerier_QueryStoreAfterConfig === RUN TestQuerier_QueryStoreAfterConfig/hit_only_ingester === RUN TestQuerier_QueryStoreAfterConfig/hit_both === RUN TestQuerier_QueryStoreAfterConfig/hit_only_storage --- PASS: TestQuerier_QueryStoreAfterConfig (0.10s) --- PASS: TestQuerier_QueryStoreAfterConfig/hit_only_ingester (0.03s) --- PASS: TestQuerier_QueryStoreAfterConfig/hit_both (0.03s) --- PASS: TestQuerier_QueryStoreAfterConfig/hit_only_storage (0.03s) === RUN TestUseAlwaysQueryable --- PASS: TestUseAlwaysQueryable (0.00s) === RUN TestUseBeforeTimestamp --- PASS: TestUseBeforeTimestamp (0.00s) === RUN TestStoreQueryable --- PASS: TestStoreQueryable (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_with_default_config === RUN TestConfig_Validate/should_pass_if_'query_store_after'_is_enabled_and_shuffle-sharding_is_disabled === RUN TestConfig_Validate/should_pass_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_<_'query_ingesters_within' === RUN TestConfig_Validate/should_fail_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_>_'query_ingesters_within' --- PASS: TestConfig_Validate (0.00s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestConfig_Validate/should_pass_if_'query_store_after'_is_enabled_and_shuffle-sharding_is_disabled (0.00s) --- PASS: TestConfig_Validate/should_pass_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_<_'query_ingesters_within' (0.00s) --- PASS: TestConfig_Validate/should_fail_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_>_'query_ingesters_within' (0.00s) === RUN TestSampledRemoteRead --- PASS: TestSampledRemoteRead (0.00s) === RUN TestStreamedRemoteRead === RUN TestStreamedRemoteRead/with_120_samples,_we_expect_1_frame_with_1_chunk === RUN TestStreamedRemoteRead/with_121_samples,_we_expect_1_frame_with_2_chunks === RUN TestStreamedRemoteRead/with_241_samples,_we_expect_1_frame_with_2_chunks,_and_1_frame_with_1_chunk_due_to_frame_limit --- PASS: TestStreamedRemoteRead (0.01s) --- PASS: TestStreamedRemoteRead/with_120_samples,_we_expect_1_frame_with_1_chunk (0.00s) --- PASS: TestStreamedRemoteRead/with_121_samples,_we_expect_1_frame_with_2_chunks (0.00s) --- PASS: TestStreamedRemoteRead/with_241_samples,_we_expect_1_frame_with_2_chunks,_and_1_frame_with_1_chunk_due_to_frame_limit (0.00s) === RUN Test_newStoreGatewayClientFactory --- PASS: Test_newStoreGatewayClientFactory (0.06s) === RUN TestTimeSeriesSeriesSet --- PASS: TestTimeSeriesSeriesSet (0.00s) === RUN TestTimeSeriesIterator --- PASS: TestTimeSeriesIterator (0.00s) === CONT TestBlockQuerierSeries === RUN TestBlockQuerierSeries/empty_series === RUN TestBlockQuerierSeries/should_return_series_on_success === RUN TestBlockQuerierSeries/should_return_error_on_failure_while_reading_encoded_chunk_data --- PASS: TestBlockQuerierSeries (0.00s) --- PASS: TestBlockQuerierSeries/empty_series (0.00s) --- PASS: TestBlockQuerierSeries/should_return_series_on_success (0.00s) --- PASS: TestBlockQuerierSeries/should_return_error_on_failure_while_reading_encoded_chunk_data (0.00s) PASS ok github.com/grafana/mimir/pkg/querier 18.620s === RUN TestSeekCorrectlyDealWithSinglePointChunks --- PASS: TestSeekCorrectlyDealWithSinglePointChunks (0.01s) === RUN TestChunkIter --- PASS: TestChunkIter (0.01s) === RUN TestSeek --- PASS: TestSeek (0.00s) === RUN TestMergeIter --- PASS: TestMergeIter (0.02s) === RUN TestMergeHarder --- PASS: TestMergeHarder (1.51s) === RUN TestNonOverlappingIter --- PASS: TestNonOverlappingIter (0.09s) === RUN TestNonOverlappingIterSparse --- PASS: TestNonOverlappingIterSparse (0.01s) === RUN TestStream === RUN TestStream/0 === RUN TestStream/1 === RUN TestStream/2 === RUN TestStream/3 === RUN TestStream/4 --- PASS: TestStream (0.01s) --- PASS: TestStream/0 (0.00s) --- PASS: TestStream/1 (0.00s) --- PASS: TestStream/2 (0.00s) --- PASS: TestStream/3 (0.00s) --- PASS: TestStream/4 (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/batch 1.953s === RUN TestQueryTrackerMaxConcurrency === RUN TestQueryTrackerMaxConcurrency/nil_tracker === RUN TestQueryTrackerMaxConcurrency/non-nil_tracker --- PASS: TestQueryTrackerMaxConcurrency (2.02s) --- PASS: TestQueryTrackerMaxConcurrency/nil_tracker (1.00s) --- PASS: TestQueryTrackerMaxConcurrency/non-nil_tracker (1.00s) === RUN TestQueryTrackerWithNilActivityTrackerInsertDoesntAllocate --- PASS: TestQueryTrackerWithNilActivityTrackerInsertDoesntAllocate (0.00s) === RUN TestActivityDescription --- PASS: TestActivityDescription (0.01s) PASS ok github.com/grafana/mimir/pkg/querier/engine 2.670s === RUN TestChunkMergeIterator === RUN TestChunkMergeIterator/0 === RUN TestChunkMergeIterator/1 === RUN TestChunkMergeIterator/2 === RUN TestChunkMergeIterator/3 --- PASS: TestChunkMergeIterator (0.04s) --- PASS: TestChunkMergeIterator/0 (0.00s) --- PASS: TestChunkMergeIterator/1 (0.00s) --- PASS: TestChunkMergeIterator/2 (0.00s) --- PASS: TestChunkMergeIterator/3 (0.00s) === RUN TestChunkMergeIteratorSeek --- PASS: TestChunkMergeIteratorSeek (0.01s) PASS ok github.com/grafana/mimir/pkg/querier/iterators 0.420s === RUN TestStats_WallTime === RUN TestStats_WallTime/add_and_load_wall_time === RUN TestStats_WallTime/add_and_load_wall_time_nil_receiver --- PASS: TestStats_WallTime (0.01s) --- PASS: TestStats_WallTime/add_and_load_wall_time (0.00s) --- PASS: TestStats_WallTime/add_and_load_wall_time_nil_receiver (0.00s) === RUN TestStats_AddFetchedSeries === RUN TestStats_AddFetchedSeries/add_and_load_series === RUN TestStats_AddFetchedSeries/add_and_load_series_nil_receiver --- PASS: TestStats_AddFetchedSeries (0.00s) --- PASS: TestStats_AddFetchedSeries/add_and_load_series (0.00s) --- PASS: TestStats_AddFetchedSeries/add_and_load_series_nil_receiver (0.00s) === RUN TestStats_AddFetchedChunkBytes === RUN TestStats_AddFetchedChunkBytes/add_and_load_bytes === RUN TestStats_AddFetchedChunkBytes/add_and_load_bytes_nil_receiver --- PASS: TestStats_AddFetchedChunkBytes (0.00s) --- PASS: TestStats_AddFetchedChunkBytes/add_and_load_bytes (0.00s) --- PASS: TestStats_AddFetchedChunkBytes/add_and_load_bytes_nil_receiver (0.00s) === RUN TestStats_AddFetchedChunks === RUN TestStats_AddFetchedChunks/add_and_load_chunks === RUN TestStats_AddFetchedChunks/add_and_load_chunks_nil_receiver --- PASS: TestStats_AddFetchedChunks (0.00s) --- PASS: TestStats_AddFetchedChunks/add_and_load_chunks (0.00s) --- PASS: TestStats_AddFetchedChunks/add_and_load_chunks_nil_receiver (0.00s) === RUN TestStats_AddShardedQueries === RUN TestStats_AddShardedQueries/add_and_load_sharded_queries === RUN TestStats_AddShardedQueries/add_and_load_sharded_queries_nil_receiver --- PASS: TestStats_AddShardedQueries (0.00s) --- PASS: TestStats_AddShardedQueries/add_and_load_sharded_queries (0.00s) --- PASS: TestStats_AddShardedQueries/add_and_load_sharded_queries_nil_receiver (0.00s) === RUN TestStats_Merge === RUN TestStats_Merge/merge_two_stats_objects === RUN TestStats_Merge/merge_two_nil_stats_objects --- PASS: TestStats_Merge (0.00s) --- PASS: TestStats_Merge/merge_two_stats_objects (0.00s) --- PASS: TestStats_Merge/merge_two_nil_stats_objects (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/stats 0.324s === RUN TestMergeExemplarQueryable_ExemplarQuerier === RUN TestMergeExemplarQueryable_ExemplarQuerier/error_getting_tenant_IDs === RUN TestMergeExemplarQueryable_ExemplarQuerier/error_getting_upstream_querier === RUN TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_bypass_single_querier_happy_path === RUN TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_federated_happy_path === RUN TestMergeExemplarQueryable_ExemplarQuerier/multi_tenant_federated_happy_path --- PASS: TestMergeExemplarQueryable_ExemplarQuerier (0.01s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/error_getting_tenant_IDs (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/error_getting_upstream_querier (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_bypass_single_querier_happy_path (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_federated_happy_path (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/multi_tenant_federated_happy_path (0.00s) === RUN TestMergeExemplarQuerier_Select === RUN TestMergeExemplarQuerier_Select/two_tenants_one_filtered === RUN TestMergeExemplarQuerier_Select/two_tenants_no_filtering === RUN TestMergeExemplarQuerier_Select/two_tenants_two_groups_of_matchers_filtering === RUN TestMergeExemplarQuerier_Select/no_matchers_to_filter === RUN TestMergeExemplarQuerier_Select/upstream_error --- PASS: TestMergeExemplarQuerier_Select (0.02s) --- PASS: TestMergeExemplarQuerier_Select/two_tenants_one_filtered (0.01s) --- PASS: TestMergeExemplarQuerier_Select/two_tenants_no_filtering (0.00s) --- PASS: TestMergeExemplarQuerier_Select/two_tenants_two_groups_of_matchers_filtering (0.01s) --- PASS: TestMergeExemplarQuerier_Select/no_matchers_to_filter (0.00s) --- PASS: TestMergeExemplarQuerier_Select/upstream_error (0.00s) === RUN TestMergeQueryable_Querier === RUN TestMergeQueryable_Querier/querying_without_a_tenant_specified_should_error --- PASS: TestMergeQueryable_Querier (0.00s) --- PASS: TestMergeQueryable_Querier/querying_without_a_tenant_specified_should_error (0.00s) === RUN TestMergeQueryable_Select === RUN TestMergeQueryable_Select/three_tenants === RUN TestMergeQueryable_Select/three_tenants/should_return_all_series_when_no_matchers_are_provided === RUN TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_the_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_the_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants/should_return_one_series_for_each_tenant_when_there_is_an_equals_matcher_for_the_host1_instance === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_no_matchers_are_provided === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_with_not-equals_matcher_for_the_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_where_there_are_conflicting_tenant_matchers === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_an_equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_a_regexp_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_when_there_is_a_not-equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label === RUN TestMergeQueryable_Select/three_tenants,_two_with_warnings === RUN TestMergeQueryable_Select/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables === RUN TestMergeQueryable_Select/three_tenants,_one_erroring === RUN TestMergeQueryable_Select/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant --- PASS: TestMergeQueryable_Select (0.02s) --- PASS: TestMergeQueryable_Select/three_tenants (0.01s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_all_series_when_no_matchers_are_provided (0.01s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_the_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_the_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_one_series_for_each_tenant_when_there_is_an_equals_matcher_for_the_host1_instance (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set (0.01s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_with_not-equals_matcher_for_the_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_where_there_are_conflicting_tenant_matchers (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_an_equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_a_regexp_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_when_there_is_a_not-equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_two_with_warnings (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_one_erroring (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant (0.00s) === RUN TestMergeQueryable_LabelNames === RUN TestMergeQueryable_LabelNames/single_tenant === RUN TestMergeQueryable_LabelNames/single_tenant/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed === RUN TestMergeQueryable_LabelNames/single_tenant#01 === RUN TestMergeQueryable_LabelNames/single_tenant#01/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed_with_matchers === RUN TestMergeQueryable_LabelNames/single_tenant_without_bypass === RUN TestMergeQueryable_LabelNames/single_tenant_without_bypass/should_return_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed === RUN TestMergeQueryable_LabelNames/three_tenants === RUN TestMergeQueryable_LabelNames/three_tenants/should_return_the___tenant_id___label_and_all_tenant_team_labels === RUN TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set === RUN TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set/should_return__the___tenant_id___label_and_all_tenant_team_labels,_and_the___original_tenant_id___label === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables === RUN TestMergeQueryable_LabelNames/three_tenants,_one_erroring === RUN TestMergeQueryable_LabelNames/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01/should_propagate_non-tenant_matchers_to_downstream_queriers === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03/should_only_query_tenant-b_and_tenant-c_when_there_is_an_regex_matcher_for_team-b|team-c_tenant === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04/only_tenant-b_is_selected_and_it_already_has_a_defaultTenantLabel_which_is_prepended_with_original__prefix --- PASS: TestMergeQueryable_LabelNames (0.03s) --- PASS: TestMergeQueryable_LabelNames/single_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant#01 (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant#01/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed_with_matchers (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant_without_bypass (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant_without_bypass/should_return_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants/should_return_the___tenant_id___label_and_all_tenant_team_labels (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set/should_return__the___tenant_id___label_and_all_tenant_team_labels,_and_the___original_tenant_id___label (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_one_erroring (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01/should_propagate_non-tenant_matchers_to_downstream_queriers (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03/should_only_query_tenant-b_and_tenant-c_when_there_is_an_regex_matcher_for_team-b|team-c_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04/only_tenant-b_is_selected_and_it_already_has_a_defaultTenantLabel_which_is_prepended_with_original__prefix (0.00s) === RUN TestMergeQueryable_LabelValues === RUN TestMergeQueryable_LabelValues/single_tenant === RUN TestMergeQueryable_LabelValues/single_tenant/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/single_tenant/should_return_no_tenant_values_for_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed === RUN TestMergeQueryable_LabelValues/single_tenant_without_bypass === RUN TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_a_tenant_team_value_for_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed === RUN TestMergeQueryable_LabelValues/three_tenants === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants/should_propagate_non-tenant_matchers_to_downstream_queriers === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_no_values_for_the_instance_label_when_there_are_conflicting_tenant_matchers === RUN TestMergeQueryable_LabelValues/three_tenants/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_all_tenant_team_values_for_the___tenant_id___label_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-b_tenant_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_tenant_values_for___tenant_id___label_name === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_with_matchers === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01 === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01/should_not_return_warnings_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01 === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01/should_not_return_errors_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label --- PASS: TestMergeQueryable_LabelValues (0.01s) --- PASS: TestMergeQueryable_LabelValues/single_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant/should_return_no_tenant_values_for_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant_without_bypass (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_a_tenant_team_value_for_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_propagate_non-tenant_matchers_to_downstream_queriers (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_no_values_for_the_instance_label_when_there_are_conflicting_tenant_matchers (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_all_tenant_team_values_for_the___tenant_id___label_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-b_tenant_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_tenant_values_for___tenant_id___label_name (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_with_matchers (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01 (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01/should_not_return_warnings_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01 (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01/should_not_return_errors_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label (0.00s) === RUN TestSetLabelsRetainExisting --- PASS: TestSetLabelsRetainExisting (0.00s) === RUN TestTracingMergeQueryable --- PASS: TestTracingMergeQueryable (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/tenantfederation 0.434s === RUN TestFrontendProcessor_processQueriesOnSingleStream === RUN TestFrontendProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query === RUN TestFrontendProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled --- PASS: TestFrontendProcessor_processQueriesOnSingleStream (1.02s) --- PASS: TestFrontendProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query (0.01s) --- PASS: TestFrontendProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled (1.01s) === RUN TestRecvFailDoesntCancelProcess --- PASS: TestRecvFailDoesntCancelProcess (0.12s) === RUN TestContextCancelStopsProcess --- PASS: TestContextCancelStopsProcess (0.02s) === RUN TestSchedulerProcessor_processQueriesOnSingleStream === RUN TestSchedulerProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query === RUN TestSchedulerProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream (1.12s) --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query (0.01s) --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled (1.11s) === RUN TestResetConcurrency === RUN TestResetConcurrency/Test_create_at_least_one_processor_per_target_if_max_concurrent_=_0 === RUN TestResetConcurrency/Test_max_concurrent_dividing_with_a_remainder === RUN TestResetConcurrency/Test_max_concurrent_dividing_evenly --- PASS: TestResetConcurrency (0.02s) --- PASS: TestResetConcurrency/Test_create_at_least_one_processor_per_target_if_max_concurrent_=_0 (0.01s) --- PASS: TestResetConcurrency/Test_max_concurrent_dividing_with_a_remainder (0.01s) --- PASS: TestResetConcurrency/Test_max_concurrent_dividing_evenly (0.01s) PASS ok github.com/grafana/mimir/pkg/querier/worker 2.648s === RUN TestRuler === RUN TestRuler/rules level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler/rules_special_characters level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler/federated_rules level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler (0.51s) --- PASS: TestRuler/rules (0.30s) --- PASS: TestRuler/rules_special_characters (0.20s) --- PASS: TestRuler/federated_rules (0.01s) === RUN TestRuler_alerts level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_alerts (0.02s) === RUN TestRuler_Create level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" === RUN TestRuler_Create/with_an_empty_payload === RUN TestRuler_Create/with_no_rule_group_name === RUN TestRuler_Create/with_no_rules === RUN TestRuler_Create/with_a_a_valid_rules_file level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_Create (0.02s) --- PASS: TestRuler_Create/with_an_empty_payload (0.00s) --- PASS: TestRuler_Create/with_no_rule_group_name (0.00s) --- PASS: TestRuler_Create/with_no_rules (0.00s) --- PASS: TestRuler_Create/with_a_a_valid_rules_file (0.01s) === RUN TestRuler_DeleteNamespace level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_DeleteNamespace (0.16s) === RUN TestRuler_LimitsPerGroup level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" === RUN TestRuler_LimitsPerGroup/when_exceeding_the_rules_per_rule_group_limit level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_LimitsPerGroup (0.13s) --- PASS: TestRuler_LimitsPerGroup/when_exceeding_the_rules_per_rule_group_limit (0.00s) === RUN TestRuler_RulerGroupLimits level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" === RUN TestRuler_RulerGroupLimits/when_pushing_the_first_group_within_bounds_of_the_limit === RUN TestRuler_RulerGroupLimits/when_exceeding_the_rule_group_limit_after_sending_the_first_group level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_RulerGroupLimits (0.13s) --- PASS: TestRuler_RulerGroupLimits/when_pushing_the_first_group_within_bounds_of_the_limit (0.00s) --- PASS: TestRuler_RulerGroupLimits/when_exceeding_the_rule_group_limit_after_sending_the_first_group (0.00s) === RUN Test_newRulerClientFactory --- PASS: Test_newRulerClientFactory (0.10s) === RUN TestPusherAppendable === RUN TestPusherAppendable/tenant_without_delay,_normal_value === RUN TestPusherAppendable/tenant_without_delay,_stale_nan_value === RUN TestPusherAppendable/ALERTS,_normal_value === RUN TestPusherAppendable/ALERTS,_stale_nan_value --- PASS: TestPusherAppendable (0.00s) --- PASS: TestPusherAppendable/tenant_without_delay,_normal_value (0.00s) --- PASS: TestPusherAppendable/tenant_without_delay,_stale_nan_value (0.00s) --- PASS: TestPusherAppendable/ALERTS,_normal_value (0.00s) --- PASS: TestPusherAppendable/ALERTS,_stale_nan_value (0.00s) === RUN TestPusherErrors === RUN TestPusherErrors/no_error === RUN TestPusherErrors/400_error === RUN TestPusherErrors/500_error === RUN TestPusherErrors/unknown_error --- PASS: TestPusherErrors (0.01s) --- PASS: TestPusherErrors/no_error (0.00s) --- PASS: TestPusherErrors/400_error (0.00s) --- PASS: TestPusherErrors/500_error (0.00s) --- PASS: TestPusherErrors/unknown_error (0.00s) === RUN TestMetricsQueryFuncErrors === RUN TestMetricsQueryFuncErrors/promql.ErrTooManySamples === RUN TestMetricsQueryFuncErrors/httpgrpc_500_error === RUN TestMetricsQueryFuncErrors/promql.ErrQueryTimeout === RUN TestMetricsQueryFuncErrors/unknown_but_non-queryable_error === RUN TestMetricsQueryFuncErrors/promql.ErrStorage === RUN TestMetricsQueryFuncErrors/promql.ErrQueryCanceled === RUN TestMetricsQueryFuncErrors/unknown_error === RUN TestMetricsQueryFuncErrors/no_error === RUN TestMetricsQueryFuncErrors/httpgrpc_400_error --- PASS: TestMetricsQueryFuncErrors (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrTooManySamples (0.00s) --- PASS: TestMetricsQueryFuncErrors/httpgrpc_500_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrQueryTimeout (0.00s) --- PASS: TestMetricsQueryFuncErrors/unknown_but_non-queryable_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrStorage (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrQueryCanceled (0.00s) --- PASS: TestMetricsQueryFuncErrors/unknown_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/no_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/httpgrpc_400_error (0.00s) === RUN TestRecordAndReportRuleQueryMetrics --- PASS: TestRecordAndReportRuleQueryMetrics (1.00s) === RUN TestManagerFactory_CorrectQueryableUsed === RUN TestManagerFactory_CorrectQueryableUsed/regular_rule_group_(without_source_tenants)_uses_regular_querier level=info msg="cleaning up mapped rules directory" path=/tmp/TestManagerFactory_CorrectQueryableUsedregular_rule_group_(without_source_tenants)_uses_regular_querier2971024876/001 level=info msg="updating rule file" file=/tmp/TestManagerFactory_CorrectQueryableUsedregular_rule_group_(without_source_tenants)_uses_regular_querier2971024876/001/tenant-1/namespace level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" === RUN TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_single_source_tenant_uses_federated_querier level=info msg="cleaning up mapped rules directory" path=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_single_source_tenant_uses_federated_querier3360111375/001 level=info msg="updating rule file" file=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_single_source_tenant_uses_federated_querier3360111375/001/tenant-1/namespace level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" === RUN TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_multiple_source_tenants_uses_federated_querier level=info msg="cleaning up mapped rules directory" path=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_multiple_source_tenants_uses_federated_querier987977173/001 level=info msg="updating rule file" file=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_multiple_source_tenants_uses_federated_querier987977173/001/tenant-1/namespace level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" --- PASS: TestManagerFactory_CorrectQueryableUsed (0.03s) --- PASS: TestManagerFactory_CorrectQueryableUsed/regular_rule_group_(without_source_tenants)_uses_regular_querier (0.02s) --- PASS: TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_single_source_tenant_uses_federated_querier (0.01s) --- PASS: TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_multiple_source_tenants_uses_federated_querier (0.00s) === RUN TestRulerShutdown level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRulerShutdown (0.18s) === RUN TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=warn msg="auto-forgetting instance from the ring because it is unhealthy for a long time" instance=unhealthy-id last_heartbeat="2022-08-24 23:16:51 +0200 CEST" forget_period=2m0s level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances (0.31s) === RUN TestManagerMetrics --- PASS: TestManagerMetrics (0.02s) === RUN TestMetricsArePerUser --- PASS: TestMetricsArePerUser (0.01s) === RUN TestSyncRuleGroups --- PASS: TestSyncRuleGroups (0.03s) === RUN Test_mapper_MapRules === RUN Test_mapper_MapRules/basic_rulegroup level=info msg="updating rule file" file=/rules/user1/file%20%2Fone === RUN Test_mapper_MapRules/identical_rulegroup === RUN Test_mapper_MapRules/out_of_order_identical_rulegroup === RUN Test_mapper_MapRules/updated_rulegroup level=info msg="updating rule file" file=/rules/user1/file%20%2Fone --- PASS: Test_mapper_MapRules (0.01s) --- PASS: Test_mapper_MapRules/basic_rulegroup (0.00s) --- PASS: Test_mapper_MapRules/identical_rulegroup (0.00s) --- PASS: Test_mapper_MapRules/out_of_order_identical_rulegroup (0.00s) --- PASS: Test_mapper_MapRules/updated_rulegroup (0.00s) === RUN Test_mapper_MapRulesMultipleFiles === RUN Test_mapper_MapRulesMultipleFiles/basic_rulegroup level=info msg="updating rule file" file=/rules/user1/file%20%2Fone === RUN Test_mapper_MapRulesMultipleFiles/add_a_file level=info msg="updating rule file" file=/rules/user1/file%20%2Ftwo === RUN Test_mapper_MapRulesMultipleFiles/update_one_file level=info msg="updating rule file" file=/rules/user1/file%20%2Ftwo === RUN Test_mapper_MapRulesMultipleFiles/delete_one_file --- PASS: Test_mapper_MapRulesMultipleFiles (0.01s) --- PASS: Test_mapper_MapRulesMultipleFiles/basic_rulegroup (0.00s) --- PASS: Test_mapper_MapRulesMultipleFiles/add_a_file (0.00s) --- PASS: Test_mapper_MapRulesMultipleFiles/update_one_file (0.00s) --- PASS: Test_mapper_MapRulesMultipleFiles/delete_one_file (0.00s) === RUN Test_mapper_MapRulesSpecialCharNamespace === RUN Test_mapper_MapRulesSpecialCharNamespace/create_special_characters_rulegroup level=info msg="updating rule file" file=/rules/user1/+A_%2FReallyStrange%3C%3ENAME:SPACE%2F%3F === RUN Test_mapper_MapRulesSpecialCharNamespace/delete_special_characters_rulegroup --- PASS: Test_mapper_MapRulesSpecialCharNamespace (0.00s) --- PASS: Test_mapper_MapRulesSpecialCharNamespace/create_special_characters_rulegroup (0.00s) --- PASS: Test_mapper_MapRulesSpecialCharNamespace/delete_special_characters_rulegroup (0.00s) === RUN Test_mapper_CleanupShouldNotFailIfPathDoesNotExist --- PASS: Test_mapper_CleanupShouldNotFailIfPathDoesNotExist (0.00s) === RUN TestBuildNotifierConfig === RUN TestBuildNotifierConfig/with_no_valid_hosts,_returns_an_empty_config === RUN TestBuildNotifierConfig/with_a_single_URL_and_no_service_discovery === RUN TestBuildNotifierConfig/with_a_single_URL,_v2_API,_and_no_service_discovery === RUN TestBuildNotifierConfig/with_a_SRV_URL_but_no_service_discovery_(missing_dns+_prefix) === RUN TestBuildNotifierConfig/with_multiple_URLs_and_no_service_discovery === RUN TestBuildNotifierConfig/with_basic_authentication_URL_and_no_service_discovery === RUN TestBuildNotifierConfig/with_basic_authentication_URL_and_service_discovery === RUN TestBuildNotifierConfig/with_basic_authentication_URL,_no_service_discovery,_and_explicit_config === RUN TestBuildNotifierConfig/with_multiple_URLs_and_service_discovery === RUN TestBuildNotifierConfig/with_DNS_service_discovery_and_missing_scheme === RUN TestBuildNotifierConfig/with_only_dns+_prefix === RUN TestBuildNotifierConfig/misspelled_DNS_SD_format_prefix_(dnsserv+_vs_dnssrv+) --- PASS: TestBuildNotifierConfig (0.01s) --- PASS: TestBuildNotifierConfig/with_no_valid_hosts,_returns_an_empty_config (0.00s) --- PASS: TestBuildNotifierConfig/with_a_single_URL_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_a_single_URL,_v2_API,_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_a_SRV_URL_but_no_service_discovery_(missing_dns+_prefix) (0.00s) --- PASS: TestBuildNotifierConfig/with_multiple_URLs_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_basic_authentication_URL_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_basic_authentication_URL_and_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_basic_authentication_URL,_no_service_discovery,_and_explicit_config (0.00s) --- PASS: TestBuildNotifierConfig/with_multiple_URLs_and_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_DNS_service_discovery_and_missing_scheme (0.00s) --- PASS: TestBuildNotifierConfig/with_only_dns+_prefix (0.00s) --- PASS: TestBuildNotifierConfig/misspelled_DNS_SD_format_prefix_(dnsserv+_vs_dnssrv+) (0.00s) === RUN TestRemoteQuerier_ReadReq --- PASS: TestRemoteQuerier_ReadReq (0.00s) === RUN TestRemoteQuerier_ReadReqTimeout --- PASS: TestRemoteQuerier_ReadReqTimeout (1.00s) === RUN TestRemoteQuerier_QueryReq --- PASS: TestRemoteQuerier_QueryReq (0.00s) === RUN TestRemoteQuerier_QueryReqTimeout --- PASS: TestRemoteQuerier_QueryReqTimeout (1.00s) === RUN TestNotifierSendsUserIDHeader level=info msg="cleaning up mapped rules directory" path=/tmp/TestNotifierSendsUserIDHeader2189391100/001 level=info user=1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestNotifierSendsUserIDHeader2189391100/001 --- PASS: TestNotifierSendsUserIDHeader (5.06s) === RUN TestRuler_Rules === RUN TestRuler_Rules/federated_rule_group level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler_Rules/rules_-_user1 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=error msg="failed to check if the ruler replica owns the rule group" user=user1 namespace=namespace1 group=group1 err="error reading ring to verify rule group ownership: empty ring" level=error msg="failed to check if the ruler replica owns the rule group" user=user2 namespace=namespace1 group=group1 err="error reading ring to verify rule group ownership: empty ring" === RUN TestRuler_Rules/rules_-_user2 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_Rules (0.18s) --- PASS: TestRuler_Rules/federated_rule_group (0.12s) --- PASS: TestRuler_Rules/rules_-_user1 (0.02s) --- PASS: TestRuler_Rules/rules_-_user2 (0.04s) === RUN TestGetRules === RUN TestGetRules/Shuffle_Shard_Size_0 level=info msg="ring doesn't exist in KV store yet" level=info msg="ring doesn't exist in KV store yet" level=info msg="ring doesn't exist in KV store yet" === RUN TestGetRules/Shuffle_Shard_Size_2 level=info msg="ring doesn't exist in KV store yet" level=info msg="ring doesn't exist in KV store yet" level=info msg="ring doesn't exist in KV store yet" --- PASS: TestGetRules (0.33s) --- PASS: TestGetRules/Shuffle_Shard_Size_0 (0.15s) --- PASS: TestGetRules/Shuffle_Shard_Size_2 (0.17s) === RUN TestSharding === RUN TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_disabled_user level=info msg="ruler using disabled users" disabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="ruler using disabled users" disabled=user1 level=info msg="ruler using disabled users" disabled=user1 === RUN TestSharding/shard_size_0,_single_ruler level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/shard_size_2,_three_rulers,_single_enabled_user level=info msg="ruler using enabled users" enabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="ruler using enabled users" enabled=user1 level=info msg="ruler using enabled users" enabled=user1 === RUN TestSharding/shard_size_2,_three_rulers,_single_disabled_user level=info msg="ruler using disabled users" disabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="ruler using disabled users" disabled=user1 level=info msg="ruler using disabled users" disabled=user1 === RUN TestSharding/shard_size_0,_unhealthy_ACTIVE_ruler level=info msg="ring doesn't exist in KV store yet" level=error msg="failed to check if the ruler replica owns the rule group" user=user1 namespace=namespace group=second err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" level=error msg="failed to check if the ruler replica owns the rule group" user=user3 namespace=namespace group=first err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" level=error msg="failed to check if the ruler replica owns the rule group" user=user1 namespace=namespace group=second err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" level=error msg="failed to check if the ruler replica owns the rule group" user=user3 namespace=namespace group=first err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" === RUN TestSharding/shard_size_2,_three_rulers,_ruler2_has_no_users level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/shard_size_0,_JOINING_ruler level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/shard_size_2,_two_rulers level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/shard_size_1,_two_rulers,_distributed_users level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/shard_size_2,_three_rulers level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/single_ruler_with_ring_setup,_single_user_disabled level=info msg="ruler using disabled users" disabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="ruler using disabled users" disabled=user1 level=info msg="ruler using disabled users" disabled=user1 === RUN TestSharding/shard_size_0,_multiple_ACTIVE_rulers level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_enabled_user level=info msg="ruler using enabled users" enabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="ruler using enabled users" enabled=user1 level=info msg="ruler using enabled users" enabled=user1 === RUN TestSharding/shard_size_0,_LEAVING_ruler level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/shard_size_1,_multiple_rulers level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/single_ruler,_with_ring_setup level=info msg="ring doesn't exist in KV store yet" === RUN TestSharding/single_ruler,_with_ring_setup,_single_user_enabled level=info msg="ruler using enabled users" enabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="ruler using enabled users" enabled=user1 level=info msg="ruler using enabled users" enabled=user1 --- PASS: TestSharding (1.85s) --- PASS: TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_disabled_user (0.11s) --- PASS: TestSharding/shard_size_0,_single_ruler (0.11s) --- PASS: TestSharding/shard_size_2,_three_rulers,_single_enabled_user (0.11s) --- PASS: TestSharding/shard_size_2,_three_rulers,_single_disabled_user (0.11s) --- PASS: TestSharding/shard_size_0,_unhealthy_ACTIVE_ruler (0.11s) --- PASS: TestSharding/shard_size_2,_three_rulers,_ruler2_has_no_users (0.11s) --- PASS: TestSharding/shard_size_0,_JOINING_ruler (0.11s) --- PASS: TestSharding/shard_size_2,_two_rulers (0.11s) --- PASS: TestSharding/shard_size_1,_two_rulers,_distributed_users (0.11s) --- PASS: TestSharding/shard_size_2,_three_rulers (0.11s) --- PASS: TestSharding/single_ruler_with_ring_setup,_single_user_disabled (0.11s) --- PASS: TestSharding/shard_size_0,_multiple_ACTIVE_rulers (0.11s) --- PASS: TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_enabled_user (0.12s) --- PASS: TestSharding/shard_size_0,_LEAVING_ruler (0.11s) --- PASS: TestSharding/shard_size_1,_multiple_rulers (0.11s) --- PASS: TestSharding/single_ruler,_with_ring_setup (0.11s) --- PASS: TestSharding/single_ruler,_with_ring_setup,_single_user_enabled (0.11s) === RUN TestDeleteTenantRuleGroups --- PASS: TestDeleteTenantRuleGroups (0.01s) === RUN TestRuler_ListAllRules level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_ListAllRules (0.02s) === RUN TestSendAlerts === RUN TestSendAlerts/0 === RUN TestSendAlerts/1 === RUN TestSendAlerts/2 --- PASS: TestSendAlerts (0.00s) --- PASS: TestSendAlerts/0 (0.00s) --- PASS: TestSendAlerts/1 (0.00s) --- PASS: TestSendAlerts/2 (0.00s) === RUN TestConfig_TranslatesToPrometheusTargetGroup === RUN TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_single_address === RUN TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_multiple_addresses === RUN TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_no_addresses --- PASS: TestConfig_TranslatesToPrometheusTargetGroup (0.00s) --- PASS: TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_single_address (0.00s) --- PASS: TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_multiple_addresses (0.00s) --- PASS: TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_no_addresses (0.00s) === RUN TestConfig_ConstructsLookupNamesCorrectly === RUN TestConfig_ConstructsLookupNamesCorrectly/dns+ === RUN TestConfig_ConstructsLookupNamesCorrectly/dnssrv+ === RUN TestConfig_ConstructsLookupNamesCorrectly/dnssrvnoa+ --- PASS: TestConfig_ConstructsLookupNamesCorrectly (0.00s) --- PASS: TestConfig_ConstructsLookupNamesCorrectly/dns+ (0.00s) --- PASS: TestConfig_ConstructsLookupNamesCorrectly/dnssrv+ (0.00s) --- PASS: TestConfig_ConstructsLookupNamesCorrectly/dnssrvnoa+ (0.00s) === RUN TestRuler_TenantFederationFlag === RUN TestRuler_TenantFederationFlag/tenant_federation_disabled_with_a_federated_rules_and_a_regular_rule level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled_with_a_federated_rules_and_a_regular_rule2367154324/001 level=info msg="updating rule file" file=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled_with_a_federated_rules_and_a_regular_rule2367154324/001/tenant-1/ns level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled_with_a_federated_rules_and_a_regular_rule2367154324/001 === RUN TestRuler_TenantFederationFlag/tenant_federation_enabled_only_with_federated_groups level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_only_with_federated_groups2181911870/001 level=info msg="updating rule file" file=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_only_with_federated_groups2181911870/001/tenant-1/ns level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_only_with_federated_groups2181911870/001 === RUN TestRuler_TenantFederationFlag/tenant_federation_enabled_with_federated_and_regular_groups level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_with_federated_and_regular_groups3027066929/001 level=info msg="updating rule file" file=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_with_federated_and_regular_groups3027066929/001/tenant-1/ns level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_with_federated_and_regular_groups3027066929/001 === RUN TestRuler_TenantFederationFlag/tenant_federation_disabled level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled1206891501/001 level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled1206891501/001 --- PASS: TestRuler_TenantFederationFlag (0.03s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_disabled_with_a_federated_rules_and_a_regular_rule (0.01s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_enabled_only_with_federated_groups (0.01s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_enabled_with_federated_and_regular_groups (0.01s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_disabled (0.00s) PASS ok github.com/grafana/mimir/pkg/ruler 12.832s ? github.com/grafana/mimir/pkg/ruler/rulespb [no test files] === RUN TestIsDefaults === RUN TestIsDefaults/should_return_true_if_the_config_only_contains_default_values === RUN TestIsDefaults/should_return_false_if_the_config_contains_zero_values === RUN TestIsDefaults/should_return_false_if_the_config_contains_default_values_and_some_overrides --- PASS: TestIsDefaults (0.01s) --- PASS: TestIsDefaults/should_return_true_if_the_config_only_contains_default_values (0.01s) --- PASS: TestIsDefaults/should_return_false_if_the_config_contains_zero_values (0.00s) --- PASS: TestIsDefaults/should_return_false_if_the_config_contains_default_values_and_some_overrides (0.00s) PASS ok github.com/grafana/mimir/pkg/ruler/rulestore 0.919s === RUN TestListRules --- PASS: TestListRules (0.01s) === RUN TestLoadRules --- PASS: TestLoadRules (0.01s) === RUN TestDelete --- PASS: TestDelete (0.00s) === RUN TestParseRuleGroupObjectKey === RUN TestParseRuleGroupObjectKey/invalid_object_key_pattern === RUN TestParseRuleGroupObjectKey/empty_namespace === RUN TestParseRuleGroupObjectKey/invalid_namespace_encoding === RUN TestParseRuleGroupObjectKey/empty_group === RUN TestParseRuleGroupObjectKey/invalid_group_encoding === RUN TestParseRuleGroupObjectKey/valid_object_key === RUN TestParseRuleGroupObjectKey/empty_object_key --- PASS: TestParseRuleGroupObjectKey (0.00s) --- PASS: TestParseRuleGroupObjectKey/invalid_object_key_pattern (0.00s) --- PASS: TestParseRuleGroupObjectKey/empty_namespace (0.00s) --- PASS: TestParseRuleGroupObjectKey/invalid_namespace_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKey/empty_group (0.00s) --- PASS: TestParseRuleGroupObjectKey/invalid_group_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKey/valid_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKey/empty_object_key (0.00s) === RUN TestParseRuleGroupObjectKeyWithUser === RUN TestParseRuleGroupObjectKeyWithUser/valid_object_key === RUN TestParseRuleGroupObjectKeyWithUser/empty_object_key === RUN TestParseRuleGroupObjectKeyWithUser/invalid_object_key_pattern === RUN TestParseRuleGroupObjectKeyWithUser/empty_user === RUN TestParseRuleGroupObjectKeyWithUser/empty_namespace === RUN TestParseRuleGroupObjectKeyWithUser/invalid_namespace_encoding === RUN TestParseRuleGroupObjectKeyWithUser/empty_group_name === RUN TestParseRuleGroupObjectKeyWithUser/invalid_group_encoding --- PASS: TestParseRuleGroupObjectKeyWithUser (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/valid_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/invalid_object_key_pattern (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_user (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_namespace (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/invalid_namespace_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_group_name (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/invalid_group_encoding (0.00s) === RUN TestListAllRuleGroupsWithNoNamespaceOrGroup --- PASS: TestListAllRuleGroupsWithNoNamespaceOrGroup (0.00s) PASS ok github.com/grafana/mimir/pkg/ruler/rulestore/bucketclient 0.568s === RUN TestClient_LoadAllRuleGroups --- PASS: TestClient_LoadAllRuleGroups (0.04s) PASS ok github.com/grafana/mimir/pkg/ruler/rulestore/local 0.600s === RUN TestSchedulerBasicEnqueue --- PASS: TestSchedulerBasicEnqueue (0.14s) === RUN TestSchedulerEnqueueWithCancel --- PASS: TestSchedulerEnqueueWithCancel (0.51s) === RUN TestSchedulerEnqueueByMultipleFrontendsWithCancel --- PASS: TestSchedulerEnqueueByMultipleFrontendsWithCancel (0.52s) === RUN TestSchedulerEnqueueWithFrontendDisconnect --- PASS: TestSchedulerEnqueueWithFrontendDisconnect (0.52s) === RUN TestCancelRequestInProgress --- PASS: TestCancelRequestInProgress (0.51s) === RUN TestTracingContext --- PASS: TestTracingContext (0.06s) === RUN TestSchedulerShutdown_FrontendLoop --- PASS: TestSchedulerShutdown_FrontendLoop (0.01s) === RUN TestSchedulerShutdown_QuerierLoop --- PASS: TestSchedulerShutdown_QuerierLoop (0.01s) === RUN TestSchedulerMaxOutstandingRequests --- PASS: TestSchedulerMaxOutstandingRequests (0.01s) === RUN TestSchedulerForwardsErrorToFrontend --- PASS: TestSchedulerForwardsErrorToFrontend (0.03s) === RUN TestSchedulerMetrics --- PASS: TestSchedulerMetrics (0.02s) PASS ok github.com/grafana/mimir/pkg/scheduler 2.842s === RUN TestRequestQueue_GetNextRequestForQuerier_ShouldGetRequestAfterReshardingBecauseQuerierHasBeenForgotten --- PASS: TestRequestQueue_GetNextRequestForQuerier_ShouldGetRequestAfterReshardingBecauseQuerierHasBeenForgotten (5.01s) === RUN TestContextCond === RUN TestContextCond/wait_until_broadcast === PAUSE TestContextCond/wait_until_broadcast === RUN TestContextCond/wait_until_context_deadline === PAUSE TestContextCond/wait_until_context_deadline === RUN TestContextCond/wait_on_already_canceled_context === PAUSE TestContextCond/wait_on_already_canceled_context === RUN TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait === PAUSE TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait === RUN TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel === PAUSE TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel === CONT TestContextCond/wait_until_broadcast === CONT TestContextCond/wait_on_already_canceled_context === CONT TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel === CONT TestContextCond/wait_until_context_deadline === CONT TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait --- PASS: TestContextCond (0.00s) --- PASS: TestContextCond/wait_on_already_canceled_context (0.00s) --- PASS: TestContextCond/wait_until_broadcast (0.10s) --- PASS: TestContextCond/wait_until_context_deadline (0.10s) --- PASS: TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel (0.13s) --- PASS: TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait (0.25s) === RUN TestQueues --- PASS: TestQueues (0.00s) === RUN TestQueuesOnTerminatingQuerier --- PASS: TestQueuesOnTerminatingQuerier (0.00s) === RUN TestQueuesWithQueriers user_queues_test.go:170: mean: 166.66666666666666 stddev: 11.178352094810558 --- PASS: TestQueuesWithQueriers (0.26s) === RUN TestQueuesConsistency === RUN TestQueuesConsistency/without_forget_delay === RUN TestQueuesConsistency/with_forget_delay --- PASS: TestQueuesConsistency (0.45s) --- PASS: TestQueuesConsistency/without_forget_delay (0.25s) --- PASS: TestQueuesConsistency/with_forget_delay (0.20s) === RUN TestQueues_ForgetDelay --- PASS: TestQueues_ForgetDelay (0.06s) === RUN TestQueues_ForgetDelay_ShouldCorrectlyHandleQuerierReconnectingBeforeForgetDelayIsPassed --- PASS: TestQueues_ForgetDelay_ShouldCorrectlyHandleQuerierReconnectingBeforeForgetDelayIsPassed (0.05s) === RUN TestShuffleQueriers --- PASS: TestShuffleQueriers (0.00s) === RUN TestShuffleQueriersCorrectness --- PASS: TestShuffleQueriersCorrectness (0.96s) PASS ok github.com/grafana/mimir/pkg/scheduler/queue 7.379s ? github.com/grafana/mimir/pkg/scheduler/schedulerpb [no test files] === RUN TestDeletePrefix --- PASS: TestDeletePrefix (0.01s) === RUN TestNewClient === PAUSE TestNewClient === RUN TestClientMock_MockGet --- PASS: TestClientMock_MockGet (0.39s) === RUN TestClient_ConfigValidation === RUN TestClient_ConfigValidation/valid_storage_prefix === RUN TestClient_ConfigValidation/storage_prefix_non-alphanumeric_characters === RUN TestClient_ConfigValidation/storage_prefix_suffixed_with_a_slash_(non-alphanumeric) === RUN TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(..) === RUN TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(.) === RUN TestClient_ConfigValidation/unsupported_backend --- PASS: TestClient_ConfigValidation (0.01s) --- PASS: TestClient_ConfigValidation/valid_storage_prefix (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_non-alphanumeric_characters (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_suffixed_with_a_slash_(non-alphanumeric) (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(..) (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(.) (0.00s) --- PASS: TestClient_ConfigValidation/unsupported_backend (0.00s) === RUN TestNewPrefixedBucketClient === RUN TestNewPrefixedBucketClient/with_prefix === RUN TestNewPrefixedBucketClient/without_prefix --- PASS: TestNewPrefixedBucketClient (0.01s) --- PASS: TestNewPrefixedBucketClient/with_prefix (0.01s) --- PASS: TestNewPrefixedBucketClient/without_prefix (0.00s) === RUN TestPrefixedBucketClient === RUN TestPrefixedBucketClient/Upload prefixed_bucket_client_test.go:26: PASS: Upload(string,string,string) === RUN TestPrefixedBucketClient/Delete prefixed_bucket_client_test.go:33: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:33: PASS: Delete(string,string) === RUN TestPrefixedBucketClient/Iter prefixed_bucket_client_test.go:43: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:43: PASS: Delete(string,string) prefixed_bucket_client_test.go:43: PASS: Iter(string,string,string,string) === RUN TestPrefixedBucketClient/Get prefixed_bucket_client_test.go:54: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:54: PASS: Delete(string,string) prefixed_bucket_client_test.go:54: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:54: PASS: Get(string,string) === RUN TestPrefixedBucketClient/GetRange prefixed_bucket_client_test.go:65: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:65: PASS: Delete(string,string) prefixed_bucket_client_test.go:65: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:65: PASS: Get(string,string) prefixed_bucket_client_test.go:65: PASS: GetRange(string,string,string,string) === RUN TestPrefixedBucketClient/Exists prefixed_bucket_client_test.go:73: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:73: PASS: Delete(string,string) prefixed_bucket_client_test.go:73: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:73: PASS: Get(string,string) prefixed_bucket_client_test.go:73: PASS: GetRange(string,string,string,string) prefixed_bucket_client_test.go:73: PASS: Exists(string,string) === RUN TestPrefixedBucketClient/Attributes prefixed_bucket_client_test.go:80: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:80: PASS: Delete(string,string) prefixed_bucket_client_test.go:80: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:80: PASS: Get(string,string) prefixed_bucket_client_test.go:80: PASS: GetRange(string,string,string,string) prefixed_bucket_client_test.go:80: PASS: Exists(string,string) prefixed_bucket_client_test.go:80: PASS: Attributes(string,string) --- PASS: TestPrefixedBucketClient (0.01s) --- PASS: TestPrefixedBucketClient/Upload (0.00s) --- PASS: TestPrefixedBucketClient/Delete (0.00s) --- PASS: TestPrefixedBucketClient/Iter (0.00s) --- PASS: TestPrefixedBucketClient/Get (0.00s) --- PASS: TestPrefixedBucketClient/GetRange (0.00s) --- PASS: TestPrefixedBucketClient/Exists (0.00s) --- PASS: TestPrefixedBucketClient/Attributes (0.00s) === RUN TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig === RUN TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/default_client === RUN TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/client_with_expected_errors --- PASS: TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig (0.09s) --- PASS: TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/default_client (0.08s) --- PASS: TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/client_with_expected_errors (0.01s) === CONT TestNewClient === RUN TestNewClient/should_return_error_on_unknown_backend === RUN TestNewClient/should_create_an_S3_bucket === RUN TestNewClient/should_create_a_GCS_bucket --- PASS: TestNewClient (0.03s) --- PASS: TestNewClient/should_return_error_on_unknown_backend (0.01s) --- PASS: TestNewClient/should_create_an_S3_bucket (0.00s) --- PASS: TestNewClient/should_create_a_GCS_bucket (0.02s) PASS ok github.com/grafana/mimir/pkg/storage/bucket 1.185s ? github.com/grafana/mimir/pkg/storage/bucket/azure [no test files] ? github.com/grafana/mimir/pkg/storage/bucket/filesystem [no test files] ? github.com/grafana/mimir/pkg/storage/bucket/gcs [no test files] === RUN TestSSEConfig_Validate === RUN TestSSEConfig_Validate/should_fail_on_invalid_SSE_type === RUN TestSSEConfig_Validate/should_fail_on_invalid_SSE_KMS_encryption_context === RUN TestSSEConfig_Validate/should_pass_on_valid_SSE_KMS_encryption_context === RUN TestSSEConfig_Validate/should_pass_with_default_config --- PASS: TestSSEConfig_Validate (0.05s) --- PASS: TestSSEConfig_Validate/should_fail_on_invalid_SSE_type (0.00s) --- PASS: TestSSEConfig_Validate/should_fail_on_invalid_SSE_KMS_encryption_context (0.00s) --- PASS: TestSSEConfig_Validate/should_pass_on_valid_SSE_KMS_encryption_context (0.00s) --- PASS: TestSSEConfig_Validate/should_pass_with_default_config (0.00s) === RUN TestSSEConfig_BuildMinioConfig === RUN TestSSEConfig_BuildMinioConfig/SSE_KMS_without_encryption_context === RUN TestSSEConfig_BuildMinioConfig/SSE_KMS_with_encryption_context --- PASS: TestSSEConfig_BuildMinioConfig (0.01s) --- PASS: TestSSEConfig_BuildMinioConfig/SSE_KMS_without_encryption_context (0.00s) --- PASS: TestSSEConfig_BuildMinioConfig/SSE_KMS_with_encryption_context (0.00s) === RUN TestParseKMSEncryptionContext --- PASS: TestParseKMSEncryptionContext (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/bucket/s3 0.475s ? github.com/grafana/mimir/pkg/storage/bucket/swift [no test files] === RUN TestLen --- PASS: TestLen (0.00s) === RUN TestChunk === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/204 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/204 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/204 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/204 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/408 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/408 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/408 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/408 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/612 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/612 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/612 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/612 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/816 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/816 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/816 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/816 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1020 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1020 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1020 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1020 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1224 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1224 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1224 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1224 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1428 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1428 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1428 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1428 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1632 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1632 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1632 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1632 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1836 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1836 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1836 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1836 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/2040 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/2040 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/2040 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/2040 --- PASS: TestChunk (9.41s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/204 (0.01s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/204 (0.04s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/204 (0.01s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/204 (0.01s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/408 (0.03s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/408 (0.08s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/408 (0.03s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/408 (0.03s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/612 (0.06s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/612 (0.12s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/612 (0.09s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/612 (0.06s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/816 (0.09s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/816 (0.16s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/816 (0.09s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/816 (0.08s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1020 (0.19s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1020 (0.30s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1020 (0.17s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1020 (0.12s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1224 (0.19s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1224 (0.29s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1224 (0.20s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1224 (0.19s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1428 (0.30s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1428 (0.40s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1428 (0.24s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1428 (0.28s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1632 (0.32s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1632 (0.55s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1632 (0.36s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1632 (0.31s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1836 (0.50s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1836 (0.60s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1836 (0.37s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1836 (0.35s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/2040 (0.52s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/2040 (0.73s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/2040 (0.48s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/2040 (0.43s) PASS ok github.com/grafana/mimir/pkg/storage/chunk 9.686s ? github.com/grafana/mimir/pkg/storage/lazyquery [no test files] === RUN TestConcreteSeriesSet --- PASS: TestConcreteSeriesSet (0.00s) === RUN TestMatrixToSeriesSetSortsMetricLabels --- PASS: TestMatrixToSeriesSetSortsMetricLabels (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/series 0.305s === RUN TestParseShard === RUN TestParseShard/should_return_error_on_invalid_format === RUN TestParseShard/should_return_error_on_invalid_index_(not_an_integer) === RUN TestParseShard/should_return_error_on_invalid_count_(not_positive) === RUN TestParseShard/should_succeed_on_valid_first_shard_ID === RUN TestParseShard/should_succeed_on_valid_last_shard_selector === RUN TestParseShard/should_return_error_on_invalid_index_(not_positive) === RUN TestParseShard/should_return_error_on_invalid_index_(too_large) === RUN TestParseShard/should_return_error_on_invalid_index_(too_small) === RUN TestParseShard/should_return_error_on_invalid_separator --- PASS: TestParseShard (0.01s) --- PASS: TestParseShard/should_return_error_on_invalid_format (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(not_an_integer) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_count_(not_positive) (0.00s) --- PASS: TestParseShard/should_succeed_on_valid_first_shard_ID (0.00s) --- PASS: TestParseShard/should_succeed_on_valid_last_shard_selector (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(not_positive) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(too_large) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(too_small) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_separator (0.00s) === RUN TestRemoveShardFromMatchers === RUN TestRemoveShardFromMatchers/should_return_no_shard_on_empty_label_matchers === RUN TestRemoveShardFromMatchers/should_return_no_shard_on_no_shard_label_matcher === RUN TestRemoveShardFromMatchers/should_return_matching_shard_and_filter_out_its_matcher --- PASS: TestRemoveShardFromMatchers (0.01s) --- PASS: TestRemoveShardFromMatchers/should_return_no_shard_on_empty_label_matchers (0.00s) --- PASS: TestRemoveShardFromMatchers/should_return_no_shard_on_no_shard_label_matcher (0.00s) --- PASS: TestRemoveShardFromMatchers/should_return_matching_shard_and_filter_out_its_matcher (0.00s) === RUN TestShardFromMatchers === RUN TestShardFromMatchers/0 === RUN TestShardFromMatchers/1 === RUN TestShardFromMatchers/2 --- PASS: TestShardFromMatchers (0.00s) --- PASS: TestShardFromMatchers/0 (0.00s) --- PASS: TestShardFromMatchers/1 (0.00s) --- PASS: TestShardFromMatchers/2 (0.00s) === RUN TestFormatAndParseShardId --- PASS: TestFormatAndParseShardId (0.03s) PASS ok github.com/grafana/mimir/pkg/storage/sharding 0.315s === RUN TestIsTenantDir --- PASS: TestIsTenantDir (0.00s) === RUN TestIsBucketIndexFile --- PASS: TestIsBucketIndexFile (0.00s) === RUN TestIsBlockIndexFile --- PASS: TestIsBlockIndexFile (0.00s) === RUN TestConfig_Validate === PAUSE TestConfig_Validate === RUN TestConfig_DurationList === PAUSE TestConfig_DurationList === RUN TestIndexCacheConfig_Validate === RUN TestIndexCacheConfig_Validate/default_config_should_pass === RUN TestIndexCacheConfig_Validate/unsupported_backend_should_fail === RUN TestIndexCacheConfig_Validate/no_memcached_addresses_should_fail === RUN TestIndexCacheConfig_Validate/one_memcached_address_should_pass --- PASS: TestIndexCacheConfig_Validate (0.00s) --- PASS: TestIndexCacheConfig_Validate/default_config_should_pass (0.00s) --- PASS: TestIndexCacheConfig_Validate/unsupported_backend_should_fail (0.00s) --- PASS: TestIndexCacheConfig_Validate/no_memcached_addresses_should_fail (0.00s) --- PASS: TestIndexCacheConfig_Validate/one_memcached_address_should_pass (0.00s) === RUN TestTenantDeletionMarkExists === RUN TestTenantDeletionMarkExists/empty === RUN TestTenantDeletionMarkExists/mark_doesn't_exist === RUN TestTenantDeletionMarkExists/mark_exists --- PASS: TestTenantDeletionMarkExists (0.00s) --- PASS: TestTenantDeletionMarkExists/empty (0.00s) --- PASS: TestTenantDeletionMarkExists/mark_doesn't_exist (0.00s) --- PASS: TestTenantDeletionMarkExists/mark_exists (0.00s) === RUN TestUploadBlock === RUN TestUploadBlock/wrong_dir === RUN TestUploadBlock/wrong_existing_dir_(not_a_block) === RUN TestUploadBlock/empty_block_dir === RUN TestUploadBlock/missing_chunks === RUN TestUploadBlock/missing_index_file === RUN TestUploadBlock/missing_meta.json_file === RUN TestUploadBlock/missing_meta.json_file,_but_valid_metadata_supplied_as_argument === RUN TestUploadBlock/full_block === RUN TestUploadBlock/upload_is_idempotent === RUN TestUploadBlock/upload_with_no_external_labels_works_just_fine === RUN TestUploadBlock/upload_with_supplied_meta.json --- PASS: TestUploadBlock (0.64s) --- PASS: TestUploadBlock/wrong_dir (0.00s) --- PASS: TestUploadBlock/wrong_existing_dir_(not_a_block) (0.00s) --- PASS: TestUploadBlock/empty_block_dir (0.00s) --- PASS: TestUploadBlock/missing_chunks (0.00s) --- PASS: TestUploadBlock/missing_index_file (0.00s) --- PASS: TestUploadBlock/missing_meta.json_file (0.00s) --- PASS: TestUploadBlock/missing_meta.json_file,_but_valid_metadata_supplied_as_argument (0.00s) --- PASS: TestUploadBlock/full_block (0.00s) --- PASS: TestUploadBlock/upload_is_idempotent (0.00s) --- PASS: TestUploadBlock/upload_with_no_external_labels_works_just_fine (0.18s) --- PASS: TestUploadBlock/upload_with_supplied_meta.json (0.19s) === RUN TestUsersScanner_ScanUsers_ShouldReturnedOwnedUsersOnly --- PASS: TestUsersScanner_ScanUsers_ShouldReturnedOwnedUsersOnly (0.01s) === RUN TestUsersScanner_ScanUsers_ShouldReturnUsersForWhichOwnerCheckOrTenantDeletionCheckFailed --- PASS: TestUsersScanner_ScanUsers_ShouldReturnUsersForWhichOwnerCheckOrTenantDeletionCheckFailed (0.00s) === RUN TestHashBlockID --- PASS: TestHashBlockID (0.00s) === CONT TestConfig_DurationList === CONT TestConfig_Validate === RUN TestConfig_DurationList/default_to_2h === RUN TestConfig_Validate/should_fail_on_unknown_storage_backend === RUN TestConfig_DurationList/parse_ranges_correctly === RUN TestConfig_Validate/should_fail_on_too_high_compaction_interval === RUN TestConfig_DurationList/handle_multiple_flag_parse === RUN TestConfig_Validate/should_fail_on_invalid_compaction_concurrency --- PASS: TestConfig_DurationList (0.01s) --- PASS: TestConfig_DurationList/default_to_2h (0.01s) --- PASS: TestConfig_DurationList/parse_ranges_correctly (0.00s) --- PASS: TestConfig_DurationList/handle_multiple_flag_parse (0.00s) === RUN TestConfig_Validate/should_fail_on_negative_stripe_size === RUN TestConfig_Validate/should_fail_on_invalid_TSDB_WAL_segment_size === RUN TestConfig_Validate/should_pass_on_GCS_backend === RUN TestConfig_Validate/should_fail_on_invalid_ship_concurrency === RUN TestConfig_Validate/should_pass_on_invalid_ship_concurrency_but_shipping_is_disabled === RUN TestConfig_Validate/should_fail_on_invalid_opening_concurrency === RUN TestConfig_Validate/should_fail_on_invalid_compaction_interval === RUN TestConfig_Validate/should_pass_on_valid_compaction_concurrency === RUN TestConfig_Validate/should_pass_on_valid_stripe_size === RUN TestConfig_Validate/should_fail_on_empty_block_ranges === RUN TestConfig_Validate/should_pass_on_S3_backend === RUN TestConfig_Validate/should_fail_on_stripe_size_1 === RUN TestConfig_Validate/should_fail_on_stripe_size_0 --- PASS: TestConfig_Validate (0.02s) --- PASS: TestConfig_Validate/should_fail_on_unknown_storage_backend (0.01s) --- PASS: TestConfig_Validate/should_fail_on_too_high_compaction_interval (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_compaction_concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_negative_stripe_size (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_TSDB_WAL_segment_size (0.00s) --- PASS: TestConfig_Validate/should_pass_on_GCS_backend (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_ship_concurrency (0.00s) --- PASS: TestConfig_Validate/should_pass_on_invalid_ship_concurrency_but_shipping_is_disabled (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_opening_concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_compaction_interval (0.00s) --- PASS: TestConfig_Validate/should_pass_on_valid_compaction_concurrency (0.00s) --- PASS: TestConfig_Validate/should_pass_on_valid_stripe_size (0.00s) --- PASS: TestConfig_Validate/should_fail_on_empty_block_ranges (0.00s) --- PASS: TestConfig_Validate/should_pass_on_S3_backend (0.00s) --- PASS: TestConfig_Validate/should_fail_on_stripe_size_1 (0.00s) --- PASS: TestConfig_Validate/should_fail_on_stripe_size_0 (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb 1.234s === RUN TestChunksCaching === RUN TestChunksCaching/basic_test === RUN TestChunksCaching/same_request_will_hit_all_subranges_in_the_cache === RUN TestChunksCaching/request_data_close_to_the_end_of_object === RUN TestChunksCaching/another_request_data_close_to_the_end_of_object,_cached_by_previous_test === RUN TestChunksCaching/entire_object,_combination_of_cached_and_uncached_subranges === RUN TestChunksCaching/entire_object_again,_everything_is_cached === RUN TestChunksCaching/entire_object_again,_nothing_is_cached === RUN TestChunksCaching/missing_first_subranges === RUN TestChunksCaching/missing_last_subranges === RUN TestChunksCaching/missing_middle_subranges === RUN TestChunksCaching/missing_everything_except_middle_subranges === RUN TestChunksCaching/missing_everything_except_middle_subranges,_one_subrequest_only === RUN TestChunksCaching/missing_everything_except_middle_subranges,_two_subrequests --- PASS: TestChunksCaching (0.15s) --- PASS: TestChunksCaching/basic_test (0.02s) --- PASS: TestChunksCaching/same_request_will_hit_all_subranges_in_the_cache (0.00s) --- PASS: TestChunksCaching/request_data_close_to_the_end_of_object (0.00s) --- PASS: TestChunksCaching/another_request_data_close_to_the_end_of_object,_cached_by_previous_test (0.00s) --- PASS: TestChunksCaching/entire_object,_combination_of_cached_and_uncached_subranges (0.02s) --- PASS: TestChunksCaching/entire_object_again,_everything_is_cached (0.02s) --- PASS: TestChunksCaching/entire_object_again,_nothing_is_cached (0.04s) --- PASS: TestChunksCaching/missing_first_subranges (0.01s) --- PASS: TestChunksCaching/missing_last_subranges (0.00s) --- PASS: TestChunksCaching/missing_middle_subranges (0.00s) --- PASS: TestChunksCaching/missing_everything_except_middle_subranges (0.01s) --- PASS: TestChunksCaching/missing_everything_except_middle_subranges,_one_subrequest_only (0.00s) --- PASS: TestChunksCaching/missing_everything_except_middle_subranges,_two_subrequests (0.00s) === RUN TestMergeRanges === RUN TestMergeRanges/0 === RUN TestMergeRanges/1 === RUN TestMergeRanges/2 === RUN TestMergeRanges/3 --- PASS: TestMergeRanges (0.00s) --- PASS: TestMergeRanges/0 (0.00s) --- PASS: TestMergeRanges/1 (0.00s) --- PASS: TestMergeRanges/2 (0.00s) --- PASS: TestMergeRanges/3 (0.00s) === RUN TestInvalidOffsetAndLength --- PASS: TestInvalidOffsetAndLength (0.00s) === RUN TestCachedIter --- PASS: TestCachedIter (0.00s) === RUN TestExists --- PASS: TestExists (0.02s) === RUN TestExistsCachingDisabled --- PASS: TestExistsCachingDisabled (0.00s) === RUN TestGet --- PASS: TestGet (0.00s) === RUN TestGetTooBigObject --- PASS: TestGetTooBigObject (0.00s) === RUN TestGetPartialRead --- PASS: TestGetPartialRead (0.00s) === RUN TestAttributes --- PASS: TestAttributes (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb/bucketcache 0.625s === RUN TestIndex_RemoveBlock --- PASS: TestIndex_RemoveBlock (0.00s) === RUN TestDetectBlockSegmentsFormat === RUN TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits_but_non_consecutive === RUN TestDetectBlockSegmentsFormat/meta.json_with_Files,_0_based_6_digits === RUN TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits === RUN TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits_but_non_consecutive === RUN TestDetectBlockSegmentsFormat/meta.json_without_SegmentFiles_and_Files === RUN TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_0_based_6_digits === RUN TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits --- PASS: TestDetectBlockSegmentsFormat (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits_but_non_consecutive (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_Files,_0_based_6_digits (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits_but_non_consecutive (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_without_SegmentFiles_and_Files (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_0_based_6_digits (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits (0.00s) === RUN TestBlockFromThanosMeta === RUN TestBlockFromThanosMeta/meta.json_with_Files === RUN TestBlockFromThanosMeta/meta.json_with_external_labels,_no_compactor_shard_ID === RUN TestBlockFromThanosMeta/meta.json_with_external_labels,_with_compactor_shard_ID === RUN TestBlockFromThanosMeta/meta.json_with_external_labels,_with_invalid_shard_ID === RUN TestBlockFromThanosMeta/meta.json_without_SegmentFiles_and_Files === RUN TestBlockFromThanosMeta/meta.json_with_SegmentFiles --- PASS: TestBlockFromThanosMeta (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_Files (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_external_labels,_no_compactor_shard_ID (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_external_labels,_with_compactor_shard_ID (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_external_labels,_with_invalid_shard_ID (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_without_SegmentFiles_and_Files (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_SegmentFiles (0.00s) === RUN TestBlock_Within --- PASS: TestBlock_Within (0.00s) === RUN TestBlock_ThanosMeta === RUN TestBlock_ThanosMeta/block_with_segment_files_format_1_based_6_digits === RUN TestBlock_ThanosMeta/block_with_unknown_segment_files_format --- PASS: TestBlock_ThanosMeta (0.00s) --- PASS: TestBlock_ThanosMeta/block_with_segment_files_format_1_based_6_digits (0.00s) --- PASS: TestBlock_ThanosMeta/block_with_unknown_segment_files_format (0.00s) === RUN TestBlockDeletionMark_ThanosDeletionMark --- PASS: TestBlockDeletionMark_ThanosDeletionMark (0.00s) === RUN TestBlockDeletionMarks_Clone --- PASS: TestBlockDeletionMarks_Clone (0.00s) === RUN TestLoader_GetIndex_ShouldLazyLoadBucketIndex --- PASS: TestLoader_GetIndex_ShouldLazyLoadBucketIndex (0.04s) === RUN TestLoader_GetIndex_ShouldCacheError --- PASS: TestLoader_GetIndex_ShouldCacheError (0.00s) === RUN TestLoader_GetIndex_ShouldCacheIndexNotFoundError --- PASS: TestLoader_GetIndex_ShouldCacheIndexNotFoundError (0.00s) === RUN TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadSuccess --- PASS: TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadSuccess (1.06s) === RUN TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadFailure --- PASS: TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadFailure (1.11s) === RUN TestLoader_ShouldUpdateIndexInBackgroundOnPreviousIndexNotFound --- PASS: TestLoader_ShouldUpdateIndexInBackgroundOnPreviousIndexNotFound (0.98s) === RUN TestLoader_ShouldNotCacheCriticalErrorOnBackgroundUpdates --- PASS: TestLoader_ShouldNotCacheCriticalErrorOnBackgroundUpdates (0.85s) === RUN TestLoader_ShouldCacheIndexNotFoundOnBackgroundUpdates --- PASS: TestLoader_ShouldCacheIndexNotFoundOnBackgroundUpdates (0.96s) === RUN TestLoader_ShouldOffloadIndexIfNotFoundDuringBackgroundUpdates --- PASS: TestLoader_ShouldOffloadIndexIfNotFoundDuringBackgroundUpdates (1.20s) === RUN TestLoader_ShouldOffloadIndexIfIdleTimeoutIsReachedDuringBackgroundUpdates --- PASS: TestLoader_ShouldOffloadIndexIfIdleTimeoutIsReachedDuringBackgroundUpdates (0.92s) === RUN TestGlobalMarkersBucket_Delete_ShouldSucceedIfDeletionMarkDoesNotExistInTheBlockButExistInTheGlobalLocation --- PASS: TestGlobalMarkersBucket_Delete_ShouldSucceedIfDeletionMarkDoesNotExistInTheBlockButExistInTheGlobalLocation (0.00s) === RUN TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist === RUN TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/deletion_mark === RUN TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/no_compact --- PASS: TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist (0.00s) --- PASS: TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/deletion_mark (0.00s) --- PASS: TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/no_compact (0.00s) === RUN TestUploadToGlobalMarkerPath === RUN TestUploadToGlobalMarkerPath/no_compact === RUN TestUploadToGlobalMarkerPath/deletion_mark --- PASS: TestUploadToGlobalMarkerPath (0.02s) --- PASS: TestUploadToGlobalMarkerPath/no_compact (0.00s) --- PASS: TestUploadToGlobalMarkerPath/deletion_mark (0.00s) === RUN TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist === RUN TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/deletion_mark === RUN TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/no_compact --- PASS: TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist (0.00s) --- PASS: TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/deletion_mark (0.00s) --- PASS: TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/no_compact (0.00s) === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/#00 === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/index === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/no-compact-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/no-compact-mark.json --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/#00 (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/index (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/no-compact-mark.json (0.00s) === RUN TestGlobalMarkersBucket_isBlockDeletionMark === RUN TestGlobalMarkersBucket_isBlockDeletionMark/#00 === RUN TestGlobalMarkersBucket_isBlockDeletionMark/deletion-mark.json === RUN TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/index === RUN TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/deletion-mark.json === RUN TestGlobalMarkersBucket_isBlockDeletionMark//path/to/00000000010000000000000000/deletion-mark.json --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/#00 (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/index (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark//path/to/00000000010000000000000000/deletion-mark.json (0.00s) === RUN TestGlobalMarkersBucket_isNoCompactMark === RUN TestGlobalMarkersBucket_isNoCompactMark/#00 === RUN TestGlobalMarkersBucket_isNoCompactMark/no-compact-mark.json === RUN TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/index === RUN TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/no-compact-mark.json === RUN TestGlobalMarkersBucket_isNoCompactMark//path/to/00000000010000000000000000/no-compact-mark.json --- PASS: TestGlobalMarkersBucket_isNoCompactMark (0.01s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/#00 (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/index (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark//path/to/00000000010000000000000000/no-compact-mark.json (0.01s) === RUN TestBucketWithGlobalMarkers_ShouldWorkCorrectlyWithBucketMetrics --- PASS: TestBucketWithGlobalMarkers_ShouldWorkCorrectlyWithBucketMetrics (0.01s) === RUN TestBlockDeletionMarkFilepath --- PASS: TestBlockDeletionMarkFilepath (0.00s) === RUN TestIsBlockDeletionMarkFilename --- PASS: TestIsBlockDeletionMarkFilename (0.00s) === RUN TestNoCompactMarkFilepath --- PASS: TestNoCompactMarkFilepath (0.00s) === RUN TestIsNoCompactMarkFilename --- PASS: TestIsNoCompactMarkFilename (0.00s) === RUN TestReadIndex_ShouldReturnErrorIfIndexDoesNotExist --- PASS: TestReadIndex_ShouldReturnErrorIfIndexDoesNotExist (0.00s) === RUN TestReadIndex_ShouldReturnErrorIfIndexIsCorrupted --- PASS: TestReadIndex_ShouldReturnErrorIfIndexIsCorrupted (0.00s) === RUN TestReadIndex_ShouldReturnTheParsedIndexOnSuccess --- PASS: TestReadIndex_ShouldReturnTheParsedIndexOnSuccess (0.03s) === RUN TestDeleteIndex_ShouldNotReturnErrorIfIndexDoesNotExist --- PASS: TestDeleteIndex_ShouldNotReturnErrorIfIndexDoesNotExist (0.00s) === RUN TestUpdater_UpdateIndex --- PASS: TestUpdater_UpdateIndex (0.01s) === RUN TestUpdater_UpdateIndex_ShouldSkipPartialBlocks --- PASS: TestUpdater_UpdateIndex_ShouldSkipPartialBlocks (0.00s) === RUN TestUpdater_UpdateIndex_ShouldSkipBlocksWithCorruptedMeta --- PASS: TestUpdater_UpdateIndex_ShouldSkipBlocksWithCorruptedMeta (0.00s) === RUN TestUpdater_UpdateIndex_ShouldSkipCorruptedDeletionMarks --- PASS: TestUpdater_UpdateIndex_ShouldSkipCorruptedDeletionMarks (0.00s) === RUN TestUpdater_UpdateIndex_NoTenantInTheBucket --- PASS: TestUpdater_UpdateIndex_NoTenantInTheBucket (0.00s) === RUN TestUpdater_UpdateIndexFromVersion1ToVersion2 --- PASS: TestUpdater_UpdateIndexFromVersion1ToVersion2 (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb/bucketindex 7.731s ? github.com/grafana/mimir/pkg/storage/tsdb/testutil [no test files] === RUN TestBucketStore_e2e === PAUSE TestBucketStore_e2e === RUN TestBucketStore_ManyParts_e2e === PAUSE TestBucketStore_ManyParts_e2e === RUN TestBucketStore_Series_ChunksLimiter_e2e === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_succeed_if_the_max_chunks_limit_is_not_exceeded === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_ResourceExhausted === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_422 === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_series_limit_is_exceeded_-_422 --- PASS: TestBucketStore_Series_ChunksLimiter_e2e (5.12s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_succeed_if_the_max_chunks_limit_is_not_exceeded (1.16s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_ResourceExhausted (1.66s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_422 (1.16s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_series_limit_is_exceeded_-_422 (1.14s) === RUN TestBucketStore_LabelNames_e2e === PAUSE TestBucketStore_LabelNames_e2e === RUN TestBucketStore_LabelValues_e2e === PAUSE TestBucketStore_LabelValues_e2e === RUN TestBucketIndexMetadataFetcher_Fetch --- PASS: TestBucketIndexMetadataFetcher_Fetch (0.03s) === RUN TestBucketIndexMetadataFetcher_Fetch_NoBucketIndex --- PASS: TestBucketIndexMetadataFetcher_Fetch_NoBucketIndex (0.00s) === RUN TestBucketIndexMetadataFetcher_Fetch_CorruptedBucketIndex --- PASS: TestBucketIndexMetadataFetcher_Fetch_CorruptedBucketIndex (0.01s) === RUN TestBucketStores_InitialSync --- PASS: TestBucketStores_InitialSync (0.41s) === RUN TestBucketStores_InitialSyncShouldRetryOnFailure --- PASS: TestBucketStores_InitialSyncShouldRetryOnFailure (1.97s) === RUN TestBucketStores_SyncBlocks --- PASS: TestBucketStores_SyncBlocks (0.30s) === RUN TestBucketStores_syncUsersBlocks === RUN TestBucketStores_syncUsersBlocks/when_sharding_is_disabled_all_users_should_be_synced === RUN TestBucketStores_syncUsersBlocks/when_sharding_is_enabled_only_stores_for_filtered_users_should_be_created --- PASS: TestBucketStores_syncUsersBlocks (0.02s) --- PASS: TestBucketStores_syncUsersBlocks/when_sharding_is_disabled_all_users_should_be_synced (0.01s) --- PASS: TestBucketStores_syncUsersBlocks/when_sharding_is_enabled_only_stores_for_filtered_users_should_be_created (0.00s) === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_end_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_entire_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_beginning_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_middle_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_entire_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_beginning_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_middle_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_end_of_the_block --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks (0.55s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true (0.32s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_end_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_entire_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_beginning_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_middle_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false (0.23s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_entire_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_beginning_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_middle_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_end_of_the_block (0.00s) === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_all_samples === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_1st_chunk_only === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_2nd_(out_of_order)_chunk_only --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks (0.15s) --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_all_samples (0.00s) --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_1st_chunk_only (0.00s) --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_2nd_(out_of_order)_chunk_only (0.00s) === RUN TestBucketStores_deleteLocalFilesForExcludedTenants --- PASS: TestBucketStores_deleteLocalFilesForExcludedTenants (0.32s) === RUN TestBucketBlock_Property + getFor always gets at least some data in range: OK, passed 20000 tests. Elapsed time: 218.627079ms + getFor always gets all data in range: OK, passed 20000 tests. Elapsed time: 181.010499ms --- PASS: TestBucketBlock_Property (0.40s) === RUN TestBucketBlock_matchLabels --- PASS: TestBucketBlock_matchLabels (0.00s) === RUN TestBucketBlockSet_addGet === RUN TestBucketBlockSet_addGet/#00 === RUN TestBucketBlockSet_addGet/#01 === RUN TestBucketBlockSet_addGet/#02 === RUN TestBucketBlockSet_addGet/#03 --- PASS: TestBucketBlockSet_addGet (0.00s) --- PASS: TestBucketBlockSet_addGet/#00 (0.00s) --- PASS: TestBucketBlockSet_addGet/#01 (0.00s) --- PASS: TestBucketBlockSet_addGet/#02 (0.00s) --- PASS: TestBucketBlockSet_addGet/#03 (0.00s) === RUN TestBucketBlockSet_remove --- PASS: TestBucketBlockSet_remove (0.00s) === RUN TestBucketBlockSet_labelMatchers --- PASS: TestBucketBlockSet_labelMatchers (0.00s) === RUN TestReadIndexCache_LoadSeries --- PASS: TestReadIndexCache_LoadSeries (0.00s) === RUN TestBlockLabelNames === RUN TestBlockLabelNames/happy_case_with_no_matchers === RUN TestBlockLabelNames/index_reader_error_with_no_matchers === RUN TestBlockLabelNames/happy_case_cached_with_no_matchers === RUN TestBlockLabelNames/error_with_matchers === RUN TestBlockLabelNames/happy_case_cached_with_matchers --- PASS: TestBlockLabelNames (0.17s) --- PASS: TestBlockLabelNames/happy_case_with_no_matchers (0.00s) --- PASS: TestBlockLabelNames/index_reader_error_with_no_matchers (0.00s) --- PASS: TestBlockLabelNames/happy_case_cached_with_no_matchers (0.00s) --- PASS: TestBlockLabelNames/error_with_matchers (0.00s) --- PASS: TestBlockLabelNames/happy_case_cached_with_matchers (0.01s) === RUN TestBlockLabelValues === RUN TestBlockLabelValues/happy_case_with_no_matchers === RUN TestBlockLabelValues/index_reader_error_with_no_matchers === RUN TestBlockLabelValues/happy_case_cached_with_no_matchers === RUN TestBlockLabelValues/error_with_matchers === RUN TestBlockLabelValues/happy_case_cached_with_matchers --- PASS: TestBlockLabelValues (0.15s) --- PASS: TestBlockLabelValues/happy_case_with_no_matchers (0.00s) --- PASS: TestBlockLabelValues/index_reader_error_with_no_matchers (0.00s) --- PASS: TestBlockLabelValues/happy_case_cached_with_no_matchers (0.00s) --- PASS: TestBlockLabelValues/error_with_matchers (0.00s) --- PASS: TestBlockLabelValues/happy_case_cached_with_matchers (0.00s) === RUN TestBucketIndexReader_ExpandedPostings === RUN TestBucketIndexReader_ExpandedPostings/happy_cases === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/j="foo",n="1" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j!="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".+" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i!="" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",i!="2",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~"1.+",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!="2",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!~"2.*",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"0xxx|1xxx|2xxx" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"(0|1|2)xxx" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"[0-2]xxx" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i!~[0-2]xxx === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*",_i!~[0-2]xxx === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/p!="" === RUN TestBucketIndexReader_ExpandedPostings/corrupted_or_undecodable_postings_cache_doesn't_fail === RUN TestBucketIndexReader_ExpandedPostings/promise === RUN TestBucketIndexReader_ExpandedPostings/cached === RUN TestBucketIndexReader_ExpandedPostings/corrupt_cached_expanded_postings_don't_make_request_fail === RUN TestBucketIndexReader_ExpandedPostings/expandedPostings_returning_error_is_not_cached --- PASS: TestBucketIndexReader_ExpandedPostings (0.18s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases (0.02s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/j="foo",n="1" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j!="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".+" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i!="" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",i!="2",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~"1.+",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!="2",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!~"2.*",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"0xxx|1xxx|2xxx" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"(0|1|2)xxx" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"[0-2]xxx" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i!~[0-2]xxx (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*",_i!~[0-2]xxx (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/p!="" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/corrupted_or_undecodable_postings_cache_doesn't_fail (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/promise (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/cached (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/corrupt_cached_expanded_postings_don't_make_request_fail (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/expandedPostings_returning_error_is_not_cached (0.00s) === RUN TestBucketSeries === RUN TestBucketSeries/10000SeriesWith1Samples bucket_test.go:2548: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSeries10000SeriesWith1Samples221969093/001/0 bucket_test.go:2548: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSeries10000SeriesWith1Samples221969093/001/1 bucket_test.go:2548: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSeries10000SeriesWith1Samples221969093/001/2 bucket_test.go:2548: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSeries10000SeriesWith1Samples221969093/001/3 === RUN TestBucketSeries/10000SeriesWith1Samples/10000of10000 === RUN TestBucketSeries/1000SeriesWith10Samples bucket_test.go:2548: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSeries1000SeriesWith10Samples699966030/001/0 bucket_test.go:2548: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSeries1000SeriesWith10Samples699966030/001/1 bucket_test.go:2548: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSeries1000SeriesWith10Samples699966030/001/2 bucket_test.go:2548: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSeries1000SeriesWith10Samples699966030/001/3 === RUN TestBucketSeries/1000SeriesWith10Samples/10000of10000 === RUN TestBucketSeries/1SeriesWith10000Samples bucket_test.go:2548: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSeries1SeriesWith10000Samples3870307456/001/0 bucket_test.go:2548: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSeries1SeriesWith10000Samples3870307456/001/1 bucket_test.go:2548: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSeries1SeriesWith10000Samples3870307456/001/2 bucket_test.go:2548: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSeries1SeriesWith10000Samples3870307456/001/3 === RUN TestBucketSeries/1SeriesWith10000Samples/10000of10000 --- PASS: TestBucketSeries (2.39s) --- PASS: TestBucketSeries/10000SeriesWith1Samples (1.23s) --- PASS: TestBucketSeries/10000SeriesWith1Samples/10000of10000 (0.23s) --- PASS: TestBucketSeries/1000SeriesWith10Samples (0.58s) --- PASS: TestBucketSeries/1000SeriesWith10Samples/10000of10000 (0.03s) --- PASS: TestBucketSeries/1SeriesWith10000Samples (0.57s) --- PASS: TestBucketSeries/1SeriesWith10000Samples/10000of10000 (0.00s) === RUN TestBucketSkipChunksSeries === RUN TestBucketSkipChunksSeries/10000SeriesWith1Samples bucket_test.go:2548: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries10000SeriesWith1Samples2101542436/001/0 bucket_test.go:2548: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries10000SeriesWith1Samples2101542436/001/1 bucket_test.go:2548: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries10000SeriesWith1Samples2101542436/001/2 bucket_test.go:2548: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries10000SeriesWith1Samples2101542436/001/3 === RUN TestBucketSkipChunksSeries/10000SeriesWith1Samples/10000of10000 === RUN TestBucketSkipChunksSeries/1000SeriesWith10Samples bucket_test.go:2548: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1000SeriesWith10Samples2969185636/001/0 bucket_test.go:2548: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1000SeriesWith10Samples2969185636/001/1 bucket_test.go:2548: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1000SeriesWith10Samples2969185636/001/2 bucket_test.go:2548: Creating 250 2-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1000SeriesWith10Samples2969185636/001/3 === RUN TestBucketSkipChunksSeries/1000SeriesWith10Samples/10000of10000 === RUN TestBucketSkipChunksSeries/1SeriesWith10000Samples bucket_test.go:2548: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1SeriesWith10000Samples2048261696/001/0 bucket_test.go:2548: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1SeriesWith10000Samples2048261696/001/1 bucket_test.go:2548: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1SeriesWith10000Samples2048261696/001/2 bucket_test.go:2548: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucketSkipChunksSeries1SeriesWith10000Samples2048261696/001/3 === RUN TestBucketSkipChunksSeries/1SeriesWith10000Samples/10000of10000 --- PASS: TestBucketSkipChunksSeries (3.39s) --- PASS: TestBucketSkipChunksSeries/10000SeriesWith1Samples (1.05s) --- PASS: TestBucketSkipChunksSeries/10000SeriesWith1Samples/10000of10000 (0.12s) --- PASS: TestBucketSkipChunksSeries/1000SeriesWith10Samples (1.10s) --- PASS: TestBucketSkipChunksSeries/1000SeriesWith10Samples/10000of10000 (0.04s) --- PASS: TestBucketSkipChunksSeries/1SeriesWith10000Samples (1.21s) --- PASS: TestBucketSkipChunksSeries/1SeriesWith10000Samples/10000of10000 (0.00s) === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_one_block._Fill_the_cache_on_the_way. === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_second_block._This_should_revoke_previous_cache. === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault/remove_second_block._Cache_stays._Ask_for_first_again. --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault (0.51s) --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_one_block._Fill_the_cache_on_the_way. (0.01s) --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_second_block._This_should_revoke_previous_cache. (0.01s) --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault/remove_second_block._Cache_stays._Ask_for_first_again. (0.01s) === RUN TestSeries_RequestAndResponseHints bucket_test.go:2548: Creating 2 1-sample series with 1ms interval in /tmp/TestSeries_RequestAndResponseHints2326941767/001/0 bucket_test.go:2548: Creating 2 1-sample series with 1ms interval in /tmp/TestSeries_RequestAndResponseHints2326941767/001/1 === RUN TestSeries_RequestAndResponseHints/querying_a_range_containing_1_block_should_return_1_block_in_the_response_hints === RUN TestSeries_RequestAndResponseHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints === RUN TestSeries_RequestAndResponseHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block --- PASS: TestSeries_RequestAndResponseHints (0.39s) --- PASS: TestSeries_RequestAndResponseHints/querying_a_range_containing_1_block_should_return_1_block_in_the_response_hints (0.00s) --- PASS: TestSeries_RequestAndResponseHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints (0.00s) --- PASS: TestSeries_RequestAndResponseHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block (0.00s) === RUN TestSeries_ErrorUnmarshallingRequestHints --- PASS: TestSeries_ErrorUnmarshallingRequestHints (0.00s) === RUN TestSeries_BlockWithMultipleChunks === RUN TestSeries_BlockWithMultipleChunks/query_the_middle_of_the_block === RUN TestSeries_BlockWithMultipleChunks/query_the_end_of_the_block === RUN TestSeries_BlockWithMultipleChunks/query_the_entire_block === RUN TestSeries_BlockWithMultipleChunks/query_the_beginning_of_the_block --- PASS: TestSeries_BlockWithMultipleChunks (0.32s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_middle_of_the_block (0.00s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_end_of_the_block (0.00s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_entire_block (0.00s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_beginning_of_the_block (0.00s) === RUN TestBigEndianPostingsCount --- PASS: TestBigEndianPostingsCount (0.00s) === RUN TestLabelNamesAndValuesHints bucket_test.go:2548: Creating 2 1-sample series with 1ms interval in /tmp/TestLabelNamesAndValuesHints1062778022/001/0 bucket_test.go:2548: Creating 2 1-sample series with 1ms interval in /tmp/TestLabelNamesAndValuesHints1062778022/001/1 === RUN TestLabelNamesAndValuesHints/querying_a_range_containing_1_block_should_return_1_block_in_the_labels_hints === RUN TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints === RUN TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block --- PASS: TestLabelNamesAndValuesHints (0.42s) --- PASS: TestLabelNamesAndValuesHints/querying_a_range_containing_1_block_should_return_1_block_in_the_labels_hints (0.00s) --- PASS: TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints (0.00s) --- PASS: TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block (0.00s) === RUN TestBlockSeries_skipChunks_ignoresMintMaxt --- PASS: TestBlockSeries_skipChunks_ignoresMintMaxt (0.20s) === RUN TestBlockSeries_Cache === RUN TestBlockSeries_Cache/does_not_update_cache_on_error === RUN TestBlockSeries_Cache/caches_series --- PASS: TestBlockSeries_Cache (0.17s) --- PASS: TestBlockSeries_Cache/does_not_update_cache_on_error (0.00s) --- PASS: TestBlockSeries_Cache/caches_series (0.01s) === RUN TestFilterPostingsByCachedShardHash === RUN TestFilterPostingsByCachedShardHash/should_be_a_noop_if_the_cache_is_empty === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_beginning_of_the_slice === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_in_the_middle_of_the_slice === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_end_of_the_slice === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_when_all_postings_are_in_the_cache --- PASS: TestFilterPostingsByCachedShardHash (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_be_a_noop_if_the_cache_is_empty (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_beginning_of_the_slice (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_in_the_middle_of_the_slice (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_end_of_the_slice (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_when_all_postings_are_in_the_cache (0.00s) === RUN TestFilterPostingsByCachedShardHash_NoAllocations --- PASS: TestFilterPostingsByCachedShardHash_NoAllocations (0.00s) === RUN TestChunkBytesPool_Get --- PASS: TestChunkBytesPool_Get (0.00s) === RUN TestIsHealthyForStoreGatewayOperations === PAUSE TestIsHealthyForStoreGatewayOperations === RUN TestUnregisterOnShutdownFlag --- PASS: TestUnregisterOnShutdownFlag (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_by_default === RUN TestConfig_Validate/should_fail_if_shard_size_is_negative === RUN TestConfig_Validate/should_pass_if_shard_size_has_been_set --- PASS: TestConfig_Validate (0.01s) --- PASS: TestConfig_Validate/should_pass_by_default (0.00s) --- PASS: TestConfig_Validate/should_fail_if_shard_size_is_negative (0.00s) --- PASS: TestConfig_Validate/should_pass_if_shard_size_has_been_set (0.00s) === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_LEAVING_state_and_has_all_tokens === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_not_in_the_ring === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_PENDING_state_and_has_no_tokens === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_JOINING_state_and_has_some_tokens === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_ACTIVE_state_and_has_all_tokens --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled (2.99s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_LEAVING_state_and_has_all_tokens (0.50s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_not_in_the_ring (0.31s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_PENDING_state_and_has_no_tokens (0.35s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_JOINING_state_and_has_some_tokens (1.46s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_ACTIVE_state_and_has_all_tokens (0.38s) === RUN TestStoreGateway_InitialSyncFailure --- PASS: TestStoreGateway_InitialSyncFailure (4.45s) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) gateway_test.go:302: random generator seed: 1661376011657560619 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) gateway_test.go:302: random generator seed: 1661376011657806401 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) gateway_test.go:302: random generator seed: 1661376011657880581 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) gateway_test.go:302: random generator seed: 1661376011658015524 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) gateway_test.go:302: random generator seed: 1661376011658130700 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) gateway_test.go:302: random generator seed: 1661376011658240026 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) gateway_test.go:302: random generator seed: 1661376011658458106 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) gateway_test.go:302: random generator seed: 1661376011658586467 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) gateway_test.go:302: random generator seed: 1661376011658793736 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) gateway_test.go:302: random generator seed: 1661376011657466362 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) gateway_test.go:302: random generator seed: 1661376011657178171 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) gateway_test.go:302: random generator seed: 1661376011657267138 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) gateway_test.go:302: random generator seed: 1661376011657379719 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) gateway_test.go:302: random generator seed: 1661376011657715611 --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability (3.26s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) (4.27s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) (4.27s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) (4.33s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) (4.37s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) (4.45s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) (5.39s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) (6.34s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) (6.36s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) (6.39s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) (6.40s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) (6.47s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) (6.59s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) (7.34s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) (7.35s) === RUN TestStoreGateway_BlocksSyncWithDefaultSharding_RingTopologyChangedAfterScaleUp gateway_test.go:404: random generator seed: 1661376021815068124 --- PASS: TestStoreGateway_BlocksSyncWithDefaultSharding_RingTopologyChangedAfterScaleUp (15.68s) === RUN TestStoreGateway_ShouldSupportLoadRingTokensFromFile === RUN TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_less_than_the_configured_ones === RUN TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_equal_to_the_configured_ones === RUN TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_more_then_the_configured_ones --- PASS: TestStoreGateway_ShouldSupportLoadRingTokensFromFile (1.14s) --- PASS: TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_less_than_the_configured_ones (0.39s) --- PASS: TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_equal_to_the_configured_ones (0.40s) --- PASS: TestStoreGateway_ShouldSupportLoadRingTokensFromFile/stored_tokens_are_more_then_the_configured_ones (0.35s) === RUN TestStoreGateway_SyncOnRingTopologyChanged === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_unhealthy_instance_becomes_healthy === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_NOT_sync_when_an_instance_updates_the_heartbeat === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_is_added_to_the_ring === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_is_removed_from_the_ring === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_changes_state === RUN TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_healthy_instance_becomes_unhealthy --- PASS: TestStoreGateway_SyncOnRingTopologyChanged (3.11s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_unhealthy_instance_becomes_healthy (0.42s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_NOT_sync_when_an_instance_updates_the_heartbeat (0.55s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state (0.54s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_is_added_to_the_ring (0.40s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_is_removed_from_the_ring (0.37s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_instance_changes_state (0.46s) --- PASS: TestStoreGateway_SyncOnRingTopologyChanged/should_sync_when_an_healthy_instance_becomes_unhealthy (0.37s) === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_healthy_in_the_ring === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_unhealthy_in_the_ring === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_missing_in_the_ring_(e.g._removed_from_another_instance_because_of_the_auto-forget_feature) === RUN TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_re-registered_to_the_ring_and_it's_healthy --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing (0.62s) --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_healthy_in_the_ring (0.01s) --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_unhealthy_in_the_ring (0.06s) --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_missing_in_the_ring_(e.g._removed_from_another_instance_because_of_the_auto-forget_feature) (0.05s) --- PASS: TestStoreGateway_SyncShouldKeepPreviousBlocksIfInstanceIsUnhealthyInTheRing/store-gateway_is_re-registered_to_the_ring_and_it's_healthy (0.06s) === RUN TestStoreGateway_RingLifecyclerShouldAutoForgetUnhealthyInstances --- PASS: TestStoreGateway_RingLifecyclerShouldAutoForgetUnhealthyInstances (0.32s) === RUN TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels === RUN TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels/bucket_index_enabled_=_true === RUN TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels/bucket_index_enabled_=_false --- PASS: TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels (0.93s) --- PASS: TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels/bucket_index_enabled_=_true (0.34s) --- PASS: TestStoreGateway_SeriesQueryingShouldRemoveExternalLabels/bucket_index_enabled_=_false (0.31s) === RUN TestStoreGateway_Series_QuerySharding === RUN TestStoreGateway_Series_QuerySharding/should_touch_all_series_on_sharding_disabled === RUN TestStoreGateway_Series_QuerySharding/should_touch_only_series_belonging_to_the_specified_shard --- PASS: TestStoreGateway_Series_QuerySharding (0.44s) --- PASS: TestStoreGateway_Series_QuerySharding/should_touch_all_series_on_sharding_disabled (0.00s) --- PASS: TestStoreGateway_Series_QuerySharding/should_touch_only_series_belonging_to_the_specified_shard (0.00s) === RUN TestStoreGateway_Series_QueryShardingConcurrency --- PASS: TestStoreGateway_Series_QueryShardingConcurrency (1.16s) === RUN TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit === RUN TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/no_limit_enforced_if_zero === RUN TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/should_return_NO_error_if_the_actual_number_of_queried_chunks_is_<=_limit === RUN TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/should_return_error_if_the_actual_number_of_queried_chunks_is_>_limit --- PASS: TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit (1.01s) --- PASS: TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/no_limit_enforced_if_zero (0.29s) --- PASS: TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/should_return_NO_error_if_the_actual_number_of_queried_chunks_is_<=_limit (0.28s) --- PASS: TestStoreGateway_SeriesQueryingShouldEnforceMaxChunksPerQueryLimit/should_return_error_if_the_actual_number_of_queried_chunks_is_>_limit (0.29s) === RUN TestByteRanges_contiguous --- PASS: TestByteRanges_contiguous (0.00s) === RUN TestReadByteRanges === RUN TestReadByteRanges/no_ranges === RUN TestReadByteRanges/single_range_with_offset_==_0 === RUN TestReadByteRanges/multiple_contiguous_ranges_with_first_offset_==_0 === RUN TestReadByteRanges/multiple_non-contiguous_ranges === RUN TestReadByteRanges/single_range_with_offset_>_0 === RUN TestReadByteRanges/multiple_contiguous_ranges_with_first_offset_>_0 === RUN TestReadByteRanges/discard_bytes_before_the_first_range === RUN TestReadByteRanges/discard_bytes_after_the_last_range === RUN TestReadByteRanges/unexpected_EOF_while_discarding_bytes === RUN TestReadByteRanges/unexpected_EOF_while_reading_byte_range === RUN TestReadByteRanges/unexpected_EOF_at_the_beginning_of_a_byte_range --- PASS: TestReadByteRanges (0.00s) --- PASS: TestReadByteRanges/no_ranges (0.00s) --- PASS: TestReadByteRanges/single_range_with_offset_==_0 (0.00s) --- PASS: TestReadByteRanges/multiple_contiguous_ranges_with_first_offset_==_0 (0.00s) --- PASS: TestReadByteRanges/multiple_non-contiguous_ranges (0.00s) --- PASS: TestReadByteRanges/single_range_with_offset_>_0 (0.00s) --- PASS: TestReadByteRanges/multiple_contiguous_ranges_with_first_offset_>_0 (0.00s) --- PASS: TestReadByteRanges/discard_bytes_before_the_first_range (0.00s) --- PASS: TestReadByteRanges/discard_bytes_after_the_last_range (0.00s) --- PASS: TestReadByteRanges/unexpected_EOF_while_discarding_bytes (0.00s) --- PASS: TestReadByteRanges/unexpected_EOF_while_reading_byte_range (0.00s) --- PASS: TestReadByteRanges/unexpected_EOF_at_the_beginning_of_a_byte_range (0.00s) === RUN TestLimiter --- PASS: TestLimiter (0.00s) === RUN TestIgnoreDeletionMarkFilter_Filter --- PASS: TestIgnoreDeletionMarkFilter_Filter (0.01s) === RUN TestIgnoreDeletionMarkFilter_FilterWithBucketIndex --- PASS: TestIgnoreDeletionMarkFilter_FilterWithBucketIndex (0.00s) === RUN TestTimeMetaFilter --- PASS: TestTimeMetaFilter (0.00s) === RUN TestMetadataFetcherMetrics --- PASS: TestMetadataFetcherMetrics (0.00s) === RUN TestGapBasedPartitioner_Metrics --- PASS: TestGapBasedPartitioner_Metrics (0.00s) === RUN TestGapBasedPartitioner_Partition --- PASS: TestGapBasedPartitioner_Partition (0.00s) === RUN TestDiffVarintCodec === RUN TestDiffVarintCodec/raw/n="1" postings_codec_test.go:77: postings entries: 400 postings_codec_test.go:78: original size (4*entries): 1600 bytes postings_codec_test.go:84: encoded size 401 bytes postings_codec_test.go:85: ratio: 0.251 === RUN TestDiffVarintCodec/snappy/n="1" postings_codec_test.go:77: postings entries: 400 postings_codec_test.go:78: original size (4*entries): 1600 bytes postings_codec_test.go:84: encoded size 31 bytes postings_codec_test.go:85: ratio: 0.019 === RUN TestDiffVarintCodec/raw/i=~".*" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 10000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i=~".*" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 478 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/i=~".+" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 10000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i=~".+" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 478 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/i=~"1.+" postings_codec_test.go:77: postings entries: 5550 postings_codec_test.go:78: original size (4*entries): 22200 bytes postings_codec_test.go:84: encoded size 5560 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i=~"1.+" postings_codec_test.go:77: postings entries: 5550 postings_codec_test.go:78: original size (4*entries): 22200 bytes postings_codec_test.go:84: encoded size 283 bytes postings_codec_test.go:85: ratio: 0.013 === RUN TestDiffVarintCodec/raw/i!~"" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 10000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i!~"" postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 478 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/i!~"2.*" postings_codec_test.go:77: postings entries: 9450 postings_codec_test.go:78: original size (4*entries): 37800 bytes postings_codec_test.go:84: encoded size 9450 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/i!~"2.*" postings_codec_test.go:77: postings entries: 9450 postings_codec_test.go:78: original size (4*entries): 37800 bytes postings_codec_test.go:84: encoded size 463 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/all postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 10000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/all postings_codec_test.go:77: postings entries: 10000 postings_codec_test.go:78: original size (4*entries): 40000 bytes postings_codec_test.go:84: encoded size 478 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/j="foo" postings_codec_test.go:77: postings entries: 4000 postings_codec_test.go:78: original size (4*entries): 16000 bytes postings_codec_test.go:84: encoded size 4000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/j="foo" postings_codec_test.go:77: postings entries: 4000 postings_codec_test.go:78: original size (4*entries): 16000 bytes postings_codec_test.go:84: encoded size 197 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/j!="foo" postings_codec_test.go:77: postings entries: 6000 postings_codec_test.go:78: original size (4*entries): 24000 bytes postings_codec_test.go:84: encoded size 6000 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/j!="foo" postings_codec_test.go:77: postings entries: 6000 postings_codec_test.go:78: original size (4*entries): 24000 bytes postings_codec_test.go:84: encoded size 292 bytes postings_codec_test.go:85: ratio: 0.012 === RUN TestDiffVarintCodec/raw/i=~"^$"' postings_codec_test.go:77: postings entries: 0 postings_codec_test.go:78: original size (4*entries): 0 bytes postings_codec_test.go:84: encoded size 0 bytes postings_codec_test.go:85: ratio: NaN === RUN TestDiffVarintCodec/snappy/i=~"^$"' postings_codec_test.go:77: postings entries: 0 postings_codec_test.go:78: original size (4*entries): 0 bytes postings_codec_test.go:84: encoded size 4 bytes postings_codec_test.go:85: ratio: +Inf === RUN TestDiffVarintCodec/raw/n!="2" postings_codec_test.go:77: postings entries: 9600 postings_codec_test.go:78: original size (4*entries): 38400 bytes postings_codec_test.go:84: encoded size 9600 bytes postings_codec_test.go:85: ratio: 0.250 === RUN TestDiffVarintCodec/snappy/n!="2" postings_codec_test.go:77: postings entries: 9600 postings_codec_test.go:78: original size (4*entries): 38400 bytes postings_codec_test.go:84: encoded size 466 bytes postings_codec_test.go:85: ratio: 0.012 --- PASS: TestDiffVarintCodec (0.25s) --- PASS: TestDiffVarintCodec/raw/n="1" (0.00s) --- PASS: TestDiffVarintCodec/snappy/n="1" (0.00s) --- PASS: TestDiffVarintCodec/raw/i=~".*" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i=~".*" (0.00s) --- PASS: TestDiffVarintCodec/raw/i=~".+" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i=~".+" (0.00s) --- PASS: TestDiffVarintCodec/raw/i=~"1.+" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i=~"1.+" (0.00s) --- PASS: TestDiffVarintCodec/raw/i!~"" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i!~"" (0.00s) --- PASS: TestDiffVarintCodec/raw/i!~"2.*" (0.00s) --- PASS: TestDiffVarintCodec/snappy/i!~"2.*" (0.00s) --- PASS: TestDiffVarintCodec/raw/all (0.00s) --- PASS: TestDiffVarintCodec/snappy/all (0.00s) --- PASS: TestDiffVarintCodec/raw/j="foo" (0.00s) --- PASS: TestDiffVarintCodec/snappy/j="foo" (0.00s) --- PASS: TestDiffVarintCodec/raw/j!="foo" (0.00s) --- PASS: TestDiffVarintCodec/snappy/j!="foo" (0.00s) --- PASS: TestDiffVarintCodec/raw/i=~"^$"' (0.00s) --- PASS: TestDiffVarintCodec/snappy/i=~"^$"' (0.00s) --- PASS: TestDiffVarintCodec/raw/n!="2" (0.00s) --- PASS: TestDiffVarintCodec/snappy/n!="2" (0.00s) === RUN TestShuffleShardingStrategy === RUN TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === PAUSE TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === RUN TestShuffleShardingStrategy/LEAVING_instance_in_the_ring_should_continue_to_keep_its_shard_blocks_and_they_should_NOT_be_replicated_to_another_instance === PAUSE TestShuffleShardingStrategy/LEAVING_instance_in_the_ring_should_continue_to_keep_its_shard_blocks_and_they_should_NOT_be_replicated_to_another_instance === RUN TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_2_(should_sync_blocks_on_2_instances_because_of_the_shard_size) === PAUSE TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_2_(should_sync_blocks_on_2_instances_because_of_the_shard_size) === RUN TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_NO_previously_loaded_blocks === PAUSE TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_NO_previously_loaded_blocks === RUN TestShuffleShardingStrategy/SS_=_0_disables_shuffle_sharding === PAUSE TestShuffleShardingStrategy/SS_=_0_disables_shuffle_sharding === RUN TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_1_(should_still_sync_blocks_on_the_only_available_instance) === PAUSE TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_1_(should_still_sync_blocks_on_the_only_available_instance) === RUN TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_2_(should_still_sync_blocks_on_the_only_available_instance) === PAUSE TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_2_(should_still_sync_blocks_on_the_only_available_instance) === RUN TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_2_(should_sync_all_blocks_on_2_instances) === PAUSE TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_2_(should_sync_all_blocks_on_2_instances) === RUN TestShuffleShardingStrategy/multiple_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_3 === PAUSE TestShuffleShardingStrategy/multiple_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_3 === RUN TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_1,_SS_=_3_and_NO_previously_loaded_blocks === PAUSE TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_1,_SS_=_3_and_NO_previously_loaded_blocks === RUN TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_3_and_NO_previously_loaded_blocks === PAUSE TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_3_and_NO_previously_loaded_blocks === RUN TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_1_and_SS_=_1 === PAUSE TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_1_and_SS_=_1 === RUN TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === PAUSE TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === RUN TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_some_previously_loaded_blocks === PAUSE TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_some_previously_loaded_blocks === RUN TestShuffleShardingStrategy/JOINING_instance_in_the_ring_should_get_its_shard_blocks_and_they_should_not_be_replicated_to_another_instance === PAUSE TestShuffleShardingStrategy/JOINING_instance_in_the_ring_should_get_its_shard_blocks_and_they_should_not_be_replicated_to_another_instance === CONT TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === CONT TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_3_and_NO_previously_loaded_blocks === CONT TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_1_(should_still_sync_blocks_on_the_only_available_instance) === CONT TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_2_(should_sync_blocks_on_2_instances_because_of_the_shard_size) === CONT TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_some_previously_loaded_blocks === CONT TestShuffleShardingStrategy/JOINING_instance_in_the_ring_should_get_its_shard_blocks_and_they_should_not_be_replicated_to_another_instance === CONT TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_NO_previously_loaded_blocks === CONT TestShuffleShardingStrategy/SS_=_0_disables_shuffle_sharding === CONT TestShuffleShardingStrategy/multiple_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_3 === CONT TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_2_(should_sync_all_blocks_on_2_instances) === CONT TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_1,_SS_=_3_and_NO_previously_loaded_blocks === CONT TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_2_(should_still_sync_blocks_on_the_only_available_instance) === CONT TestShuffleShardingStrategy/LEAVING_instance_in_the_ring_should_continue_to_keep_its_shard_blocks_and_they_should_NOT_be_replicated_to_another_instance === CONT TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) === CONT TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_1_and_SS_=_1 --- PASS: TestShuffleShardingStrategy (0.00s) --- PASS: TestShuffleShardingStrategy/multiple_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_3 (1.00s) --- PASS: TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_2_(should_still_sync_blocks_on_the_only_available_instance) (1.00s) --- PASS: TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_2_and_SS_=_1_(should_still_sync_blocks_on_the_only_available_instance) (2.00s) --- PASS: TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_2_(should_sync_blocks_on_2_instances_because_of_the_shard_size) (2.00s) --- PASS: TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) (2.00s) --- PASS: TestShuffleShardingStrategy/JOINING_instance_in_the_ring_should_get_its_shard_blocks_and_they_should_not_be_replicated_to_another_instance (2.00s) --- PASS: TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_some_previously_loaded_blocks (2.00s) --- PASS: TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_3_and_NO_previously_loaded_blocks (2.00s) --- PASS: TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_2,_SS_=_2_and_NO_previously_loaded_blocks (2.00s) --- PASS: TestShuffleShardingStrategy/one_ACTIVE_instance_in_the_ring_with_RF_=_1_and_SS_=_1 (2.00s) --- PASS: TestShuffleShardingStrategy/one_unhealthy_instance_in_the_ring_with_RF_=_1,_SS_=_3_and_NO_previously_loaded_blocks (2.00s) --- PASS: TestShuffleShardingStrategy/SS_=_0_disables_shuffle_sharding (2.00s) --- PASS: TestShuffleShardingStrategy/LEAVING_instance_in_the_ring_should_continue_to_keep_its_shard_blocks_and_they_should_NOT_be_replicated_to_another_instance (2.00s) --- PASS: TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_1_and_SS_=_1_(should_sync_blocks_on_1_instance_because_of_the_shard_size) (2.00s) --- PASS: TestShuffleShardingStrategy/two_ACTIVE_instances_in_the_ring_with_RF_=_2_and_SS_=_2_(should_sync_all_blocks_on_2_instances) (2.00s) === RUN TestSnappyGobSeriesCacheEntryCodec === RUN TestSnappyGobSeriesCacheEntryCodec/happy_case_roundtrip === RUN TestSnappyGobSeriesCacheEntryCodec/can't_decode_wrong_codec === RUN TestSnappyGobSeriesCacheEntryCodec/can't_decode_wrong_data --- PASS: TestSnappyGobSeriesCacheEntryCodec (0.00s) --- PASS: TestSnappyGobSeriesCacheEntryCodec/happy_case_roundtrip (0.00s) --- PASS: TestSnappyGobSeriesCacheEntryCodec/can't_decode_wrong_codec (0.00s) --- PASS: TestSnappyGobSeriesCacheEntryCodec/can't_decode_wrong_data (0.00s) === CONT TestBucketStore_e2e === CONT TestBucketStore_LabelValues_e2e === CONT TestBucketStore_LabelNames_e2e === RUN TestBucketStore_e2e/inmem === CONT TestBucketStore_ManyParts_e2e === RUN TestBucketStore_LabelValues_e2e/inmem === CONT TestIsHealthyForStoreGatewayOperations === RUN TestBucketStore_ManyParts_e2e/inmem === RUN TestBucketStore_LabelNames_e2e/inmem === RUN TestIsHealthyForStoreGatewayOperations/PENDING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForStoreGatewayOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForStoreGatewayOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout === RUN TestIsHealthyForStoreGatewayOperations/JOINING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForStoreGatewayOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout --- PASS: TestIsHealthyForStoreGatewayOperations (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/PENDING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/JOINING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForStoreGatewayOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout (0.00s) === RUN TestBucketStore_e2e/inmem/no_index_cache === RUN TestBucketStore_e2e/inmem/no_index_cache/0 === RUN TestBucketStore_e2e/inmem/no_index_cache/1 === RUN TestBucketStore_e2e/inmem/no_index_cache/2 === RUN TestBucketStore_e2e/inmem/no_index_cache/3 === RUN TestBucketStore_e2e/inmem/no_index_cache/4 === RUN TestBucketStore_e2e/inmem/no_index_cache/5 === RUN TestBucketStore_e2e/inmem/no_index_cache/6 === RUN TestBucketStore_e2e/inmem/no_index_cache/7 === RUN TestBucketStore_e2e/inmem/no_index_cache/8 === RUN TestBucketStore_e2e/inmem/no_index_cache/9 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/0 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/1 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/2 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/3 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/4 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/5 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/6 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/7 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/8 === RUN TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/9 === RUN TestBucketStore_e2e/inmem/with_small_index_cache === RUN TestBucketStore_e2e/inmem/with_small_index_cache/0 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/1 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/2 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/3 === RUN TestBucketStore_ManyParts_e2e/inmem/0 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/4 === RUN TestBucketStore_ManyParts_e2e/inmem/1 === RUN TestBucketStore_LabelNames_e2e/inmem/b=1_matcher === RUN TestBucketStore_e2e/inmem/with_small_index_cache/5 === RUN TestBucketStore_ManyParts_e2e/inmem/2 === RUN TestBucketStore_LabelNames_e2e/inmem/b=''_matcher === RUN TestBucketStore_e2e/inmem/with_small_index_cache/6 === RUN TestBucketStore_LabelNames_e2e/inmem/outside_the_time_range,_with_matcher === RUN TestBucketStore_LabelNames_e2e/inmem/basic_labelNames === RUN TestBucketStore_ManyParts_e2e/inmem/3 === RUN TestBucketStore_LabelNames_e2e/inmem/outside_the_time_range === RUN TestBucketStore_LabelNames_e2e/inmem/matcher_matching_everything === RUN TestBucketStore_e2e/inmem/with_small_index_cache/7 === RUN TestBucketStore_ManyParts_e2e/inmem/4 === RUN TestBucketStore_LabelNames_e2e/filesystem === PAUSE TestBucketStore_LabelNames_e2e/filesystem === CONT TestBucketStore_LabelNames_e2e/filesystem === RUN TestBucketStore_ManyParts_e2e/inmem/5 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/8 === RUN TestBucketStore_ManyParts_e2e/inmem/6 === RUN TestBucketStore_e2e/inmem/with_small_index_cache/9 === RUN TestBucketStore_ManyParts_e2e/inmem/7 === RUN TestBucketStore_ManyParts_e2e/inmem/8 === RUN TestBucketStore_e2e/filesystem === PAUSE TestBucketStore_e2e/filesystem === CONT TestBucketStore_e2e/filesystem === RUN TestBucketStore_ManyParts_e2e/inmem/9 === RUN TestBucketStore_LabelValues_e2e/inmem/label_a === RUN TestBucketStore_LabelValues_e2e/inmem/label_a,_outside_time_range === RUN TestBucketStore_LabelValues_e2e/inmem/label_a,_a=1 === RUN TestBucketStore_ManyParts_e2e/filesystem === PAUSE TestBucketStore_ManyParts_e2e/filesystem === CONT TestBucketStore_ManyParts_e2e/filesystem === RUN TestBucketStore_LabelValues_e2e/inmem/label_a,_a=2,_c=2 === RUN TestBucketStore_LabelValues_e2e/inmem/label_ext1 === RUN TestBucketStore_LabelValues_e2e/filesystem === PAUSE TestBucketStore_LabelValues_e2e/filesystem === CONT TestBucketStore_LabelValues_e2e/filesystem === RUN TestBucketStore_LabelNames_e2e/filesystem/outside_the_time_range === RUN TestBucketStore_LabelNames_e2e/filesystem/matcher_matching_everything === RUN TestBucketStore_LabelNames_e2e/filesystem/b=1_matcher === RUN TestBucketStore_LabelNames_e2e/filesystem/b=''_matcher === RUN TestBucketStore_LabelNames_e2e/filesystem/outside_the_time_range,_with_matcher === RUN TestBucketStore_LabelValues_e2e/filesystem/label_a === RUN TestBucketStore_LabelNames_e2e/filesystem/basic_labelNames === RUN TestBucketStore_LabelValues_e2e/filesystem/label_a,_outside_time_range === RUN TestBucketStore_LabelValues_e2e/filesystem/label_a,_a=1 === RUN TestBucketStore_e2e/filesystem/no_index_cache --- PASS: TestBucketStore_LabelNames_e2e (1.18s) --- PASS: TestBucketStore_LabelNames_e2e/inmem (1.18s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/b=1_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/b=''_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/outside_the_time_range,_with_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/basic_labelNames (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/outside_the_time_range (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/inmem/matcher_matching_everything (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem (1.15s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/outside_the_time_range (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/matcher_matching_everything (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/b=1_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/b=''_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/outside_the_time_range,_with_matcher (0.00s) --- PASS: TestBucketStore_LabelNames_e2e/filesystem/basic_labelNames (0.00s) === RUN TestBucketStore_LabelValues_e2e/filesystem/label_a,_a=2,_c=2 === RUN TestBucketStore_e2e/filesystem/no_index_cache/0 === RUN TestBucketStore_LabelValues_e2e/filesystem/label_ext1 === RUN TestBucketStore_e2e/filesystem/no_index_cache/1 --- PASS: TestBucketStore_LabelValues_e2e (1.19s) --- PASS: TestBucketStore_LabelValues_e2e/inmem (1.19s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_a (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_a,_outside_time_range (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_a,_a=1 (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_a,_a=2,_c=2 (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/inmem/label_ext1 (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem (1.14s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_a (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_a,_outside_time_range (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_a,_a=1 (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_a,_a=2,_c=2 (0.00s) --- PASS: TestBucketStore_LabelValues_e2e/filesystem/label_ext1 (0.00s) === RUN TestBucketStore_e2e/filesystem/no_index_cache/2 === RUN TestBucketStore_ManyParts_e2e/filesystem/0 === RUN TestBucketStore_e2e/filesystem/no_index_cache/3 === RUN TestBucketStore_e2e/filesystem/no_index_cache/4 === RUN TestBucketStore_ManyParts_e2e/filesystem/1 === RUN TestBucketStore_e2e/filesystem/no_index_cache/5 === RUN TestBucketStore_ManyParts_e2e/filesystem/2 === RUN TestBucketStore_e2e/filesystem/no_index_cache/6 === RUN TestBucketStore_ManyParts_e2e/filesystem/3 === RUN TestBucketStore_e2e/filesystem/no_index_cache/7 === RUN TestBucketStore_e2e/filesystem/no_index_cache/8 === RUN TestBucketStore_ManyParts_e2e/filesystem/4 === RUN TestBucketStore_e2e/filesystem/no_index_cache/9 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache === RUN TestBucketStore_ManyParts_e2e/filesystem/5 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/0 === RUN TestBucketStore_ManyParts_e2e/filesystem/6 === RUN TestBucketStore_ManyParts_e2e/filesystem/7 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/1 === RUN TestBucketStore_ManyParts_e2e/filesystem/8 === RUN TestBucketStore_ManyParts_e2e/filesystem/9 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/2 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/3 --- PASS: TestBucketStore_ManyParts_e2e (1.19s) --- PASS: TestBucketStore_ManyParts_e2e/inmem (1.19s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/0 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/1 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/2 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/3 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/4 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/5 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/6 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/7 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/8 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/inmem/9 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem (1.16s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/0 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/1 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/2 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/3 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/4 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/5 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/6 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/7 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/8 (0.00s) --- PASS: TestBucketStore_ManyParts_e2e/filesystem/9 (0.00s) === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/4 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/5 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/6 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/7 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/8 === RUN TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/9 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/0 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/1 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/2 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/3 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/4 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/5 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/6 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/7 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/8 === RUN TestBucketStore_e2e/filesystem/with_small_index_cache/9 --- PASS: TestBucketStore_e2e (1.19s) --- PASS: TestBucketStore_e2e/inmem (1.19s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache (0.01s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/0 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/1 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/2 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/3 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/4 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/5 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/6 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/7 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/inmem/no_index_cache/9 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache (0.01s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/0 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/1 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/2 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/3 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/4 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/5 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/6 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/7 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_large,_sufficient_index_cache/9 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache (0.02s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/0 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/1 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/2 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/3 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/4 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/5 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/6 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/7 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/inmem/with_small_index_cache/9 (0.00s) --- PASS: TestBucketStore_e2e/filesystem (1.19s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache (0.01s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/0 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/1 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/2 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/3 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/4 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/5 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/6 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/7 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/no_index_cache/9 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache (0.01s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/0 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/1 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/2 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/3 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/4 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/5 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/6 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/7 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_large,_sufficient_index_cache/9 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache (0.02s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/0 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/1 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/2 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/3 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/4 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/5 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/6 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/7 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/8 (0.00s) --- PASS: TestBucketStore_e2e/filesystem/with_small_index_cache/9 (0.00s) PASS ok github.com/grafana/mimir/pkg/storegateway 65.356s === RUN TestCanonicalLabelMatchersKey --- PASS: TestCanonicalLabelMatchersKey (0.00s) === RUN TestNewInMemoryIndexCache --- PASS: TestNewInMemoryIndexCache (0.02s) === RUN TestInMemoryIndexCache_AvoidsDeadlock --- PASS: TestInMemoryIndexCache_AvoidsDeadlock (0.01s) === RUN TestInMemoryIndexCache_UpdateItem === RUN TestInMemoryIndexCache_UpdateItem/Postings === RUN TestInMemoryIndexCache_UpdateItem/SeriesForRef === RUN TestInMemoryIndexCache_UpdateItem/ExpandedPostings === RUN TestInMemoryIndexCache_UpdateItem/Series === RUN TestInMemoryIndexCache_UpdateItem/LabelNames === RUN TestInMemoryIndexCache_UpdateItem/LabelValues --- PASS: TestInMemoryIndexCache_UpdateItem (0.02s) --- PASS: TestInMemoryIndexCache_UpdateItem/Postings (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/SeriesForRef (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/ExpandedPostings (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/Series (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/LabelNames (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/LabelValues (0.00s) === RUN TestInMemoryIndexCache_MaxNumberOfItemsHit --- PASS: TestInMemoryIndexCache_MaxNumberOfItemsHit (0.00s) === RUN TestInMemoryIndexCache_Eviction_WithMetrics --- PASS: TestInMemoryIndexCache_Eviction_WithMetrics (0.01s) === RUN TestMemcachedIndexCache_FetchMultiPostings === PAUSE TestMemcachedIndexCache_FetchMultiPostings === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef === PAUSE TestMemcachedIndexCache_FetchMultiSeriesForRef === RUN TestMemcachedIndexCache_FetchExpandedPostings === PAUSE TestMemcachedIndexCache_FetchExpandedPostings === RUN TestMemcachedIndexCache_FetchSeries === PAUSE TestMemcachedIndexCache_FetchSeries === RUN TestMemcachedIndexCache_FetchLabelNames === PAUSE TestMemcachedIndexCache_FetchLabelNames === RUN TestMemcachedIndexCache_FetchLabelValues === PAUSE TestMemcachedIndexCache_FetchLabelValues === RUN TestStringCacheKeys_Values === PAUSE TestStringCacheKeys_Values === RUN TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength === PAUSE TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength === CONT TestMemcachedIndexCache_FetchLabelNames === CONT TestMemcachedIndexCache_FetchMultiPostings === RUN TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_empty_cache === CONT TestMemcachedIndexCache_FetchExpandedPostings === RUN TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_empty_cache === RUN TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_memcached_error === CONT TestMemcachedIndexCache_FetchMultiSeriesForRef --- PASS: TestMemcachedIndexCache_FetchExpandedPostings (0.01s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_memcached_error (0.00s) === CONT TestMemcachedIndexCache_FetchSeries === RUN TestMemcachedIndexCache_FetchSeries/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchLabelNames/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_memcached_error === RUN TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_memcached_error --- PASS: TestMemcachedIndexCache_FetchLabelNames (0.02s) --- PASS: TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_empty_cache (0.01s) --- PASS: TestMemcachedIndexCache_FetchLabelNames/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_memcached_error (0.00s) === CONT TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength === RUN TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_memcached_error === RUN TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_empty_cache --- PASS: TestMemcachedIndexCache_FetchSeries (0.01s) --- PASS: TestMemcachedIndexCache_FetchSeries/should_return_no_miss_on_hit (0.01s) --- PASS: TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_memcached_error (0.00s) --- PASS: TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_empty_cache (0.00s) === CONT TestStringCacheKeys_Values === RUN TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_postings === RUN TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_series --- PASS: TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength (0.01s) --- PASS: TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_postings (0.00s) --- PASS: TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_series (0.00s) === CONT TestMemcachedIndexCache_FetchLabelValues === RUN TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_empty_cache === RUN TestStringCacheKeys_Values/should_stringify_postings_cache_key === RUN TestStringCacheKeys_Values/should_stringify_series_cache_key --- PASS: TestStringCacheKeys_Values (0.01s) --- PASS: TestStringCacheKeys_Values/should_stringify_postings_cache_key (0.00s) --- PASS: TestStringCacheKeys_Values/should_stringify_series_cache_key (0.00s) === RUN TestMemcachedIndexCache_FetchLabelValues/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_empty_cache === RUN TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_memcached_error === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_misses_on_100%_hit_ratio --- PASS: TestMemcachedIndexCache_FetchLabelValues (0.01s) --- PASS: TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelValues/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_memcached_error (0.00s) === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_hits_and_misses_on_partial_hits --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef (0.02s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_memcached_error (0.01s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_misses_on_100%_hit_ratio (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_hits_and_misses_on_partial_hits (0.00s) === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_memcached_error === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_empty_cache === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_no_misses_on_100%_hit_ratio === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_hits_and_misses_on_partial_hits --- PASS: TestMemcachedIndexCache_FetchMultiPostings (0.04s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_memcached_error (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_no_misses_on_100%_hit_ratio (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_hits_and_misses_on_partial_hits (0.00s) PASS ok github.com/grafana/mimir/pkg/storegateway/indexcache 0.470s === RUN TestReaders === RUN TestReaders/01GB8VJF1383ABZ73XMQFJJPQN === RUN TestReaders/01GB8VJF1383ABZ73XMQFJJPQN/binary_reader === RUN TestReaders/01GB8VJF1383ABZ73XMQFJJPQN/binary_reader_with_map_populate === RUN TestReaders/01GB8VJF1383ABZ73XMQFJJPQN/lazy_binary_reader === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader_with_map_populate === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/lazy_binary_reader --- PASS: TestReaders (0.46s) --- PASS: TestReaders/01GB8VJF1383ABZ73XMQFJJPQN (0.02s) --- PASS: TestReaders/01GB8VJF1383ABZ73XMQFJJPQN/binary_reader (0.01s) --- PASS: TestReaders/01GB8VJF1383ABZ73XMQFJJPQN/binary_reader_with_map_populate (0.00s) --- PASS: TestReaders/01GB8VJF1383ABZ73XMQFJJPQN/lazy_binary_reader (0.00s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ (0.02s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader (0.01s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader_with_map_populate (0.01s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/lazy_binary_reader (0.01s) === RUN TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader --- PASS: TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader (0.00s) === RUN TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket --- PASS: TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket (0.24s) === RUN TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader --- PASS: TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader (0.24s) === RUN TestLazyBinaryReader_ShouldReopenOnUsageAfterClose --- PASS: TestLazyBinaryReader_ShouldReopenOnUsageAfterClose (0.20s) === RUN TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle --- PASS: TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle (0.29s) === RUN TestLazyBinaryReader_LoadUnloadRaceCondition --- PASS: TestLazyBinaryReader_LoadUnloadRaceCondition (5.24s) === RUN TestReaderPool_NewBinaryReader === RUN TestReaderPool_NewBinaryReader/lazy_reader_is_enabled_but_close_on_idle_timeout_is_disabled === RUN TestReaderPool_NewBinaryReader/lazy_reader_and_close_on_idle_timeout_are_both_enabled === RUN TestReaderPool_NewBinaryReader/lazy_reader_is_disabled --- PASS: TestReaderPool_NewBinaryReader (0.23s) --- PASS: TestReaderPool_NewBinaryReader/lazy_reader_is_enabled_but_close_on_idle_timeout_is_disabled (0.00s) --- PASS: TestReaderPool_NewBinaryReader/lazy_reader_and_close_on_idle_timeout_are_both_enabled (0.00s) --- PASS: TestReaderPool_NewBinaryReader/lazy_reader_is_disabled (0.00s) === RUN TestReaderPool_ShouldCloseIdleLazyReaders --- PASS: TestReaderPool_ShouldCloseIdleLazyReaders (2.20s) PASS ok github.com/grafana/mimir/pkg/storegateway/indexheader 9.816s ? github.com/grafana/mimir/pkg/storegateway/indexheader/fileutil [no test files] ? github.com/grafana/mimir/pkg/storegateway/storegatewaypb [no test files] ? github.com/grafana/mimir/pkg/storegateway/testhelper [no test files] === RUN TestOSThread_Call === RUN TestOSThread_Call/run_by_thread === RUN TestOSThread_Call/run_by_thread_but_stopped --- PASS: TestOSThread_Call (0.06s) --- PASS: TestOSThread_Call/run_by_thread (0.03s) --- PASS: TestOSThread_Call/run_by_thread_but_stopped (0.03s) === RUN TestThreadpool_Call === RUN TestThreadpool_Call/pool_is_stopped === RUN TestThreadpool_Call/no_threads_in_pool === RUN TestThreadpool_Call/execute_a_single_function === RUN TestThreadpool_Call/execute_more_functions_than_there_are_threads --- PASS: TestThreadpool_Call (0.03s) --- PASS: TestThreadpool_Call/pool_is_stopped (0.01s) --- PASS: TestThreadpool_Call/no_threads_in_pool (0.00s) --- PASS: TestThreadpool_Call/execute_a_single_function (0.00s) --- PASS: TestThreadpool_Call/execute_more_functions_than_there_are_threads (0.02s) PASS ok github.com/grafana/mimir/pkg/storegateway/threadpool 0.516s === RUN TestActiveUser --- PASS: TestActiveUser (0.00s) === RUN TestActiveUserConcurrentUpdateAndPurge --- PASS: TestActiveUserConcurrentUpdateAndPurge (1.01s) === RUN TestAllowedTenants_NoConfig --- PASS: TestAllowedTenants_NoConfig (0.00s) === RUN TestAllowedTenants_Enabled --- PASS: TestAllowedTenants_Enabled (0.00s) === RUN TestAllowedTenants_Disabled --- PASS: TestAllowedTenants_Disabled (0.00s) === RUN TestAllowedTenants_Combination --- PASS: TestAllowedTenants_Combination (0.00s) === RUN TestAllowedTenants_Nil --- PASS: TestAllowedTenants_Nil (0.00s) === RUN TestGetSourceFromOutgoingCtx === RUN TestGetSourceFromOutgoingCtx/No_value_in_key === RUN TestGetSourceFromOutgoingCtx/Value_in_key === RUN TestGetSourceFromOutgoingCtx/Stored_under_wrong_key --- PASS: TestGetSourceFromOutgoingCtx (0.00s) --- PASS: TestGetSourceFromOutgoingCtx/No_value_in_key (0.00s) --- PASS: TestGetSourceFromOutgoingCtx/Value_in_key (0.00s) --- PASS: TestGetSourceFromOutgoingCtx/Stored_under_wrong_key (0.00s) === RUN TestLabelMatchersToString --- PASS: TestLabelMatchersToString (0.00s) === RUN TestMultiMatchersStringer === RUN TestMultiMatchersStringer/One_nested_matcher === RUN TestMultiMatchersStringer/Two_nested_matchers --- PASS: TestMultiMatchersStringer (0.00s) --- PASS: TestMultiMatchersStringer/One_nested_matcher (0.00s) --- PASS: TestMultiMatchersStringer/Two_nested_matchers (0.00s) === RUN TestMatchersStringer === RUN TestMatchersStringer/One_matcher === RUN TestMatchersStringer/Two_matchers --- PASS: TestMatchersStringer (0.00s) --- PASS: TestMatchersStringer/One_matcher (0.00s) --- PASS: TestMatchersStringer/Two_matchers (0.00s) === RUN TestMergeSampleSets --- PASS: TestMergeSampleSets (0.00s) === RUN TestMergeNSampleSets --- PASS: TestMergeNSampleSets (0.00s) === RUN TestSum --- PASS: TestSum (0.00s) === RUN TestMax --- PASS: TestMax (0.00s) === RUN TestCounterValue --- PASS: TestCounterValue (0.00s) === RUN TestGetMetricsWithLabelNames --- PASS: TestGetMetricsWithLabelNames (0.00s) === RUN TestSendSumOfGaugesPerUserWithLabels --- PASS: TestSendSumOfGaugesPerUserWithLabels (0.02s) === RUN TestSendMaxOfGauges --- PASS: TestSendMaxOfGauges (0.00s) === RUN TestSendSumOfHistogramsWithLabels --- PASS: TestSendSumOfHistogramsWithLabels (0.01s) === RUN TestSendSumOfCountersPerUser_WithLabels === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one,_and_skip_zero_value_metrics === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two,_and_skip_zero_value_metrics === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two,_and_skip_zero_value_metrics --- PASS: TestSendSumOfCountersPerUser_WithLabels (0.01s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one,_and_skip_zero_value_metrics (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two,_and_skip_zero_value_metrics (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two,_and_skip_zero_value_metrics (0.00s) === RUN TestSendSumOfSummariesPerUser --- PASS: TestSendSumOfSummariesPerUser (0.01s) === RUN TestFloat64PrecisionStability metrics_helper_test.go:519: random generator seed: 1661375958471166644 --- PASS: TestFloat64PrecisionStability (14.99s) === RUN TestUserRegistries_RemoveBaseline --- PASS: TestUserRegistries_RemoveBaseline (0.03s) === RUN TestUserRegistries_RemoveUserRegistry_SoftRemoval --- PASS: TestUserRegistries_RemoveUserRegistry_SoftRemoval (0.01s) === RUN TestUserRegistries_RemoveUserRegistry_HardRemoval --- PASS: TestUserRegistries_RemoveUserRegistry_HardRemoval (0.01s) === RUN TestUserRegistries_AddUserRegistry_ReplaceRegistry --- PASS: TestUserRegistries_AddUserRegistry_ReplaceRegistry (0.01s) === RUN TestGetLabels --- PASS: TestGetLabels (0.01s) === RUN TestShuffleShardExpectedInstancesPerZone --- PASS: TestShuffleShardExpectedInstancesPerZone (0.00s) === RUN TestShuffleShardExpectedInstances --- PASS: TestShuffleShardExpectedInstances (0.00s) === RUN TestTimeFromMillis === RUN TestTimeFromMillis/0 === RUN TestTimeFromMillis/1 --- PASS: TestTimeFromMillis (0.00s) --- PASS: TestTimeFromMillis/0 (0.00s) --- PASS: TestTimeFromMillis/1 (0.00s) === RUN TestTimeRoundTrip === RUN TestTimeRoundTrip/0 === RUN TestTimeRoundTrip/1 === RUN TestTimeRoundTrip/2 --- PASS: TestTimeRoundTrip (0.01s) --- PASS: TestTimeRoundTrip/0 (0.00s) --- PASS: TestTimeRoundTrip/1 (0.00s) --- PASS: TestTimeRoundTrip/2 (0.00s) === RUN TestDurationWithJitter --- PASS: TestDurationWithJitter (0.02s) === RUN TestDurationWithJitter_ZeroInputDuration --- PASS: TestDurationWithJitter_ZeroInputDuration (0.00s) === RUN TestDurationWithPositiveJitter --- PASS: TestDurationWithPositiveJitter (0.01s) === RUN TestDurationWithPositiveJitter_ZeroInputDuration --- PASS: TestDurationWithPositiveJitter_ZeroInputDuration (0.00s) === RUN TestParseTime --- PASS: TestParseTime (0.01s) === RUN TestNewDisableableTicker_Enabled --- PASS: TestNewDisableableTicker_Enabled (0.10s) === RUN TestNewDisableableTicker_Disabled --- PASS: TestNewDisableableTicker_Disabled (0.10s) === RUN TestYoloBuf --- PASS: TestYoloBuf (0.00s) === RUN TestRenderHTTPResponse === RUN TestRenderHTTPResponse/Test_Renders_json === RUN TestRenderHTTPResponse/Test_Renders_html --- PASS: TestRenderHTTPResponse (0.03s) --- PASS: TestRenderHTTPResponse/Test_Renders_json (0.01s) --- PASS: TestRenderHTTPResponse/Test_Renders_html (0.02s) === RUN TestWriteTextResponse --- PASS: TestWriteTextResponse (0.00s) === RUN TestStreamWriteYAMLResponse --- PASS: TestStreamWriteYAMLResponse (0.04s) === RUN TestParseProtoReader === RUN TestParseProtoReader/rawSnappy === RUN TestParseProtoReader/noCompression === RUN TestParseProtoReader/too_big_rawSnappy === RUN TestParseProtoReader/too_big_decoded_rawSnappy === RUN TestParseProtoReader/too_big_noCompression === RUN TestParseProtoReader/bytesbuffer_rawSnappy === RUN TestParseProtoReader/bytesbuffer_noCompression === RUN TestParseProtoReader/bytesbuffer_too_big_rawSnappy === RUN TestParseProtoReader/bytesbuffer_too_big_decoded_rawSnappy === RUN TestParseProtoReader/bytesbuffer_too_big_noCompression --- PASS: TestParseProtoReader (0.01s) --- PASS: TestParseProtoReader/rawSnappy (0.01s) --- PASS: TestParseProtoReader/noCompression (0.00s) --- PASS: TestParseProtoReader/too_big_rawSnappy (0.00s) --- PASS: TestParseProtoReader/too_big_decoded_rawSnappy (0.00s) --- PASS: TestParseProtoReader/too_big_noCompression (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_rawSnappy (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_noCompression (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_too_big_rawSnappy (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_too_big_decoded_rawSnappy (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_too_big_noCompression (0.00s) === RUN TestIsRequestBodyTooLargeRegression --- PASS: TestIsRequestBodyTooLargeRegression (0.00s) PASS ok github.com/grafana/mimir/pkg/util 17.255s === RUN TestActivityTracker --- PASS: TestActivityTracker (0.02s) === RUN TestNilActivityTracker --- PASS: TestNilActivityTracker (0.00s) === RUN TestTrimEntrySize === RUN TestTrimEntrySize/hello_world,_100 === RUN TestTrimEntrySize/hello_world,_10 === RUN TestTrimEntrySize/hello_world,_5 === RUN TestTrimEntrySize/🎉🎄🎅,_5 === RUN TestTrimEntrySize/🎉🎄🎅,_8 === RUN TestTrimEntrySize/🎉🎄🎅,_9 === RUN TestTrimEntrySize/🎉🎄🎅,_10 === RUN TestTrimEntrySize/🎉🎄🎅,_11 === RUN TestTrimEntrySize/🎉🎄🎅,_12 --- PASS: TestTrimEntrySize (0.00s) --- PASS: TestTrimEntrySize/hello_world,_100 (0.00s) --- PASS: TestTrimEntrySize/hello_world,_10 (0.00s) --- PASS: TestTrimEntrySize/hello_world,_5 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_5 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_8 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_9 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_10 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_11 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_12 (0.00s) PASS ok github.com/grafana/mimir/pkg/util/activitytracker 0.258s ? github.com/grafana/mimir/pkg/util/chunkcompat [no test files] ? github.com/grafana/mimir/pkg/util/extract [no test files] ? github.com/grafana/mimir/pkg/util/fieldcategory [no test files] ? github.com/grafana/mimir/pkg/util/fs [no test files] === RUN TestID_Message --- PASS: TestID_Message (0.00s) === RUN TestID_MessageWithLimitConfig --- PASS: TestID_MessageWithLimitConfig (0.00s) PASS ok github.com/grafana/mimir/pkg/util/globalerror 0.310s === RUN TestSetAcceptEncodingForPushOptionsWithoutHeaders --- PASS: TestSetAcceptEncodingForPushOptionsWithoutHeaders (0.00s) === RUN TestSetAcceptEncodingForPushOptionsWithHeaders --- PASS: TestSetAcceptEncodingForPushOptionsWithHeaders (0.00s) === RUN TestParseEncodings --- PASS: TestParseEncodings (0.00s) === RUN TestRequestAcceptance === RUN TestRequestAcceptance/identity;q=0 === RUN TestRequestAcceptance/identity;q=0,_*;q=0.5 === RUN TestRequestAcceptance/gzip === RUN TestRequestAcceptance/gzip;q=1 === RUN TestRequestAcceptance/gzip;q=1,_identity;q=0 === RUN TestRequestAcceptance/gzip;q=1,_identity;q=0,_*;q=0.5 === RUN TestRequestAcceptance/foo;q=1,_gzip;q=0.5,_*;q=0 --- PASS: TestRequestAcceptance (0.00s) --- PASS: TestRequestAcceptance/identity;q=0 (0.00s) --- PASS: TestRequestAcceptance/identity;q=0,_*;q=0.5 (0.00s) --- PASS: TestRequestAcceptance/gzip (0.00s) --- PASS: TestRequestAcceptance/gzip;q=1 (0.00s) --- PASS: TestRequestAcceptance/gzip;q=1,_identity;q=0 (0.00s) --- PASS: TestRequestAcceptance/gzip;q=1,_identity;q=0,_*;q=0.5 (0.00s) --- PASS: TestRequestAcceptance/foo;q=1,_gzip;q=0.5,_*;q=0 (0.00s) === RUN TestGzipHandler --- PASS: TestGzipHandler (0.01s) === RUN TestGzipHandlerSmallBodyNoCompression --- PASS: TestGzipHandlerSmallBodyNoCompression (0.00s) === RUN TestGzipHandlerSmallButDoesNotAcceptIdentity --- PASS: TestGzipHandlerSmallButDoesNotAcceptIdentity (0.00s) === RUN TestGzipHandlerAlreadyCompressed --- PASS: TestGzipHandlerAlreadyCompressed (0.00s) === RUN TestNewGzipLevelHandler --- PASS: TestNewGzipLevelHandler (0.05s) === RUN TestNewGzipLevelHandlerReturnsErrorForInvalidLevels --- PASS: TestNewGzipLevelHandlerReturnsErrorForInvalidLevels (0.00s) === RUN TestMustNewGzipLevelHandlerWillPanic --- PASS: TestMustNewGzipLevelHandlerWillPanic (0.00s) === RUN TestGzipHandlerNoBody --- PASS: TestGzipHandlerNoBody (0.00s) === RUN TestGzipHandlerContentLength --- PASS: TestGzipHandlerContentLength (0.07s) === RUN TestGzipHandlerMinSizeMustBePositive --- PASS: TestGzipHandlerMinSizeMustBePositive (0.00s) === RUN TestGzipHandlerMinSize --- PASS: TestGzipHandlerMinSize (0.00s) === RUN TestGzipDoubleClose --- PASS: TestGzipDoubleClose (0.00s) === RUN TestGzipHandlerDoubleWriteHeader --- PASS: TestGzipHandlerDoubleWriteHeader (0.00s) === RUN TestStatusCodes --- PASS: TestStatusCodes (0.00s) === RUN TestFlushBeforeWrite --- PASS: TestFlushBeforeWrite (0.00s) === RUN TestImplementFlusher --- PASS: TestImplementFlusher (0.00s) === RUN TestIgnoreSubsequentWriteHeader --- PASS: TestIgnoreSubsequentWriteHeader (0.00s) === RUN TestDontWriteWhenNotWrittenTo --- PASS: TestDontWriteWhenNotWrittenTo (0.00s) === RUN TestContentTypes --- PASS: TestContentTypes (0.00s) PASS ok github.com/grafana/mimir/pkg/util/gziphandler 0.456s === RUN TestPrioritizeRecoverableErr === RUN TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error === RUN TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error,_reverse_order === RUN TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_non-grpc_error === RUN TestPrioritizeRecoverableErr/recoverable_grpc_error,_non-recoverable_grpc_error_and_non-grpc_error === RUN TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_too_many_requests_error === RUN TestPrioritizeRecoverableErr/non-recoverable_grpc_error === RUN TestPrioritizeRecoverableErr/no_error --- PASS: TestPrioritizeRecoverableErr (0.03s) --- PASS: TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error (0.01s) --- PASS: TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error,_reverse_order (0.00s) --- PASS: TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_non-grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/recoverable_grpc_error,_non-recoverable_grpc_error_and_non-grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_too_many_requests_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/non-recoverable_grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/no_error (0.00s) PASS ok github.com/grafana/mimir/pkg/util/httpgrpcutil 0.297s === RUN TestTracerTransportPropagatesTrace === RUN TestTracerTransportPropagatesTrace/no_next_transport === RUN TestTracerTransportPropagatesTrace/with_next_transport --- PASS: TestTracerTransportPropagatesTrace (0.15s) --- PASS: TestTracerTransportPropagatesTrace/no_next_transport (0.14s) --- PASS: TestTracerTransportPropagatesTrace/with_next_transport (0.01s) PASS ok github.com/grafana/mimir/pkg/util/instrumentation 0.502s === RUN TestQueryLimiter_AddSeries_ShouldReturnNoErrorOnLimitNotExceeded --- PASS: TestQueryLimiter_AddSeries_ShouldReturnNoErrorOnLimitNotExceeded (0.00s) === RUN TestQueryLimiter_AddSeriers_ShouldReturnErrorOnLimitExceeded --- PASS: TestQueryLimiter_AddSeriers_ShouldReturnErrorOnLimitExceeded (0.00s) === RUN TestQueryLimiter_AddChunkBytes --- PASS: TestQueryLimiter_AddChunkBytes (0.00s) PASS ok github.com/grafana/mimir/pkg/util/limiter 0.456s ? github.com/grafana/mimir/pkg/util/listblocks [no test files] === RUN TestRateLimitedLogger rate_limit_test.go:34: PASS: Log() --- PASS: TestRateLimitedLogger (0.01s) === RUN TestRateLimitedLogger_Burst rate_limit_test.go:60: PASS: Log() --- PASS: TestRateLimitedLogger_Burst (0.00s) PASS ok github.com/grafana/mimir/pkg/util/log 0.353s === RUN TestRate --- PASS: TestRate (0.00s) PASS ok github.com/grafana/mimir/pkg/util/math 0.246s === RUN TestFirewallDialer === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_localhost === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_127.0.0.1 === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_google.com === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_private_addresses === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_localhost === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_127.0.0.1 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_192.168.0.1 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_10.0.0.1 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_google.com === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_fdf8:f53b:82e4::53 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_fe80::200:5aee:feaa:20a2 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_2001:4860:4860::8844 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:192.168.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_localhost === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_127.0.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_192.168.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_10.0.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fdf8:f53b:82e4::53 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fe80::200:5aee:feaa:20a2 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_2001:4860:4860::8844 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:10.0.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:172.217.168.78 --- PASS: TestFirewallDialer (0.86s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config (0.14s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_localhost (0.06s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_127.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_google.com (0.04s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_172.217.168.78 (0.03s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses (0.21s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_localhost (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_127.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_192.168.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_10.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_google.com (0.04s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_172.217.168.78 (0.03s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_fdf8:f53b:82e4::53 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_fe80::200:5aee:feaa:20a2 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_2001:4860:4860::8844 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:172.217.168.78 (0.03s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:192.168.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs (0.51s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_localhost (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_127.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_192.168.0.1 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_10.0.0.1 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_172.217.168.78 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fdf8:f53b:82e4::53 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fe80::200:5aee:feaa:20a2 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_2001:4860:4860::8844 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:10.0.0.1 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:172.217.168.78 (0.00s) PASS ok github.com/grafana/mimir/pkg/util/net 1.184s ? github.com/grafana/mimir/pkg/util/noauth [no test files] === RUN TestProcessCollector --- PASS: TestProcessCollector (0.02s) === RUN TestProcessCollector_UnsupportedPlatform --- PASS: TestProcessCollector_UnsupportedPlatform (0.00s) PASS ok github.com/grafana/mimir/pkg/util/process 0.327s === RUN TestHandler_remoteWrite --- PASS: TestHandler_remoteWrite (0.01s) === RUN TestHandler_cortexWriteRequest --- PASS: TestHandler_cortexWriteRequest (0.00s) === RUN TestHandler_contextCanceledRequest --- PASS: TestHandler_contextCanceledRequest (0.00s) === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_false === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_always_false_even_if_write_requests_sets_it_to_true === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_but_write_request_set_to_false_means_SkipLabelNameValidation_is_false === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_means_SkipLabelNameValidation_is_true === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_but_header_not_sent_means_SkipLabelNameValidation_is_false --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_false (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_always_false_even_if_write_requests_sets_it_to_true (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_but_write_request_set_to_false_means_SkipLabelNameValidation_is_false (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_means_SkipLabelNameValidation_is_true (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_but_header_not_sent_means_SkipLabelNameValidation_is_false (0.00s) PASS ok github.com/grafana/mimir/pkg/util/push 0.460s ? github.com/grafana/mimir/pkg/util/spanlogger [no test files] ? github.com/grafana/mimir/pkg/util/test [no test files] ? github.com/grafana/mimir/pkg/util/usage [no test files] === RUN TestNewMetadataMetricNameMissingError --- PASS: TestNewMetadataMetricNameMissingError (0.00s) === RUN TestNewMetadataMetricNameTooLongError --- PASS: TestNewMetadataMetricNameTooLongError (0.00s) === RUN TestNewMetadataHelpTooLongError --- PASS: TestNewMetadataHelpTooLongError (0.00s) === RUN TestNewMetadataUnitTooLongError --- PASS: TestNewMetadataUnitTooLongError (0.00s) === RUN TestNewMaxQueryLengthError --- PASS: TestNewMaxQueryLengthError (0.00s) === RUN TestNewRequestRateLimitedError --- PASS: TestNewRequestRateLimitedError (0.00s) === RUN TestNewIngestionRateLimitedError --- PASS: TestNewIngestionRateLimitedError (0.00s) === RUN TestOverridesExporter_noConfig --- PASS: TestOverridesExporter_noConfig (0.01s) === RUN TestOverridesExporter_emptyConfig --- PASS: TestOverridesExporter_emptyConfig (0.00s) === RUN TestOverridesExporter_withConfig --- PASS: TestOverridesExporter_withConfig (0.01s) === RUN TestOverridesManager_GetOverrides --- PASS: TestOverridesManager_GetOverrides (0.00s) === RUN TestLimitsLoadingFromYaml --- PASS: TestLimitsLoadingFromYaml (0.01s) === RUN TestLimitsLoadingFromJson --- PASS: TestLimitsLoadingFromJson (0.01s) === RUN TestLimitsTagsYamlMatchJson --- PASS: TestLimitsTagsYamlMatchJson (0.00s) === RUN TestLimitsStringDurationYamlMatchJson --- PASS: TestLimitsStringDurationYamlMatchJson (0.00s) === RUN TestLimitsAlwaysUsesPromDuration --- PASS: TestLimitsAlwaysUsesPromDuration (0.00s) === RUN TestMetricRelabelConfigLimitsLoadingFromYaml --- PASS: TestMetricRelabelConfigLimitsLoadingFromYaml (0.01s) === RUN TestSmallestPositiveIntPerTenant --- PASS: TestSmallestPositiveIntPerTenant (0.00s) === RUN TestSmallestPositiveNonZeroIntPerTenant --- PASS: TestSmallestPositiveNonZeroIntPerTenant (0.00s) === RUN TestSmallestPositiveNonZeroDurationPerTenant --- PASS: TestSmallestPositiveNonZeroDurationPerTenant (0.00s) === RUN TestAlertmanagerNotificationLimits === RUN TestAlertmanagerNotificationLimits/no_email_specific_limit === RUN TestAlertmanagerNotificationLimits/zero_limit === RUN TestAlertmanagerNotificationLimits/negative_limit === RUN TestAlertmanagerNotificationLimits/positive_limit,_negative_burst === RUN TestAlertmanagerNotificationLimits/infinte_limit --- PASS: TestAlertmanagerNotificationLimits (0.01s) --- PASS: TestAlertmanagerNotificationLimits/no_email_specific_limit (0.01s) --- PASS: TestAlertmanagerNotificationLimits/zero_limit (0.00s) --- PASS: TestAlertmanagerNotificationLimits/negative_limit (0.00s) --- PASS: TestAlertmanagerNotificationLimits/positive_limit,_negative_burst (0.00s) --- PASS: TestAlertmanagerNotificationLimits/infinte_limit (0.00s) === RUN TestAlertmanagerNotificationLimitsOverrides === RUN TestAlertmanagerNotificationLimitsOverrides/no_overrides,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/generic_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/generic_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/different_user_overridem,_email === RUN TestAlertmanagerNotificationLimitsOverrides/no_overrides,_email === RUN TestAlertmanagerNotificationLimitsOverrides/partial_email_limit_override === RUN TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/different_user_override,_pushover --- PASS: TestAlertmanagerNotificationLimitsOverrides (0.01s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/no_overrides,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/different_user_overridem,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/no_overrides,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/partial_email_limit_override (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/different_user_override,_pushover (0.00s) === RUN TestCustomTrackerConfigDeserialize === RUN TestCustomTrackerConfigDeserialize/testBothVersionsOldTakesPrecedenceInNewField === RUN TestCustomTrackerConfigDeserialize/testOldVersionCopiedToNewField === RUN TestCustomTrackerConfigDeserialize/testNewVersion --- PASS: TestCustomTrackerConfigDeserialize (0.00s) --- PASS: TestCustomTrackerConfigDeserialize/testBothVersionsOldTakesPrecedenceInNewField (0.00s) --- PASS: TestCustomTrackerConfigDeserialize/testOldVersionCopiedToNewField (0.00s) --- PASS: TestCustomTrackerConfigDeserialize/testNewVersion (0.00s) === RUN TestNotificationLimitsMap === RUN TestNotificationLimitsMap/basic_test === RUN TestNotificationLimitsMap/unknown_integration === RUN TestNotificationLimitsMap/parsing_error --- PASS: TestNotificationLimitsMap (0.01s) --- PASS: TestNotificationLimitsMap/basic_test (0.00s) --- PASS: TestNotificationLimitsMap/unknown_integration (0.00s) --- PASS: TestNotificationLimitsMap/parsing_error (0.00s) === RUN TestNotificationsLimitMapYaml --- PASS: TestNotificationsLimitMapYaml (0.01s) === RUN TestUnknownIntegrationWhenLoadingYaml --- PASS: TestUnknownIntegrationWhenLoadingYaml (0.00s) === RUN TestWrongYamlStructureWhenLoadingYaml --- PASS: TestWrongYamlStructureWhenLoadingYaml (0.00s) === RUN TestValidateLabels --- PASS: TestValidateLabels (0.03s) === RUN TestValidateExemplars --- PASS: TestValidateExemplars (0.01s) === RUN TestValidateMetadata === RUN TestValidateMetadata/with_a_valid_config === RUN TestValidateMetadata/with_no_metric_name === RUN TestValidateMetadata/with_a_long_metric_name === RUN TestValidateMetadata/with_a_long_help === RUN TestValidateMetadata/with_a_long_unit --- PASS: TestValidateMetadata (0.01s) --- PASS: TestValidateMetadata/with_a_valid_config (0.00s) --- PASS: TestValidateMetadata/with_no_metric_name (0.00s) --- PASS: TestValidateMetadata/with_a_long_metric_name (0.00s) --- PASS: TestValidateMetadata/with_a_long_help (0.00s) --- PASS: TestValidateMetadata/with_a_long_unit (0.00s) === RUN TestValidateLabelOrder --- PASS: TestValidateLabelOrder (0.00s) === RUN TestValidateLabelDuplication --- PASS: TestValidateLabelDuplication (0.00s) PASS ok github.com/grafana/mimir/pkg/util/validation 0.588s === RUN TestBuildInfoHandler --- PASS: TestBuildInfoHandler (0.01s) PASS ok github.com/grafana/mimir/pkg/util/version 0.455s ? github.com/grafana/mimir/tools/add-license [no test files] ? github.com/grafana/mimir/tools/compaction-planner [no test files] === RUN TestConfigDescriptorIsUpToDate main_test.go:24: Error Trace: main_test.go:24 Error: Not equal: expected: map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Comma-separated list of components to include in the instantiated process. The default value 'all' includes all components that are required to form a functional Grafana Mimir instance in single-binary mode. Use the '-modules' command line flag to get a list of available components, and to see which components are included with 'all'.", "fieldDefaultValue":"all", "fieldFlag":"target", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"target", "required":false}, map[string]interface {}{"desc":"When set to true, incoming HTTP requests must specify tenant ID in HTTP X-Scope-OrgId header. When set to false, tenant ID from -auth.no-auth-tenant is used instead.", "fieldDefaultValue":true, "fieldFlag":"auth.multitenancy-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"multitenancy_enabled", "required":false}, map[string]interface {}{"desc":"Tenant ID to use when multitenancy is disabled.", "fieldCategory":"advanced", "fieldDefaultValue":"anonymous", "fieldFlag":"auth.no-auth-tenant", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"no_auth_tenant", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Allows to skip label name validation via X-Mimir-SkipLabelNameValidation header on the http write path. Use with caution as it breaks PromQL. Allowing this for external clients allows any client to send invalid label names. After enabling it, requests with a specific HTTP header set to true will not have label names validated.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"api.skip-label-name-validation-header-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"skip_label_name_validation_header_enabled", "required":false}, map[string]interface {}{"desc":"HTTP URL path under which the Alertmanager ui and api will be served.", "fieldCategory":"advanced", "fieldDefaultValue":"/alertmanager", "fieldFlag":"http.alertmanager-http-prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"alertmanager_http_prefix", "required":false}, map[string]interface {}{"desc":"HTTP URL path under which the Prometheus api will be served.", "fieldCategory":"advanced", "fieldDefaultValue":"/prometheus", "fieldFlag":"http.prometheus-http-prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"prometheus_http_prefix", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"api", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"HTTP server listen network, default tcp", "fieldCategory":"advanced", "fieldDefaultValue":"tcp", "fieldFlag":"server.http-listen-network", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"http_listen_network", "required":false}, map[string]interface {}{"desc":"HTTP server listen address.", "fieldDefaultValue":"", "fieldFlag":"server.http-listen-address", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"http_listen_address", "required":false}, map[string]interface {}{"desc":"HTTP server listen port.", "fieldDefaultValue":8080, "fieldFlag":"server.http-listen-port", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"http_listen_port", "required":false}, map[string]interface {}{"desc":"Maximum number of simultaneous http connections, <=0 to disable", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"server.http-conn-limit", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"http_listen_conn_limit", "required":false}, map[string]interface {}{"desc":"gRPC server listen network", "fieldCategory":"advanced", "fieldDefaultValue":"tcp", "fieldFlag":"server.grpc-listen-network", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_listen_network", "required":false}, map[string]interface {}{"desc":"gRPC server listen address.", "fieldDefaultValue":"", "fieldFlag":"server.grpc-listen-address", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_listen_address", "required":false}, map[string]interface {}{"desc":"gRPC server listen port.", "fieldDefaultValue":9095, "fieldFlag":"server.grpc-listen-port", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_listen_port", "required":false}, map[string]interface {}{"desc":"Maximum number of simultaneous grpc connections, <=0 to disable", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"server.grpc-conn-limit", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_listen_conn_limit", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"HTTP server cert path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.http-tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"cert_file", "required":false}, map[string]interface {}{"desc":"HTTP server key path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.http-tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"key_file", "required":false}, map[string]interface {}{"desc":"HTTP TLS Client Auth type.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.http-tls-client-auth", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"client_auth_type", "required":false}, map[string]interface {}{"desc":"HTTP TLS Client CA path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.http-tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"client_ca_file", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"http_tls_config", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"GRPC TLS server cert path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.grpc-tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"cert_file", "required":false}, map[string]interface {}{"desc":"GRPC TLS server key path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.grpc-tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"key_file", "required":false}, map[string]interface {}{"desc":"GRPC TLS Client Auth type.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.grpc-tls-client-auth", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"client_auth_type", "required":false}, map[string]interface {}{"desc":"GRPC TLS Client CA path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.grpc-tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"client_ca_file", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"grpc_tls_config", "required":false}, map[string]interface {}{"desc":"Register the intrumentation handlers (/metrics etc).", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"server.register-instrumentation", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"register_instrumentation", "required":false}, map[string]interface {}{"desc":"Timeout for graceful shutdowns", "fieldCategory":"advanced", "fieldDefaultValue":3e+10, "fieldFlag":"server.graceful-shutdown-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"graceful_shutdown_timeout", "required":false}, map[string]interface {}{"desc":"Read timeout for HTTP server", "fieldCategory":"advanced", "fieldDefaultValue":3e+10, "fieldFlag":"server.http-read-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_server_read_timeout", "required":false}, map[string]interface {}{"desc":"Write timeout for HTTP server", "fieldCategory":"advanced", "fieldDefaultValue":3e+10, "fieldFlag":"server.http-write-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_server_write_timeout", "required":false}, map[string]interface {}{"desc":"Idle timeout for HTTP server", "fieldCategory":"advanced", "fieldDefaultValue":1.2e+11, "fieldFlag":"server.http-idle-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_server_idle_timeout", "required":false}, map[string]interface {}{"desc":"Limit on the size of a gRPC message this server can receive (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"server.grpc-max-recv-msg-size-bytes", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_recv_msg_size", "required":false}, map[string]interface {}{"desc":"Limit on the size of a gRPC message this server can send (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"server.grpc-max-send-msg-size-bytes", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_send_msg_size", "required":false}, map[string]interface {}{"desc":"Limit on the number of concurrent streams for gRPC calls (0 = unlimited)", "fieldCategory":"advanced", "fieldDefaultValue":100, "fieldFlag":"server.grpc-max-concurrent-streams", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_concurrent_streams", "required":false}, map[string]interface {}{"desc":"The duration after which an idle connection should be closed. Default: infinity", "fieldCategory":"advanced", "fieldDefaultValue":9.223372036854776e+18, "fieldFlag":"server.grpc.keepalive.max-connection-idle", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_connection_idle", "required":false}, map[string]interface {}{"desc":"The duration for the maximum amount of time a connection may exist before it will be closed. Default: infinity", "fieldCategory":"advanced", "fieldDefaultValue":9.223372036854776e+18, "fieldFlag":"server.grpc.keepalive.max-connection-age", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_connection_age", "required":false}, map[string]interface {}{"desc":"An additive period after max-connection-age after which the connection will be forcibly closed. Default: infinity", "fieldCategory":"advanced", "fieldDefaultValue":9.223372036854776e+18, "fieldFlag":"server.grpc.keepalive.max-connection-age-grace", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_connection_age_grace", "required":false}, map[string]interface {}{"desc":"Duration after which a keepalive probe is sent in case of no activity over the connection., Default: 2h", "fieldCategory":"advanced", "fieldDefaultValue":7.2e+12, "fieldFlag":"server.grpc.keepalive.time", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_keepalive_time", "required":false}, map[string]interface {}{"desc":"After having pinged for keepalive check, the duration after which an idle connection should be closed, Default: 20s", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"server.grpc.keepalive.timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_keepalive_timeout", "required":false}, map[string]interface {}{"desc":"Minimum amount of time a client should wait before sending a keepalive ping. If client sends keepalive ping more often, server will send GOAWAY and close the connection.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"server.grpc.keepalive.min-time-between-pings", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_min_time_between_pings", "required":false}, map[string]interface {}{"desc":"If true, server allows keepalive pings even when there are no active streams(RPCs). If false, and client sends ping when there are no active streams, server will send GOAWAY and close the connection.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"server.grpc.keepalive.ping-without-stream-allowed", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_ping_without_stream_allowed", "required":false}, map[string]interface {}{"desc":"Output log messages in the given format. Valid formats: [logfmt, json]", "fieldDefaultValue":"logfmt", "fieldFlag":"log.format", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"log_format", "required":false}, map[string]interface {}{"desc":"Only log messages with the given severity or above. Valid levels: [debug, info, warn, error]", "fieldDefaultValue":"info", "fieldFlag":"log.level", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"log_level", "required":false}, map[string]interface {}{"desc":"Optionally log the source IPs.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"server.log-source-ips-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"log_source_ips_enabled", "required":false}, map[string]interface {}{"desc":"Header field storing the source IPs. Only used if server.log-source-ips-enabled is true. If not set the default Forwarded, X-Real-IP and X-Forwarded-For headers are used", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.log-source-ips-header", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"log_source_ips_header", "required":false}, map[string]interface {}{"desc":"Regex for matching the source IPs. Only used if server.log-source-ips-enabled is true. If not set the default Forwarded, X-Real-IP and X-Forwarded-For headers are used", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.log-source-ips-regex", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"log_source_ips_regex", "required":false}, map[string]interface {}{"desc":"Base path to serve all API routes from (e.g. /v1/)", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.path-prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"http_path_prefix", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"server", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"How frequently to clean up clients for ingesters that have gone away.", "fieldCategory":"advanced", "fieldDefaultValue":1.5e+10, "fieldFlag":"distributor.client-cleanup-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"client_cleanup_period", "required":false}, map[string]interface {}{"desc":"Run a health check on each ingester client during periodic cleanup.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"distributor.health-check-ingesters", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"health_check_ingesters", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"pool", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Enable the distributors HA tracker so that it can accept samples from Prometheus HA replicas gracefully (requires labels).", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.enable", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"enable_ha_tracker", "required":false}, map[string]interface {}{"desc":"Update the timestamp in the KV store for a given cluster/replica only after this amount of time has passed since the current stored timestamp.", "fieldCategory":"advanced", "fieldDefaultValue":1.5e+10, "fieldFlag":"distributor.ha-tracker.update-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"ha_tracker_update_timeout", "required":false}, map[string]interface {}{"desc":"Maximum jitter applied to the update timeout, in order to spread the HA heartbeats over time.", "fieldCategory":"advanced", "fieldDefaultValue":5e+09, "fieldFlag":"distributor.ha-tracker.update-timeout-jitter-max", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"ha_tracker_update_timeout_jitter_max", "required":false}, map[string]interface {}{"desc":"If we don't receive any samples from the accepted replica for a cluster in this amount of time we will failover to the next replica we receive a sample from. This value must be greater than the update timeout", "fieldCategory":"advanced", "fieldDefaultValue":3e+10, "fieldFlag":"distributor.ha-tracker.failover-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"ha_tracker_failover_timeout", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Backend storage to use for the ring. Supported values are: consul, etcd, inmemory, memberlist, multi.", "fieldDefaultValue":"consul", "fieldFlag":"distributor.ha-tracker.store", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"store", "required":false}, map[string]interface {}{"desc":"The prefix for the keys in the store. Should end with a /.", "fieldCategory":"advanced", "fieldDefaultValue":"ha-tracker/", "fieldFlag":"distributor.ha-tracker.prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"prefix", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Hostname and port of Consul.", "fieldDefaultValue":"localhost:8500", "fieldFlag":"distributor.ha-tracker.consul.hostname", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"host", "required":false}, map[string]interface {}{"desc":"ACL Token used to interact with Consul.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.consul.acl-token", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"acl_token", "required":false}, map[string]interface {}{"desc":"HTTP timeout when talking to Consul", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"distributor.ha-tracker.consul.client-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_client_timeout", "required":false}, map[string]interface {}{"desc":"Enable consistent reads to Consul.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.consul.consistent-reads", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"consistent_reads", "required":false}, map[string]interface {}{"desc":"Rate limit when watching key or prefix in Consul, in requests per second. 0 disables the rate limit.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"distributor.ha-tracker.consul.watch-rate-limit", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_rate_limit", "required":false}, map[string]interface {}{"desc":"Burst size used in rate limit. Values less than 1 are treated as 1.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"distributor.ha-tracker.consul.watch-burst-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_burst_size", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"consul", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"The etcd endpoints to connect to.", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"distributor.ha-tracker.etcd.endpoints", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"endpoints", "required":false}, map[string]interface {}{"desc":"The dial timeout for the etcd connection.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"distributor.ha-tracker.etcd.dial-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"dial_timeout", "required":false}, map[string]interface {}{"desc":"The maximum number of retries to do for failed ops.", "fieldCategory":"advanced", "fieldDefaultValue":10, "fieldFlag":"distributor.ha-tracker.etcd.max-retries", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_retries", "required":false}, map[string]interface {}{"desc":"Enable TLS.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.etcd.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.etcd.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}, map[string]interface {}{"desc":"Etcd username.", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.username", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"username", "required":false}, map[string]interface {}{"desc":"Etcd password.", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.password", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"password", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"etcd", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Primary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.multi.primary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"primary", "required":false}, map[string]interface {}{"desc":"Secondary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.multi.secondary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"secondary", "required":false}, map[string]interface {}{"desc":"Mirror writes to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.multi.mirror-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_enabled", "required":false}, map[string]interface {}{"desc":"Timeout for storing value to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":2e+09, "fieldFlag":"distributor.ha-tracker.multi.mirror-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_timeout", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"multi", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"kvstore", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"ha_tracker", "required":false}, map[string]interface {}{"desc":"remote_write API max receive message size (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"distributor.max-recv-msg-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_recv_msg_size", "required":false}, map[string]interface {}{"desc":"Timeout for downstream ingesters.", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"distributor.remote-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"remote_timeout", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Backend storage to use for the ring. Supported values are: consul, etcd, inmemory, memberlist, multi.", "fieldDefaultValue":"memberlist", "fieldFlag":"distributor.ring.store", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"store", "required":false}, map[string]interface {}{"desc":"The prefix for the keys in the store. Should end with a /.", "fieldCategory":"advanced", "fieldDefaultValue":"collectors/", "fieldFlag":"distributor.ring.prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"prefix", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Hostname and port of Consul.", "fieldDefaultValue":"localhost:8500", "fieldFlag":"distributor.ring.consul.hostname", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"host", "required":false}, map[string]interface {}{"desc":"ACL Token used to interact with Consul.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.consul.acl-token", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"acl_token", "required":false}, map[string]interface {}{"desc":"HTTP timeout when talking to Consul", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"distributor.ring.consul.client-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_client_timeout", "required":false}, map[string]interface {}{"desc":"Enable consistent reads to Consul.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ring.consul.consistent-reads", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"consistent_reads", "required":false}, map[string]interface {}{"desc":"Rate limit when watching key or prefix in Consul, in requests per second. 0 disables the rate limit.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"distributor.ring.consul.watch-rate-limit", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_rate_limit", "required":false}, map[string]interface {}{"desc":"Burst size used in rate limit. Values less than 1 are treated as 1.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"distributor.ring.consul.watch-burst-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_burst_size", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"consul", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"The etcd endpoints to connect to.", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"distributor.ring.etcd.endpoints", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"endpoints", "required":false}, map[string]interface {}{"desc":"The dial timeout for the etcd connection.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"distributor.ring.etcd.dial-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"dial_timeout", "required":false}, map[string]interface {}{"desc":"The maximum number of retries to do for failed ops.", "fieldCategory":"advanced", "fieldDefaultValue":10, "fieldFlag":"distributor.ring.etcd.max-retries", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_retries", "required":false}, map[string]interface {}{"desc":"Enable TLS.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ring.etcd.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ring.etcd.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}, map[string]interface {}{"desc":"Etcd username.", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.username", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"username", "required":false}, map[string]interface {}{"desc":"Etcd password.", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.password", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"password", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"etcd", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Primary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.multi.primary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"primary", "required":false}, map[string]interface {}{"desc":"Secondary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.multi.secondary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"secondary", "required":false}, map[string]interface {}{"desc":"Mirror writes to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ring.multi.mirror-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_enabled", "required":false}, map[string]interface {}{"desc":"Timeout for storing value to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":2e+09, "fieldFlag":"distributor.ring.multi.mirror-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_timeout", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"multi", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"kvstore", "required":false}, map[string]interface {}{"desc":"Period at which to heartbeat to the ring. 0 = disabled.", "fieldCategory":"advanced", "fieldDefaultValue":5e+09, "fieldFlag":"distributor.ring.heartbeat-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"heartbeat_period", "required":false}, map[string]interface {}{"desc":"The heartbeat timeout after which distributors are considered unhealthy within the ring. 0 = never (timeout disabled).", "fieldCategory":"advanced", "fieldDefaultValue":6e+10, "fieldFlag":"distributor.ring.heartbeat-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"heartbeat_timeout", "required":false}, map[string]interface {}{"desc":"Instance ID to register in the ring.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.instance-id", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_id", "required":false}, map[string]interface {}{"desc":"List of network interface names to look up when finding the instance IP address.", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"distributor.ring.instance-interface-names", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_interface_names", "required":false}, map[string]interface {}{"desc":"Port to advertise in the ring (defaults to -server.grpc-listen-port).", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"distributor.ring.instance-port", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_port", "required":false}, map[string]interface {}{"desc":"IP address to advertise in the ring. Default is auto-detected.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.instance-addr", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_addr", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"ring", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Max ingestion rate (samples/sec) that this distributor will accept. This limit is per-distributor, not per-tenant. Additional push requests will be rejected. Current ingestion rate is computed as exponentially weighted moving average, updated every second. 0 = unlimited.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"distributor.instance-limits.max-ingestion-rate", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"max_ingestion_rate", "required":false}, map[string]interface {}{"desc":"Max inflight push requests that this distributor can handle. This limit is per-distributor, not per-tenant. Additional requests will be rejected. 0 = unlimited.", "fieldCategory":"advanced", "fieldDefaultValue":2000, "fieldFlag":"distributor.instance-limits.max-inflight-push-requests", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_inflight_push_requests", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"instance_limits", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Enables the feature to forward certain metrics in remote_write requests, depending on defined rules.", "fieldCategory":"experimental", "fieldDefaultValue":false, "fieldFlag":"distributor.forwarding.enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"enabled", "required":false}, map[string]interface {}{"desc":"Timeout for requests to ingestion endpoints to which we forward metrics.", "fieldCategory":"experimental", "fieldDefaultValue":1e+10, "fieldFlag":"distributor.forwarding.request-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"request_timeout", "required":false}, map[string]interface {}{"desc":"If disabled then forwarding requests are always considered to be successful, errors are ignored.", "fieldCategory":"experimental", "fieldDefaultValue":true, "fieldFlag":"distributor.forwarding.propagate-errors", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"propagate_errors", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"forwarding", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"distributor", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Use iterators to execute query, as opposed to fully materialising the series in memory.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"querier.iterators", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"iterators", "required":false}, map[string]interface {}{"desc":"Use batch iterators to execute query, as opposed to fully materialising the series in memory. Takes precedent over the -querier.iterators flag.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"querier.batch-iterators", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"batch_iterators", "required":false}, map[string]interface {}{"desc":"Maximum lookback beyond which queries are not sent to ingester. 0 means all queries are sent to ingester.", "fieldCategory":"advanced", "fieldDefaultValue":4.68e+13, "fieldFlag":"querier.query-ingesters-within", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"query_ingesters_within", "required":false}, map[string]interface {}{"desc":"The time after which a metric should be queried from storage and not just ingesters. 0 means all queries are sent to store. If this option is enabled, the time range of the query sent to the store-gateway will be manipulated to ensure the query end is not more recent than 'now - query-store-after'.", "fieldCategory":"advanced", "fieldDefaultValue":4.32e+13, "fieldFlag":"querier.query-store-after", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"query_store_after", "required":false}, map[string]interface {}{"desc":"Maximum duration into the future you can query. 0 to disable.", "fieldCategory":"advanced", "fieldDefaultValue":6e+11, "fieldFlag":"querier.max-query-into-future", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"max_query_into_future", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Enable TLS for gRPC client connecting to store-gateway.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"querier.store-gateway-client.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"querier.store-gateway-client.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"querier.store-gateway-client.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"querier.store-gateway-client.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"querier.store-gateway-client.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"querier.store-gateway-client.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"store_gateway_client", "required":false}, map[string]interface {}{"desc":"Fetch in-memory series from the minimum set of required ingesters, selecting only ingesters which may have received series since -querier.query-ingesters-within. If this setting is false or -querier.query-ingesters-within is '0', queriers always query all ingesters (ingesters shuffle sharding on read path is disabled).", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"querier.shuffle-sharding-ingesters-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"shuffle_sharding_ingesters_enabled", "required":false}, map[string]interface {}{"desc":"The maximum number of concurrent queries. This config option should be set on query-frontend too when query sharding is enabled.", "fieldDefaultValue":20, "fieldFlag":"querier.max-concurrent", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_concurrent", "required":false}, map[string]interface {}{"desc":"The timeout for a query. This config option should be set on query-frontend too when query sharding is enabled. This also applies to queries evaluated by the ruler (internally or remotely).", "fieldDefaultValue":1.2e+11, "fieldFlag":"querier.timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"timeout", "required":false}, map[string]interface {}{"desc":"Maximum number of samples a single query can load into memory. This config option should be set on query-frontend too when query sharding is enabled.", "fieldDefaultValue":5e+07, "fieldFlag":"querier.max-samples", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_samples", "required":false}, map[string]interface {}{"desc":"The default evaluation interval or step size for subqueries. This config option should be set on query-frontend too when query sharding is enabled.", "fieldCategory":"advanced", "fieldDefaultValue":6e+10, "fieldFlag":"querier.default-evaluation-interval", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"default_evaluation_interval", "required":false}, map[string]interface {}{"desc":"Time since the last sample after which a time series is considered stale and ignored by expression evaluations. This config option should be set on query-frontend too when query sharding is enabled.", "fieldCategory":"advanced", "fieldDefaultValue":3e+11, "fieldFlag":"querier.lookback-delta", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"lookback_delta", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"querier", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"gRPC client max receive message size (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"ingester.client.grpc-max-recv-msg-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_recv_msg_size", "required":false}, map[string]interface {}{"desc":"gRPC client max send message size (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"ingester.client.grpc-max-send-msg-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_send_msg_size", "required":false}, map[string]interface {}{"desc":"Use compression when sending messages. Supported values are: 'gzip', 'snappy' and '' (disable compression)", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.grpc-compression", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_compression", "required":false}, map[string]interface {}{"desc":"Rate limit for gRPC client; 0 means disabled.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.client.grpc-client-rate-limit", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"rate_limit", "required":false}, map[string]interface {}{"desc":"Rate limit burst for gRPC client.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.client.grpc-client-rate-limit-burst", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"rate_limit_burst", "required":false}, map[string]interface {}{"desc":"Enable backoff and retry when we hit ratelimits.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.client.backoff-on-ratelimits", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"backoff_on_ratelimits", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Minimum delay when backing off.", "fieldCategory":"advanced", "fieldDefaultValue":1e+08, "fieldFlag":"ingester.client.backoff-min-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"min_period", "required":false}, map[string]interface {}{"desc":"Maximum delay when backing off.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"ingester.client.backoff-max-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"max_period", "required":false}, map[string]interface {}{"desc":"Number of times to backoff and retry before failing.", "fieldCategory":"advanced", "fieldDefaultValue":10, "fieldFlag":"ingester.client.backoff-retries", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_retries", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"backoff_config", "required":false}, map[string]interface {}{"desc":"Enable TLS in the GRPC client. This flag needs to be enabled when any other TLS flag is set. If set to false, insecure connection to gRPC server will be used.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.client.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.client.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"grpc_client_config", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"ingester_client", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Backend storage to use for the ring. Supported values are: consul, etcd, inmemory, memberlist, multi.", "fieldDefaultValue":"memberlist", "fieldFlag":"ingester.ring.store", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"store", "required":false}, map[string]interface {}{"desc":"The prefix for the keys in the store. Should end with a /.", "fieldCategory":"advanced", "fieldDefaultValue":"collectors/", "fieldFlag":"ingester.ring.prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"prefix", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Hostname and port of Consul.", "fieldDefaultValue":"localhost:8500", "fieldFlag":"ingester.ring.consul.hostname", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"host", "required":false}, map[string]interface {}{"desc":"ACL Token used to interact with Consul.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.consul.acl-token", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"acl_token", "required":false}, map[string]interface {}{"desc":"HTTP timeout when talking to Consul", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"ingester.ring.consul.client-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_client_timeout", "required":false}, map[string]interface {}{"desc":"Enable consistent reads to Consul.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.consul.consistent-reads", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"consistent_reads", "required":false}, map[string]interface {}{"desc":"Rate limit when watching key or prefix in Consul, in requests per second. 0 disables the rate limit.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"ingester.ring.consul.watch-rate-limit", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_rate_limit", "required":false}, map[string]interface {}{"desc":"Burst size used in rate limit. Values less than 1 are treated as 1.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"ingester.ring.consul.watch-burst-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_burst_size", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"consul", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"The etcd endpoints to connect to.", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"ingester.ring.etcd.endpoints", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"endpoints", "required":false}, map[string]interface {}{"desc":"The dial timeout for the etcd connection.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"ingester.ring.etcd.dial-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"dial_timeout", "required":false}, map[string]interface {}{"desc":"The maximum number of retries to do for failed ops.", "fieldCategory":"advanced", "fieldDefaultValue":10, "fieldFlag":"ingester.ring.etcd.max-retries", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_retries", "required":false}, map[string]interface {}{"desc":"Enable TLS.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.etcd.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.etcd.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}, map[string]interface {}{"desc":"Etcd username.", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.username", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"username", "required":false}, map[string]interface {}{"desc":"Etcd password.", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.password", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"password", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"etcd", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Primary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.multi.primary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"primary", "required":false}, map[string]interface {}{"desc":"Secondary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.multi.secondary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"secondary", "required":false}, map[string]interface {}{"desc":"Mirror writes to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.multi.mirror-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_enabled", "required":false}, map[string]interface {}{"desc":"Timeout for storing value to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":2e+09, "fieldFlag":"ingester.ring.multi.mirror-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_timeout", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"multi", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"kvstore", "required":false}, map[string]interface {}{"desc":"Period at which to heartbeat to the ring. 0 = disabled.", "fieldCategory":"advanced", "fieldDefaultValue":5e+09, "fieldFlag":"ingester.ring.heartbeat-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"heartbeat_period", "required":false}, map[string]interface {}{"desc":"The heartbeat timeout after which ingesters are skipped for reads/writes. 0 = never (timeout disabled). This option needs be set on ingesters, distributors, queriers and rulers when running in microservices mode.", "fieldCategory":"advanced", "fieldDefaultValue":6e+10, "fieldFlag":"ingester.ring.heartbeat-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"heartbeat_timeout", "required":false}, map[string]interface {}{"desc":"Number of ingesters that each time series is replicated to. This option needs be set on ingesters, distributors, queriers and rulers when running in microservices mode.", "fieldDefaultValue":3, "fieldFlag":"ingester.ring.replication-factor", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"replication_factor", "required":false}, map[string]interface {}{"desc":"True to enable the zone-awareness and replicate ingested samples across different availability zones. This option needs be set on ingesters, distributors, queriers and rulers when running in microservices mode.", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.zone-awareness-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"zone_awareness_enabled", "required":false}, map[string]interface {}{"desc":"Comma-separated list of zones to exclude from the ring. Instances in excluded zones will be filtered out from the ring. This option needs be set on ingesters, distributors, queriers and rulers when running in microservices mode.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.excluded-zones", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"excluded_zones", "required":false}, map[string]interface {}{"desc":"File path where tokens are stored. If empty, tokens are not stored at shutdown and restored at startup.", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.tokens-file-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tokens_file_path", "required":false}, map[string]interface {}{"desc":"Number of tokens for each ingester.", "fieldCategory":"advanced", "fieldDefaultValue":128, "fieldFlag":"ingester.ring.num-tokens", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"num_tokens", "required":false}, map[string]interface {}{"desc":"Instance ID to register in the ring.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.instance-id", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_id", "required":false}, map[string]interface {}{"desc":"List of network interface names to look up when finding the instance IP address.", "fieldCategory":"advanced", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"ingester.ring.instance-interface-names", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_interface_names", "required":false}, map[string]interface {}{"desc":"Port to advertise in the ring (defaults to -server.grpc-listen-port).", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.ring.instance-port", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_port", "required":false}, map[string]interface {}{"desc":"IP address to advertise in the ring. Default is auto-detected.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.instance-addr", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_addr", "required":false}, map[string]interface {}{"desc":"The availability zone where this instance is running.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.instance-availability-zone", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_availability_zone", "required":false}, map[string]interface {}{"desc":"Unregister from the ring upon clean shutdown. It can be useful to disable for rolling restarts with consistent naming.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"ingester.ring.unregister-on-shutdown", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"unregister_on_shutdown", "required":false}, map[string]interface {}{"desc":"Observe tokens after generating to resolve collisions. Useful when using gossiping ring.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.ring.observe-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"observe_period", "required":false}, map[string]interface {}{"desc":"Minimum duration to wait after the internal readiness checks have passed but before succeeding the readiness endpoint. This is used to slowdown deployment controllers (eg. Kubernetes) after an instance is ready and before they proceed with a rolling update, to give the rest of the cluster instances enough time to receive ring updates.", "fieldCategory":"advanced", "fieldDefaultValue":1.5e+10, "fieldFlag":"ingester.ring.min-ready-duration", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"min_ready_duration", "required":false}, map[string]interface {}{"desc":"Duration to sleep for before exiting, to ensure metrics are scraped.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.ring.final-sleep", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"final_sleep", "required":false}, map[string]interface {}{"desc":"When enabled the readiness probe succeeds only after all instances are ACTIVE and healthy in the ring, otherwise only the instance itself is checked. This option should be disabled if in your cluster multiple instances can be rolled out simultaneously, otherwise rolling updates may be slowed down.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"ingester.ring.readiness-check-ring-health", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"readiness_check_ring_health", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"ring", "required":false}, map[string]interface {}{"desc":"Period at which metadata we have not seen will remain in memory before being deleted.", "fieldCategory":"advanced", "fieldDefaultValue":6e+11, "fieldFlag":"ingester.metadata-retain-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"metadata_retain_period", "required":false}, map[string]interface {}{"desc":"Pe<... truncated> actual : map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Comma-separated list of components to include in the instantiated process. The default value 'all' includes all components that are required to form a functional Grafana Mimir instance in single-binary mode. Use the '-modules' command line flag to get a list of available components, and to see which components are included with 'all'.", "fieldDefaultValue":"all", "fieldFlag":"target", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"target", "required":false}, map[string]interface {}{"desc":"When set to true, incoming HTTP requests must specify tenant ID in HTTP X-Scope-OrgId header. When set to false, tenant ID from -auth.no-auth-tenant is used instead.", "fieldDefaultValue":true, "fieldFlag":"auth.multitenancy-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"multitenancy_enabled", "required":false}, map[string]interface {}{"desc":"Tenant ID to use when multitenancy is disabled.", "fieldCategory":"advanced", "fieldDefaultValue":"anonymous", "fieldFlag":"auth.no-auth-tenant", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"no_auth_tenant", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Allows to skip label name validation via X-Mimir-SkipLabelNameValidation header on the http write path. Use with caution as it breaks PromQL. Allowing this for external clients allows any client to send invalid label names. After enabling it, requests with a specific HTTP header set to true will not have label names validated.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"api.skip-label-name-validation-header-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"skip_label_name_validation_header_enabled", "required":false}, map[string]interface {}{"desc":"HTTP URL path under which the Alertmanager ui and api will be served.", "fieldCategory":"advanced", "fieldDefaultValue":"/alertmanager", "fieldFlag":"http.alertmanager-http-prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"alertmanager_http_prefix", "required":false}, map[string]interface {}{"desc":"HTTP URL path under which the Prometheus api will be served.", "fieldCategory":"advanced", "fieldDefaultValue":"/prometheus", "fieldFlag":"http.prometheus-http-prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"prometheus_http_prefix", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"api", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"HTTP server listen network, default tcp", "fieldCategory":"advanced", "fieldDefaultValue":"tcp", "fieldFlag":"server.http-listen-network", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"http_listen_network", "required":false}, map[string]interface {}{"desc":"HTTP server listen address.", "fieldDefaultValue":"", "fieldFlag":"server.http-listen-address", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"http_listen_address", "required":false}, map[string]interface {}{"desc":"HTTP server listen port.", "fieldDefaultValue":8080, "fieldFlag":"server.http-listen-port", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"http_listen_port", "required":false}, map[string]interface {}{"desc":"Maximum number of simultaneous http connections, <=0 to disable", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"server.http-conn-limit", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"http_listen_conn_limit", "required":false}, map[string]interface {}{"desc":"gRPC server listen network", "fieldCategory":"advanced", "fieldDefaultValue":"tcp", "fieldFlag":"server.grpc-listen-network", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_listen_network", "required":false}, map[string]interface {}{"desc":"gRPC server listen address.", "fieldDefaultValue":"", "fieldFlag":"server.grpc-listen-address", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_listen_address", "required":false}, map[string]interface {}{"desc":"gRPC server listen port.", "fieldDefaultValue":9095, "fieldFlag":"server.grpc-listen-port", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_listen_port", "required":false}, map[string]interface {}{"desc":"Maximum number of simultaneous grpc connections, <=0 to disable", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"server.grpc-conn-limit", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_listen_conn_limit", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"HTTP server cert path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.http-tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"cert_file", "required":false}, map[string]interface {}{"desc":"HTTP server key path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.http-tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"key_file", "required":false}, map[string]interface {}{"desc":"HTTP TLS Client Auth type.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.http-tls-client-auth", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"client_auth_type", "required":false}, map[string]interface {}{"desc":"HTTP TLS Client CA path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.http-tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"client_ca_file", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"http_tls_config", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"GRPC TLS server cert path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.grpc-tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"cert_file", "required":false}, map[string]interface {}{"desc":"GRPC TLS server key path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.grpc-tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"key_file", "required":false}, map[string]interface {}{"desc":"GRPC TLS Client Auth type.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.grpc-tls-client-auth", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"client_auth_type", "required":false}, map[string]interface {}{"desc":"GRPC TLS Client CA path.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.grpc-tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"client_ca_file", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"grpc_tls_config", "required":false}, map[string]interface {}{"desc":"Register the intrumentation handlers (/metrics etc).", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"server.register-instrumentation", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"register_instrumentation", "required":false}, map[string]interface {}{"desc":"Timeout for graceful shutdowns", "fieldCategory":"advanced", "fieldDefaultValue":3e+10, "fieldFlag":"server.graceful-shutdown-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"graceful_shutdown_timeout", "required":false}, map[string]interface {}{"desc":"Read timeout for HTTP server", "fieldCategory":"advanced", "fieldDefaultValue":3e+10, "fieldFlag":"server.http-read-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_server_read_timeout", "required":false}, map[string]interface {}{"desc":"Write timeout for HTTP server", "fieldCategory":"advanced", "fieldDefaultValue":3e+10, "fieldFlag":"server.http-write-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_server_write_timeout", "required":false}, map[string]interface {}{"desc":"Idle timeout for HTTP server", "fieldCategory":"advanced", "fieldDefaultValue":1.2e+11, "fieldFlag":"server.http-idle-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_server_idle_timeout", "required":false}, map[string]interface {}{"desc":"Limit on the size of a gRPC message this server can receive (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"server.grpc-max-recv-msg-size-bytes", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_recv_msg_size", "required":false}, map[string]interface {}{"desc":"Limit on the size of a gRPC message this server can send (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"server.grpc-max-send-msg-size-bytes", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_send_msg_size", "required":false}, map[string]interface {}{"desc":"Limit on the number of concurrent streams for gRPC calls (0 = unlimited)", "fieldCategory":"advanced", "fieldDefaultValue":100, "fieldFlag":"server.grpc-max-concurrent-streams", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_concurrent_streams", "required":false}, map[string]interface {}{"desc":"The duration after which an idle connection should be closed. Default: infinity", "fieldCategory":"advanced", "fieldDefaultValue":9.223372036854776e+18, "fieldFlag":"server.grpc.keepalive.max-connection-idle", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_connection_idle", "required":false}, map[string]interface {}{"desc":"The duration for the maximum amount of time a connection may exist before it will be closed. Default: infinity", "fieldCategory":"advanced", "fieldDefaultValue":9.223372036854776e+18, "fieldFlag":"server.grpc.keepalive.max-connection-age", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_connection_age", "required":false}, map[string]interface {}{"desc":"An additive period after max-connection-age after which the connection will be forcibly closed. Default: infinity", "fieldCategory":"advanced", "fieldDefaultValue":9.223372036854776e+18, "fieldFlag":"server.grpc.keepalive.max-connection-age-grace", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_max_connection_age_grace", "required":false}, map[string]interface {}{"desc":"Duration after which a keepalive probe is sent in case of no activity over the connection., Default: 2h", "fieldCategory":"advanced", "fieldDefaultValue":7.2e+12, "fieldFlag":"server.grpc.keepalive.time", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_keepalive_time", "required":false}, map[string]interface {}{"desc":"After having pinged for keepalive check, the duration after which an idle connection should be closed, Default: 20s", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"server.grpc.keepalive.timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_keepalive_timeout", "required":false}, map[string]interface {}{"desc":"Minimum amount of time a client should wait before sending a keepalive ping. If client sends keepalive ping more often, server will send GOAWAY and close the connection.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"server.grpc.keepalive.min-time-between-pings", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_min_time_between_pings", "required":false}, map[string]interface {}{"desc":"If true, server allows keepalive pings even when there are no active streams(RPCs). If false, and client sends ping when there are no active streams, server will send GOAWAY and close the connection.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"server.grpc.keepalive.ping-without-stream-allowed", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_server_ping_without_stream_allowed", "required":false}, map[string]interface {}{"desc":"Output log messages in the given format. Valid formats: [logfmt, json]", "fieldDefaultValue":"logfmt", "fieldFlag":"log.format", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"log_format", "required":false}, map[string]interface {}{"desc":"Only log messages with the given severity or above. Valid levels: [debug, info, warn, error]", "fieldDefaultValue":"info", "fieldFlag":"log.level", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"log_level", "required":false}, map[string]interface {}{"desc":"Optionally log the source IPs.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"server.log-source-ips-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"log_source_ips_enabled", "required":false}, map[string]interface {}{"desc":"Header field storing the source IPs. Only used if server.log-source-ips-enabled is true. If not set the default Forwarded, X-Real-IP and X-Forwarded-For headers are used", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.log-source-ips-header", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"log_source_ips_header", "required":false}, map[string]interface {}{"desc":"Regex for matching the source IPs. Only used if server.log-source-ips-enabled is true. If not set the default Forwarded, X-Real-IP and X-Forwarded-For headers are used", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.log-source-ips-regex", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"log_source_ips_regex", "required":false}, map[string]interface {}{"desc":"Base path to serve all API routes from (e.g. /v1/)", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"server.path-prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"http_path_prefix", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"server", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"How frequently to clean up clients for ingesters that have gone away.", "fieldCategory":"advanced", "fieldDefaultValue":1.5e+10, "fieldFlag":"distributor.client-cleanup-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"client_cleanup_period", "required":false}, map[string]interface {}{"desc":"Run a health check on each ingester client during periodic cleanup.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"distributor.health-check-ingesters", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"health_check_ingesters", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"pool", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Enable the distributors HA tracker so that it can accept samples from Prometheus HA replicas gracefully (requires labels).", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.enable", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"enable_ha_tracker", "required":false}, map[string]interface {}{"desc":"Update the timestamp in the KV store for a given cluster/replica only after this amount of time has passed since the current stored timestamp.", "fieldCategory":"advanced", "fieldDefaultValue":1.5e+10, "fieldFlag":"distributor.ha-tracker.update-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"ha_tracker_update_timeout", "required":false}, map[string]interface {}{"desc":"Maximum jitter applied to the update timeout, in order to spread the HA heartbeats over time.", "fieldCategory":"advanced", "fieldDefaultValue":5e+09, "fieldFlag":"distributor.ha-tracker.update-timeout-jitter-max", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"ha_tracker_update_timeout_jitter_max", "required":false}, map[string]interface {}{"desc":"If we don't receive any samples from the accepted replica for a cluster in this amount of time we will failover to the next replica we receive a sample from. This value must be greater than the update timeout", "fieldCategory":"advanced", "fieldDefaultValue":3e+10, "fieldFlag":"distributor.ha-tracker.failover-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"ha_tracker_failover_timeout", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Backend storage to use for the ring. Supported values are: consul, etcd, inmemory, memberlist, multi.", "fieldDefaultValue":"consul", "fieldFlag":"distributor.ha-tracker.store", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"store", "required":false}, map[string]interface {}{"desc":"The prefix for the keys in the store. Should end with a /.", "fieldCategory":"advanced", "fieldDefaultValue":"ha-tracker/", "fieldFlag":"distributor.ha-tracker.prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"prefix", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Hostname and port of Consul.", "fieldDefaultValue":"localhost:8500", "fieldFlag":"distributor.ha-tracker.consul.hostname", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"host", "required":false}, map[string]interface {}{"desc":"ACL Token used to interact with Consul.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.consul.acl-token", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"acl_token", "required":false}, map[string]interface {}{"desc":"HTTP timeout when talking to Consul", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"distributor.ha-tracker.consul.client-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_client_timeout", "required":false}, map[string]interface {}{"desc":"Enable consistent reads to Consul.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.consul.consistent-reads", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"consistent_reads", "required":false}, map[string]interface {}{"desc":"Rate limit when watching key or prefix in Consul, in requests per second. 0 disables the rate limit.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"distributor.ha-tracker.consul.watch-rate-limit", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_rate_limit", "required":false}, map[string]interface {}{"desc":"Burst size used in rate limit. Values less than 1 are treated as 1.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"distributor.ha-tracker.consul.watch-burst-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_burst_size", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"consul", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"The etcd endpoints to connect to.", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"distributor.ha-tracker.etcd.endpoints", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"endpoints", "required":false}, map[string]interface {}{"desc":"The dial timeout for the etcd connection.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"distributor.ha-tracker.etcd.dial-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"dial_timeout", "required":false}, map[string]interface {}{"desc":"The maximum number of retries to do for failed ops.", "fieldCategory":"advanced", "fieldDefaultValue":10, "fieldFlag":"distributor.ha-tracker.etcd.max-retries", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_retries", "required":false}, map[string]interface {}{"desc":"Enable TLS.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.etcd.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.etcd.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}, map[string]interface {}{"desc":"Etcd username.", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.username", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"username", "required":false}, map[string]interface {}{"desc":"Etcd password.", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.etcd.password", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"password", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"etcd", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Primary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.multi.primary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"primary", "required":false}, map[string]interface {}{"desc":"Secondary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ha-tracker.multi.secondary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"secondary", "required":false}, map[string]interface {}{"desc":"Mirror writes to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ha-tracker.multi.mirror-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_enabled", "required":false}, map[string]interface {}{"desc":"Timeout for storing value to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":2e+09, "fieldFlag":"distributor.ha-tracker.multi.mirror-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_timeout", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"multi", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"kvstore", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"ha_tracker", "required":false}, map[string]interface {}{"desc":"remote_write API max receive message size (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"distributor.max-recv-msg-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_recv_msg_size", "required":false}, map[string]interface {}{"desc":"Timeout for downstream ingesters.", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"distributor.remote-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"remote_timeout", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Backend storage to use for the ring. Supported values are: consul, etcd, inmemory, memberlist, multi.", "fieldDefaultValue":"memberlist", "fieldFlag":"distributor.ring.store", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"store", "required":false}, map[string]interface {}{"desc":"The prefix for the keys in the store. Should end with a /.", "fieldCategory":"advanced", "fieldDefaultValue":"collectors/", "fieldFlag":"distributor.ring.prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"prefix", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Hostname and port of Consul.", "fieldDefaultValue":"localhost:8500", "fieldFlag":"distributor.ring.consul.hostname", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"host", "required":false}, map[string]interface {}{"desc":"ACL Token used to interact with Consul.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.consul.acl-token", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"acl_token", "required":false}, map[string]interface {}{"desc":"HTTP timeout when talking to Consul", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"distributor.ring.consul.client-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_client_timeout", "required":false}, map[string]interface {}{"desc":"Enable consistent reads to Consul.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ring.consul.consistent-reads", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"consistent_reads", "required":false}, map[string]interface {}{"desc":"Rate limit when watching key or prefix in Consul, in requests per second. 0 disables the rate limit.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"distributor.ring.consul.watch-rate-limit", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_rate_limit", "required":false}, map[string]interface {}{"desc":"Burst size used in rate limit. Values less than 1 are treated as 1.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"distributor.ring.consul.watch-burst-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_burst_size", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"consul", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"The etcd endpoints to connect to.", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"distributor.ring.etcd.endpoints", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"endpoints", "required":false}, map[string]interface {}{"desc":"The dial timeout for the etcd connection.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"distributor.ring.etcd.dial-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"dial_timeout", "required":false}, map[string]interface {}{"desc":"The maximum number of retries to do for failed ops.", "fieldCategory":"advanced", "fieldDefaultValue":10, "fieldFlag":"distributor.ring.etcd.max-retries", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_retries", "required":false}, map[string]interface {}{"desc":"Enable TLS.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ring.etcd.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ring.etcd.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}, map[string]interface {}{"desc":"Etcd username.", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.username", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"username", "required":false}, map[string]interface {}{"desc":"Etcd password.", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.etcd.password", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"password", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"etcd", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Primary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.multi.primary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"primary", "required":false}, map[string]interface {}{"desc":"Secondary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.multi.secondary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"secondary", "required":false}, map[string]interface {}{"desc":"Mirror writes to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"distributor.ring.multi.mirror-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_enabled", "required":false}, map[string]interface {}{"desc":"Timeout for storing value to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":2e+09, "fieldFlag":"distributor.ring.multi.mirror-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_timeout", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"multi", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"kvstore", "required":false}, map[string]interface {}{"desc":"Period at which to heartbeat to the ring. 0 = disabled.", "fieldCategory":"advanced", "fieldDefaultValue":5e+09, "fieldFlag":"distributor.ring.heartbeat-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"heartbeat_period", "required":false}, map[string]interface {}{"desc":"The heartbeat timeout after which distributors are considered unhealthy within the ring. 0 = never (timeout disabled).", "fieldCategory":"advanced", "fieldDefaultValue":6e+10, "fieldFlag":"distributor.ring.heartbeat-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"heartbeat_timeout", "required":false}, map[string]interface {}{"desc":"Instance ID to register in the ring.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.instance-id", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_id", "required":false}, map[string]interface {}{"desc":"List of network interface names to look up when finding the instance IP address.", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"distributor.ring.instance-interface-names", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_interface_names", "required":false}, map[string]interface {}{"desc":"Port to advertise in the ring (defaults to -server.grpc-listen-port).", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"distributor.ring.instance-port", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_port", "required":false}, map[string]interface {}{"desc":"IP address to advertise in the ring. Default is auto-detected.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"distributor.ring.instance-addr", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_addr", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"ring", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Max ingestion rate (samples/sec) that this distributor will accept. This limit is per-distributor, not per-tenant. Additional push requests will be rejected. Current ingestion rate is computed as exponentially weighted moving average, updated every second. 0 = unlimited.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"distributor.instance-limits.max-ingestion-rate", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"max_ingestion_rate", "required":false}, map[string]interface {}{"desc":"Max inflight push requests that this distributor can handle. This limit is per-distributor, not per-tenant. Additional requests will be rejected. 0 = unlimited.", "fieldCategory":"advanced", "fieldDefaultValue":2000, "fieldFlag":"distributor.instance-limits.max-inflight-push-requests", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_inflight_push_requests", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"instance_limits", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Enables the feature to forward certain metrics in remote_write requests, depending on defined rules.", "fieldCategory":"experimental", "fieldDefaultValue":false, "fieldFlag":"distributor.forwarding.enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"enabled", "required":false}, map[string]interface {}{"desc":"Timeout for requests to ingestion endpoints to which we forward metrics.", "fieldCategory":"experimental", "fieldDefaultValue":1e+10, "fieldFlag":"distributor.forwarding.request-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"request_timeout", "required":false}, map[string]interface {}{"desc":"If disabled then forwarding requests are always considered to be successful, errors are ignored.", "fieldCategory":"experimental", "fieldDefaultValue":true, "fieldFlag":"distributor.forwarding.propagate-errors", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"propagate_errors", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"forwarding", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"distributor", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Use iterators to execute query, as opposed to fully materialising the series in memory.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"querier.iterators", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"iterators", "required":false}, map[string]interface {}{"desc":"Use batch iterators to execute query, as opposed to fully materialising the series in memory. Takes precedent over the -querier.iterators flag.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"querier.batch-iterators", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"batch_iterators", "required":false}, map[string]interface {}{"desc":"Maximum lookback beyond which queries are not sent to ingester. 0 means all queries are sent to ingester.", "fieldCategory":"advanced", "fieldDefaultValue":4.68e+13, "fieldFlag":"querier.query-ingesters-within", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"query_ingesters_within", "required":false}, map[string]interface {}{"desc":"The time after which a metric should be queried from storage and not just ingesters. 0 means all queries are sent to store. If this option is enabled, the time range of the query sent to the store-gateway will be manipulated to ensure the query end is not more recent than 'now - query-store-after'.", "fieldCategory":"advanced", "fieldDefaultValue":4.32e+13, "fieldFlag":"querier.query-store-after", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"query_store_after", "required":false}, map[string]interface {}{"desc":"Maximum duration into the future you can query. 0 to disable.", "fieldCategory":"advanced", "fieldDefaultValue":6e+11, "fieldFlag":"querier.max-query-into-future", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"max_query_into_future", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Enable TLS for gRPC client connecting to store-gateway.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"querier.store-gateway-client.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"querier.store-gateway-client.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"querier.store-gateway-client.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"querier.store-gateway-client.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"querier.store-gateway-client.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"querier.store-gateway-client.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"store_gateway_client", "required":false}, map[string]interface {}{"desc":"Fetch in-memory series from the minimum set of required ingesters, selecting only ingesters which may have received series since -querier.query-ingesters-within. If this setting is false or -querier.query-ingesters-within is '0', queriers always query all ingesters (ingesters shuffle sharding on read path is disabled).", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"querier.shuffle-sharding-ingesters-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"shuffle_sharding_ingesters_enabled", "required":false}, map[string]interface {}{"desc":"The maximum number of concurrent queries. This config option should be set on query-frontend too when query sharding is enabled.", "fieldDefaultValue":20, "fieldFlag":"querier.max-concurrent", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_concurrent", "required":false}, map[string]interface {}{"desc":"The timeout for a query. This config option should be set on query-frontend too when query sharding is enabled. This also applies to queries evaluated by the ruler (internally or remotely).", "fieldDefaultValue":1.2e+11, "fieldFlag":"querier.timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"timeout", "required":false}, map[string]interface {}{"desc":"Maximum number of samples a single query can load into memory. This config option should be set on query-frontend too when query sharding is enabled.", "fieldDefaultValue":5e+07, "fieldFlag":"querier.max-samples", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_samples", "required":false}, map[string]interface {}{"desc":"The default evaluation interval or step size for subqueries. This config option should be set on query-frontend too when query sharding is enabled.", "fieldCategory":"advanced", "fieldDefaultValue":6e+10, "fieldFlag":"querier.default-evaluation-interval", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"default_evaluation_interval", "required":false}, map[string]interface {}{"desc":"Time since the last sample after which a time series is considered stale and ignored by expression evaluations. This config option should be set on query-frontend too when query sharding is enabled.", "fieldCategory":"advanced", "fieldDefaultValue":3e+11, "fieldFlag":"querier.lookback-delta", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"lookback_delta", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"querier", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"gRPC client max receive message size (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"ingester.client.grpc-max-recv-msg-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_recv_msg_size", "required":false}, map[string]interface {}{"desc":"gRPC client max send message size (bytes).", "fieldCategory":"advanced", "fieldDefaultValue":1.048576e+08, "fieldFlag":"ingester.client.grpc-max-send-msg-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_send_msg_size", "required":false}, map[string]interface {}{"desc":"Use compression when sending messages. Supported values are: 'gzip', 'snappy' and '' (disable compression)", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.grpc-compression", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"grpc_compression", "required":false}, map[string]interface {}{"desc":"Rate limit for gRPC client; 0 means disabled.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.client.grpc-client-rate-limit", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"rate_limit", "required":false}, map[string]interface {}{"desc":"Rate limit burst for gRPC client.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.client.grpc-client-rate-limit-burst", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"rate_limit_burst", "required":false}, map[string]interface {}{"desc":"Enable backoff and retry when we hit ratelimits.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.client.backoff-on-ratelimits", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"backoff_on_ratelimits", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Minimum delay when backing off.", "fieldCategory":"advanced", "fieldDefaultValue":1e+08, "fieldFlag":"ingester.client.backoff-min-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"min_period", "required":false}, map[string]interface {}{"desc":"Maximum delay when backing off.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"ingester.client.backoff-max-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"max_period", "required":false}, map[string]interface {}{"desc":"Number of times to backoff and retry before failing.", "fieldCategory":"advanced", "fieldDefaultValue":10, "fieldFlag":"ingester.client.backoff-retries", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_retries", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"backoff_config", "required":false}, map[string]interface {}{"desc":"Enable TLS in the GRPC client. This flag needs to be enabled when any other TLS flag is set. If set to false, insecure connection to gRPC server will be used.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.client.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.client.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.client.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"grpc_client_config", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"ingester_client", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Backend storage to use for the ring. Supported values are: consul, etcd, inmemory, memberlist, multi.", "fieldDefaultValue":"memberlist", "fieldFlag":"ingester.ring.store", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"store", "required":false}, map[string]interface {}{"desc":"The prefix for the keys in the store. Should end with a /.", "fieldCategory":"advanced", "fieldDefaultValue":"collectors/", "fieldFlag":"ingester.ring.prefix", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"prefix", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Hostname and port of Consul.", "fieldDefaultValue":"localhost:8500", "fieldFlag":"ingester.ring.consul.hostname", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"host", "required":false}, map[string]interface {}{"desc":"ACL Token used to interact with Consul.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.consul.acl-token", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"acl_token", "required":false}, map[string]interface {}{"desc":"HTTP timeout when talking to Consul", "fieldCategory":"advanced", "fieldDefaultValue":2e+10, "fieldFlag":"ingester.ring.consul.client-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"http_client_timeout", "required":false}, map[string]interface {}{"desc":"Enable consistent reads to Consul.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.consul.consistent-reads", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"consistent_reads", "required":false}, map[string]interface {}{"desc":"Rate limit when watching key or prefix in Consul, in requests per second. 0 disables the rate limit.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"ingester.ring.consul.watch-rate-limit", "fieldType":"float", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_rate_limit", "required":false}, map[string]interface {}{"desc":"Burst size used in rate limit. Values less than 1 are treated as 1.", "fieldCategory":"advanced", "fieldDefaultValue":1, "fieldFlag":"ingester.ring.consul.watch-burst-size", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"watch_burst_size", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"consul", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"The etcd endpoints to connect to.", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"ingester.ring.etcd.endpoints", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"endpoints", "required":false}, map[string]interface {}{"desc":"The dial timeout for the etcd connection.", "fieldCategory":"advanced", "fieldDefaultValue":1e+10, "fieldFlag":"ingester.ring.etcd.dial-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"dial_timeout", "required":false}, map[string]interface {}{"desc":"The maximum number of retries to do for failed ops.", "fieldCategory":"advanced", "fieldDefaultValue":10, "fieldFlag":"ingester.ring.etcd.max-retries", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"max_retries", "required":false}, map[string]interface {}{"desc":"Enable TLS.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.etcd.tls-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_enabled", "required":false}, map[string]interface {}{"desc":"Path to the client certificate file, which will be used for authenticating with the server. Also requires the key path to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.tls-cert-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_cert_path", "required":false}, map[string]interface {}{"desc":"Path to the key file for the client certificate. Also requires the client certificate to be configured.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.tls-key-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_key_path", "required":false}, map[string]interface {}{"desc":"Path to the CA certificates file to validate server certificate against. If not set, the host's root CA certificates are used.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.tls-ca-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_ca_path", "required":false}, map[string]interface {}{"desc":"Override the expected name on the server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.tls-server-name", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_server_name", "required":false}, map[string]interface {}{"desc":"Skip validating server certificate.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.etcd.tls-insecure-skip-verify", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"tls_insecure_skip_verify", "required":false}, map[string]interface {}{"desc":"Etcd username.", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.username", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"username", "required":false}, map[string]interface {}{"desc":"Etcd password.", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.etcd.password", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"password", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"etcd", "required":false}, map[string]interface {}{"blockEntries":[]interface {}{map[string]interface {}{"desc":"Primary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.multi.primary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"primary", "required":false}, map[string]interface {}{"desc":"Secondary backend storage used by multi-client.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.multi.secondary", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"secondary", "required":false}, map[string]interface {}{"desc":"Mirror writes to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.multi.mirror-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_enabled", "required":false}, map[string]interface {}{"desc":"Timeout for storing value to secondary store.", "fieldCategory":"advanced", "fieldDefaultValue":2e+09, "fieldFlag":"ingester.ring.multi.mirror-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"mirror_timeout", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"multi", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"kvstore", "required":false}, map[string]interface {}{"desc":"Period at which to heartbeat to the ring. 0 = disabled.", "fieldCategory":"advanced", "fieldDefaultValue":5e+09, "fieldFlag":"ingester.ring.heartbeat-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"heartbeat_period", "required":false}, map[string]interface {}{"desc":"The heartbeat timeout after which ingesters are skipped for reads/writes. 0 = never (timeout disabled). This option needs be set on ingesters, distributors, queriers and rulers when running in microservices mode.", "fieldCategory":"advanced", "fieldDefaultValue":6e+10, "fieldFlag":"ingester.ring.heartbeat-timeout", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"heartbeat_timeout", "required":false}, map[string]interface {}{"desc":"Number of ingesters that each time series is replicated to. This option needs be set on ingesters, distributors, queriers and rulers when running in microservices mode.", "fieldDefaultValue":3, "fieldFlag":"ingester.ring.replication-factor", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"replication_factor", "required":false}, map[string]interface {}{"desc":"True to enable the zone-awareness and replicate ingested samples across different availability zones. This option needs be set on ingesters, distributors, queriers and rulers when running in microservices mode.", "fieldDefaultValue":false, "fieldFlag":"ingester.ring.zone-awareness-enabled", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"zone_awareness_enabled", "required":false}, map[string]interface {}{"desc":"Comma-separated list of zones to exclude from the ring. Instances in excluded zones will be filtered out from the ring. This option needs be set on ingesters, distributors, queriers and rulers when running in microservices mode.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.excluded-zones", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"excluded_zones", "required":false}, map[string]interface {}{"desc":"File path where tokens are stored. If empty, tokens are not stored at shutdown and restored at startup.", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.tokens-file-path", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"tokens_file_path", "required":false}, map[string]interface {}{"desc":"Number of tokens for each ingester.", "fieldCategory":"advanced", "fieldDefaultValue":128, "fieldFlag":"ingester.ring.num-tokens", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"num_tokens", "required":false}, map[string]interface {}{"desc":"Instance ID to register in the ring.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.instance-id", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_id", "required":false}, map[string]interface {}{"desc":"List of network interface names to look up when finding the instance IP address.", "fieldCategory":"advanced", "fieldDefaultValue":[]interface {}{}, "fieldFlag":"ingester.ring.instance-interface-names", "fieldType":"list of string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_interface_names", "required":false}, map[string]interface {}{"desc":"Port to advertise in the ring (defaults to -server.grpc-listen-port).", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.ring.instance-port", "fieldType":"int", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_port", "required":false}, map[string]interface {}{"desc":"IP address to advertise in the ring. Default is auto-detected.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.instance-addr", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_addr", "required":false}, map[string]interface {}{"desc":"The availability zone where this instance is running.", "fieldCategory":"advanced", "fieldDefaultValue":"", "fieldFlag":"ingester.ring.instance-availability-zone", "fieldType":"string", "fieldValue":interface {}(nil), "kind":"field", "name":"instance_availability_zone", "required":false}, map[string]interface {}{"desc":"Unregister from the ring upon clean shutdown. It can be useful to disable for rolling restarts with consistent naming.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"ingester.ring.unregister-on-shutdown", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"unregister_on_shutdown", "required":false}, map[string]interface {}{"desc":"Observe tokens after generating to resolve collisions. Useful when using gossiping ring.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.ring.observe-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"observe_period", "required":false}, map[string]interface {}{"desc":"Minimum duration to wait after the internal readiness checks have passed but before succeeding the readiness endpoint. This is used to slowdown deployment controllers (eg. Kubernetes) after an instance is ready and before they proceed with a rolling update, to give the rest of the cluster instances enough time to receive ring updates.", "fieldCategory":"advanced", "fieldDefaultValue":1.5e+10, "fieldFlag":"ingester.ring.min-ready-duration", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"min_ready_duration", "required":false}, map[string]interface {}{"desc":"Duration to sleep for before exiting, to ensure metrics are scraped.", "fieldCategory":"advanced", "fieldDefaultValue":0, "fieldFlag":"ingester.ring.final-sleep", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"final_sleep", "required":false}, map[string]interface {}{"desc":"When enabled the readiness probe succeeds only after all instances are ACTIVE and healthy in the ring, otherwise only the instance itself is checked. This option should be disabled if in your cluster multiple instances can be rolled out simultaneously, otherwise rolling updates may be slowed down.", "fieldCategory":"advanced", "fieldDefaultValue":true, "fieldFlag":"ingester.ring.readiness-check-ring-health", "fieldType":"boolean", "fieldValue":interface {}(nil), "kind":"field", "name":"readiness_check_ring_health", "required":false}}, "desc":"", "fieldDefaultValue":interface {}(nil), "fieldValue":interface {}(nil), "kind":"block", "name":"ring", "required":false}, map[string]interface {}{"desc":"Period at which metadata we have not seen will remain in memory before being deleted.", "fieldCategory":"advanced", "fieldDefaultValue":6e+11, "fieldFlag":"ingester.metadata-retain-period", "fieldType":"duration", "fieldValue":interface {}(nil), "kind":"field", "name":"metadata_retain_period", "required":false}, map[string]interface {}{"desc":"Pe<... truncated> Diff: --- Expected +++ Actual @@ -7060,3 +7060,3 @@ (string) (len=4) "desc": (string) (len=409) "The URL under which Alertmanager is externally reachable (eg. could be different than -http.alertmanager-http-prefix in case Alertmanager is served via a reverse proxy). This setting is used both to configure the internal requests router and to generate links in alert templates. If the external URL has a path portion, it will be used to prefix all HTTP endpoints served by Alertmanager, both the UI and API.", - (string) (len=17) "fieldDefaultValue": (map[string]interface {}) (len=11) { + (string) (len=17) "fieldDefaultValue": (map[string]interface {}) (len=10) { (string) (len=10) "ForceQuery": (bool) false, @@ -7064,3 +7064,2 @@ (string) (len=4) "Host": (string) (len=14) "localhost:8080", - (string) (len=8) "OmitHost": (bool) false, (string) (len=6) "Opaque": (string) "", Test: TestConfigDescriptorIsUpToDate Messages: config descriptor is not up to date; run `make reference-help` --- FAIL: TestConfigDescriptorIsUpToDate (0.48s) FAIL FAIL github.com/grafana/mimir/tools/config-inspector 2.129s ? github.com/grafana/mimir/tools/doc-generator [no test files] === RUN Test_findFlagsPrefix --- PASS: Test_findFlagsPrefix (0.00s) PASS ok github.com/grafana/mimir/tools/doc-generator/parse 0.748s ? github.com/grafana/mimir/tools/list-deduplicated-blocks [no test files] ? github.com/grafana/mimir/tools/listblocks [no test files] ? github.com/grafana/mimir/tools/markblocks [no test files] ? github.com/grafana/mimir/tools/pre-pull-images [no test files] ? github.com/grafana/mimir/tools/query-step-alignment-analysis [no test files] === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/no_auth === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_no_auth_it_should_forward_the_request_auth === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_an_username_set_it_should_forward_the_request_password_only === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_NOT_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication (0.01s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/no_auth (0.01s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_no_auth_it_should_forward_the_request_auth (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_an_username_set_it_should_forward_the_request_password_only (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_NOT_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth (0.00s) === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_1st_response_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_last_response_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/no_received_response_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_1st_response_received === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received_but_it's_not_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_2nd_response_received_but_only_the_last_one_is_successful --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream (0.01s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_1st_response_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_last_response_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/no_received_response_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_1st_response_received (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received_but_it's_not_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_2nd_response_received_but_only_the_last_one_is_successful (0.00s) === RUN Test_ProxyEndpoint_Requests === RUN Test_ProxyEndpoint_Requests/GET-request === RUN Test_ProxyEndpoint_Requests/GET-filter-accept-encoding === RUN Test_ProxyEndpoint_Requests/POST-request-with-body --- PASS: Test_ProxyEndpoint_Requests (0.08s) --- PASS: Test_ProxyEndpoint_Requests/GET-request (0.04s) --- PASS: Test_ProxyEndpoint_Requests/GET-filter-accept-encoding (0.00s) --- PASS: Test_ProxyEndpoint_Requests/POST-request-with-body (0.01s) === RUN Test_backendResponse_succeeded === RUN Test_backendResponse_succeeded/Error_while_executing_request === RUN Test_backendResponse_succeeded/2xx_response_status_code === RUN Test_backendResponse_succeeded/3xx_response_status_code === RUN Test_backendResponse_succeeded/4xx_response_status_code === RUN Test_backendResponse_succeeded/5xx_response_status_code --- PASS: Test_backendResponse_succeeded (0.00s) --- PASS: Test_backendResponse_succeeded/Error_while_executing_request (0.00s) --- PASS: Test_backendResponse_succeeded/2xx_response_status_code (0.00s) --- PASS: Test_backendResponse_succeeded/3xx_response_status_code (0.00s) --- PASS: Test_backendResponse_succeeded/4xx_response_status_code (0.00s) --- PASS: Test_backendResponse_succeeded/5xx_response_status_code (0.00s) === RUN Test_backendResponse_statusCode === RUN Test_backendResponse_statusCode/200_response_status_code === RUN Test_backendResponse_statusCode/503_response_status_code === RUN Test_backendResponse_statusCode/Error_while_executing_request --- PASS: Test_backendResponse_statusCode (0.00s) --- PASS: Test_backendResponse_statusCode/200_response_status_code (0.00s) --- PASS: Test_backendResponse_statusCode/503_response_status_code (0.00s) --- PASS: Test_backendResponse_statusCode/Error_while_executing_request (0.00s) === RUN Test_NewProxy --- PASS: Test_NewProxy (0.00s) === RUN Test_Proxy_RequestsForwarding === RUN Test_Proxy_RequestsForwarding/two_backends_with_different_path_prefix === RUN Test_Proxy_RequestsForwarding/preferred_backend_returns_5xx === RUN Test_Proxy_RequestsForwarding/non-preferred_backend_returns_5xx === RUN Test_Proxy_RequestsForwarding/all_backends_returns_5xx === RUN Test_Proxy_RequestsForwarding/one_backend_returning_2xx === RUN Test_Proxy_RequestsForwarding/two_backends_with_the_same_path_prefix === RUN Test_Proxy_RequestsForwarding/preferred_backend_returns_4xx === RUN Test_Proxy_RequestsForwarding/one_backend_returning_5xx === RUN Test_Proxy_RequestsForwarding/two_backends_without_path_prefix --- PASS: Test_Proxy_RequestsForwarding (0.14s) --- PASS: Test_Proxy_RequestsForwarding/two_backends_with_different_path_prefix (0.02s) --- PASS: Test_Proxy_RequestsForwarding/preferred_backend_returns_5xx (0.01s) --- PASS: Test_Proxy_RequestsForwarding/non-preferred_backend_returns_5xx (0.06s) --- PASS: Test_Proxy_RequestsForwarding/all_backends_returns_5xx (0.00s) --- PASS: Test_Proxy_RequestsForwarding/one_backend_returning_2xx (0.00s) --- PASS: Test_Proxy_RequestsForwarding/two_backends_with_the_same_path_prefix (0.00s) --- PASS: Test_Proxy_RequestsForwarding/preferred_backend_returns_4xx (0.02s) --- PASS: Test_Proxy_RequestsForwarding/one_backend_returning_5xx (0.00s) --- PASS: Test_Proxy_RequestsForwarding/two_backends_without_path_prefix (0.00s) === RUN TestProxy_Passthrough === RUN TestProxy_Passthrough/first_backend_preferred === RUN TestProxy_Passthrough/second_backend_preferred --- PASS: TestProxy_Passthrough (0.02s) --- PASS: TestProxy_Passthrough/first_backend_preferred (0.01s) --- PASS: TestProxy_Passthrough/second_backend_preferred (0.01s) === RUN TestCompareMatrix === RUN TestCompareMatrix/no_metrics === RUN TestCompareMatrix/no_metrics_in_actual_response === RUN TestCompareMatrix/extra_metric_in_actual_response === RUN TestCompareMatrix/same_number_of_metrics_but_with_different_labels === RUN TestCompareMatrix/difference_in_number_of_samples === RUN TestCompareMatrix/difference_in_sample_timestamp === RUN TestCompareMatrix/difference_in_sample_value === RUN TestCompareMatrix/correct_samples --- PASS: TestCompareMatrix (0.01s) --- PASS: TestCompareMatrix/no_metrics (0.00s) --- PASS: TestCompareMatrix/no_metrics_in_actual_response (0.00s) --- PASS: TestCompareMatrix/extra_metric_in_actual_response (0.00s) --- PASS: TestCompareMatrix/same_number_of_metrics_but_with_different_labels (0.00s) --- PASS: TestCompareMatrix/difference_in_number_of_samples (0.00s) --- PASS: TestCompareMatrix/difference_in_sample_timestamp (0.00s) --- PASS: TestCompareMatrix/difference_in_sample_value (0.00s) --- PASS: TestCompareMatrix/correct_samples (0.00s) === RUN TestCompareVector === RUN TestCompareVector/no_metrics === RUN TestCompareVector/no_metrics_in_actual_response === RUN TestCompareVector/extra_metric_in_actual_response === RUN TestCompareVector/same_number_of_metrics_but_with_different_labels === RUN TestCompareVector/difference_in_sample_timestamp === RUN TestCompareVector/difference_in_sample_value === RUN TestCompareVector/correct_samples --- PASS: TestCompareVector (0.00s) --- PASS: TestCompareVector/no_metrics (0.00s) --- PASS: TestCompareVector/no_metrics_in_actual_response (0.00s) --- PASS: TestCompareVector/extra_metric_in_actual_response (0.00s) --- PASS: TestCompareVector/same_number_of_metrics_but_with_different_labels (0.00s) --- PASS: TestCompareVector/difference_in_sample_timestamp (0.00s) --- PASS: TestCompareVector/difference_in_sample_value (0.00s) --- PASS: TestCompareVector/correct_samples (0.00s) === RUN TestCompareScalar === RUN TestCompareScalar/difference_in_timestamp === RUN TestCompareScalar/difference_in_value === RUN TestCompareScalar/correct_values --- PASS: TestCompareScalar (0.00s) --- PASS: TestCompareScalar/difference_in_timestamp (0.00s) --- PASS: TestCompareScalar/difference_in_value (0.00s) --- PASS: TestCompareScalar/correct_values (0.00s) === RUN TestCompareSamplesResponse === RUN TestCompareSamplesResponse/difference_in_response_status === RUN TestCompareSamplesResponse/difference_in_resultType === RUN TestCompareSamplesResponse/unregistered_resultType === RUN TestCompareSamplesResponse/valid_scalar_response === RUN TestCompareSamplesResponse/should_pass_if_values_are_slightly_different_but_within_the_tolerance === RUN TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_disabled === RUN TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_enabled === RUN TestCompareSamplesResponse/should_correctly_compare_Inf_values === RUN TestCompareSamplesResponse/should_correctly_compare_-Inf_values === RUN TestCompareSamplesResponse/should_correctly_compare_+Inf_values === RUN TestCompareSamplesResponse/should_fail_if_values_are_significantly_different,_over_the_tolerance === RUN TestCompareSamplesResponse/should_fail_if_large_values_are_significantly_different,_over_the_tolerance_without_using_relative_error === RUN TestCompareSamplesResponse/should_not_fail_if_large_values_are_significantly_different,_over_the_tolerance_using_relative_error === RUN TestCompareSamplesResponse/should_not_fail_when_the_sample_is_recent_and_configured_to_skip --- PASS: TestCompareSamplesResponse (0.01s) --- PASS: TestCompareSamplesResponse/difference_in_response_status (0.00s) --- PASS: TestCompareSamplesResponse/difference_in_resultType (0.00s) --- PASS: TestCompareSamplesResponse/unregistered_resultType (0.00s) --- PASS: TestCompareSamplesResponse/valid_scalar_response (0.00s) --- PASS: TestCompareSamplesResponse/should_pass_if_values_are_slightly_different_but_within_the_tolerance (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_disabled (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_enabled (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_Inf_values (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_-Inf_values (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_+Inf_values (0.00s) --- PASS: TestCompareSamplesResponse/should_fail_if_values_are_significantly_different,_over_the_tolerance (0.00s) --- PASS: TestCompareSamplesResponse/should_fail_if_large_values_are_significantly_different,_over_the_tolerance_without_using_relative_error (0.00s) --- PASS: TestCompareSamplesResponse/should_not_fail_if_large_values_are_significantly_different,_over_the_tolerance_using_relative_error (0.00s) --- PASS: TestCompareSamplesResponse/should_not_fail_when_the_sample_is_recent_and_configured_to_skip (0.00s) PASS ok github.com/grafana/mimir/tools/querytee 0.690s ? github.com/grafana/mimir/tools/tenant-injector [no test files] ? github.com/grafana/mimir/tools/trafficdump [no test files] ? github.com/grafana/mimir/tools/tsdb-chunks [no test files] ? github.com/grafana/mimir/tools/tsdb-compact [no test files] ? github.com/grafana/mimir/tools/tsdb-index [no test files] ? github.com/grafana/mimir/tools/tsdb-index-health [no test files] ? github.com/grafana/mimir/tools/tsdb-index-toc [no test files] ? github.com/grafana/mimir/tools/tsdb-print-chunk [no test files] ? github.com/grafana/mimir/tools/tsdb-symbols [no test files] ? github.com/grafana/mimir/tools/ulidtime [no test files] FAIL ==> ERROR: A failure occurred in check().  Aborting... ==> ERROR: Build failed, check /var/lib/archbuild/extra-riscv64/felix20/build receiving incremental file list mimir-2.2.0-1-riscv64-build.log mimir-2.2.0-1-riscv64-check.log mimir-2.2.0-1-riscv64-pkgver.log mimir-2.2.0-1-riscv64-prepare.log sent 100 bytes received 132,684 bytes 88,522.67 bytes/sec total size is 1,613,204 speedup is 12.15