==> Building on reshiram ==> Attempt to run pkgver()... ==> Checking for remote environment... ==> Syncing package to remote host... sending incremental file list ./ PKGBUILD 1,399 57% 0.00kB/s 0:00:00 2,430 100% 1006.84kB/s 0:00:00 (xfr#1, to-chk=5/7) config.yaml 38 100% 37.11kB/s 0:00:00 38 100% 37.11kB/s 0:00:00 (xfr#2, to-chk=4/7) mimir-2.6.0-1.log 428 100% 417.97kB/s 0:00:00 428 100% 417.97kB/s 0:00:00 (xfr#3, to-chk=3/7) systemd.service 700 69% 683.59kB/s 0:00:00 1,011 100% 987.30kB/s 0:00:00 (xfr#4, to-chk=2/7) sysusers.conf 45 100% 43.95kB/s 0:00:00 45 100% 43.95kB/s 0:00:00 (xfr#5, to-chk=1/7) tmpfiles.conf 34 100% 33.20kB/s 0:00:00 34 100% 33.20kB/s 0:00:00 (xfr#6, to-chk=0/7) sent 895 bytes received 193 bytes 2,176.00 bytes/sec total size is 3,805 speedup is 3.50 ==> Patching arch to riscv64... ==> Running extra-riscv64-build -- -d /home/felix/packages/riscv64-pkg-cache:/var/cache/pacman/pkg -l root1 on remote host... [?25l:: Synchronizing package databases... core downloading... extra downloading... community downloading... :: Starting full system upgrade... there is nothing to do [?25h==> Building in chroot for [extra] (riscv64)... ==> Synchronizing chroot copy [/var/lib/archbuild/extra-riscv64/root] -> [root1]...done ==> Making package: mimir 2.6.0-1 (Mon Apr 10 04:28:10 2023) ==> Retrieving sources...  -> Updating mimir git repo...  -> Found systemd.service  -> Found sysusers.conf  -> Found tmpfiles.conf  -> Found config.yaml ==> Validating source files with b2sums... mimir ... Skipped systemd.service ... Passed sysusers.conf ... Passed tmpfiles.conf ... Passed config.yaml ... Passed ==> Making package: mimir 2.6.0-1 (Mon Apr 10 04:28:57 2023) ==> Checking runtime dependencies... ==> Checking buildtime dependencies... ==> Installing missing dependencies... [?25lresolving dependencies... looking for conflicting packages... Package (5) New Version Net Change extra/perl-error 0.17029-4 0.04 MiB extra/perl-mailtools 2.21-6 0.11 MiB extra/perl-timedate 2.33-4 0.08 MiB extra/git 2.40.0-1 33.06 MiB community/go 2:1.20.2-1 195.06 MiB Total Installed Size: 228.36 MiB :: Proceed with installation? [Y/n] checking keyring... checking package integrity... loading package files... checking for file conflicts... :: Processing package changes... installing perl-error... installing perl-timedate... installing perl-mailtools... installing git... Optional dependencies for git tk: gitk and git gui perl-libwww: git svn perl-term-readkey: git svn and interactive.singlekey setting perl-io-socket-ssl: git send-email TLS support perl-authen-sasl: git send-email TLS support perl-mediawiki-api: git mediawiki support perl-datetime-format-iso8601: git mediawiki support perl-lwp-protocol-https: git mediawiki https support perl-cgi: gitweb (web interface) support python: git svn & git p4 subversion: git svn org.freedesktop.secrets: keyring credential helper libsecret: libsecret credential helper [installed] installing go... :: Running post-transaction hooks... (1/1) Warn about old perl modules [?25h==> Retrieving sources...  -> Found systemd.service  -> Found sysusers.conf  -> Found tmpfiles.conf  -> Found config.yaml ==> WARNING: Skipping all source file integrity checks. ==> Extracting sources...  -> Creating working copy of mimir git repo... Cloning into 'mimir'... done. Updating files: 17% (1600/9083) Updating files: 18% (1635/9083) Updating files: 19% (1726/9083) Updating files: 20% (1817/9083) Updating files: 21% (1908/9083) Updating files: 22% (1999/9083) Updating files: 23% (2090/9083) Updating files: 24% (2180/9083) Updating files: 25% (2271/9083) Updating files: 26% (2362/9083) Updating files: 27% (2453/9083) Updating files: 28% (2544/9083) Updating files: 28% (2573/9083) Updating files: 29% (2635/9083) Updating files: 30% (2725/9083) Updating files: 31% (2816/9083) Updating files: 32% (2907/9083) Updating files: 33% (2998/9083) Updating files: 34% (3089/9083) Updating files: 35% (3180/9083) Updating files: 36% (3270/9083) Updating files: 37% (3361/9083) Updating files: 38% (3452/9083) Updating files: 39% (3543/9083) Updating files: 40% (3634/9083) Updating files: 41% (3725/9083) Updating files: 42% (3815/9083) Updating files: 43% (3906/9083) Updating files: 43% (3966/9083) Updating files: 44% (3997/9083) Updating files: 45% (4088/9083) Updating files: 46% (4179/9083) Updating files: 47% (4270/9083) Updating files: 48% (4360/9083) Updating files: 49% (4451/9083) Updating files: 50% (4542/9083) Updating files: 51% (4633/9083) Updating files: 52% (4724/9083) Updating files: 53% (4814/9083) Updating files: 54% (4905/9083) Updating files: 55% (4996/9083) Updating files: 56% (5087/9083) Updating files: 57% (5178/9083) Updating files: 58% (5269/9083) Updating files: 59% (5359/9083) Updating files: 60% (5450/9083) Updating files: 61% (5541/9083) Updating files: 61% (5618/9083) Updating files: 62% (5632/9083) Updating files: 63% (5723/9083) Updating files: 64% (5814/9083) Updating files: 65% (5904/9083) Updating files: 66% (5995/9083) Updating files: 67% (6086/9083) Updating files: 68% (6177/9083) Updating files: 69% (6268/9083) Updating files: 70% (6359/9083) Updating files: 71% (6449/9083) Updating files: 72% (6540/9083) Updating files: 73% (6631/9083) Updating files: 74% (6722/9083) Updating files: 75% (6813/9083) Updating files: 76% (6904/9083) Updating files: 77% (6994/9083) Updating files: 78% (7085/9083) Updating files: 78% (7090/9083) Updating files: 79% (7176/9083) Updating files: 80% (7267/9083) Updating files: 81% (7358/9083) Updating files: 82% (7449/9083) Updating files: 83% (7539/9083) Updating files: 84% (7630/9083) Updating files: 85% (7721/9083) Updating files: 86% (7812/9083) Updating files: 87% (7903/9083) Updating files: 88% (7994/9083) Updating files: 89% (8084/9083) Updating files: 90% (8175/9083) Updating files: 91% (8266/9083) Updating files: 92% (8357/9083) Updating files: 92% (8421/9083) Updating files: 93% (8448/9083) Updating files: 94% (8539/9083) Updating files: 95% (8629/9083) Updating files: 96% (8720/9083) Updating files: 97% (8811/9083) Updating files: 98% (8902/9083) Updating files: 99% (8993/9083) Updating files: 100% (9083/9083) Updating files: 100% (9083/9083), done. Updating files: 68% (1458/2131) Updating files: 69% (1471/2131) Updating files: 70% (1492/2131) Updating files: 71% (1514/2131) Updating files: 72% (1535/2131) Updating files: 73% (1556/2131) Updating files: 74% (1577/2131) Updating files: 75% (1599/2131) Updating files: 76% (1620/2131) Updating files: 77% (1641/2131) Updating files: 78% (1663/2131) Updating files: 79% (1684/2131) Updating files: 80% (1705/2131) Updating files: 81% (1727/2131) Updating files: 82% (1748/2131) Updating files: 83% (1769/2131) Updating files: 84% (1791/2131) Updating files: 85% (1812/2131) Updating files: 86% (1833/2131) Updating files: 87% (1854/2131) Updating files: 88% (1876/2131) Updating files: 89% (1897/2131) Updating files: 90% (1918/2131) Updating files: 91% (1940/2131) Updating files: 92% (1961/2131) Updating files: 93% (1982/2131) Updating files: 94% (2004/2131) Updating files: 95% (2025/2131) Updating files: 96% (2046/2131) Updating files: 97% (2068/2131) Updating files: 98% (2089/2131) Updating files: 99% (2110/2131) Updating files: 100% (2131/2131) Updating files: 100% (2131/2131), done. Switched to a new branch 'makepkg' ==> Starting prepare()... ==> Starting pkgver()... ==> Starting build()... all modules verified go: downloading github.com/prometheus/client_golang v1.14.0 go: downloading gopkg.in/alecthomas/kingpin.v2 v2.2.6 go: downloading github.com/go-kit/log v0.2.1 go: downloading github.com/weaveworks/common v0.0.0-20221201103051-7c2720a9024d go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/thanos-io/objstore v0.0.0-20221213124554-e4d8ba6bc6f3 go: downloading golang.org/x/exp v0.0.0-20221212164502-fae10dda9338 go: downloading github.com/grafana/dskit v0.0.0-20230109170026-7242706251b9 go: downloading github.com/colega/go-yaml-yaml v0.0.0-20220720105220-255a8d16d094 go: downloading github.com/google/go-github/v32 v32.1.0 go: downloading github.com/sirupsen/logrus v1.9.0 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/golang/snappy v0.0.4 go: downloading github.com/grafana-tools/sdk v0.0.0-20211220201350-966b3088eec9 go: downloading github.com/prometheus/alertmanager v0.25.0-rc.0.0.20221216141313-26cbd6bd862e go: downloading github.com/prometheus/common v0.39.0 go: downloading github.com/grafana/mimir-prometheus v0.0.0-20230119151144-44904a663c20 go: downloading github.com/alecthomas/template v0.0.0-20190718012654-fb15b899a751 go: downloading github.com/alecthomas/units v0.0.0-20211218093645-b94a6e3cc137 go: downloading github.com/grafana/regexp v0.0.0-20221005093135-b4c2bcb0a4b6 go: downloading github.com/minio/minio-go/v7 v7.0.45 go: downloading github.com/stretchr/testify v1.8.1 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading golang.org/x/sync v0.1.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/opentracing/opentracing-go v1.2.0 go: downloading go.uber.org/atomic v1.10.0 go: downloading github.com/go-logfmt/logfmt v0.5.1 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/golang/protobuf v1.5.2 go: downloading github.com/prometheus/client_model v0.3.0 go: downloading github.com/prometheus/procfs v0.8.0 go: downloading github.com/cespare/xxhash v1.1.0 go: downloading google.golang.org/protobuf v1.28.1 go: downloading github.com/weaveworks/promrus v1.2.0 go: downloading github.com/uber/jaeger-client-go v2.30.0+incompatible go: downloading github.com/uber/jaeger-lib v2.4.1+incompatible go: downloading github.com/grpc-ecosystem/go-grpc-middleware v1.3.0 go: downloading github.com/opentracing-contrib/go-grpc v0.0.0-20210225150812-73cb765af46e go: downloading github.com/prometheus/exporter-toolkit v0.8.2 go: downloading golang.org/x/net v0.5.0 go: downloading google.golang.org/grpc v1.45.0 go: downloading github.com/opentracing-contrib/go-stdlib v1.0.0 go: downloading go.opentelemetry.io/otel v1.11.2 go: downloading go.opentelemetry.io/otel/trace v1.11.2 go: downloading github.com/efficientgo/core v1.0.0-rc.0.0.20221201130417-ba593f67d2a4 go: downloading golang.org/x/sys v0.4.0 go: downloading github.com/alecthomas/chroma v0.10.0 go: downloading github.com/mitchellh/colorstring v0.0.0-20190213212951-d06e56a500db go: downloading github.com/google/go-querystring v1.1.0 go: downloading golang.org/x/crypto v0.3.0 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/gosimple/slug v1.1.1 go: downloading github.com/mwitkow/go-conntrack v0.0.0-20190716064945-2f068394615f go: downloading golang.org/x/oauth2 v0.3.0 go: downloading github.com/prometheus/common/sigv4 v0.1.0 go: downloading go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.37.0 go: downloading github.com/aws/aws-sdk-go-v2 v1.16.0 go: downloading github.com/aws/aws-sdk-go-v2/config v1.15.1 go: downloading github.com/facette/natsort v0.0.0-20181210072756-2cd4dd1e2dcb go: downloading github.com/go-redis/redis/v8 v8.11.5 go: downloading github.com/grafana/gomemcache v0.0.0-20230105173749-11f792309e1f go: downloading github.com/hashicorp/golang-lru v0.6.0 go: downloading github.com/dennwc/varint v1.0.0 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 go: downloading github.com/stretchr/objx v0.5.0 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/gogo/googleapis v1.4.1 go: downloading github.com/gogo/status v1.1.1 go: downloading github.com/sercand/kuberesolver v2.4.0+incompatible go: downloading github.com/felixge/httpsnoop v1.0.3 go: downloading github.com/coreos/go-systemd/v22 v22.4.0 go: downloading google.golang.org/genproto v0.0.0-20221207170731-23e4bf6bdc37 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/grafana/memberlist v0.3.1-0.20220714140823-09ffed8adbbe go: downloading github.com/felixge/fgprof v0.9.2 go: downloading github.com/segmentio/fasthash v0.0.0-20180216231524-a72b379d632e go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/edsrzf/mmap-go v1.1.0 go: downloading github.com/google/uuid v1.3.0 go: downloading github.com/spf13/afero v1.8.2 go: downloading github.com/go-logr/logr v1.2.3 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/rainycape/unidecode v0.0.0-20150907023854-cb7f23ec59be go: downloading github.com/jpillora/backoff v1.0.0 go: downloading github.com/aws/aws-sdk-go v1.44.159 go: downloading github.com/Azure/azure-sdk-for-go/sdk/azcore v1.2.0 go: downloading github.com/Azure/azure-sdk-for-go/sdk/azidentity v1.2.0 go: downloading github.com/Azure/azure-sdk-for-go/sdk/storage/azblob v0.5.1 go: downloading cloud.google.com/go/storage v1.27.0 go: downloading google.golang.org/api v0.104.0 go: downloading github.com/ncw/swift v1.0.53 go: downloading go.opentelemetry.io/otel/metric v0.34.0 go: downloading github.com/klauspost/compress v1.15.9 go: downloading cloud.google.com/go v0.105.0 go: downloading github.com/minio/md5-simd v1.1.2 go: downloading github.com/minio/sha256-simd v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/dgryski/go-rendezvous v0.0.0-20200823014737-9f7001d12a5f go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/consul/api v1.18.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading go.etcd.io/etcd/api/v3 v3.5.4 go: downloading go.etcd.io/etcd/client/pkg/v3 v3.5.4 go: downloading go.etcd.io/etcd/client/v3 v3.5.4 go: downloading github.com/hashicorp/go-immutable-radix v1.2.0 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/hashicorp/go-msgpack v0.5.5 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/google/pprof v0.0.0-20221212185716-aee1124e3a93 go: downloading github.com/open-telemetry/opentelemetry-collector-contrib/pkg/translator/prometheusremotewrite v0.69.0 go: downloading go.opentelemetry.io/collector/pdata v1.0.0-rc3.0.20230109164642-7d168dd20efd go: downloading go.opentelemetry.io/collector v0.57.2 go: downloading go.uber.org/multierr v1.9.0 go: downloading github.com/julienschmidt/httprouter v1.3.0 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/oklog/run v1.1.0 go: downloading github.com/cenkalti/backoff/v4 v4.2.0 go: downloading gopkg.in/telebot.v3 v3.1.2 go: downloading github.com/benbjohnson/clock v1.3.0 go: downloading github.com/gofrs/uuid v4.3.1+incompatible go: downloading golang.org/x/text v0.6.0 go: downloading github.com/go-openapi/strfmt v0.21.3 go: downloading go.uber.org/goleak v1.2.0 go: downloading github.com/dustin/go-humanize v1.0.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/dlclark/regexp2 v1.4.0 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.11.0 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.12.1 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.3.8 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.11.1 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.16.1 go: downloading github.com/aws/smithy-go v1.11.1 go: downloading github.com/Azure/azure-sdk-for-go/sdk/internal v1.1.1 go: downloading github.com/AzureAD/microsoft-authentication-library-for-go v0.7.0 go: downloading cloud.google.com/go/compute/metadata v0.2.2 go: downloading cloud.google.com/go/iam v0.8.0 go: downloading cloud.google.com/go/compute v1.13.0 go: downloading github.com/googleapis/gax-go/v2 v2.7.0 go: downloading github.com/rs/xid v1.4.0 go: downloading github.com/klauspost/cpuid/v2 v2.1.1 go: downloading github.com/hashicorp/go-hclog v0.12.2 go: downloading github.com/hashicorp/go-rootcerts v1.0.2 go: downloading github.com/hashicorp/serf v0.10.1 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading go.uber.org/zap v1.21.0 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/open-telemetry/opentelemetry-collector-contrib/pkg/translator/prometheus v0.69.0 go: downloading go.opentelemetry.io/collector/semconv v0.69.0 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/go-openapi/analysis v0.21.4 go: downloading github.com/go-openapi/loads v0.21.2 go: downloading github.com/go-openapi/runtime v0.25.0 go: downloading github.com/rs/cors v1.8.2 go: downloading github.com/go-openapi/errors v0.20.3 go: downloading github.com/go-openapi/validate v0.22.0 go: downloading github.com/shurcooL/vfsgen v0.0.0-20200824052919-0d455de96546 go: downloading github.com/asaskevich/govalidator v0.0.0-20210307081110-f21760c49a8d go: downloading go.mongodb.org/mongo-driver v1.11.0 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.1.7 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.9.1 go: downloading github.com/kylelemons/godebug v1.1.0 go: downloading github.com/pkg/browser v0.0.0-20210911075715-681adbf594b8 go: downloading go.opencensus.io v0.24.0 go: downloading golang.org/x/xerrors v0.0.0-20220907171357-04be3eba64a2 go: downloading github.com/fatih/color v1.13.0 go: downloading github.com/mattn/go-isatty v0.0.14 go: downloading github.com/coreos/go-semver v0.3.0 go: downloading go.opentelemetry.io/collector/featuregate v0.69.0 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/jessevdk/go-flags v1.5.0 go: downloading github.com/go-openapi/spec v0.20.7 go: downloading github.com/go-openapi/jsonpointer v0.19.5 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/shurcooL/httpfs v0.0.0-20190707220628-8d4bc4ba7749 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.4.1 go: downloading github.com/golang-jwt/jwt/v4 v4.4.3 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.0 go: downloading github.com/mattn/go-colorable v0.1.12 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/go-openapi/jsonreference v0.20.0 internal/goarch internal/coverage/rtcov internal/unsafeheader internal/cpu internal/abi internal/goexperiment internal/goos runtime/internal/math runtime/internal/atomic runtime/internal/sys runtime/internal/syscall internal/bytealg internal/race sync/atomic unicode unicode/utf8 runtime internal/itoa encoding math/bits unicode/utf16 container/list math crypto/internal/alias crypto/internal/boring/sig vendor/golang.org/x/crypto/cryptobyte/asn1 internal/nettrace vendor/golang.org/x/crypto/internal/alias google.golang.org/protobuf/internal/flags google.golang.org/protobuf/internal/set github.com/Azure/azure-sdk-for-go/sdk/azcore/cloud github.com/Azure/azure-sdk-for-go/sdk/azcore/to github.com/Azure/azure-sdk-for-go/sdk/internal/errorinfo github.com/AzureAD/microsoft-authentication-library-for-go/apps/cache github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/exported github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/oauth/ops/internal/grant github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/version github.com/googleapis/gax-go/v2/internal google.golang.org/grpc/attributes google.golang.org/grpc/serviceconfig github.com/golang/groupcache/lru go.opencensus.io go.opencensus.io/trace/internal golang.org/x/xerrors/internal cloud.google.com/go/storage/internal go.opencensus.io/internal/tagencoding github.com/google/go-cmp/cmp/internal/flags github.com/weaveworks/common/errors github.com/uber/jaeger-client-go/internal/baggage github.com/uber/jaeger-client-go/internal/reporterstats github.com/uber/jaeger-client-go/internal/throttler github.com/aws/aws-sdk-go-v2/internal/sdkio github.com/aws/aws-sdk-go-v2 github.com/dgryski/go-rendezvous golang.org/x/net/internal/iana github.com/grafana/dskit/internal/slices github.com/prometheus/prometheus/model/value github.com/dennwc/varint golang.org/x/exp/constraints github.com/aws/aws-sdk-go/aws/client/metadata golang.org/x/exp/slices github.com/aws/aws-sdk-go/internal/sdkmath github.com/prometheus/prometheus/tsdb/goversion github.com/grafana/dskit/internal/math go.mongodb.org/mongo-driver/bson/bsonoptions go.mongodb.org/mongo-driver/bson/bsontype go.opentelemetry.io/collector/semconv/v1.6.1 go.opentelemetry.io/otel/internal go.opentelemetry.io/otel/metric/unit go.opentelemetry.io/otel/metric/instrument github.com/segmentio/fasthash/fnv1a image/color internal/reflectlite crypto/subtle runtime/metrics sync internal/godebug internal/testlog internal/singleflight google.golang.org/protobuf/internal/pragma runtime/cgo math/rand internal/intern internal/sysinfo google.golang.org/grpc/internal/buffer google.golang.org/grpc/internal/grpcsync github.com/aws/aws-sdk-go-v2/internal/sync/singleflight github.com/go-redis/redis/v8/internal/rand github.com/golang/groupcache/singleflight github.com/aws/aws-sdk-go/internal/sync/singleflight github.com/josharian/intern errors sort internal/oserror io syscall strconv bytes internal/safefilepath path strings reflect hash bufio regexp/syntax time internal/syscall/unix internal/syscall/execenv hash/crc32 crypto crypto/internal/randutil crypto/internal/nistec/fiat regexp context internal/poll io/fs crypto/rc4 vendor/golang.org/x/net/dns/dnsmessage os internal/fmtsort encoding/binary crypto/internal/nistec net/netip fmt encoding/base64 crypto/cipher crypto/internal/edwards25519/field crypto/md5 crypto/internal/boring crypto/aes crypto/des crypto/ecdh crypto/sha512 crypto/internal/edwards25519 flag encoding/json github.com/go-logfmt/logfmt log github.com/alecthomas/units github.com/pkg/errors compress/flate math/big crypto/hmac crypto/sha1 crypto/sha256 encoding/hex compress/gzip encoding/pem net net/url github.com/go-kit/log github.com/go-kit/log/level path/filepath vendor/golang.org/x/crypto/chacha20 vendor/golang.org/x/crypto/internal/poly1305 vendor/golang.org/x/crypto/hkdf vendor/golang.org/x/text/transform vendor/golang.org/x/crypto/chacha20poly1305 vendor/golang.org/x/text/unicode/bidi vendor/golang.org/x/text/unicode/norm crypto/rand crypto/elliptic crypto/internal/bigmod crypto/internal/boring/bbig encoding/asn1 crypto/ed25519 crypto/rsa vendor/golang.org/x/crypto/cryptobyte crypto/dsa crypto/x509/pkix vendor/golang.org/x/text/secure/bidirule vendor/golang.org/x/net/http2/hpack vendor/golang.org/x/net/idna crypto/ecdsa mime mime/quotedprintable net/http/internal net/http/internal/ascii github.com/beorn7/perks/quantile github.com/cespare/xxhash/v2 hash/fnv go/token google.golang.org/protobuf/internal/detrand io/ioutil google.golang.org/protobuf/internal/errors google.golang.org/protobuf/internal/version github.com/prometheus/common/model github.com/prometheus/common/internal/bitbucket.org/ww/goautoneg google.golang.org/protobuf/encoding/protowire github.com/prometheus/procfs/internal/fs github.com/prometheus/procfs/internal/util google.golang.org/protobuf/reflect/protoreflect golang.org/x/sys/unix runtime/debug github.com/efficientgo/core/errors github.com/efficientgo/core/logerrcapture github.com/davecgh/go-spew/spew google.golang.org/protobuf/internal/encoding/messageset google.golang.org/protobuf/internal/strs google.golang.org/protobuf/internal/encoding/text google.golang.org/protobuf/internal/genid google.golang.org/protobuf/internal/order google.golang.org/protobuf/reflect/protoregistry google.golang.org/protobuf/runtime/protoiface google.golang.org/protobuf/internal/encoding/defval google.golang.org/protobuf/internal/descfmt google.golang.org/protobuf/proto crypto/x509 net/textproto vendor/golang.org/x/net/http/httpguts vendor/golang.org/x/net/http/httpproxy mime/multipart google.golang.org/protobuf/encoding/prototext google.golang.org/protobuf/internal/descopts google.golang.org/protobuf/internal/filedesc github.com/prometheus/procfs github.com/efficientgo/core/testutil/internal runtime/trace crypto/tls testing google.golang.org/protobuf/internal/encoding/tag google.golang.org/protobuf/internal/impl github.com/efficientgo/core/testutil github.com/opentracing/opentracing-go/log golang.org/x/sync/errgroup golang.org/x/text/transform golang.org/x/text/unicode/bidi golang.org/x/text/unicode/norm golang.org/x/text/secure/bidirule github.com/Azure/azure-sdk-for-go/sdk/azcore/tracing encoding/xml net/http/httptrace net/http golang.org/x/net/idna github.com/Azure/azure-sdk-for-go/sdk/internal/log github.com/Azure/azure-sdk-for-go/sdk/azcore/log github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/log github.com/Azure/azure-sdk-for-go/sdk/internal/diag github.com/Azure/azure-sdk-for-go/sdk/internal/temporal github.com/Azure/azure-sdk-for-go/sdk/internal/uuid github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/json github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/json/types/time github.com/kylelemons/godebug/diff github.com/kylelemons/godebug/pretty golang.org/x/net/http/httpguts database/sql/driver github.com/golang-jwt/jwt/v4 github.com/google/uuid google.golang.org/protobuf/internal/filetype os/exec google.golang.org/protobuf/runtime/protoimpl golang.org/x/crypto/pkcs12/internal/rc2 google.golang.org/protobuf/types/descriptorpb google.golang.org/protobuf/types/known/timestamppb github.com/pkg/browser golang.org/x/crypto/pkcs12 github.com/golang/protobuf/ptypes/timestamp gopkg.in/yaml.v2 gopkg.in/yaml.v3 google.golang.org/protobuf/reflect/protodesc github.com/golang/protobuf/proto github.com/efficientgo/core/merrors github.com/efficientgo/core/errcapture google.golang.org/genproto/googleapis/rpc/code google.golang.org/protobuf/types/known/anypb google.golang.org/api/internal/third_party/uritemplates google.golang.org/protobuf/types/known/durationpb github.com/googleapis/gax-go/v2/apierror/internal/proto google.golang.org/genproto/googleapis/rpc/errdetails google.golang.org/genproto/googleapis/rpc/status github.com/prometheus/client_model/go github.com/matttproud/golang_protobuf_extensions/pbutil expvar github.com/opentracing/opentracing-go github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported github.com/prometheus/client_golang/prometheus/internal github.com/prometheus/common/expfmt github.com/thanos-io/objstore/tracing github.com/AzureAD/microsoft-authentication-library-for-go/apps/errors github.com/Azure/azure-sdk-for-go/sdk/azcore/policy github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/pollers github.com/Azure/azure-sdk-for-go/sdk/azcore/streaming github.com/Azure/azure-sdk-for-go/sdk/azcore github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/oauth/ops/authority github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/pollers/async github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/pollers/body github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/pollers/loc github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/pollers/op github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/shared github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/oauth/ops/wstrust/defs github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/oauth/ops/internal/comm github.com/prometheus/client_golang/prometheus github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/oauth/ops/wstrust github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/local github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/oauth/ops/accesstokens github.com/thanos-io/objstore/exthttp github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/internal/generated cloud.google.com/go/compute/metadata github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/oauth/ops github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/oauth google.golang.org/api/googleapi github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/base/internal/storage google.golang.org/grpc/codes github.com/golang/protobuf/ptypes/any github.com/golang/protobuf/ptypes/duration github.com/AzureAD/microsoft-authentication-library-for-go/apps/internal/base github.com/golang/protobuf/ptypes google.golang.org/grpc/internal/status github.com/AzureAD/microsoft-authentication-library-for-go/apps/confidential github.com/prometheus/client_golang/prometheus/promauto github.com/AzureAD/microsoft-authentication-library-for-go/apps/public github.com/grafana/dskit/flagext github.com/thanos-io/objstore github.com/Azure/azure-sdk-for-go/sdk/azidentity google.golang.org/grpc/status google.golang.org/protobuf/internal/encoding/json google.golang.org/protobuf/encoding/protojson github.com/thanos-io/objstore/providers/filesystem golang.org/x/net/internal/timeseries github.com/grafana/mimir/pkg/storage/bucket/filesystem html text/template/parse text/tabwriter google.golang.org/grpc/backoff google.golang.org/grpc/internal/grpclog google.golang.org/grpc/grpclog github.com/googleapis/gax-go/v2/apierror google.golang.org/grpc/connectivity google.golang.org/grpc/internal/credentials text/template github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/internal/shared github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/bloberror google.golang.org/grpc/metadata google.golang.org/grpc/credentials google.golang.org/grpc/internal/grpcrand github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/internal/exported google.golang.org/grpc/encoding google.golang.org/grpc/resolver google.golang.org/grpc/credentials/insecure google.golang.org/grpc/encoding/proto google.golang.org/grpc/internal google.golang.org/grpc/internal/backoff github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/internal/base github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/sas google.golang.org/grpc/balancer google.golang.org/grpc/balancer/base google.golang.org/grpc/internal/balancerload google.golang.org/grpc/binarylog/grpc_binarylog_v1 google.golang.org/grpc/balancer/roundrobin google.golang.org/grpc/internal/grpcutil github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/blob google.golang.org/grpc/internal/channelz html/template google.golang.org/grpc/internal/binarylog google.golang.org/grpc/internal/serviceconfig github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/blockblob github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/appendblob github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/pageblob google.golang.org/grpc/internal/resolver golang.org/x/net/trace google.golang.org/grpc/balancer/grpclb/state google.golang.org/grpc/internal/envconfig google.golang.org/grpc/internal/resolver/passthrough google.golang.org/grpc/internal/resolver/dns github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/container google.golang.org/grpc/internal/transport/networktype google.golang.org/grpc/internal/resolver/unix golang.org/x/net/http2/hpack google.golang.org/grpc/internal/metadata google.golang.org/grpc/internal/syscall google.golang.org/grpc/keepalive golang.org/x/net/http2 google.golang.org/grpc/peer google.golang.org/grpc/stats google.golang.org/grpc/tap net/http/httputil google.golang.org/genproto/googleapis/api github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/service google.golang.org/genproto/googleapis/api/annotations google.golang.org/genproto/googleapis/type/expr github.com/Azure/azure-sdk-for-go/sdk/storage/azblob google.golang.org/protobuf/types/known/fieldmaskpb cloud.google.com/go/internal/optional go.opencensus.io/internal go.opencensus.io/trace/tracestate golang.org/x/xerrors go.opencensus.io/trace github.com/thanos-io/objstore/providers/azure cloud.google.com/go/internal/version google.golang.org/protobuf/types/known/emptypb github.com/golang/protobuf/ptypes/empty google.golang.org/genproto/googleapis/type/date github.com/grafana/mimir/pkg/storage/bucket/azure cloud.google.com/go/internal/trace google.golang.org/genproto/protobuf/field_mask google.golang.org/api/iterator golang.org/x/net/context/ctxhttp golang.org/x/oauth2/jws golang.org/x/oauth2/internal os/user go.opencensus.io/resource go.opencensus.io/metric/metricdata runtime/pprof golang.org/x/oauth2 golang.org/x/oauth2/authhandler golang.org/x/oauth2/google/internal/externalaccount golang.org/x/oauth2/jwt google.golang.org/grpc/internal/transport google.golang.org/api/internal/impersonate go.opencensus.io/tag go.opencensus.io/metric/metricproducer go.opencensus.io/trace/propagation internal/saferio go.opencensus.io/stats/internal go.opencensus.io/stats encoding/gob go.opencensus.io/stats/view golang.org/x/oauth2/google go.opencensus.io/plugin/ocgrpc github.com/googleapis/enterprise-certificate-proxy/client/util github.com/google/go-cmp/cmp/internal/diff github.com/google/go-cmp/cmp/internal/function github.com/google/go-cmp/cmp/internal/value google.golang.org/grpc/credentials/alts/internal google.golang.org/grpc/credentials/alts/internal/conn github.com/google/go-cmp/cmp google.golang.org/grpc/internal/googlecloud net/rpc google.golang.org/grpc/credentials/oauth google.golang.org/grpc go.opencensus.io/plugin/ochttp/propagation/b3 go.opencensus.io/plugin/ochttp github.com/googleapis/enterprise-certificate-proxy/client google.golang.org/api/transport/cert google.golang.org/api/googleapi/transport google.golang.org/api/transport/http/internal/propagation github.com/prometheus/common/version github.com/gogo/protobuf/proto github.com/golang/snappy github.com/grafana/dskit/services github.com/sirupsen/logrus golang.org/x/net/context github.com/gorilla/mux github.com/opentracing/opentracing-go/ext github.com/weaveworks/promrus github.com/prometheus/client_golang/prometheus/promhttp github.com/googleapis/gax-go/v2 cloud.google.com/go/iam/apiv1/iampb cloud.google.com/go/internal google.golang.org/api/internal google.golang.org/genproto/googleapis/iam/v1 google.golang.org/api/option cloud.google.com/go/iam cloud.google.com/go/storage/internal/apiv2/stubs google.golang.org/api/option/internaloption google.golang.org/api/transport/internal/dca google.golang.org/grpc/balancer/grpclb/grpc_lb_v1 google.golang.org/grpc/credentials/alts/internal/proto/grpc_gcp google.golang.org/grpc/balancer/grpclb google.golang.org/grpc/credentials/alts/internal/authinfo google.golang.org/grpc/credentials/alts/internal/handshaker google.golang.org/grpc/credentials/alts/internal/handshaker/service google.golang.org/api/internal/gensupport google.golang.org/grpc/credentials/alts google.golang.org/grpc/credentials/google google.golang.org/api/transport/grpc google.golang.org/api/transport/http github.com/weaveworks/common/logging google.golang.org/api/iamcredentials/v1 cloud.google.com/go/storage/internal/apiv2 google.golang.org/api/storage/v1 google.golang.org/api/transport github.com/weaveworks/common/user github.com/grafana/dskit/tenant github.com/grpc-ecosystem/go-grpc-middleware github.com/opentracing-contrib/go-grpc github.com/coreos/go-systemd/v22/activation github.com/jpillora/backoff golang.org/x/oauth2/clientcredentials github.com/mwitkow/go-conntrack golang.org/x/crypto/blowfish github.com/gogo/protobuf/sortkeys golang.org/x/crypto/bcrypt github.com/gogo/protobuf/types github.com/gogo/protobuf/protoc-gen-gogo/descriptor github.com/prometheus/common/config github.com/prometheus/exporter-toolkit/web github.com/sercand/kuberesolver cloud.google.com/go/storage github.com/gogo/protobuf/gogoproto github.com/felixge/httpsnoop github.com/opentracing-contrib/go-stdlib/nethttp github.com/weaveworks/common/grpc github.com/uber/jaeger-client-go/internal/spanlog github.com/uber/jaeger-client-go/log hash/adler32 github.com/uber/jaeger-lib/metrics compress/zlib github.com/uber/jaeger-client-go/thrift go.uber.org/atomic github.com/gogo/googleapis/google/rpc github.com/uber/jaeger-lib/metrics/prometheus net/http/internal/testcert net/http/httptest os/signal github.com/weaveworks/common/signals golang.org/x/net/netutil internal/profile github.com/gogo/status github.com/thanos-io/objstore/providers/gcs github.com/weaveworks/common/httpgrpc github.com/uber/jaeger-client-go/thrift-gen/jaeger github.com/grafana/mimir/pkg/storage/bucket/gcs github.com/uber/jaeger-client-go/thrift-gen/sampling github.com/uber/jaeger-client-go/thrift-gen/zipkincore github.com/uber/jaeger-client-go/thrift-gen/baggage net/http/pprof github.com/grafana/regexp/syntax github.com/modern-go/concurrent github.com/uber/jaeger-client-go/thrift-gen/agent github.com/modern-go/reflect2 golang.org/x/crypto/blake2b github.com/uber/jaeger-client-go/utils golang.org/x/crypto/argon2 github.com/aws/aws-sdk-go-v2/internal/rand github.com/aws/aws-sdk-go-v2/internal/sdk github.com/uber/jaeger-client-go github.com/aws/smithy-go/logging github.com/aws/smithy-go/middleware github.com/grafana/regexp github.com/aws/smithy-go/ptr github.com/prometheus/prometheus/model/labels github.com/aws/aws-sdk-go-v2/aws github.com/aws/smithy-go/rand github.com/json-iterator/go github.com/aws/smithy-go github.com/aws/smithy-go/time github.com/aws/smithy-go/transport/http/internal/io github.com/aws/aws-sdk-go-v2/credentials github.com/aws/smithy-go/transport/http github.com/aws/aws-sdk-go-v2/aws/ratelimit github.com/uber/jaeger-client-go/internal/baggage/remote github.com/uber/jaeger-client-go/internal/throttler/remote github.com/uber/jaeger-client-go/rpcmetrics github.com/uber/jaeger-client-go/transport github.com/aws/aws-sdk-go-v2/internal/timeconv github.com/aws/aws-sdk-go-v2/feature/ec2/imds/internal/config github.com/aws/aws-sdk-go-v2/aws/middleware github.com/aws/smithy-go/io github.com/uber/jaeger-client-go/config github.com/aws/aws-sdk-go-v2/credentials/processcreds github.com/aws/aws-sdk-go-v2/aws/defaults github.com/aws/aws-sdk-go-v2/aws/transport/http github.com/aws/aws-sdk-go-v2/aws/retry github.com/weaveworks/common/tracing github.com/aws/aws-sdk-go-v2/aws/protocol/restjson github.com/aws/aws-sdk-go-v2/internal/strings github.com/aws/aws-sdk-go-v2/aws/signer/internal/v4 github.com/weaveworks/common/instrument github.com/aws/aws-sdk-go-v2/feature/ec2/imds github.com/weaveworks/common/middleware github.com/aws/aws-sdk-go-v2/credentials/endpointcreds/internal/client github.com/aws/aws-sdk-go-v2/credentials/ec2rolecreds github.com/aws/aws-sdk-go-v2/credentials/endpointcreds github.com/aws/smithy-go/encoding/httpbinding github.com/aws/aws-sdk-go-v2/internal/configsources github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 github.com/weaveworks/common/httpgrpc/server github.com/aws/aws-sdk-go-v2/service/sso/internal/endpoints github.com/minio/minio-go/v7/pkg/encrypt github.com/aws/aws-sdk-go-v2/aws/signer/v4 github.com/aws/smithy-go/document github.com/aws/aws-sdk-go-v2/aws/protocol/query github.com/aws/aws-sdk-go-v2/service/sso/types github.com/weaveworks/common/server github.com/aws/aws-sdk-go-v2/aws/protocol/xml github.com/aws/aws-sdk-go-v2/service/sts/internal/endpoints github.com/aws/aws-sdk-go-v2/service/sso github.com/aws/aws-sdk-go-v2/service/internal/presigned-url github.com/aws/aws-sdk-go-v2/service/sts/types github.com/aws/smithy-go/encoding github.com/aws/smithy-go/encoding/xml github.com/aws/aws-sdk-go-v2/internal/ini github.com/aws/aws-sdk-go-v2/service/sts github.com/grafana/mimir/pkg/util/log archive/tar github.com/aws/aws-sdk-go-v2/credentials/ssocreds github.com/grafana/mimir/pkg/util github.com/klauspost/compress/s2 github.com/minio/md5-simd github.com/minio/minio-go/v7/pkg/s3utils github.com/minio/minio-go/v7/pkg/signer gopkg.in/ini.v1 github.com/minio/minio-go/v7/pkg/lifecycle github.com/aws/aws-sdk-go-v2/credentials/stscreds github.com/minio/minio-go/v7/pkg/set github.com/aws/aws-sdk-go-v2/config github.com/minio/minio-go/v7/pkg/notification github.com/rs/xid github.com/minio/minio-go/v7/pkg/sse github.com/minio/minio-go/v7/pkg/tags github.com/minio/minio-go/v7/pkg/replication github.com/klauspost/cpuid/v2 github.com/minio/minio-go/v7/pkg/credentials embed net/http/cookiejar golang.org/x/net/publicsuffix github.com/pmezard/go-difflib/difflib github.com/ncw/swift github.com/stretchr/objx github.com/minio/sha256-simd github.com/stretchr/testify/assert github.com/minio/minio-go/v7 github.com/thanos-io/objstore/providers/swift github.com/grafana/mimir/pkg/storage/bucket/swift github.com/cespare/xxhash github.com/facette/natsort github.com/go-redis/redis/v8/internal/util github.com/go-redis/redis/v8/internal/hashtag github.com/go-redis/redis/v8/internal github.com/go-redis/redis/v8/internal/hscan github.com/go-redis/redis/v8/internal/proto github.com/grafana/dskit/crypto/tls github.com/stretchr/testify/mock github.com/go-redis/redis/v8/internal/pool github.com/grafana/dskit/dns/godns encoding/base32 golang.org/x/net/bpf golang.org/x/net/internal/socket github.com/go-redis/redis/v8 github.com/grafana/dskit/multierror github.com/grafana/dskit/gate golang.org/x/net/ipv4 golang.org/x/net/ipv6 github.com/grafana/dskit/spanlogger github.com/grafana/gomemcache/memcache github.com/miekg/dns github.com/thanos-io/objstore/providers/s3 github.com/hashicorp/golang-lru/simplelru github.com/grafana/dskit/backoff github.com/grafana/dskit/grpcencoding/snappy golang.org/x/time/rate github.com/grafana/mimir/pkg/storage/bucket/s3 google.golang.org/grpc/encoding/gzip github.com/grafana/dskit/grpcclient github.com/grafana/mimir/pkg/storage/bucket github.com/prometheus/prometheus/model/exemplar github.com/prometheus/prometheus/model/histogram github.com/prometheus/prometheus/prompb/io/prometheus/client github.com/prometheus/prometheus/util/jsonutil google.golang.org/grpc/health/grpc_health_v1 github.com/grafana/dskit/runutil github.com/oklog/ulid github.com/prometheus/prometheus/model/textparse github.com/prometheus/prometheus/model/relabel github.com/prometheus/prometheus/model/timestamp container/heap github.com/prometheus/prometheus/tsdb/chunkenc github.com/grafana/mimir/pkg/mimirpb github.com/prometheus/prometheus/model/metadata github.com/prometheus/prometheus/tsdb/errors github.com/prometheus/prometheus/tsdb/fileutil github.com/prometheus/prometheus/tsdb/chunks github.com/grafana/mimir/pkg/ingester/client github.com/prometheus/client_golang/prometheus/testutil/promlint github.com/prometheus/client_golang/prometheus/testutil github.com/stretchr/testify/require github.com/grafana/dskit/dns/miekgdns github.com/grafana/dskit/dns go.uber.org/goleak/internal/stack github.com/prometheus/prometheus/util/strutil go.uber.org/goleak github.com/aws/aws-sdk-go/aws/awserr github.com/prometheus/prometheus/util/testutil github.com/aws/aws-sdk-go/internal/ini github.com/prometheus/prometheus/tsdb/tsdbutil github.com/prometheus/prometheus/storage github.com/aws/aws-sdk-go/internal/shareddefaults github.com/aws/aws-sdk-go/aws/credentials github.com/aws/aws-sdk-go/aws/endpoints github.com/aws/aws-sdk-go/internal/sdkio github.com/jmespath/go-jmespath github.com/prometheus/prometheus/promql/parser github.com/aws/aws-sdk-go/aws/awsutil github.com/aws/aws-sdk-go/internal/sdkrand github.com/aws/aws-sdk-go/internal/strings github.com/aws/aws-sdk-go/aws/credentials/processcreds github.com/aws/aws-sdk-go/internal/sdkuri github.com/prometheus/prometheus/discovery/targetgroup github.com/prometheus/prometheus/discovery github.com/prometheus/prometheus/tsdb/encoding github.com/prometheus/prometheus/tsdb/hashcache github.com/prometheus/prometheus/tsdb/index github.com/prometheus/prometheus/tsdb/tombstones github.com/prometheus/prometheus/tsdb/record github.com/prometheus/prometheus/tsdb/wlog github.com/grafana/dskit/cache golang.org/x/sync/semaphore github.com/grafana/mimir/pkg/util/extprom github.com/grafana/mimir/pkg/storage/sharding github.com/grafana/mimir/pkg/util/spanlogger github.com/grafana/mimir/pkg/util/math github.com/grafana/mimir/pkg/storegateway/indexheader/encoding github.com/grafana/mimir/pkg/storegateway/indexheader/fileutil github.com/grafana/dskit/grpcutil github.com/grafana/mimir/pkg/storegateway/indexheader/index github.com/grafana/dskit/kv/codec github.com/hashicorp/go-cleanhttp github.com/mattn/go-isatty github.com/hashicorp/go-rootcerts github.com/mattn/go-colorable github.com/hashicorp/go-immutable-radix github.com/fatih/color github.com/hashicorp/go-hclog github.com/armon/go-metrics github.com/grafana/mimir/pkg/storage/tsdb/bucketcache github.com/grafana/mimir/pkg/storegateway/indexcache github.com/mitchellh/mapstructure github.com/hashicorp/serf/coordinate go.etcd.io/etcd/api/v3/authpb go.etcd.io/etcd/api/v3/membershippb github.com/hashicorp/consul/api go.etcd.io/etcd/api/v3/mvccpb go.uber.org/multierr go.etcd.io/etcd/api/v3/etcdserverpb go.uber.org/zap/buffer go.uber.org/zap/internal/bufferpool go.uber.org/zap/internal/color go.uber.org/zap/internal/exit go.uber.org/zap/zapcore go.uber.org/zap go.etcd.io/etcd/client/pkg/v3/fileutil github.com/grafana/dskit/kv/consul go.etcd.io/etcd/client/pkg/v3/tlsutil go.etcd.io/etcd/client/pkg/v3/transport go.etcd.io/etcd/api/v3/v3rpc/rpctypes github.com/coreos/go-semver/semver go.etcd.io/etcd/api/v3/version go.etcd.io/etcd/client/pkg/v3/systemd github.com/coreos/go-systemd/v22/journal go.etcd.io/etcd/client/pkg/v3/types github.com/aws/aws-sdk-go/aws go.etcd.io/etcd/client/pkg/v3/logutil go.etcd.io/etcd/client/v3/credentials go.etcd.io/etcd/client/v3/internal/endpoint google.golang.org/grpc/resolver/manual go.uber.org/zap/zapgrpc go.etcd.io/etcd/client/v3/internal/resolver github.com/aws/aws-sdk-go/aws/request github.com/prometheus/client_golang/prometheus/push github.com/hashicorp/go-sockaddr github.com/armon/go-metrics/prometheus compress/lzw github.com/aws/aws-sdk-go/aws/client github.com/aws/aws-sdk-go/private/protocol github.com/aws/aws-sdk-go/aws/corehandlers github.com/aws/aws-sdk-go/private/protocol/rest github.com/aws/aws-sdk-go/private/protocol/query/queryutil github.com/aws/aws-sdk-go/private/protocol/xml/xmlutil github.com/aws/aws-sdk-go/private/protocol/json/jsonutil github.com/aws/aws-sdk-go/aws/signer/v4 github.com/aws/aws-sdk-go/private/protocol/jsonrpc github.com/aws/aws-sdk-go/private/protocol/query github.com/aws/aws-sdk-go/aws/csm github.com/aws/aws-sdk-go/private/protocol/restjson github.com/aws/aws-sdk-go/service/sts github.com/aws/aws-sdk-go/service/sso github.com/aws/aws-sdk-go/aws/ec2metadata github.com/aws/aws-sdk-go/aws/credentials/endpointcreds github.com/aws/aws-sdk-go/aws/credentials/ec2rolecreds github.com/aws/aws-sdk-go/service/sso/ssoiface go.etcd.io/etcd/client/v3 github.com/aws/aws-sdk-go/aws/defaults github.com/aws/aws-sdk-go/aws/credentials/ssocreds github.com/aws/aws-sdk-go/service/sts/stsiface github.com/google/btree github.com/aws/aws-sdk-go/aws/credentials/stscreds github.com/hashicorp/go-msgpack/codec github.com/hashicorp/errwrap github.com/aws/aws-sdk-go/aws/session github.com/hashicorp/go-multierror github.com/sean-/seed github.com/grafana/dskit/modules github.com/grafana/dskit/netutil github.com/grafana/dskit/ring/shard github.com/grafana/dskit/runtimeconfig github.com/prometheus/common/sigv4 github.com/grafana/dskit/concurrency github.com/prometheus/prometheus/config github.com/prometheus/alertmanager/cluster/clusterpb github.com/grafana/mimir/pkg/alertmanager/alertmanagerpb github.com/prometheus/prometheus/tsdb github.com/hashicorp/memberlist github.com/grafana/dskit/kv/etcd github.com/grafana/mimir/pkg/alertmanager/alertspb github.com/grafana/mimir/pkg/alertmanager/alertstore/bucketclient github.com/prometheus/alertmanager/pkg/labels github.com/prometheus/alertmanager/timeinterval github.com/mailru/easyjson/jlexer github.com/prometheus/alertmanager/config github.com/mailru/easyjson/buffer github.com/mailru/easyjson/jwriter github.com/grafana/dskit/kv/memberlist github.com/go-openapi/swag github.com/grafana/mimir/pkg/alertmanager/alertstore/local github.com/grafana/mimir/pkg/alertmanager/alertstore github.com/prometheus/alertmanager/api/metrics github.com/hashicorp/golang-lru github.com/cenkalti/backoff/v4 github.com/prometheus/alertmanager/cluster github.com/oklog/run github.com/prometheus/alertmanager/types github.com/grafana/dskit/kv github.com/prometheus/alertmanager/provider github.com/prometheus/alertmanager/store github.com/prometheus/alertmanager/inhibit github.com/prometheus/alertmanager/nflog/nflogpb github.com/benbjohnson/clock github.com/grafana/dskit/ring github.com/gofrs/uuid github.com/prometheus/alertmanager/nflog github.com/prometheus/alertmanager/silence/silencepb github.com/shurcooL/httpfs/vfsutil github.com/shurcooL/vfsgen github.com/prometheus/alertmanager/silence github.com/prometheus/alertmanager/asset golang.org/x/text/internal/tag golang.org/x/text/internal/language github.com/grafana/mimir/pkg/storage/tsdb/metadata github.com/grafana/mimir/pkg/storage/tsdb/block github.com/grafana/dskit/ring/client github.com/julienschmidt/httprouter github.com/go-openapi/analysis/internal/debug github.com/go-openapi/jsonpointer golang.org/x/text/internal/language/compact github.com/go-openapi/jsonreference/internal github.com/prometheus/common/route github.com/go-openapi/jsonreference github.com/grafana/mimir/pkg/storegateway/indexheader github.com/go-openapi/spec github.com/asaskevich/govalidator golang.org/x/text/language golang.org/x/text/internal golang.org/x/text/cases github.com/grafana/mimir/pkg/storage/tsdb github.com/go-openapi/errors github.com/grafana/mimir/cmd/metaconvert go.mongodb.org/mongo-driver/bson/primitive github.com/prometheus/alertmanager/template github.com/go-openapi/analysis/internal/flatten/normalize github.com/go-openapi/analysis/internal/flatten/operations github.com/go-openapi/analysis/internal/flatten/replace github.com/prometheus/alertmanager/notify github.com/go-openapi/analysis/internal/flatten/schutils github.com/go-openapi/analysis/internal/flatten/sortref go.mongodb.org/mongo-driver/x/bsonx/bsoncore net/mail github.com/prometheus/alertmanager/dispatch encoding/csv github.com/go-openapi/runtime/logger github.com/go-openapi/runtime/middleware/denco github.com/prometheus/alertmanager/api/v1 go.mongodb.org/mongo-driver/bson/bsonrw github.com/go-openapi/runtime/middleware/header github.com/docker/go-units github.com/go-openapi/runtime/flagext github.com/jessevdk/go-flags github.com/rs/cors github.com/grafana/mimir/pkg/util/net github.com/prometheus/alertmanager/notify/discord net/smtp github.com/prometheus/alertmanager/notify/email go.mongodb.org/mongo-driver/bson/bsoncodec github.com/prometheus/alertmanager/notify/opsgenie github.com/prometheus/alertmanager/notify/pagerduty github.com/prometheus/alertmanager/notify/pushover github.com/prometheus/alertmanager/notify/slack github.com/aws/aws-sdk-go/service/sns gopkg.in/telebot.v3 go.mongodb.org/mongo-driver/bson github.com/prometheus/alertmanager/notify/telegram github.com/prometheus/alertmanager/notify/sns github.com/go-openapi/strfmt github.com/prometheus/alertmanager/notify/victorops github.com/prometheus/alertmanager/notify/webex github.com/prometheus/alertmanager/notify/webhook github.com/prometheus/alertmanager/notify/wechat github.com/prometheus/alertmanager/provider/mem github.com/prometheus/alertmanager/ui github.com/google/pprof/profile github.com/grafana/mimir/pkg/storage/tsdb/bucketindex github.com/go-openapi/analysis github.com/go-openapi/runtime github.com/go-openapi/runtime/security github.com/grafana/mimir/pkg/ingester/activeseries github.com/go-openapi/loads github.com/felixge/fgprof github.com/grafana/mimir/pkg/util/ephemeral github.com/go-openapi/runtime/middleware/untyped github.com/go-openapi/validate github.com/grafana/mimir/pkg/util/extract github.com/grafana/mimir/pkg/util/globalerror github.com/grafana/dskit/limiter github.com/grafana/mimir/pkg/querier/stats github.com/grafana/mimir/pkg/util/validation github.com/grafana/mimir/pkg/util/httpgrpcutil go.opentelemetry.io/collector/featuregate go.opentelemetry.io/collector/pdata/internal/data go.opentelemetry.io/collector/pdata/internal/data/protogen/common/v1 github.com/grafana/mimir/pkg/compactor github.com/grafana/mimir/pkg/distributor/forwarding github.com/go-openapi/runtime/middleware github.com/prometheus/alertmanager/api/v2/models github.com/grafana/mimir/pkg/util/limiter github.com/prometheus/alertmanager/api/v2/restapi/operations/alert github.com/prometheus/alertmanager/api/v2/restapi/operations/alertgroup github.com/prometheus/alertmanager/api/v2/restapi/operations/general github.com/prometheus/alertmanager/api/v2/restapi/operations/receiver github.com/prometheus/alertmanager/api/v2/restapi/operations/silence go.opentelemetry.io/collector/pdata/internal/data/protogen/resource/v1 github.com/gogo/protobuf/jsonpb go.opentelemetry.io/collector/pdata/internal/data/protogen/logs/v1 github.com/prometheus/alertmanager/api/v2/restapi/operations go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/logs/v1 github.com/prometheus/alertmanager/api/v2/restapi go.opentelemetry.io/collector/pdata/internal/data/protogen/metrics/v1 go.opentelemetry.io/collector/pdata/internal/data/protogen/trace/v1 github.com/prometheus/alertmanager/api/v2 go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1 github.com/grafana/mimir/pkg/alertmanager/merger github.com/prometheus/alertmanager/api go.opentelemetry.io/collector/pdata/internal/json go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/metrics/v1 go.opentelemetry.io/collector/pdata/internal/otlp github.com/prometheus/prometheus/prompb github.com/grafana/mimir/pkg/alertmanager go.opentelemetry.io/collector/pdata/internal go.opentelemetry.io/collector/pdata/pcommon go.opentelemetry.io/collector/pdata/pmetric/internal/pmetricjson go.opentelemetry.io/collector/pdata/plog/internal/plogjson go.opentelemetry.io/collector/pdata/pmetric go.opentelemetry.io/collector/pdata/plog go.opentelemetry.io/collector/pdata/ptrace/internal/ptracejson github.com/prometheus/prometheus/util/osutil go.opentelemetry.io/collector/pdata/ptrace github.com/prometheus/prometheus/util/pool github.com/prometheus/prometheus/scrape github.com/weaveworks/common/mtime github.com/grafana/mimir/pkg/distributor/distributorpb github.com/grafana/mimir/pkg/frontend/v1/frontendv1pb github.com/grafana/mimir/pkg/scheduler/queue github.com/open-telemetry/opentelemetry-collector-contrib/pkg/translator/prometheus go.opentelemetry.io/collector/consumer/consumererror go.opentelemetry.io/collector/pdata/pmetric/pmetricotlp github.com/grafana/mimir/pkg/frontend/v1 github.com/open-telemetry/opentelemetry-collector-contrib/pkg/translator/prometheusremotewrite github.com/grafana/mimir/pkg/frontend/v2/frontendv2pb github.com/grafana/mimir/pkg/util/servicediscovery github.com/grafana/mimir/pkg/scheduler/schedulerpb github.com/grafana/mimir/pkg/storage/chunk github.com/grafana/mimir/pkg/util/push github.com/grafana/mimir/pkg/scheduler/schedulerdiscovery github.com/grafana/mimir/pkg/querier/batch github.com/grafana/mimir/pkg/distributor github.com/edsrzf/mmap-go github.com/go-logr/logr github.com/grafana/mimir/pkg/frontend/v2 github.com/grafana/mimir/pkg/util/activitytracker github.com/go-logr/logr/funcr go.opentelemetry.io/otel/internal/attribute go.opentelemetry.io/otel/attribute github.com/go-logr/stdr go.opentelemetry.io/otel/codes go.opentelemetry.io/otel/internal/baggage go.opentelemetry.io/otel/baggage github.com/prometheus/prometheus/util/teststorage go.opentelemetry.io/otel/trace github.com/grafana/mimir/pkg/querier/iterators github.com/grafana/mimir/pkg/storage/lazyquery github.com/grafana/mimir/pkg/storage/series github.com/grafana/mimir/pkg/storegateway/storepb go.opentelemetry.io/otel/propagation github.com/dustin/go-humanize go.opentelemetry.io/otel/internal/global github.com/grafana/mimir/pkg/util/listblocks go.opentelemetry.io/otel github.com/prometheus/prometheus/util/stats github.com/grafana/mimir/pkg/util/pool github.com/grafana/mimir/pkg/util/chunkcompat github.com/prometheus/prometheus/notifier github.com/prometheus/prometheus/promql github.com/prometheus/prometheus/util/gate github.com/prometheus/prometheus/util/logging go.opentelemetry.io/otel/metric/instrument/asyncfloat64 go.opentelemetry.io/otel/metric/instrument/asyncint64 go.opentelemetry.io/otel/metric/instrument/syncfloat64 go.opentelemetry.io/otel/metric/instrument/syncint64 go.opentelemetry.io/otel/metric go.opentelemetry.io/otel/semconv/internal github.com/grafana/mimir/pkg/storegateway/hintspb github.com/grafana/mimir/pkg/storegateway/storegatewaypb go.opentelemetry.io/otel/metric/internal/global go.opentelemetry.io/otel/semconv/v1.12.0 go.opentelemetry.io/otel/metric/global github.com/grafana/mimir/pkg/util/version github.com/grafana/mimir/pkg/storegateway github.com/prometheus/client_golang/api github.com/prometheus/client_golang/api/prometheus/v1 go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp github.com/prometheus/prometheus/discovery/refresh github.com/prometheus/prometheus/storage/remote github.com/spf13/afero/mem github.com/spf13/afero github.com/grafana/mimir/pkg/querier/engine github.com/prometheus/prometheus/template github.com/prometheus/prometheus/model/rulefmt github.com/prometheus/prometheus/rules github.com/grafana/mimir/pkg/ruler/rulespb github.com/grafana/mimir/pkg/scheduler github.com/prometheus/prometheus/util/httputil github.com/grafana/mimir/pkg/ruler/rulestore/local github.com/prometheus/prometheus/web/api/v1 github.com/grafana/mimir/pkg/ruler/rulestore github.com/grafana/mimir/pkg/util/gziphandler github.com/grafana/mimir/pkg/querier github.com/grafana/mimir/pkg/ruler/rulestore/bucketclient github.com/grafana/mimir/pkg/util/validation/exporter github.com/grafana/mimir/pkg/api/error github.com/grafana/mimir/pkg/frontend/querymiddleware/astmapper github.com/grafana/mimir/pkg/frontend/transport github.com/grafana/mimir/pkg/frontend/querymiddleware github.com/grafana/mimir/pkg/usagestats github.com/grafana/mimir/pkg/util/instrumentation github.com/grafana/mimir/pkg/ingester github.com/grafana/mimir/pkg/querier/worker github.com/grafana/mimir/pkg/util/fs github.com/grafana/mimir/pkg/util/noauth github.com/grafana/mimir/pkg/ruler github.com/grafana/mimir/pkg/querier/tenantfederation github.com/grafana/mimir/pkg/util/process github.com/grafana/mimir/pkg/frontend github.com/grafana/mimir/pkg/util/fieldcategory github.com/grafana/mimir/pkg/util/usage github.com/grafana/mimir/pkg/continuoustest database/sql github.com/grafana/mimir/pkg/flusher github.com/rainycape/unidecode github.com/gosimple/slug github.com/grafana-tools/sdk github.com/grafana/mimir/pkg/mimirtool/minisdk github.com/prometheus/client_golang/prometheus/collectors github.com/grafana/mimir/pkg/mimirtool/rules/rwrulefmt github.com/grafana/mimir/pkg/mimirtool/analyze github.com/grafana/mimir/cmd/mimir-continuous-test github.com/grafana/mimir/pkg/api github.com/grafana/mimir/pkg/mimirtool/backfill github.com/grafana/mimir/pkg/mimirtool/client github.com/dlclark/regexp2/syntax github.com/mitchellh/colorstring github.com/grafana/mimir/pkg/mimirtool/rules github.com/alecthomas/template/parse github.com/grafana/mimir/pkg/mimir github.com/dlclark/regexp2 github.com/alecthomas/template go/scanner github.com/alecthomas/chroma go/ast github.com/alecthomas/chroma/formatters/html github.com/alecthomas/chroma/formatters/svg github.com/alecthomas/chroma/lexers/internal github.com/grafana/mimir/cmd/mimir github.com/grafana/mimir/tools/doc-generator/parse github.com/alecthomas/chroma/formatters github.com/grafana/mimir/pkg/mimirtool/config github.com/alecthomas/chroma/lexers/a github.com/alecthomas/chroma/lexers/b github.com/alecthomas/chroma/lexers/p github.com/alecthomas/chroma/lexers/j github.com/alecthomas/chroma/lexers/d github.com/alecthomas/chroma/lexers/e github.com/alecthomas/chroma/lexers/c github.com/alecthomas/chroma/lexers/f github.com/alecthomas/chroma/lexers/i github.com/alecthomas/chroma/lexers/k github.com/alecthomas/chroma/lexers/l github.com/alecthomas/chroma/lexers/h github.com/alecthomas/chroma/lexers/n github.com/alecthomas/chroma/lexers/o github.com/alecthomas/chroma/lexers/q github.com/alecthomas/chroma/lexers/r github.com/alecthomas/chroma/lexers/t github.com/alecthomas/chroma/lexers/v github.com/alecthomas/chroma/lexers/circular github.com/alecthomas/chroma/lexers/g github.com/alecthomas/chroma/lexers/m github.com/alecthomas/chroma/lexers/s github.com/alecthomas/chroma/lexers/w github.com/alecthomas/chroma/lexers/x github.com/alecthomas/chroma/lexers/y github.com/alecthomas/chroma/lexers/z github.com/alecthomas/chroma/styles go/doc/comment internal/lazyregexp github.com/google/go-querystring/query go/doc golang.org/x/crypto/openpgp/errors golang.org/x/crypto/openpgp/armor compress/bzip2 golang.org/x/crypto/cast5 github.com/alecthomas/chroma/lexers gopkg.in/alecthomas/kingpin.v2 github.com/alecthomas/chroma/quick golang.org/x/crypto/openpgp/elgamal github.com/grafana/mimir/pkg/mimirtool/printer golang.org/x/crypto/openpgp/s2k image github.com/grafana/mimir/tools/querytee image/internal/imageutil image/jpeg github.com/grafana/mimir/cmd/query-tee golang.org/x/crypto/openpgp/packet github.com/grafana/mimir/pkg/mimirtool/commands golang.org/x/crypto/openpgp github.com/google/go-github/v32/github github.com/grafana/mimir/pkg/mimirtool/version github.com/grafana/mimir/cmd/mimirtool ==> Starting check()... === RUN TestConvertTenantBlocks --- PASS: TestConvertTenantBlocks (0.03s) === RUN TestConvertTenantBlocksDryMode --- PASS: TestConvertTenantBlocksDryMode (0.02s) PASS ok github.com/grafana/mimir/cmd/metaconvert 0.334s ? github.com/grafana/mimir/cmd/mimir-continuous-test [no test files] === RUN TestFlagParsing === RUN TestFlagParsing/unknown_flag === RUN TestFlagParsing/new_flag,_with_config === RUN TestFlagParsing/config_with_expand-env === RUN TestFlagParsing/version === RUN TestFlagParsing/common_yaml_inheritance_with_common_config_in_the_first_place === RUN TestFlagParsing/common_yaml_inheritance_with_common_config_in_the_last_place === RUN TestFlagParsing/help-short === RUN TestFlagParsing/common_yaml_unmarshaling_is_strict === RUN TestFlagParsing/help-all === RUN TestFlagParsing/config_with_arguments_override === RUN TestFlagParsing/user_visible_module_listing_flag_take_precedence_over_target_flag === RUN TestFlagParsing/default_values === RUN TestFlagParsing/root_level_configuration_option_specified_as_an_empty_node_in_YAML_does_not_set_entire_config_to_zero_value === RUN TestFlagParsing/common_yaml_sets_a_value_but_specific_config_reverts_it_back === RUN TestFlagParsing/help === RUN TestFlagParsing/user_visible_module_listing === RUN TestFlagParsing/common_yaml_overridden_by_a_common_flag_and_specific_flag === RUN TestFlagParsing/common_flag_inheritance === RUN TestFlagParsing/config --- PASS: TestFlagParsing (3.10s) --- PASS: TestFlagParsing/unknown_flag (0.17s) --- PASS: TestFlagParsing/new_flag,_with_config (0.15s) --- PASS: TestFlagParsing/config_with_expand-env (0.23s) --- PASS: TestFlagParsing/version (0.08s) --- PASS: TestFlagParsing/common_yaml_inheritance_with_common_config_in_the_first_place (0.38s) --- PASS: TestFlagParsing/common_yaml_inheritance_with_common_config_in_the_last_place (0.42s) --- PASS: TestFlagParsing/help-short (0.12s) --- PASS: TestFlagParsing/common_yaml_unmarshaling_is_strict (0.09s) --- PASS: TestFlagParsing/help-all (0.16s) --- PASS: TestFlagParsing/config_with_arguments_override (0.12s) --- PASS: TestFlagParsing/user_visible_module_listing_flag_take_precedence_over_target_flag (0.04s) --- PASS: TestFlagParsing/default_values (0.11s) --- PASS: TestFlagParsing/root_level_configuration_option_specified_as_an_empty_node_in_YAML_does_not_set_entire_config_to_zero_value (0.19s) --- PASS: TestFlagParsing/common_yaml_sets_a_value_but_specific_config_reverts_it_back (0.20s) --- PASS: TestFlagParsing/help (0.06s) --- PASS: TestFlagParsing/user_visible_module_listing (0.07s) --- PASS: TestFlagParsing/common_yaml_overridden_by_a_common_flag_and_specific_flag (0.17s) --- PASS: TestFlagParsing/common_flag_inheritance (0.17s) --- PASS: TestFlagParsing/config (0.12s) === RUN TestHelp === RUN TestHelp/basic === RUN TestHelp/all --- PASS: TestHelp (0.27s) --- PASS: TestHelp/basic (0.06s) --- PASS: TestHelp/all (0.20s) === RUN TestExpandEnvironmentVariables === RUN TestExpandEnvironmentVariables/x$y === RUN TestExpandEnvironmentVariables/x${y} === RUN TestExpandEnvironmentVariables/x$Y === RUN TestExpandEnvironmentVariables/x${Y} === RUN TestExpandEnvironmentVariables/x${Z:D} === RUN TestExpandEnvironmentVariables/x${Z:A_B_C_D} === RUN TestExpandEnvironmentVariables/x${Z:} === RUN TestExpandEnvironmentVariables/x$y:D --- PASS: TestExpandEnvironmentVariables (0.01s) --- PASS: TestExpandEnvironmentVariables/x$y (0.00s) --- PASS: TestExpandEnvironmentVariables/x${y} (0.00s) --- PASS: TestExpandEnvironmentVariables/x$Y (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Y} (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Z:D} (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Z:A_B_C_D} (0.00s) --- PASS: TestExpandEnvironmentVariables/x${Z:} (0.00s) --- PASS: TestExpandEnvironmentVariables/x$y:D (0.00s) === RUN TestParseConfigFileParameter === RUN TestParseConfigFileParameter/#00 === RUN TestParseConfigFileParameter/--foo === RUN TestParseConfigFileParameter/-f_-a === RUN TestParseConfigFileParameter/--config.file=foo === RUN TestParseConfigFileParameter/--config.file_foo === RUN TestParseConfigFileParameter/--config.file=foo_--config.expand-env === RUN TestParseConfigFileParameter/--config.expand-env_--config.file=foo === RUN TestParseConfigFileParameter/--opt1_--config.file=foo === RUN TestParseConfigFileParameter/--opt1_--config.file_foo === RUN TestParseConfigFileParameter/--opt1_--config.file=foo_--config.expand-env === RUN TestParseConfigFileParameter/--opt1_--config.expand-env_--config.file=foo === RUN TestParseConfigFileParameter/--config.file=foo_--opt1 === RUN TestParseConfigFileParameter/--config.file_foo_--opt1 === RUN TestParseConfigFileParameter/--config.file=foo_--config.expand-env_--opt1 === RUN TestParseConfigFileParameter/--config.expand-env_--config.file=foo_--opt1 === RUN TestParseConfigFileParameter/--config.file=foo_--opt1_--config.expand-env === RUN TestParseConfigFileParameter/--config.expand-env_--opt1_--config.file=foo --- PASS: TestParseConfigFileParameter (0.00s) --- PASS: TestParseConfigFileParameter/#00 (0.00s) --- PASS: TestParseConfigFileParameter/--foo (0.00s) --- PASS: TestParseConfigFileParameter/-f_-a (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--config.file_foo (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--config.expand-env (0.00s) --- PASS: TestParseConfigFileParameter/--config.expand-env_--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.file_foo (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.file=foo_--config.expand-env (0.00s) --- PASS: TestParseConfigFileParameter/--opt1_--config.expand-env_--config.file=foo (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.file_foo_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--config.expand-env_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.expand-env_--config.file=foo_--opt1 (0.00s) --- PASS: TestParseConfigFileParameter/--config.file=foo_--opt1_--config.expand-env (0.00s) --- PASS: TestParseConfigFileParameter/--config.expand-env_--opt1_--config.file=foo (0.00s) === RUN TestFieldCategoryOverridesNotStale --- PASS: TestFieldCategoryOverridesNotStale (0.09s) PASS ok github.com/grafana/mimir/cmd/mimir 4.346s ? github.com/grafana/mimir/cmd/mimirtool [no test files] ? github.com/grafana/mimir/integration [no test files] ? github.com/grafana/mimir/integration/e2emimir [no test files] ? github.com/grafana/mimir/integration/ca [no test files] === RUN TestMimirReadRoutes --- PASS: TestMimirReadRoutes (0.00s) PASS ok github.com/grafana/mimir/cmd/query-tee 0.117s === RUN TestResolveConfigs === RUN TestResolveConfigs/ResolveConfigs_annotates_values_that_match_defaults === RUN TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_cli_arguments === RUN TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_mounted_ConfigMaps === RUN TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_mounted_Secrets --- PASS: TestResolveConfigs (0.98s) --- PASS: TestResolveConfigs/ResolveConfigs_annotates_values_that_match_defaults (0.24s) --- PASS: TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_cli_arguments (0.26s) --- PASS: TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_mounted_ConfigMaps (0.24s) --- PASS: TestResolveConfigs/ResolveConfigs_sets_configuration_parameters_from_mounted_Secrets (0.23s) PASS ok github.com/grafana/mimir/operations/compare-helm-with-jsonnet/plugins/resolve-config 1.446s ? github.com/grafana/mimir/pkg/alertmanager/alertmanagerpb [no test files] ? github.com/grafana/mimir/pkg/alertmanager/alertspb [no test files] === RUN TestMultitenantAlertmanager_GetStatusHandler --- PASS: TestMultitenantAlertmanager_GetStatusHandler (0.03s) === RUN TestAlertmanagerMetricsStore --- PASS: TestAlertmanagerMetricsStore (0.14s) === RUN TestAlertmanagerMetricsRemoval --- PASS: TestAlertmanagerMetricsRemoval (0.14s) === RUN TestIsHealthyForAlertmanagerOperations === PAUSE TestIsHealthyForAlertmanagerOperations === RUN Test_withCustomFunctions === RUN Test_withCustomFunctions/template_tenant_ID === RUN Test_withCustomFunctions/generate_grafana_explore_URL === RUN Test_withCustomFunctions/invalid_params_for_grafanaExploreURL --- PASS: Test_withCustomFunctions (0.03s) --- PASS: Test_withCustomFunctions/template_tenant_ID (0.00s) --- PASS: Test_withCustomFunctions/generate_grafana_explore_URL (0.00s) --- PASS: Test_withCustomFunctions/invalid_params_for_grafanaExploreURL (0.00s) === RUN TestDispatcherGroupLimits === RUN TestDispatcherGroupLimits/no_limit === RUN TestDispatcherGroupLimits/high_limit === RUN TestDispatcherGroupLimits/low_limit --- PASS: TestDispatcherGroupLimits (0.72s) --- PASS: TestDispatcherGroupLimits/no_limit (0.52s) --- PASS: TestDispatcherGroupLimits/high_limit (0.09s) --- PASS: TestDispatcherGroupLimits/low_limit (0.10s) === RUN TestDispatcherLoggerInsightKey --- PASS: TestDispatcherLoggerInsightKey (0.15s) === RUN TestAlertsLimiterWithNoLimits --- PASS: TestAlertsLimiterWithNoLimits (0.00s) === RUN TestAlertsLimiterWithCountLimit --- PASS: TestAlertsLimiterWithCountLimit (0.00s) === RUN TestAlertsLimiterWithSizeLimit --- PASS: TestAlertsLimiterWithSizeLimit (0.00s) === RUN TestAlertsLimiterWithSizeLimitAndAnnotationUpdate --- PASS: TestAlertsLimiterWithSizeLimitAndAnnotationUpdate (0.00s) === RUN TestAMConfigValidationAPI === RUN TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_contains_no_receivers === RUN TestAMConfigValidationAPI/Should_pass_if_the_alertmanager_config_is_valid === RUN TestAMConfigValidationAPI/Should_return_error_if_the_config_is_empty_due_to_wrong_indentation === RUN TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_is_empty_due_to_wrong_key === RUN TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_an_absolute_path === RUN TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_a_relative_path === RUN TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_is_not_a_valid_filename === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_/ === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_with_repeated_separators_/// === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_an_absolute_path === RUN TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_a_relative_path === RUN TestAMConfigValidationAPI/Should_pass_if_the_referenced_template_is_valid_filename === RUN TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_password_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_bearer_token_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_credentials_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_client_secret_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_proxy_url_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_TLS_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_password_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_bearer_token_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_credentials_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_client_secret_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_proxy_url_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_slack_api_url_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_Slack_api_url_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_opsgenie_api_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_OpsGenie_api_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_global_victorops_api_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_VictorOps_api_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_PagerDuty_service_key_file_is_set === RUN TestAMConfigValidationAPI/Should_return_error_if_PagerDuty_routing_key_file_is_set === RUN TestAMConfigValidationAPI/should_return_error_if_template_is_wrong === RUN TestAMConfigValidationAPI/config_too_big === RUN TestAMConfigValidationAPI/config_size_OK === RUN TestAMConfigValidationAPI/templates_limit_reached === RUN TestAMConfigValidationAPI/templates_limit_not_reached === RUN TestAMConfigValidationAPI/template_size_limit_reached === RUN TestAMConfigValidationAPI/template_size_limit_ok === RUN TestAMConfigValidationAPI/Should_pass_if_template_uses_the_tenantID_custom_function === RUN TestAMConfigValidationAPI/Should_pass_if_template_uses_the_grafanaExploreURL_custom_function --- PASS: TestAMConfigValidationAPI (0.35s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_contains_no_receivers (0.01s) --- PASS: TestAMConfigValidationAPI/Should_pass_if_the_alertmanager_config_is_valid (0.02s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_config_is_empty_due_to_wrong_indentation (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_alertmanager_config_is_empty_due_to_wrong_key (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_an_absolute_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_contains_a_relative_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_external_template_file_name_is_not_a_valid_filename (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_/ (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_the_root_with_repeated_separators_/// (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_an_absolute_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_the_referenced_template_contains_a_relative_path (0.00s) --- PASS: TestAMConfigValidationAPI/Should_pass_if_the_referenced_template_is_valid_filename (0.02s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_password_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_bearer_token_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_HTTP_credentials_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_client_secret_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_proxy_url_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_OAuth2_TLS_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_password_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_bearer_token_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_HTTP_credentials_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_client_secret_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_receiver's_OAuth2_proxy_url_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_slack_api_url_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_Slack_api_url_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_opsgenie_api_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_OpsGenie_api_key_file_is_set (0.02s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_global_victorops_api_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_VictorOps_api_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_PagerDuty_service_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/Should_return_error_if_PagerDuty_routing_key_file_is_set (0.00s) --- PASS: TestAMConfigValidationAPI/should_return_error_if_template_is_wrong (0.03s) --- PASS: TestAMConfigValidationAPI/config_too_big (0.00s) --- PASS: TestAMConfigValidationAPI/config_size_OK (0.02s) --- PASS: TestAMConfigValidationAPI/templates_limit_reached (0.00s) --- PASS: TestAMConfigValidationAPI/templates_limit_not_reached (0.02s) --- PASS: TestAMConfigValidationAPI/template_size_limit_reached (0.00s) --- PASS: TestAMConfigValidationAPI/template_size_limit_ok (0.04s) --- PASS: TestAMConfigValidationAPI/Should_pass_if_template_uses_the_tenantID_custom_function (0.02s) --- PASS: TestAMConfigValidationAPI/Should_pass_if_template_uses_the_grafanaExploreURL_custom_function (0.07s) === RUN TestMultitenantAlertmanager_DeleteUserConfig --- PASS: TestMultitenantAlertmanager_DeleteUserConfig (0.00s) === RUN TestAMConfigListUserConfig --- PASS: TestAMConfigListUserConfig (0.32s) === RUN TestValidateAlertmanagerConfig === RUN TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_direct_child === RUN TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child === RUN TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child_within_a_slice === RUN TestValidateAlertmanagerConfig/map_containing_*HTTPClientConfig === RUN TestValidateAlertmanagerConfig/*HTTPClientConfig === RUN TestValidateAlertmanagerConfig/HTTPClientConfig === RUN TestValidateAlertmanagerConfig/*TLSConfig === RUN TestValidateAlertmanagerConfig/TLSConfig === RUN TestValidateAlertmanagerConfig/*GlobalConfig.SMTPAuthPasswordFile === RUN TestValidateAlertmanagerConfig/GlobalConfig.SMTPAuthPasswordFile === RUN TestValidateAlertmanagerConfig/*EmailConfig.AuthPasswordFile === RUN TestValidateAlertmanagerConfig/EmailConfig.AuthPasswordFile === RUN TestValidateAlertmanagerConfig/map_containing_TLSConfig_as_nested_child --- PASS: TestValidateAlertmanagerConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_direct_child (0.00s) --- PASS: TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child (0.00s) --- PASS: TestValidateAlertmanagerConfig/struct_containing_*HTTPClientConfig_as_nested_child_within_a_slice (0.00s) --- PASS: TestValidateAlertmanagerConfig/map_containing_*HTTPClientConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/*HTTPClientConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/HTTPClientConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/*TLSConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/TLSConfig (0.00s) --- PASS: TestValidateAlertmanagerConfig/*GlobalConfig.SMTPAuthPasswordFile (0.00s) --- PASS: TestValidateAlertmanagerConfig/GlobalConfig.SMTPAuthPasswordFile (0.00s) --- PASS: TestValidateAlertmanagerConfig/*EmailConfig.AuthPasswordFile (0.00s) --- PASS: TestValidateAlertmanagerConfig/EmailConfig.AuthPasswordFile (0.00s) --- PASS: TestValidateAlertmanagerConfig/map_containing_TLSConfig_as_nested_child (0.00s) === RUN TestDistributor_DistributeRequest === RUN TestDistributor_DistributeRequest/Write_/alerts,_Simple_AM_request,_all_AM_healthy === RUN TestDistributor_DistributeRequest/Write_/alerts,_no_healthy_Alertmanagers === RUN TestDistributor_DistributeRequest/Write_/alerts,_1_healthy_Alertmanager_out_of_3 === RUN TestDistributor_DistributeRequest/Write_/alerts,_3_healthy_Alertmanagers_out_of_5 === RUN TestDistributor_DistributeRequest/Read_/v1/alerts_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/alerts_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/alerts/groups_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Write_/alerts/groups_not_supported === RUN TestDistributor_DistributeRequest/Read_/v1/silences_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/silences_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Write_/silences_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Read_/v1/silence/id_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Read_/v2/silence/id_is_sent_to_3_AMs === RUN TestDistributor_DistributeRequest/Write_/silence/id_not_supported === RUN TestDistributor_DistributeRequest/Delete_/silence/id_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Read_/status_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Write_/status_not_supported === RUN TestDistributor_DistributeRequest/Read_/some/place/arbitrary_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Read_/receivers_is_sent_to_only_1_AM === RUN TestDistributor_DistributeRequest/Write_/receivers_not_supported --- PASS: TestDistributor_DistributeRequest (0.15s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_Simple_AM_request,_all_AM_healthy (0.01s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_no_healthy_Alertmanagers (0.02s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_1_healthy_Alertmanager_out_of_3 (0.01s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts,_3_healthy_Alertmanagers_out_of_5 (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v1/alerts_is_sent_to_3_AMs (0.02s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/alerts_is_sent_to_3_AMs (0.01s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/alerts/groups_is_sent_to_3_AMs (0.01s) --- PASS: TestDistributor_DistributeRequest/Write_/alerts/groups_not_supported (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/v1/silences_is_sent_to_3_AMs (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/silences_is_sent_to_3_AMs (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/silences_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/v1/silence/id_is_sent_to_3_AMs (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/v2/silence/id_is_sent_to_3_AMs (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/silence/id_not_supported (0.00s) --- PASS: TestDistributor_DistributeRequest/Delete_/silence/id_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/status_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/status_not_supported (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/some/place/arbitrary_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Read_/receivers_is_sent_to_only_1_AM (0.00s) --- PASS: TestDistributor_DistributeRequest/Write_/receivers_not_supported (0.00s) === RUN TestMultitenantAlertmanagerConfig_Validate === RUN TestMultitenantAlertmanagerConfig_Validate/should_pass_with_default_config === RUN TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_external_URL_does_not_end_with_/ === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_has_no_hostname === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_zone_aware_is_enabled_but_zone_is_not_set === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_with_empty_external_URL === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_0 === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_negative === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_ends_with_/ === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_has_no_scheme === RUN TestMultitenantAlertmanagerConfig_Validate/should_pass_if_the_URL_just_contains_the_path_with_the_leading_/ === RUN TestMultitenantAlertmanagerConfig_Validate/should_fail_if_the_URL_just_contains_the_hostname_(because_it_can't_be_disambiguated_with_a_path) --- PASS: TestMultitenantAlertmanagerConfig_Validate (0.02s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_succeed_if_external_URL_does_not_end_with_/ (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_has_no_hostname (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_zone_aware_is_enabled_but_zone_is_not_set (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_with_empty_external_URL (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_0 (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_persistent_interval_is_negative (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_ends_with_/ (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_external_URL_has_no_scheme (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_pass_if_the_URL_just_contains_the_path_with_the_leading_/ (0.00s) --- PASS: TestMultitenantAlertmanagerConfig_Validate/should_fail_if_the_URL_just_contains_the_hostname_(because_it_can't_be_disambiguated_with_a_path) (0.00s) === RUN TestMultitenantAlertmanager_relativeDataDir --- PASS: TestMultitenantAlertmanager_relativeDataDir (0.26s) === RUN TestMultitenantAlertmanager_loadAndSyncConfigs --- PASS: TestMultitenantAlertmanager_loadAndSyncConfigs (0.68s) === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=discord_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=discord_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=discord_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=discord_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webex_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webex_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webex_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webex_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true === RUN TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false === PAUSE TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=discord_firewall_enabled=true === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=telegram integration=telegram[0] msg="Notify attempt failed, will retry later" attempts=1 err="telebot: unexpected end of JSON input" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=slack integration=slack[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=error component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="wechat/wechat[0]: notify retry canceled due to unrecoverable error after 1 attempts: EOF" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webex_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=webex incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webex integration=webex[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=discord_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=discord incident={}:{} level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=discord integration=discord[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:33879: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=discord incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=discord incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=discord incident={}:{} === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=sns integration=sns[0] msg="Notify attempt failed, will retry later" attempts=1 err="RequestError: send request failed\ncaused by: Post \"http://127.0.0.1:36193/\": dial tcp 127.0.0.1:36193: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webex_firewall_enabled=true === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=telegram integration=telegram[0] msg="Notify attempt failed, will retry later" attempts=1 err="telebot: Post \"http://127.0.0.1:44155/botxxx/sendMessage\": dial tcp 127.0.0.1:44155: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=slack integration=slack[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:34065: blocked address" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=opsgenie integration=opsgenie[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=discord_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=discord incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=discord integration=discord[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=pagerduty integration=pagerduty[0] msg="Notify success" attempts=1 === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=wechat integration=wechat[0] msg="Notify attempt failed, will retry later" attempts=1 err="Get \"\": dial tcp 127.0.0.1:37147: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=wechat incident={}:{} === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webex_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=webex incident={}:{} level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webex integration=webex[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:35609: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=webex incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=webex incident={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=webex incident={}:{} === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://www.google.com\": http: server gave HTTP response to HTTPS client" === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=opsgenie integration=opsgenie[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"http://127.0.0.1:43025/v2/alerts\": dial tcp 127.0.0.1:43025: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} level=debug component=MultiTenantAlertmanager user=user-1 integration=opsgenie alert={}:{} === CONT TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=sns msg="SNS message successfully published" message_id=null sequencenumber=null level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=sns integration=sns[0] msg="Notify success" attempts=1 === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=pagerduty integration=pagerduty[0] msg="Notify attempt failed, will retry later" attempts=1 err="failed to post message to PagerDuty: Post \"http://127.0.0.1:34229\": dial tcp 127.0.0.1:34229: blocked address" level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger level=debug component=MultiTenantAlertmanager user=user-1 integration=pagerduty incident={}:{} eventType=trigger === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"http://127.0.0.1:33713\": dial tcp 127.0.0.1:33713: blocked address" === NAME TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true multitenant_test.go:687: Alertmanager logs: level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=test ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user-1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user-1 level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user-1 user=user-1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher msg="Received alert" alert=test[1f56cb8][active] level=debug component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher aggrGroup={}:{} msg=flushing alerts=[test[1f56cb8][active]] level=warn component=MultiTenantAlertmanager user=user-1 component=dispatcher insight=true component=dispatcher receiver=webhook integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://www.google.com\": proxyconnect tcp: dial tcp 127.0.0.1:34169: blocked address" --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled (0.01s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=false (0.41s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=false (0.61s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=false (0.42s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webex_firewall_enabled=false (0.53s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=discord_firewall_enabled=true (3.36s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=true (3.52s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=telegram_firewall_enabled=true (3.43s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=slack_firewall_enabled=true (3.34s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=false (0.55s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=false (0.22s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=discord_firewall_enabled=false (0.37s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=false (0.20s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=wechat_firewall_enabled=true (3.32s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webex_firewall_enabled=true (3.42s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=false (0.61s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=opsgenie_firewall_enabled=true (3.29s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=sns_firewall_enabled=false (0.57s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=pagerduty_firewall_enabled=true (3.29s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=webhook_firewall_enabled=true (3.31s) --- PASS: TestMultitenantAlertmanager_FirewallShouldBlockHTTPBasedReceiversWhenEnabled/receiver=HTTP_proxy_firewall_enabled=true (3.46s) === RUN TestMultitenantAlertmanager_deleteUnusedLocalUserState --- PASS: TestMultitenantAlertmanager_deleteUnusedLocalUserState (0.38s) === RUN TestMultitenantAlertmanager_zoneAwareSharding level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-1 ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-2 ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-3 ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=3 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user2 level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user2 addr=127.0.0.1-3:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-3:0 user=user2 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-3: no such host\"" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="no state for user in storage; proceeding" level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user1 addr=127.0.0.1-3:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-3:0 user=user1 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-3: no such host\"" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="no state for user in storage; proceeding" level=debug component=MultiTenantAlertmanager msg="setting config" user=user3 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user3 level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user3 addr=127.0.0.1-3:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-3:0 user=user3 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-3: no such host\"" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=3 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user2 level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user2 addr=127.0.0.1-2:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-2:0 user=user2 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-2: no such host\"" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="no state for user in storage; proceeding" level=debug component=MultiTenantAlertmanager msg="setting config" user=user3 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user3 level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user3 addr=127.0.0.1-2:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-2:0 user=user3 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-2: no such host\"" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user3 user=user3 msg="no state for user in storage; proceeding" level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="Waiting for notification and silences to settle..." level=debug component=MultiTenantAlertmanager msg="contacting replica for full state" user=user1 addr=127.0.0.1-2:0 level=error component=MultiTenantAlertmanager msg="rpc reading state from replica failed" addr=127.0.0.1-2:0 user=user1 err="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial tcp: lookup 127.0.0.1-2: no such host\"" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="unable to read state from other Alertmanager replicas; trying to read from storage" err="failed to read state from any replica" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="no state for user in storage; proceeding" level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Maintenance done" duration=726µs size=0 level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Maintenance done" duration=1.633ms size=0 level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Maintenance done" duration=309µs size=0 level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Maintenance done" duration=277µs size=0 level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Maintenance done" duration=541µs size=0 level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Maintenance done" duration=930µs size=0 level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Maintenance done" duration=717µs size=0 level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Maintenance done" duration=643µs size=0 level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user3 component=silences msg="Maintenance done" duration=352µs size=0 level=debug component=MultiTenantAlertmanager user=user3 component=nflog msg="Maintenance done" duration=527µs size=0 level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Maintenance done" duration=336µs size=0 level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Maintenance done" duration=1.75ms size=0 level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager --- PASS: TestMultitenantAlertmanager_zoneAwareSharding (1.42s) === RUN TestMultitenantAlertmanager_deleteUnusedRemoteUserState level=info component=MultiTenantAlertmanager msg="ring doesn't exist in KV store yet" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-1 ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="instance not found in the ring" instance=instance-2 ring=alertmanager level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is JOINING in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="waiting until initial state sync is complete for all users" level=info component=MultiTenantAlertmanager msg="initial state sync is complete" level=info component=MultiTenantAlertmanager msg="waiting until alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="alertmanager is ACTIVE in the ring" level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=2 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user1 user=user1 msg="no state for user in storage; proceeding" level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=debug component=MultiTenantAlertmanager msg="initializing new per-tenant alertmanager" user=user2 level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="reading state from storage" level=info component=MultiTenantAlertmanager user=user2 user=user2 msg="no state for user in storage; proceeding" level=debug component=MultiTenantAlertmanager user=user1 msg="persisting state" user=user1 level=debug component=MultiTenantAlertmanager user=user2 msg="persisting state" user=user2 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=2 level=debug component=MultiTenantAlertmanager msg="setting config" user=user1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=0 level=info component=MultiTenantAlertmanager msg="deleted remote state for user" user=user1 level=info component=MultiTenantAlertmanager msg="synchronizing alertmanager configs for users" level=debug component=MultiTenantAlertmanager msg="adding configurations" num_configs=1 level=debug component=MultiTenantAlertmanager msg="setting config" user=user2 level=info component=MultiTenantAlertmanager msg="deactivating per-tenant alertmanager" user=user1 level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=silences msg="Maintenance done" duration=542µs size=0 level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user1 component=nflog msg="Maintenance done" duration=1.904999ms size=0 level=info component=MultiTenantAlertmanager msg="deactivated per-tenant alertmanager" user=user1 level=info component=MultiTenantAlertmanager msg="deleted local directory for user" dir=/tmp/TestMultitenantAlertmanager_deleteUnusedRemoteUserState2268035286/002/user1 user=user1 level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=nflog msg="Maintenance done" duration=776µs size=0 level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Running maintenance" level=debug component=MultiTenantAlertmanager user=user2 component=silences msg="Maintenance done" duration=1.67ms size=0 level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="ring lifecycler is shutting down" ring=alertmanager level=info component=MultiTenantAlertmanager msg="unregistering instance from ring" ring=alertmanager level=info component=MultiTenantAlertmanager msg="instance removed from the ring" ring=alertmanager --- PASS: TestMultitenantAlertmanager_deleteUnusedRemoteUserState (1.27s) === RUN TestMultitenantAlertmanager_ServeHTTP --- PASS: TestMultitenantAlertmanager_ServeHTTP (0.21s) === RUN TestMultitenantAlertmanager_ServeHTTPWithFallbackConfig --- PASS: TestMultitenantAlertmanager_ServeHTTPWithFallbackConfig (0.51s) === RUN TestMultitenantAlertmanager_ServeHTTPBeforeSyncFailsIfConfigExists --- PASS: TestMultitenantAlertmanager_ServeHTTPBeforeSyncFailsIfConfigExists (0.23s) === RUN TestMultitenantAlertmanager_InitialSync === RUN TestMultitenantAlertmanager_InitialSync/with_no_instance_in_the_ring === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_PENDING_state_and_no_tokens === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_JOINING_state_and_some_tokens === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_ACTIVE_state_and_all_tokens === RUN TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_LEAVING_state_and_all_tokens --- PASS: TestMultitenantAlertmanager_InitialSync (0.96s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_no_instance_in_the_ring (0.28s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_PENDING_state_and_no_tokens (0.17s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_JOINING_state_and_some_tokens (0.17s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_ACTIVE_state_and_all_tokens (0.19s) --- PASS: TestMultitenantAlertmanager_InitialSync/with_an_instance_already_in_the_ring_with_LEAVING_state_and_all_tokens (0.14s) === RUN TestMultitenantAlertmanager_PerTenantSharding === RUN TestMultitenantAlertmanager_PerTenantSharding/1_instance,_RF_=_1 === RUN TestMultitenantAlertmanager_PerTenantSharding/2_instances,_RF_=_1 === RUN TestMultitenantAlertmanager_PerTenantSharding/3_instances,_RF_=_2 === RUN TestMultitenantAlertmanager_PerTenantSharding/5_instances,_RF_=_3 --- PASS: TestMultitenantAlertmanager_PerTenantSharding (8.92s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/1_instance,_RF_=_1 (0.79s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/2_instances,_RF_=_1 (1.17s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/3_instances,_RF_=_2 (2.54s) --- PASS: TestMultitenantAlertmanager_PerTenantSharding/5_instances,_RF_=_3 (4.42s) === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_added_to_the_ring === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_removed_from_the_ring === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_instance_changes_state === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_healthy_instance_becomes_unhealthy === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_unhealthy_instance_becomes_healthy === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_updates_the_heartbeat === RUN TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges (2.78s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_added_to_the_ring (0.33s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/when_an_instance_is_removed_from_the_ring (0.49s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_instance_changes_state (0.37s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_healthy_instance_becomes_unhealthy (0.48s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_sync_when_an_unhealthy_instance_becomes_healthy (0.38s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_updates_the_heartbeat (0.38s) --- PASS: TestMultitenantAlertmanager_SyncOnRingTopologyChanges/should_NOT_sync_when_an_instance_is_auto-forgotten_in_the_ring_but_was_already_unhealthy_in_the_previous_state (0.37s) === RUN TestMultitenantAlertmanager_RingLifecyclerShouldAutoForgetUnhealthyInstances --- PASS: TestMultitenantAlertmanager_RingLifecyclerShouldAutoForgetUnhealthyInstances (0.42s) === RUN TestMultitenantAlertmanager_InitialSyncFailure --- PASS: TestMultitenantAlertmanager_InitialSyncFailure (0.13s) === RUN TestAlertmanager_ReplicasPosition --- PASS: TestAlertmanager_ReplicasPosition (1.19s) === RUN TestAlertmanager_StateReplication === RUN TestAlertmanager_StateReplication/RF_=_1,_1_instance === RUN TestAlertmanager_StateReplication/RF_=_2,_2_instances === RUN TestAlertmanager_StateReplication/RF_=_3,_10_instance --- PASS: TestAlertmanager_StateReplication (10.60s) --- PASS: TestAlertmanager_StateReplication/RF_=_1,_1_instance (1.04s) --- PASS: TestAlertmanager_StateReplication/RF_=_2,_2_instances (2.21s) --- PASS: TestAlertmanager_StateReplication/RF_=_3,_10_instance (7.36s) === RUN TestAlertmanager_StateReplication_InitialSyncFromPeers === RUN TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_2 === RUN TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_3 --- PASS: TestAlertmanager_StateReplication_InitialSyncFromPeers (2.03s) --- PASS: TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_2 (0.77s) --- PASS: TestAlertmanager_StateReplication_InitialSyncFromPeers/RF_=_3 (1.26s) === RUN TestSafeTemplateFilepath === RUN TestSafeTemplateFilepath/should_fail_if_the_provided_template_is_escaping_the_dir === RUN TestSafeTemplateFilepath/escaping_template_name_that_has_prefix_of_dir_(tmp_is_prefix_of_tmpfile) === RUN TestSafeTemplateFilepath/empty_template_name === RUN TestSafeTemplateFilepath/dot_template_name === RUN TestSafeTemplateFilepath/should_succeed_if_the_provided_template_is_a_filename === RUN TestSafeTemplateFilepath/template_name_starting_with_/ === RUN TestSafeTemplateFilepath/root_dir === RUN TestSafeTemplateFilepath/root_dir_2 --- PASS: TestSafeTemplateFilepath (0.00s) --- PASS: TestSafeTemplateFilepath/should_fail_if_the_provided_template_is_escaping_the_dir (0.00s) --- PASS: TestSafeTemplateFilepath/escaping_template_name_that_has_prefix_of_dir_(tmp_is_prefix_of_tmpfile) (0.00s) --- PASS: TestSafeTemplateFilepath/empty_template_name (0.00s) --- PASS: TestSafeTemplateFilepath/dot_template_name (0.00s) --- PASS: TestSafeTemplateFilepath/should_succeed_if_the_provided_template_is_a_filename (0.00s) --- PASS: TestSafeTemplateFilepath/template_name_starting_with_/ (0.00s) --- PASS: TestSafeTemplateFilepath/root_dir (0.00s) --- PASS: TestSafeTemplateFilepath/root_dir_2 (0.00s) === RUN TestStoreTemplateFile --- PASS: TestStoreTemplateFile (0.00s) === RUN TestMultitenantAlertmanager_verifyRateLimitedEmailConfig --- PASS: TestMultitenantAlertmanager_verifyRateLimitedEmailConfig (0.20s) === RUN TestRateLimitedNotifier --- PASS: TestRateLimitedNotifier (1.00s) === RUN TestStatePersister_Position0ShouldWrite --- PASS: TestStatePersister_Position0ShouldWrite (6.10s) === RUN TestStatePersister_Position1ShouldNotWrite --- PASS: TestStatePersister_Position1ShouldNotWrite (5.00s) === RUN TestStateReplication === RUN TestStateReplication/with_a_replication_factor_of_<=_1,_state_is_not_replicated_but_loaded_from_storage. === RUN TestStateReplication/with_a_replication_factor_of_>_1,_state_is_broadcasted_for_replication. --- PASS: TestStateReplication (0.21s) --- PASS: TestStateReplication/with_a_replication_factor_of_<=_1,_state_is_not_replicated_but_loaded_from_storage. (0.10s) --- PASS: TestStateReplication/with_a_replication_factor_of_>_1,_state_is_broadcasted_for_replication. (0.11s) === RUN TestStateReplication_Settle === RUN TestStateReplication_Settle/with_a_replication_factor_of_<=_1,_no_state_can_be_read_from_peers. === RUN TestStateReplication_Settle/with_a_replication_factor_of_>_1,_state_is_read_from_all_peers. === RUN TestStateReplication_Settle/with_full_state_having_no_parts,_nothing_is_merged. === RUN TestStateReplication_Settle/with_an_unknown_key,_parts_in_the_same_state_are_merged. === RUN TestStateReplication_Settle/with_an_unknown_key,_parts_in_other_states_are_merged. === RUN TestStateReplication_Settle/when_reading_from_replicas_fails,_state_is_read_from_storage. === RUN TestStateReplication_Settle/when_reading_from_replicas_and_from_storage_fails,_still_become_ready. === RUN TestStateReplication_Settle/when_user_not_found_in_all_replicas_and_storage,_read_not_counted_as_failure_and_still_become_ready. === RUN TestStateReplication_Settle/when_reading_the_full_state_takes_too_long,_hit_timeout_but_become_ready. --- PASS: TestStateReplication_Settle (1.03s) --- PASS: TestStateReplication_Settle/with_a_replication_factor_of_<=_1,_no_state_can_be_read_from_peers. (0.00s) --- PASS: TestStateReplication_Settle/with_a_replication_factor_of_>_1,_state_is_read_from_all_peers. (0.00s) --- PASS: TestStateReplication_Settle/with_full_state_having_no_parts,_nothing_is_merged. (0.00s) --- PASS: TestStateReplication_Settle/with_an_unknown_key,_parts_in_the_same_state_are_merged. (0.00s) --- PASS: TestStateReplication_Settle/with_an_unknown_key,_parts_in_other_states_are_merged. (0.00s) --- PASS: TestStateReplication_Settle/when_reading_from_replicas_fails,_state_is_read_from_storage. (0.00s) --- PASS: TestStateReplication_Settle/when_reading_from_replicas_and_from_storage_fails,_still_become_ready. (0.00s) --- PASS: TestStateReplication_Settle/when_user_not_found_in_all_replicas_and_storage,_read_not_counted_as_failure_and_still_become_ready. (0.00s) --- PASS: TestStateReplication_Settle/when_reading_the_full_state_takes_too_long,_hit_timeout_but_become_ready. (1.00s) === RUN TestStateReplication_GetFullState === RUN TestStateReplication_GetFullState/no_keys === RUN TestStateReplication_GetFullState/zero_length_data === RUN TestStateReplication_GetFullState/keys_with_data --- PASS: TestStateReplication_GetFullState (0.00s) --- PASS: TestStateReplication_GetFullState/no_keys (0.00s) --- PASS: TestStateReplication_GetFullState/zero_length_data (0.00s) --- PASS: TestStateReplication_GetFullState/keys_with_data (0.00s) === CONT TestIsHealthyForAlertmanagerOperations === RUN TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/JOINING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout === RUN TestIsHealthyForAlertmanagerOperations/PENDING_instance_with_last_keepalive_newer_than_timeout --- PASS: TestIsHealthyForAlertmanagerOperations (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/ACTIVE_instance_with_last_keepalive_older_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/JOINING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/LEAVING_instance_with_last_keepalive_newer_than_timeout (0.00s) --- PASS: TestIsHealthyForAlertmanagerOperations/PENDING_instance_with_last_keepalive_newer_than_timeout (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager 58.865s === RUN TestAlertStore_ListAllUsers --- PASS: TestAlertStore_ListAllUsers (0.00s) === RUN TestAlertStore_SetAndGetAlertConfig --- PASS: TestAlertStore_SetAndGetAlertConfig (0.00s) === RUN TestStore_GetAlertConfigs --- PASS: TestStore_GetAlertConfigs (0.00s) === RUN TestAlertStore_DeleteAlertConfig --- PASS: TestAlertStore_DeleteAlertConfig (0.00s) === RUN TestBucketAlertStore_GetSetDeleteFullState --- PASS: TestBucketAlertStore_GetSetDeleteFullState (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager/alertstore 0.254s testing: warning: no tests to run PASS ok github.com/grafana/mimir/pkg/alertmanager/alertstore/bucketclient 0.249s [no tests to run] === RUN TestStore_ListAllUsers --- PASS: TestStore_ListAllUsers (0.02s) === RUN TestStore_GetAlertConfig --- PASS: TestStore_GetAlertConfig (0.01s) === RUN TestStore_GetAlertConfigs --- PASS: TestStore_GetAlertConfigs (0.00s) === RUN TestStore_FullState --- PASS: TestStore_FullState (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager/alertstore/local 0.185s === RUN TestV1Alerts --- PASS: TestV1Alerts (0.00s) === RUN TestMergeV1Alerts === RUN TestMergeV1Alerts/no_alerts,_should_return_an_empty_list === RUN TestMergeV1Alerts/one_alert,_should_return_the_alert === RUN TestMergeV1Alerts/two_alerts,_should_return_two_alerts === RUN TestMergeV1Alerts/three_alerts,_should_return_three_alerts === RUN TestMergeV1Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order === RUN TestMergeV1Alerts/two_identical_alerts,_should_return_one_alert === RUN TestMergeV1Alerts/two_identical_alerts_plus_another,_should_return_two_alerts === RUN TestMergeV1Alerts/two_duplicates_out_of_sync_alerts,_should_return_first_seen_alert === RUN TestMergeV1Alerts/two_duplicates_plus_others,_should_return_first_seen_alert_and_others --- PASS: TestMergeV1Alerts (0.00s) --- PASS: TestMergeV1Alerts/no_alerts,_should_return_an_empty_list (0.00s) --- PASS: TestMergeV1Alerts/one_alert,_should_return_the_alert (0.00s) --- PASS: TestMergeV1Alerts/two_alerts,_should_return_two_alerts (0.00s) --- PASS: TestMergeV1Alerts/three_alerts,_should_return_three_alerts (0.00s) --- PASS: TestMergeV1Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order (0.00s) --- PASS: TestMergeV1Alerts/two_identical_alerts,_should_return_one_alert (0.00s) --- PASS: TestMergeV1Alerts/two_identical_alerts_plus_another,_should_return_two_alerts (0.00s) --- PASS: TestMergeV1Alerts/two_duplicates_out_of_sync_alerts,_should_return_first_seen_alert (0.00s) --- PASS: TestMergeV1Alerts/two_duplicates_plus_others,_should_return_first_seen_alert_and_others (0.00s) === RUN TestV1SilenceID_ReturnsNewestSilence --- PASS: TestV1SilenceID_ReturnsNewestSilence (0.00s) === RUN TestV1SilenceID_InvalidDifferentIDs --- PASS: TestV1SilenceID_InvalidDifferentIDs (0.00s) === RUN TestV1Silences --- PASS: TestV1Silences (0.00s) === RUN TestV2AlertGroups --- PASS: TestV2AlertGroups (0.00s) === RUN TestMergeV2AlertGroups === RUN TestMergeV2AlertGroups/no_groups,_should_return_no_groups === RUN TestMergeV2AlertGroups/one_group_with_one_alert,_should_return_one_group === RUN TestMergeV2AlertGroups/two_groups_with_different_labels,_should_return_two_groups === RUN TestMergeV2AlertGroups/two_groups_with_different_receiver,_should_return_two_groups === RUN TestMergeV2AlertGroups/two_identical_groups_with_different_alerts,_should_return_one_group_with_two_alerts === RUN TestMergeV2AlertGroups/two_identical_groups_with_identical_alerts,_should_return_one_group_with_one_alert === RUN TestMergeV2AlertGroups/two_identical_groups_with_diverged_alerts,_should_return_one_group_with_the_newer_alert === RUN TestMergeV2AlertGroups/two_sets_of_identical_groups_with_single_alerts,_should_merge_all_into_two_groups_ === RUN TestMergeV2AlertGroups/many_unordered_groups,_should_return_groups_ordered_by_labels_then_receiver --- PASS: TestMergeV2AlertGroups (0.00s) --- PASS: TestMergeV2AlertGroups/no_groups,_should_return_no_groups (0.00s) --- PASS: TestMergeV2AlertGroups/one_group_with_one_alert,_should_return_one_group (0.00s) --- PASS: TestMergeV2AlertGroups/two_groups_with_different_labels,_should_return_two_groups (0.00s) --- PASS: TestMergeV2AlertGroups/two_groups_with_different_receiver,_should_return_two_groups (0.00s) --- PASS: TestMergeV2AlertGroups/two_identical_groups_with_different_alerts,_should_return_one_group_with_two_alerts (0.00s) --- PASS: TestMergeV2AlertGroups/two_identical_groups_with_identical_alerts,_should_return_one_group_with_one_alert (0.00s) --- PASS: TestMergeV2AlertGroups/two_identical_groups_with_diverged_alerts,_should_return_one_group_with_the_newer_alert (0.00s) --- PASS: TestMergeV2AlertGroups/two_sets_of_identical_groups_with_single_alerts,_should_merge_all_into_two_groups_ (0.00s) --- PASS: TestMergeV2AlertGroups/many_unordered_groups,_should_return_groups_ordered_by_labels_then_receiver (0.00s) === RUN TestV2Alerts --- PASS: TestV2Alerts (0.00s) === RUN TestMergeV2Alerts === RUN TestMergeV2Alerts/no_alerts,_should_return_an_empty_list === RUN TestMergeV2Alerts/one_alert,_should_return_the_alert === RUN TestMergeV2Alerts/two_alerts,_should_return_two_alerts === RUN TestMergeV2Alerts/three_alerts,_should_return_three_alerts === RUN TestMergeV2Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order === RUN TestMergeV2Alerts/two_identical_alerts,_should_return_one_alert === RUN TestMergeV2Alerts/two_identical_alerts_plus_another,_should_return_two_alerts === RUN TestMergeV2Alerts/two_duplicates_out_of_sync_alerts,_should_return_newer_alert === RUN TestMergeV2Alerts/two_duplicates_out_of_sync_alerts_(newer_first),_should_return_newer_alert === RUN TestMergeV2Alerts/two_duplicates_plus_others,_should_return_newer_alert_and_others --- PASS: TestMergeV2Alerts (0.00s) --- PASS: TestMergeV2Alerts/no_alerts,_should_return_an_empty_list (0.00s) --- PASS: TestMergeV2Alerts/one_alert,_should_return_the_alert (0.00s) --- PASS: TestMergeV2Alerts/two_alerts,_should_return_two_alerts (0.00s) --- PASS: TestMergeV2Alerts/three_alerts,_should_return_three_alerts (0.00s) --- PASS: TestMergeV2Alerts/three_alerts_out_of_order,_should_return_three_alerts_in_fingerprint_order (0.00s) --- PASS: TestMergeV2Alerts/two_identical_alerts,_should_return_one_alert (0.00s) --- PASS: TestMergeV2Alerts/two_identical_alerts_plus_another,_should_return_two_alerts (0.00s) --- PASS: TestMergeV2Alerts/two_duplicates_out_of_sync_alerts,_should_return_newer_alert (0.00s) --- PASS: TestMergeV2Alerts/two_duplicates_out_of_sync_alerts_(newer_first),_should_return_newer_alert (0.00s) --- PASS: TestMergeV2Alerts/two_duplicates_plus_others,_should_return_newer_alert_and_others (0.00s) === RUN TestV2SilenceId_ReturnsNewestSilence --- PASS: TestV2SilenceId_ReturnsNewestSilence (0.00s) === RUN TestV2SilenceID_InvalidDifferentIDs --- PASS: TestV2SilenceID_InvalidDifferentIDs (0.00s) === RUN TestV2Silences --- PASS: TestV2Silences (0.00s) === RUN TestMergeV2Silences === RUN TestMergeV2Silences/no_silences,_should_return_an_empty_list === RUN TestMergeV2Silences/one_silence,_should_return_the_silence === RUN TestMergeV2Silences/two_silences,_should_return_two_silences === RUN TestMergeV2Silences/three_silences,_should_return_three_silences === RUN TestMergeV2Silences/three_active_silences_out_of_order,_should_return_three_silences_in_expiry_order === RUN TestMergeV2Silences/two_identical_silences,_should_return_one_silence === RUN TestMergeV2Silences/two_identical_silences_plus_another,_should_return_two_silences === RUN TestMergeV2Silences/two_duplicates_out_of_sync_silences,_should_return_newer_silence === RUN TestMergeV2Silences/two_duplicates_out_of_sync_silences_(newer_first),_should_return_newer_silence === RUN TestMergeV2Silences/two_duplicates_plus_others,_should_return_newer_silence_and_others --- PASS: TestMergeV2Silences (0.00s) --- PASS: TestMergeV2Silences/no_silences,_should_return_an_empty_list (0.00s) --- PASS: TestMergeV2Silences/one_silence,_should_return_the_silence (0.00s) --- PASS: TestMergeV2Silences/two_silences,_should_return_two_silences (0.00s) --- PASS: TestMergeV2Silences/three_silences,_should_return_three_silences (0.00s) --- PASS: TestMergeV2Silences/three_active_silences_out_of_order,_should_return_three_silences_in_expiry_order (0.00s) --- PASS: TestMergeV2Silences/two_identical_silences,_should_return_one_silence (0.00s) --- PASS: TestMergeV2Silences/two_identical_silences_plus_another,_should_return_two_silences (0.00s) --- PASS: TestMergeV2Silences/two_duplicates_out_of_sync_silences,_should_return_newer_silence (0.00s) --- PASS: TestMergeV2Silences/two_duplicates_out_of_sync_silences_(newer_first),_should_return_newer_silence (0.00s) --- PASS: TestMergeV2Silences/two_duplicates_plus_others,_should_return_newer_silence_and_others (0.00s) PASS ok github.com/grafana/mimir/pkg/alertmanager/merger 0.306s ? github.com/grafana/mimir/pkg/api/error [no test files] === RUN TestNewApiWithoutSourceIPExtractor --- PASS: TestNewApiWithoutSourceIPExtractor (0.00s) === RUN TestNewApiWithSourceIPExtractor --- PASS: TestNewApiWithSourceIPExtractor (0.00s) === RUN TestNewApiWithInvalidSourceIPExtractor --- PASS: TestNewApiWithInvalidSourceIPExtractor (0.00s) === RUN TestApiGzip === RUN TestApiGzip/happy_case_gzip === RUN TestApiGzip/gzip_with_priority_header === RUN TestApiGzip/gzip_because_any_is_accepted === RUN TestApiGzip/no_gzip_because_no_header === RUN TestApiGzip/no_gzip_because_not_accepted === RUN TestApiGzip/no_gzip_because_small_payload === RUN TestApiGzip/forced_gzip_with_small_payload === RUN TestApiGzip/gzip_disabled_endpoint === RUN TestApiGzip/compressed_with_gzip --- PASS: TestApiGzip (0.15s) --- PASS: TestApiGzip/happy_case_gzip (0.04s) --- PASS: TestApiGzip/gzip_with_priority_header (0.03s) --- PASS: TestApiGzip/gzip_because_any_is_accepted (0.02s) --- PASS: TestApiGzip/no_gzip_because_no_header (0.03s) --- PASS: TestApiGzip/no_gzip_because_not_accepted (0.01s) --- PASS: TestApiGzip/no_gzip_because_small_payload (0.00s) --- PASS: TestApiGzip/forced_gzip_with_small_payload (0.00s) --- PASS: TestApiGzip/gzip_disabled_endpoint (0.00s) --- PASS: TestApiGzip/compressed_with_gzip (0.00s) === RUN TestIndexHandlerPrefix --- PASS: TestIndexHandlerPrefix (0.01s) === RUN TestIndexPageContent --- PASS: TestIndexPageContent (0.00s) === RUN TestConfigDiffHandler === RUN TestConfigDiffHandler/no_config_parameters_overridden === RUN TestConfigDiffHandler/slice_changed === RUN TestConfigDiffHandler/string_in_nested_struct_changed === RUN TestConfigDiffHandler/bool_in_nested_struct_changed === RUN TestConfigDiffHandler/test_invalid_input --- PASS: TestConfigDiffHandler (0.01s) --- PASS: TestConfigDiffHandler/no_config_parameters_overridden (0.00s) --- PASS: TestConfigDiffHandler/slice_changed (0.00s) --- PASS: TestConfigDiffHandler/string_in_nested_struct_changed (0.00s) --- PASS: TestConfigDiffHandler/bool_in_nested_struct_changed (0.00s) --- PASS: TestConfigDiffHandler/test_invalid_input (0.00s) === RUN TestConfigOverrideHandler --- PASS: TestConfigOverrideHandler (0.00s) PASS ok github.com/grafana/mimir/pkg/api 0.790s ? github.com/grafana/mimir/pkg/distributor/distributorpb [no test files] ? github.com/grafana/mimir/pkg/flusher [no test files] ? github.com/grafana/mimir/pkg/frontend/v1/frontendv1pb [no test files] ? github.com/grafana/mimir/pkg/frontend/v2/frontendv2pb [no test files] === RUN TestMultitenantCompactor_HandleBlockUpload_Create === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_tenant_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_body block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/malformed_body block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_file_path block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/missing_file_size block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_minTime block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_maxTime block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/maxTime_before_minTime block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/block_before_retention_period block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_version block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_==_0 block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_<_0 block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_compactor_shard_ID_label block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/failure_checking_for_complete_block block_upload_test.go:555: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/complete_block_already_exists block_upload_test.go:555: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/failure_uploading_meta_file block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/block_upload_disabled === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_empty_compactor_shard_ID_label block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_without_compactor_shard_ID_label block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_different_block_ID_in_meta_file block_upload_test.go:555: PASS: Exists(string,string) block_upload_test.go:555: PASS: Get(string,string) block_upload_test.go:555: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_both_in-flight_meta_file_and_complete_meta_file_exist_in_object_storage === RUN TestMultitenantCompactor_HandleBlockUpload_Create/invalid_request_when_in-flight_meta_file_exists_in_object_storage === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_same_in-flight_meta_file_exists_in_object_storage === RUN TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_different_in-flight_meta_file_exists_in_object_storage --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create (0.10s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_tenant_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_body (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/malformed_body (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_file_path (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/missing_file_size (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_minTime (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_maxTime (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/maxTime_before_minTime (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/block_before_retention_period (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_version (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_==_0 (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/ignore_retention_period_if_<_0 (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_compactor_shard_ID_label (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/failure_checking_for_complete_block (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/complete_block_already_exists (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/failure_uploading_meta_file (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/block_upload_disabled (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_empty_compactor_shard_ID_label (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_without_compactor_shard_ID_label (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_with_different_block_ID_in_meta_file (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_both_in-flight_meta_file_and_complete_meta_file_exist_in_object_storage (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/invalid_request_when_in-flight_meta_file_exists_in_object_storage (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_same_in-flight_meta_file_exists_in_object_storage (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Create/valid_request_when_different_in-flight_meta_file_exists_in_object_storage (0.00s) === RUN TestMultitenantCompactor_UploadBlockFile === RUN TestMultitenantCompactor_UploadBlockFile/without_tenant_ID === RUN TestMultitenantCompactor_UploadBlockFile/without_block_ID === RUN TestMultitenantCompactor_UploadBlockFile/invalid_block_ID === RUN TestMultitenantCompactor_UploadBlockFile/without_path === RUN TestMultitenantCompactor_UploadBlockFile/invalid_path === RUN TestMultitenantCompactor_UploadBlockFile/empty_file === RUN TestMultitenantCompactor_UploadBlockFile/attempt_block_metadata_file === RUN TestMultitenantCompactor_UploadBlockFile/attempt_in-flight_block_metadata_file === RUN TestMultitenantCompactor_UploadBlockFile/block_upload_disabled === RUN TestMultitenantCompactor_UploadBlockFile/complete_block_already_exists block_upload_test.go:967: PASS: Exists(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/failure_checking_for_complete_block block_upload_test.go:967: PASS: Exists(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/failure_checking_for_in-flight_meta_file block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/missing_in-flight_meta_file block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/file_upload_fails block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_UploadBlockFile/invalid_file_size block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Get(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/unexpected_file block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Get(string,string) === RUN TestMultitenantCompactor_UploadBlockFile/valid_request block_upload_test.go:967: PASS: Exists(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Get(string,string) block_upload_test.go:967: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_UploadBlockFile/multiple_sequential_uploads_of_same_file --- PASS: TestMultitenantCompactor_UploadBlockFile (0.05s) --- PASS: TestMultitenantCompactor_UploadBlockFile/without_tenant_ID (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/without_block_ID (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/invalid_block_ID (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/without_path (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/invalid_path (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/empty_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/attempt_block_metadata_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/attempt_in-flight_block_metadata_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/block_upload_disabled (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/complete_block_already_exists (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/failure_checking_for_complete_block (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/failure_checking_for_in-flight_meta_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/missing_in-flight_meta_file (0.00s) --- PASS: TestMultitenantCompactor_UploadBlockFile/file_upload_fails (0.01s) --- PASS: TestMultitenantCompactor_UploadBlockFile/invalid_file_size (0.01s) --- PASS: TestMultitenantCompactor_UploadBlockFile/unexpected_file (0.02s) --- PASS: TestMultitenantCompactor_UploadBlockFile/valid_request (0.01s) --- PASS: TestMultitenantCompactor_UploadBlockFile/multiple_sequential_uploads_of_same_file (0.00s) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/without_tenant_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/without_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/invalid_block_ID === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/block_upload_disabled === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/complete_block_already_exists block_upload_test.go:1264: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/checking_for_complete_block_fails block_upload_test.go:1264: PASS: Exists(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/missing_in-flight_meta_file block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/downloading_in-flight_meta_file_fails block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/corrupt_in-flight_meta_file block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/uploading_meta_file_fails block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Upload(string,string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/removing_in-flight_meta_file_fails block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Upload(string,string,string) block_upload_test.go:1264: PASS: Delete(string,string) === RUN TestMultitenantCompactor_HandleBlockUpload_Complete/valid_request block_upload_test.go:1264: PASS: Exists(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Get(string,string) block_upload_test.go:1264: PASS: Upload(string,string,string) block_upload_test.go:1264: PASS: Delete(string,string) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete (0.06s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/without_tenant_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/without_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/invalid_block_ID (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/block_upload_disabled (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/complete_block_already_exists (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/checking_for_complete_block_fails (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/missing_in-flight_meta_file (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/downloading_in-flight_meta_file_fails (0.00s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/corrupt_in-flight_meta_file (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/uploading_meta_file_fails (0.01s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/removing_in-flight_meta_file_fails (0.02s) --- PASS: TestMultitenantCompactor_HandleBlockUpload_Complete/valid_request (0.01s) === RUN TestMultitenantCompactor_GetBlockUploadStateHandler === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/block_doesn't_exist === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/complete_block === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/upload_in_progress === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/validating === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/validation_failed === RUN TestMultitenantCompactor_GetBlockUploadStateHandler/stale_validation_file --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler (0.01s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/block_doesn't_exist (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/complete_block (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/upload_in_progress (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/validating (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/validation_failed (0.00s) --- PASS: TestMultitenantCompactor_GetBlockUploadStateHandler/stale_validation_file (0.00s) === RUN TestBlocksCleaner === RUN TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s === PAUSE TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s === RUN TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s === PAUSE TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s === RUN TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s === PAUSE TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s === RUN TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s === PAUSE TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s === CONT TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s --- PASS: TestBlocksCleaner (0.00s) --- PASS: TestBlocksCleaner/concurrency=10,_tenant_deletion_delay=0s (46.64s) --- PASS: TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=0s (47.56s) --- PASS: TestBlocksCleaner/concurrency=2,_tenant_deletion_delay=0s (47.57s) --- PASS: TestBlocksCleaner/concurrency=1,_tenant_deletion_delay=2h0m0s (48.43s) === RUN TestBlocksCleaner_ShouldContinueOnBlockDeletionFailure --- PASS: TestBlocksCleaner_ShouldContinueOnBlockDeletionFailure (15.96s) === RUN TestBlocksCleaner_ShouldRebuildBucketIndexOnCorruptedOne --- PASS: TestBlocksCleaner_ShouldRebuildBucketIndexOnCorruptedOne (13.96s) === RUN TestBlocksCleaner_ShouldRemoveMetricsForTenantsNotBelongingAnymoreToTheShard --- PASS: TestBlocksCleaner_ShouldRemoveMetricsForTenantsNotBelongingAnymoreToTheShard (19.35s) === RUN TestBlocksCleaner_ShouldNotCleanupUserThatDoesntBelongToShardAnymore --- PASS: TestBlocksCleaner_ShouldNotCleanupUserThatDoesntBelongToShardAnymore (7.09s) === RUN TestBlocksCleaner_ListBlocksOutsideRetentionPeriod --- PASS: TestBlocksCleaner_ListBlocksOutsideRetentionPeriod (11.42s) === RUN TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 14.815998ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 6.960999ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 9h0m0s logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 13.371998ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 6.724998ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level info component cleaner user user-1 msg applied retention: marking block for deletion block 01GXKXGNBQSXVF7JW68NBFW1S8 maxTime 1681045643000 logger.go:22: level info component cleaner user user-1 msg block has been marked for deletion block 01GXKXGNBQSXVF7JW68NBFW1S8 logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 18.924997ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 6.561999ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 7.294999ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 11.155999ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GXKXGNBQSXVF7JW68NBFW1S8/meta.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GXKXGNBQSXVF7JW68NBFW1S8/chunks/000001 bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GXKXGNBQSXVF7JW68NBFW1S8/index bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GXKXGNBQSXVF7JW68NBFW1S8/tombstones bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-1 msg deleted file file 01GXKXGNBQSXVF7JW68NBFW1S8/deletion-mark.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level info component cleaner user user-1 msg deleted block marked for deletion block 01GXKXGNBQSXVF7JW68NBFW1S8 logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 29.041995ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 9.996999ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-1 msg applying retention retention 7h0m0s logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 26.744995ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level debug component cleaner user user-2 msg applying retention retention 5h0m0s logger.go:22: level info component cleaner user user-2 msg applied retention: marking block for deletion block 01GXKXGY9HQ7P48DX6HKJ89WZ1 maxTime 1681045652000 logger.go:22: level info component cleaner user user-2 msg block has been marked for deletion block 01GXKXGY9HQ7P48DX6HKJ89WZ1 logger.go:22: level info component cleaner user user-2 msg applied retention: marking block for deletion block 01GXKXH488W3XZZ63GJX0JTQEY maxTime 1681052858000 logger.go:22: level info component cleaner user user-2 msg block has been marked for deletion block 01GXKXH488W3XZZ63GJX0JTQEY logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXGY9HQ7P48DX6HKJ89WZ1/meta.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXGY9HQ7P48DX6HKJ89WZ1/chunks/000001 bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXGY9HQ7P48DX6HKJ89WZ1/index bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXGY9HQ7P48DX6HKJ89WZ1/tombstones bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXGY9HQ7P48DX6HKJ89WZ1/deletion-mark.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level info component cleaner user user-2 msg deleted block marked for deletion block 01GXKXGY9HQ7P48DX6HKJ89WZ1 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXH488W3XZZ63GJX0JTQEY/meta.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXH488W3XZZ63GJX0JTQEY/chunks/000001 bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXH488W3XZZ63GJX0JTQEY/index bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXH488W3XZZ63GJX0JTQEY/tombstones bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level debug component cleaner user user-2 msg deleted file file 01GXKXH488W3XZZ63GJX0JTQEY/deletion-mark.json bucket fs: /tmp/TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod2852252756/001 logger.go:22: level info component cleaner user user-2 msg deleted block marked for deletion block 01GXKXH488W3XZZ63GJX0JTQEY logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 32.474995ms --- PASS: TestBlocksCleaner_ShouldRemoveBlocksOutsideRetentionPeriod (22.58s) === RUN TestBlocksCleaner_ShouldRemovePartialBlocksOutsideDelayPeriod logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level warn component cleaner user user-1 msg skipped partial block when updating bucket index block 01GXKXHBF0TKYZ3AC1E78YQ1FJ logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 19.950997ms logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level warn component cleaner user user-1 msg skipped partial block when updating bucket index block 01GXKXHBF0TKYZ3AC1E78YQ1FJ logger.go:22: level info component cleaner user user-1 msg stale partial block found: marking block for deletion block 01GXKXHBF0TKYZ3AC1E78YQ1FJ last modified 2023-04-10 05:07:51.290177255 +0800 CST logger.go:22: level info component cleaner user user-1 msg block has been marked for deletion block 01GXKXHBF0TKYZ3AC1E78YQ1FJ logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 18.314997ms --- PASS: TestBlocksCleaner_ShouldRemovePartialBlocksOutsideDelayPeriod (10.52s) === RUN TestBlocksCleaner_ShouldNotRemovePartialBlocksInsideDelayPeriod logger.go:22: level info component cleaner user user-1 msg started blocks cleanup and maintenance logger.go:22: level warn component cleaner user user-1 msg skipped partial block when updating bucket index block 01GXKXHNQBKB5KKQBC43JK1PWR logger.go:22: level info component cleaner user user-1 msg completed blocks cleanup and maintenance duration 7.358999ms logger.go:22: level info component cleaner user user-2 msg started blocks cleanup and maintenance logger.go:22: level error component cleaner user user-2 msg skipped block with corrupted meta.json when updating bucket index block 01GXKXHVFRV4TA80BJJHMHMBX8 err unmarshal block meta file 01GXKXHVFRV4TA80BJJHMHMBX8/meta.json: invalid character 'c' looking for beginning of value: meta.json corrupted logger.go:22: level info component cleaner user user-2 msg completed blocks cleanup and maintenance duration 10.484998ms --- PASS: TestBlocksCleaner_ShouldNotRemovePartialBlocksInsideDelayPeriod (11.27s) === RUN TestBlocksCleaner_ShouldNotRemovePartialBlocksIfConfiguredDelayIsInvalid --- PASS: TestBlocksCleaner_ShouldNotRemovePartialBlocksIfConfiguredDelayIsInvalid (4.94s) === RUN TestFindMostRecentModifiedTimeForBlock --- PASS: TestFindMostRecentModifiedTimeForBlock (5.18s) === RUN TestSyncer_GarbageCollect_e2e === PAUSE TestSyncer_GarbageCollect_e2e === RUN TestGroupCompactE2E === PAUSE TestGroupCompactE2E === RUN TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly === PAUSE TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly === RUN TestGroupKey === RUN TestGroupKey/#00 === RUN TestGroupKey/#01 === RUN TestGroupKey/#02 === RUN TestGroupKey/#03 --- PASS: TestGroupKey (0.00s) --- PASS: TestGroupKey/#00 (0.00s) --- PASS: TestGroupKey/#01 (0.00s) --- PASS: TestGroupKey/#02 (0.00s) --- PASS: TestGroupKey/#03 (0.00s) === RUN TestGroupMaxMinTime --- PASS: TestGroupMaxMinTime (0.00s) === RUN TestFilterOwnJobs === RUN TestFilterOwnJobs/should_return_all_planned_jobs_if_the_compactor_instance_owns_all_of_them === RUN TestFilterOwnJobs/should_return_no_jobs_if_the_compactor_instance_owns_none_of_them === RUN TestFilterOwnJobs/should_return_some_jobs_if_the_compactor_instance_owns_some_of_them --- PASS: TestFilterOwnJobs (0.00s) --- PASS: TestFilterOwnJobs/should_return_all_planned_jobs_if_the_compactor_instance_owns_all_of_them (0.00s) --- PASS: TestFilterOwnJobs/should_return_no_jobs_if_the_compactor_instance_owns_none_of_them (0.00s) --- PASS: TestFilterOwnJobs/should_return_some_jobs_if_the_compactor_instance_owns_some_of_them (0.00s) === RUN TestBlockMaxTimeDeltas --- PASS: TestBlockMaxTimeDeltas (0.00s) === RUN TestNoCompactionMarkFilter === RUN TestNoCompactionMarkFilter/filter_with_no_deletion_of_blocks_marked_for_no-compaction === RUN TestNoCompactionMarkFilter/filter_with_deletion_enabled === RUN TestNoCompactionMarkFilter/filter_with_deletion_enabled,_but_canceled_context === RUN TestNoCompactionMarkFilter/filtering_block_with_wrong_marker_version --- PASS: TestNoCompactionMarkFilter (0.00s) --- PASS: TestNoCompactionMarkFilter/filter_with_no_deletion_of_blocks_marked_for_no-compaction (0.00s) --- PASS: TestNoCompactionMarkFilter/filter_with_deletion_enabled (0.00s) --- PASS: TestNoCompactionMarkFilter/filter_with_deletion_enabled,_but_canceled_context (0.00s) --- PASS: TestNoCompactionMarkFilter/filtering_block_with_wrong_marker_version (0.00s) === RUN TestConvertCompactionResultToForEachJobs --- PASS: TestConvertCompactionResultToForEachJobs (0.00s) === RUN TestConfig_ShouldSupportYamlConfig --- PASS: TestConfig_ShouldSupportYamlConfig (0.00s) === RUN TestConfig_ShouldSupportCliFlags --- PASS: TestConfig_ShouldSupportCliFlags (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_fail_with_non_divisible_block_range_periods === RUN TestConfig_Validate/should_fail_on_unknown_compaction_jobs_order === RUN TestConfig_Validate/should_fail_on_invalid_value_of_max-opening-blocks-concurrency === RUN TestConfig_Validate/should_fail_on_invalid_value_of_max-closing-blocks-concurrency === RUN TestConfig_Validate/should_fail_on_invalid_value_of_symbols-flushers-concurrency === RUN TestConfig_Validate/should_pass_with_the_default_config === RUN TestConfig_Validate/should_pass_with_only_1_block_range_period --- PASS: TestConfig_Validate (0.01s) --- PASS: TestConfig_Validate/should_fail_with_non_divisible_block_range_periods (0.00s) --- PASS: TestConfig_Validate/should_fail_on_unknown_compaction_jobs_order (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_value_of_max-opening-blocks-concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_value_of_max-closing-blocks-concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_value_of_symbols-flushers-concurrency (0.00s) --- PASS: TestConfig_Validate/should_pass_with_the_default_config (0.00s) --- PASS: TestConfig_Validate/should_pass_with_only_1_block_range_period (0.00s) === RUN TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks === PAUSE TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks === RUN TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket === PAUSE TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket === RUN TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant === PAUSE TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant === RUN TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction === PAUSE TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction === RUN TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime === PAUSE TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime === RUN TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion === PAUSE TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion === RUN TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction === PAUSE TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction === RUN TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion === PAUSE TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion === RUN TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning === PAUSE TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning === RUN TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning === PAUSE TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning === RUN TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning === PAUSE TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning === RUN TestMultitenantCompactor_DeleteLocalSyncFiles --- PASS: TestMultitenantCompactor_DeleteLocalSyncFiles (6.56s) === RUN TestMultitenantCompactor_ShouldFailCompactionOnTimeout === PAUSE TestMultitenantCompactor_ShouldFailCompactionOnTimeout === RUN TestOwnUser === RUN TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size === PAUSE TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size === RUN TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes === PAUSE TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes === RUN TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size === PAUSE TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size === CONT TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size === CONT TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size === CONT TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes --- PASS: TestOwnUser (0.00s) --- PASS: TestOwnUser/5_compactors,_sharding_enabled,_no_compactor_shard_size (3.60s) --- PASS: TestOwnUser/10_compactors,_sharding_enabled,_with_non-zero_shard_sizes (4.00s) --- PASS: TestOwnUser/10_compactors,_sharding_enabled,_with_zero_shard_size (4.29s) === RUN TestMultitenantCompactor_OutOfOrderCompaction --- PASS: TestMultitenantCompactor_OutOfOrderCompaction (9.34s) === RUN TestSortJobsBySmallestRangeOldestBlocksFirst === RUN TestSortJobsBySmallestRangeOldestBlocksFirst/should_do_nothing_on_empty_input === RUN TestSortJobsBySmallestRangeOldestBlocksFirst/should_sort_jobs_by_smallest_range,_oldest_blocks_first === RUN TestSortJobsBySmallestRangeOldestBlocksFirst/split_jobs_are_always_sorted_first --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst (0.00s) --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst/should_do_nothing_on_empty_input (0.00s) --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst/should_sort_jobs_by_smallest_range,_oldest_blocks_first (0.00s) --- PASS: TestSortJobsBySmallestRangeOldestBlocksFirst/split_jobs_are_always_sorted_first (0.00s) === RUN TestSortJobsByNewestBlocksFirst === RUN TestSortJobsByNewestBlocksFirst/should_sort_jobs_by_newest_blocks_first job_sorting_test.go:127: sorted jobs: job_sorting_test.go:129: - (minTime: 40 maxTime: 80) job_sorting_test.go:129: - (minTime: 10 maxTime: 30) job_sorting_test.go:129: - (minTime: 10 maxTime: 20) === RUN TestSortJobsByNewestBlocksFirst/should_give_precedence_to_smaller_time_ranges_in_case_of_multiple_jobs_with_the_same_max_time job_sorting_test.go:127: sorted jobs: job_sorting_test.go:129: - (minTime: 30 maxTime: 40) job_sorting_test.go:129: - (minTime: 10 maxTime: 40) === RUN TestSortJobsByNewestBlocksFirst/should_give_precedence_to_newest_blocks_over_smaller_time_ranges job_sorting_test.go:127: sorted jobs: job_sorting_test.go:129: - (minTime: 10 maxTime: 40) job_sorting_test.go:129: - (minTime: 10 maxTime: 30) job_sorting_test.go:129: - (minTime: 10 maxTime: 20) === RUN TestSortJobsByNewestBlocksFirst/should_do_nothing_on_empty_input job_sorting_test.go:127: sorted jobs: --- PASS: TestSortJobsByNewestBlocksFirst (0.02s) --- PASS: TestSortJobsByNewestBlocksFirst/should_sort_jobs_by_newest_blocks_first (0.01s) --- PASS: TestSortJobsByNewestBlocksFirst/should_give_precedence_to_smaller_time_ranges_in_case_of_multiple_jobs_with_the_same_max_time (0.00s) --- PASS: TestSortJobsByNewestBlocksFirst/should_give_precedence_to_newest_blocks_over_smaller_time_ranges (0.01s) --- PASS: TestSortJobsByNewestBlocksFirst/should_do_nothing_on_empty_input (0.00s) === RUN TestLabelRemoverFilter === RUN TestLabelRemoverFilter/should_remove_configured_labels_2 === RUN TestLabelRemoverFilter/should_remove_configured_labels --- PASS: TestLabelRemoverFilter (0.00s) --- PASS: TestLabelRemoverFilter/should_remove_configured_labels_2 (0.00s) --- PASS: TestLabelRemoverFilter/should_remove_configured_labels (0.00s) === RUN TestShardAwareDeduplicateFilter_Filter === RUN TestShardAwareDeduplicateFilter_Filter/3_compacted_blocks_of_level_2_and_one_compacted_block_of_level_3_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/blocks_with_same_sources_and_different_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/when_invalid_shard_IDs_present,_no_deduplication_happens_for_source_blocks === RUN TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_same_sources === RUN TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_overlapping_sources === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length_and_different_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/block_with_invalid_shardID_cannot_'include'_its_source_blocks === RUN TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level === RUN TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level,_with_various_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/3_non_compacted_blocks_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_equal_length === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources_and_different_resolutions === RUN TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_single_shard === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources === RUN TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length === RUN TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_two_shards === RUN TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split_into_two,_one_shard_missing === RUN TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards === RUN TestShardAwareDeduplicateFilter_Filter/compacted_block_without_sources_in_bucket === RUN TestShardAwareDeduplicateFilter_Filter/4_non_compacted_blocks_and_compacted_block_of_level_2_in_bucket --- PASS: TestShardAwareDeduplicateFilter_Filter (0.03s) --- PASS: TestShardAwareDeduplicateFilter_Filter/3_compacted_blocks_of_level_2_and_one_compacted_block_of_level_3_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/blocks_with_same_sources_and_different_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/when_invalid_shard_IDs_present,_no_deduplication_happens_for_source_blocks (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_same_sources (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_compacted_blocks_with_overlapping_sources (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length_and_different_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/block_with_invalid_shardID_cannot_'include'_its_source_blocks (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards,_plus_another_level,_with_various_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/3_non_compacted_blocks_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_equal_length (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources_and_different_resolutions (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_single_shard (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_with_overlapping_sources (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_blocks_of_level_3_with_overlapping_sources_of_different_length (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split,_with_two_shards (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/two_blocks_merged_and_split_into_two,_one_shard_missing (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/four_base_blocks_merged_and_split_into_2_separate_shards (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/compacted_block_without_sources_in_bucket (0.00s) --- PASS: TestShardAwareDeduplicateFilter_Filter/4_non_compacted_blocks_and_compacted_block_of_level_2_in_bucket (0.00s) === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner run_id=1681074532 msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=7.982998ms level=info component=cleaner run_id=1681074532 msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=17.156998ms duration_ms=17 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GXKXJYDB88JC9TD3RE47APST (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GXKXK2WA9VW7K6F913QXH4RN (min time: 1970-01-01 00:01:00 +0000 UTC, max time: 1970-01-01 00:07:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXJYDB88JC9TD3RE47APST (min time: 0, max time: 300000) 01GXKXK2WA9VW7K6F913QXH4RN (min time: 60000, max time: 420000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXK2WA9VW7K6F913QXH4RN/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXJYDB88JC9TD3RE47APST/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXJYDB88JC9TD3RE47APST /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXK2WA9VW7K6F913QXH4RN]" duration=14.006998ms duration_ms=14 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=420000 ulid=01GXKXKC3FJ194WWS6A1F2P389 sources="[01GXKXK2WA9VW7K6F913QXH4RN 01GXKXJYDB88JC9TD3RE47APST]" duration=7.482172775s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=420000 ulid=01GXKXKC3FZYY3TJDR1CYNCQ7N sources="[01GXKXK2WA9VW7K6F913QXH4RN 01GXKXJYDB88JC9TD3RE47APST]" duration=7.482350775s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="compacted blocks" new="[01GXKXKC3FJ194WWS6A1F2P389 01GXKXKC3FZYY3TJDR1CYNCQ7N]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXJYDB88JC9TD3RE47APST /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXK2WA9VW7K6F913QXH4RN]" duration=7.482657775s duration_ms=7482 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXKC3FZYY3TJDR1CYNCQ7N/chunks/000001 dst=01GXKXKC3FZYY3TJDR1CYNCQ7N/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXKC3FZYY3TJDR1CYNCQ7N/index dst=01GXKXKC3FZYY3TJDR1CYNCQ7N/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded block" result_block=01GXKXKC3FZYY3TJDR1CYNCQ7N duration=3.655ms duration_ms=3 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXKC3FJ194WWS6A1F2P389/chunks/000001 dst=01GXKXKC3FJ194WWS6A1F2P389/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXKC3FJ194WWS6A1F2P389/index dst=01GXKXKC3FJ194WWS6A1F2P389/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split2725464508/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded block" result_block=01GXKXKC3FJ194WWS6A1F2P389 duration=3.829ms duration_ms=3 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=13.057998ms duration_ms=13 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXJYDB88JC9TD3RE47APST level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXJYDB88JC9TD3RE47APST level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXK2WA9VW7K6F913QXH4RN level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXK2WA9VW7K6F913QXH4RN level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:07:00 +0000 UTC" msg="compaction job succeeded" duration=7.51482877s duration_ms=7514 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=5.861999ms duration_ms=5 cached=5 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=9.688998ms duration_ms=9 cached=5 returned=3 partial=0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/should_correctly_handle_empty_blocks_generated_in_the_splitting_stage level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=cleaner run_id=1681074544 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=8.503998ms level=info component=cleaner run_id=1681074544 msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=3.356ms duration_ms=3 cached=1 returned=1 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GXKXKKM4APCS393MTZGFNZV1 (min time: 1970-01-01 03:59:59.999 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=1 plan="[01GXKXKKM4APCS393MTZGFNZV1 (min time: 14399999, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXKKM4APCS393MTZGFNZV1/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=1 plan=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3553599635/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXKKM4APCS393MTZGFNZV1] duration=5.628999ms duration_ms=5 level=info component=compactor msg="compact blocks" count=1 mint=14399999 maxt=14400000 ulid=01GXKXKR0CM1KA7YSD3ER6ZYF2 sources=[01GXKXKKM4APCS393MTZGFNZV1] duration=4.844135207s shard=1_of_2 level=info component=compactor msg="compact blocks resulted in empty block" count=1 sources=[01GXKXKKM4APCS393MTZGFNZV1] duration=4.844306206s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GXKXKR0CM1KA7YSD3ER6ZYF2 00000000000000000000000000]" blocks=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3553599635/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXKKM4APCS393MTZGFNZV1] duration=4.844521206s duration_ms=4844 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction produced an empty block" shard_id=2_of_2 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3553599635/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXKR0CM1KA7YSD3ER6ZYF2/chunks/000001 dst=01GXKXKR0CM1KA7YSD3ER6ZYF2/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3553599635/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3553599635/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXKR0CM1KA7YSD3ER6ZYF2/index dst=01GXKXKR0CM1KA7YSD3ER6ZYF2/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorshould_correctly_handle_empty_blocks_generated_in_the_splitting_stage3553599635/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXKR0CM1KA7YSD3ER6ZYF2 duration=3.133ms duration_ms=3 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=5.531ms duration_ms=5 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXKKM4APCS393MTZGFNZV1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXKKM4APCS393MTZGFNZV1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 03:59:59.999 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=4.858456204s duration_ms=4858 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=18.137997ms duration_ms=18 cached=2 returned=1 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=4.290999ms duration_ms=4 cached=2 returned=1 partial=0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0 level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner run_id=1681074599 msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=14.557997ms duration_ms=14 cached=10 returned=10 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 1_of_2, blocks: 01GXKXMP6DV0FR152AZY89B895 (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GXKXMZ41PZKV89AD7GTEQ91S (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 2_of_2, blocks: 01GXKXMTZGQ46FXAG09ASWCBRP (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GXKXN2K09RHF0G7071B1TNHT (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge--28800000-57600000 job="stage: merge, range start: 28800000, range end: 57600000, shard: , blocks: 01GXKXN66Y1JBY17STYV5GSGQ2 (min time: 1970-01-01 08:00:00 +0000 UTC, max time: 1970-01-01 10:00:00 +0000 UTC),01GXKXN9GBBXSPAC036HFZRA0D (min time: 1970-01-01 14:00:00 +0000 UTC, max time: 1970-01-01 16:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge--7200000-14400000 job="stage: merge, range start: 7200000, range end: 14400000, shard: , blocks: 01GXKXM8YFZBSD9Z3KMSM3SFZ9 (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GXKXMFE0S3VR9K4V5MJZ7HT1 (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXM8YFZBSD9Z3KMSM3SFZ9 (min time: 7200000, max time: 14400000) 01GXKXMFE0S3VR9K4V5MJZ7HT1 (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXMFE0S3VR9K4V5MJZ7HT1/meta.json level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=41.741993ms level=info component=cleaner run_id=1681074599 msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXM8YFZBSD9Z3KMSM3SFZ9/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--7200000-14400000/01GXKXM8YFZBSD9Z3KMSM3SFZ9 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--7200000-14400000/01GXKXMFE0S3VR9K4V5MJZ7HT1]" duration=25.925995ms duration_ms=25 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GXKXNDCGTBHRVT4JXEQZR483 sources="[01GXKXMFE0S3VR9K4V5MJZ7HT1 01GXKXM8YFZBSD9Z3KMSM3SFZ9]" duration=3.501441427s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new=[01GXKXNDCGTBHRVT4JXEQZR483] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--7200000-14400000/01GXKXM8YFZBSD9Z3KMSM3SFZ9 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--7200000-14400000/01GXKXMFE0S3VR9K4V5MJZ7HT1]" duration=3.501835427s duration_ms=3501 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--7200000-14400000/01GXKXNDCGTBHRVT4JXEQZR483/chunks/000001" dst=01GXKXNDCGTBHRVT4JXEQZR483/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--7200000-14400000/01GXKXNDCGTBHRVT4JXEQZR483/index" dst=01GXKXNDCGTBHRVT4JXEQZR483/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXNDCGTBHRVT4JXEQZR483 duration=3.775ms duration_ms=3 external_labels={} level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=6.955999ms duration_ms=6 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXM8YFZBSD9Z3KMSM3SFZ9 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXM8YFZBSD9Z3KMSM3SFZ9 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXMFE0S3VR9K4V5MJZ7HT1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXMFE0S3VR9K4V5MJZ7HT1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=3.54087142s duration_ms=3540 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXMP6DV0FR152AZY89B895 (min time: 14400000, max time: 21600000) 01GXKXMZ41PZKV89AD7GTEQ91S (min time: 21600000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXMZ41PZKV89AD7GTEQ91S/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXMP6DV0FR152AZY89B895/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GXKXMP6DV0FR152AZY89B895 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GXKXMZ41PZKV89AD7GTEQ91S]" duration=6.520999ms duration_ms=6 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=14400000 maxt=28800000 ulid=01GXKXNGTJC3KDJ85VNR7900FJ sources="[01GXKXMZ41PZKV89AD7GTEQ91S 01GXKXMP6DV0FR152AZY89B895]" duration=3.84564337s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GXKXNGTJC3KDJ85VNR7900FJ] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GXKXMP6DV0FR152AZY89B895 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GXKXMZ41PZKV89AD7GTEQ91S]" duration=3.859497368s duration_ms=3859 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GXKXNGTJC3KDJ85VNR7900FJ/chunks/000001" dst=01GXKXNGTJC3KDJ85VNR7900FJ/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-14400000-28800000/01GXKXNGTJC3KDJ85VNR7900FJ/index" dst=01GXKXNGTJC3KDJ85VNR7900FJ/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXNGTJC3KDJ85VNR7900FJ duration=9.570998ms duration_ms=9 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=23.020996ms duration_ms=23 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXMP6DV0FR152AZY89B895 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXMP6DV0FR152AZY89B895 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXMZ41PZKV89AD7GTEQ91S level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXMZ41PZKV89AD7GTEQ91S level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job succeeded" duration=3.899690361s duration_ms=3899 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXMTZGQ46FXAG09ASWCBRP (min time: 14400000, max time: 21600000) 01GXKXN2K09RHF0G7071B1TNHT (min time: 21600000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXN2K09RHF0G7071B1TNHT/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXMTZGQ46FXAG09ASWCBRP/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GXKXMTZGQ46FXAG09ASWCBRP /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GXKXN2K09RHF0G7071B1TNHT]" duration=29.320995ms duration_ms=29 level=info component=compactor msg="compact blocks" count=2 mint=14400000 maxt=28800000 ulid=01GXKXNMNF089YPXBAP702NS4D sources="[01GXKXMTZGQ46FXAG09ASWCBRP 01GXKXN2K09RHF0G7071B1TNHT]" duration=3.440376437s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compacted blocks" new=[01GXKXNMNF089YPXBAP702NS4D] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GXKXMTZGQ46FXAG09ASWCBRP /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GXKXN2K09RHF0G7071B1TNHT]" duration=3.440734437s duration_ms=3440 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GXKXNMNF089YPXBAP702NS4D/chunks/000001" dst=01GXKXNMNF089YPXBAP702NS4D/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-2_of_2-14400000-28800000/01GXKXNMNF089YPXBAP702NS4D/index" dst=01GXKXNMNF089YPXBAP702NS4D/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXNMNF089YPXBAP702NS4D duration=4.016999ms duration_ms=4 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=7.000998ms duration_ms=7 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXMTZGQ46FXAG09ASWCBRP level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXMTZGQ46FXAG09ASWCBRP level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXN2K09RHF0G7071B1TNHT level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXN2K09RHF0G7071B1TNHT level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 minTime="1970-01-01 04:00:00 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job succeeded" duration=3.488744429s duration_ms=3488 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXN66Y1JBY17STYV5GSGQ2 (min time: 28800000, max time: 36000000) 01GXKXN9GBBXSPAC036HFZRA0D (min time: 50400000, max time: 57600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXN9GBBXSPAC036HFZRA0D/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXN66Y1JBY17STYV5GSGQ2/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--28800000-57600000/01GXKXN66Y1JBY17STYV5GSGQ2 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--28800000-57600000/01GXKXN9GBBXSPAC036HFZRA0D]" duration=6.126999ms duration_ms=6 level=info component=compactor msg="compact blocks" count=2 mint=28800000 maxt=57600000 ulid=01GXKXNR1KGH6VYYSBZH5XEE3H sources="[01GXKXN66Y1JBY17STYV5GSGQ2 01GXKXN9GBBXSPAC036HFZRA0D]" duration=3.733687389s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compacted blocks" new=[01GXKXNR1KGH6VYYSBZH5XEE3H] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--28800000-57600000/01GXKXN66Y1JBY17STYV5GSGQ2 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--28800000-57600000/01GXKXN9GBBXSPAC036HFZRA0D]" duration=3.734361389s duration_ms=3734 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--28800000-57600000/01GXKXNR1KGH6VYYSBZH5XEE3H/chunks/000001" dst=01GXKXNR1KGH6VYYSBZH5XEE3H/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge--28800000-57600000/01GXKXNR1KGH6VYYSBZH5XEE3H/index" dst=01GXKXNR1KGH6VYYSBZH5XEE3H/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXNR1KGH6VYYSBZH5XEE3H duration=3.686ms duration_ms=3 external_labels={} level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=6.668999ms duration_ms=6 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXN66Y1JBY17STYV5GSGQ2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXN66Y1JBY17STYV5GSGQ2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXN9GBBXSPAC036HFZRA0D level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXN9GBBXSPAC036HFZRA0D level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--28800000-57600000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 16:00:00 +0000 UTC" msg="compaction job succeeded" duration=3.752427386s duration_ms=3752 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=8.363999ms duration_ms=8 cached=14 returned=6 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 job="stage: merge, range start: 0, range end: 28800000, shard: 1_of_2, blocks: 01GXKXKX4CV2HW6SZY0PZ9AVTB (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC),01GXKXNGTJC3KDJ85VNR7900FJ (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-0-28800000 job="stage: merge, range start: 0, range end: 28800000, shard: 2_of_2, blocks: 01GXKXM2YCGBX06KT2ZGSCDP7X (min time: 1970-01-01 00:00:00.001 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC),01GXKXNMNF089YPXBAP702NS4D (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXKX4CV2HW6SZY0PZ9AVTB (min time: 1, max time: 7200000) 01GXKXNGTJC3KDJ85VNR7900FJ (min time: 14400000, max time: 28800000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXKX4CV2HW6SZY0PZ9AVTB/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXNGTJC3KDJ85VNR7900FJ/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GXKXKX4CV2HW6SZY0PZ9AVTB /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GXKXNGTJC3KDJ85VNR7900FJ]" duration=8.896999ms duration_ms=8 split_merge_compactor_test.go:640: expected , got Diff: --- metric output does not match expectation; want +++ got: @@ -2,3 +2,3 @@ # TYPE cortex_compactor_runs_completed_total counter -cortex_compactor_runs_completed_total 1 +cortex_compactor_runs_completed_total 0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor level=error component=compactor user=user-1 groupKey=0@17241709254077376921-merge-1_of_2-0-28800000 minTime="1970-01-01 00:00:00.001 +0000 UTC" maxTime="1970-01-01 08:00:00 +0000 UTC" msg="compaction job failed" duration=3.259986466s duration_ms=3259 err="compact blocks [/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GXKXKX4CV2HW6SZY0PZ9AVTB /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GXKXNGTJC3KDJ85VNR7900FJ]: 2 errors: populate block: adding series: asyncBlockWriter doesn't run anymore: add series: context canceled; context canceled" level=error component=compactor msg="failed to compact user blocks" user=user-1 err="compaction: group 0@17241709254077376921-merge-1_of_2-0-28800000: compact blocks [/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GXKXKX4CV2HW6SZY0PZ9AVTB /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_02654901834/001/compact/0@17241709254077376921-merge-1_of_2-0-28800000/01GXKXNGTJC3KDJ85VNR7900FJ]: 2 errors: populate block: adding series: asyncBlockWriter doesn't run anymore: add series: context canceled; context canceled" === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner run_id=1681074625 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=3.972999ms duration_ms=3 cached=2 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GXKXNYZKYXNSN0PCMK0CBPR3 (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GXKXP22B0YXQWWFMJ8B771G8 (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=10.323998ms level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXNYZKYXNSN0PCMK0CBPR3 (min time: 7200000, max time: 14400000) 01GXKXP22B0YXQWWFMJ8B771G8 (min time: 7200000, max time: 14400000)]" level=info component=cleaner run_id=1681074625 msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXNYZKYXNSN0PCMK0CBPR3/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXP22B0YXQWWFMJ8B771G8/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXNYZKYXNSN0PCMK0CBPR3 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXP22B0YXQWWFMJ8B771G8]" duration=6.524999ms duration_ms=6 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GXKXP6H18J7VV0FG7BP4D590 sources="[01GXKXNYZKYXNSN0PCMK0CBPR3 01GXKXP22B0YXQWWFMJ8B771G8]" duration=7.649804747s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GXKXP6H1VSN6ZYA1731AB79D sources="[01GXKXNYZKYXNSN0PCMK0CBPR3 01GXKXP22B0YXQWWFMJ8B771G8]" duration=7.653662747s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GXKXP6H18J7VV0FG7BP4D590 01GXKXP6H1VSN6ZYA1731AB79D]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXNYZKYXNSN0PCMK0CBPR3 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXP22B0YXQWWFMJ8B771G8]" duration=7.654648747s duration_ms=7654 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXP6H1VSN6ZYA1731AB79D/chunks/000001 dst=01GXKXP6H1VSN6ZYA1731AB79D/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXP6H1VSN6ZYA1731AB79D/index dst=01GXKXP6H1VSN6ZYA1731AB79D/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXP6H1VSN6ZYA1731AB79D duration=3.3ms duration_ms=3 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXP6H18J7VV0FG7BP4D590/chunks/000001 dst=01GXKXP6H18J7VV0FG7BP4D590/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXP6H18J7VV0FG7BP4D590/index dst=01GXKXP6H18J7VV0FG7BP4D590/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split2244429701/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXP6H18J7VV0FG7BP4D590 duration=13.059998ms duration_ms=13 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=22.038996ms duration_ms=22 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXNYZKYXNSN0PCMK0CBPR3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXNYZKYXNSN0PCMK0CBPR3 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXP22B0YXQWWFMJ8B771G8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXP22B0YXQWWFMJ8B771G8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=7.688020741s duration_ms=7688 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=9.827999ms duration_ms=9 cached=4 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=10.894998ms duration_ms=10 cached=4 returned=2 partial=0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner run_id=1681074643 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=12.920998ms level=info component=cleaner run_id=1681074643 msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=6.396999ms duration_ms=6 cached=2 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GXKXPEAEHS37EV3SGR8HZX8M (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GXKXPMF3XZ799K7C70SVVDHV (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXPEAEHS37EV3SGR8HZX8M (min time: 7200000, max time: 14400000) 01GXKXPMF3XZ799K7C70SVVDHV (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXPMF3XZ799K7C70SVVDHV/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXPEAEHS37EV3SGR8HZX8M/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXPEAEHS37EV3SGR8HZX8M /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXPMF3XZ799K7C70SVVDHV]" duration=15.977997ms duration_ms=15 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GXKXPRHCP00SNAG70WJ7DY7Y sources="[01GXKXPEAEHS37EV3SGR8HZX8M 01GXKXPMF3XZ799K7C70SVVDHV]" duration=7.661708746s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GXKXPRHCE808Y4JMYNA0YNK5 sources="[01GXKXPEAEHS37EV3SGR8HZX8M 01GXKXPMF3XZ799K7C70SVVDHV]" duration=7.661933746s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GXKXPRHCP00SNAG70WJ7DY7Y 01GXKXPRHCE808Y4JMYNA0YNK5]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXPEAEHS37EV3SGR8HZX8M /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXPMF3XZ799K7C70SVVDHV]" duration=7.662267746s duration_ms=7662 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXPRHCE808Y4JMYNA0YNK5/chunks/000001 dst=01GXKXPRHCE808Y4JMYNA0YNK5/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXPRHCE808Y4JMYNA0YNK5/index dst=01GXKXPRHCE808Y4JMYNA0YNK5/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXPRHCE808Y4JMYNA0YNK5 duration=3.782ms duration_ms=3 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXPRHCP00SNAG70WJ7DY7Y/chunks/000001 dst=01GXKXPRHCP00SNAG70WJ7DY7Y/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXPRHCP00SNAG70WJ7DY7Y/index dst=01GXKXPRHCP00SNAG70WJ7DY7Y/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split3153695817/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXPRHCP00SNAG70WJ7DY7Y duration=8.578999ms duration_ms=8 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=16.717997ms duration_ms=16 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXPEAEHS37EV3SGR8HZX8M level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXPEAEHS37EV3SGR8HZX8M level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXPMF3XZ799K7C70SVVDHV level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXPMF3XZ799K7C70SVVDHV level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=7.710193737s duration_ms=7710 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=9.652998ms duration_ms=9 cached=4 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=14.957998ms duration_ms=14 cached=4 returned=2 partial=0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner run_id=1681074669 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=8.447999ms duration_ms=8 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GXKXQ0B0YY49X6KTBWVS5WS7 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GXKXQ61DYQMQQB79XKY3D1H9 (min time: 1970-01-01 00:05:00 +0000 UTC, max time: 1970-01-01 00:10:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXQ0B0YY49X6KTBWVS5WS7 (min time: 0, max time: 300000) 01GXKXQ61DYQMQQB79XKY3D1H9 (min time: 300000, max time: 600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXQ61DYQMQQB79XKY3D1H9/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXQ0B0YY49X6KTBWVS5WS7/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQ0B0YY49X6KTBWVS5WS7 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQ61DYQMQQB79XKY3D1H9]" duration=9.635998ms duration_ms=9 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=36.766994ms level=info component=cleaner run_id=1681074669 msg="successfully completed blocks cleanup and maintenance" level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GXKXQJB2GVJW93FPNNTTRX2M sources="[01GXKXQ0B0YY49X6KTBWVS5WS7 01GXKXQ61DYQMQQB79XKY3D1H9]" duration=11.550737109s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GXKXQJB243XNXS6GD2B1417P sources="[01GXKXQ0B0YY49X6KTBWVS5WS7 01GXKXQ61DYQMQQB79XKY3D1H9]" duration=11.551209109s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compacted blocks" new="[01GXKXQJB2GVJW93FPNNTTRX2M 01GXKXQJB243XNXS6GD2B1417P]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQ0B0YY49X6KTBWVS5WS7 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQ61DYQMQQB79XKY3D1H9]" duration=11.551845109s duration_ms=11551 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQJB2GVJW93FPNNTTRX2M/chunks/000001 dst=01GXKXQJB2GVJW93FPNNTTRX2M/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQJB2GVJW93FPNNTTRX2M/index dst=01GXKXQJB2GVJW93FPNNTTRX2M/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQJB243XNXS6GD2B1417P/chunks/000001 dst=01GXKXQJB243XNXS6GD2B1417P/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQJB243XNXS6GD2B1417P/index dst=01GXKXQJB243XNXS6GD2B1417P/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split3508558865/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GXKXQJB243XNXS6GD2B1417P duration=4.657999ms duration_ms=4 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GXKXQJB2GVJW93FPNNTTRX2M duration=11.986998ms duration_ms=11 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=15.244997ms duration_ms=15 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXQ0B0YY49X6KTBWVS5WS7 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXQ0B0YY49X6KTBWVS5WS7 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXQ61DYQMQQB79XKY3D1H9 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXQ61DYQMQQB79XKY3D1H9 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction job succeeded" duration=11.594282101s duration_ms=11594 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=9.738998ms duration_ms=9 cached=5 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=11.542998ms duration_ms=11 cached=5 returned=3 partial=0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner run_id=1681074699 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=22.570997ms level=info component=cleaner run_id=1681074699 msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=33.413995ms duration_ms=33 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GXKXQXV24T4RHTA819JPMD9J (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GXKXR2STJ09DA0WMBJBFF4DS (min time: 1970-01-01 00:07:00 +0000 UTC, max time: 1970-01-01 00:10:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXQXV24T4RHTA819JPMD9J (min time: 0, max time: 300000) 01GXKXR2STJ09DA0WMBJBFF4DS (min time: 420000, max time: 600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXR2STJ09DA0WMBJBFF4DS/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXQXV24T4RHTA819JPMD9J/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQXV24T4RHTA819JPMD9J /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXR2STJ09DA0WMBJBFF4DS]" duration=12.787998ms duration_ms=12 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GXKXRFBMNCTYBQ0PX8AHAD80 sources="[01GXKXQXV24T4RHTA819JPMD9J 01GXKXR2STJ09DA0WMBJBFF4DS]" duration=8.317689638s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GXKXRFBMAY86TZAWX3E2AM64 sources="[01GXKXQXV24T4RHTA819JPMD9J 01GXKXR2STJ09DA0WMBJBFF4DS]" duration=8.317919638s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compacted blocks" new="[01GXKXRFBMNCTYBQ0PX8AHAD80 01GXKXRFBMAY86TZAWX3E2AM64]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXQXV24T4RHTA819JPMD9J /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXR2STJ09DA0WMBJBFF4DS]" duration=8.318283638s duration_ms=8318 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXRFBMAY86TZAWX3E2AM64/chunks/000001 dst=01GXKXRFBMAY86TZAWX3E2AM64/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXRFBMAY86TZAWX3E2AM64/index dst=01GXKXRFBMAY86TZAWX3E2AM64/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GXKXRFBMAY86TZAWX3E2AM64 duration=4.012ms duration_ms=4 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXRFBMNCTYBQ0PX8AHAD80/chunks/000001 dst=01GXKXRFBMNCTYBQ0PX8AHAD80/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXRFBMNCTYBQ0PX8AHAD80/index dst=01GXKXRFBMNCTYBQ0PX8AHAD80/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactornon-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split1690583794/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GXKXRFBMNCTYBQ0PX8AHAD80 duration=11.241998ms duration_ms=11 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=29.977995ms duration_ms=29 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXQXV24T4RHTA819JPMD9J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXQXV24T4RHTA819JPMD9J level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXR2STJ09DA0WMBJBFF4DS level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXR2STJ09DA0WMBJBFF4DS level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction job succeeded" duration=8.373069629s duration_ms=8373 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=8.520999ms duration_ms=8 cached=5 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=19.228997ms duration_ms=19 cached=5 returned=3 partial=0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/smaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=cleaner run_id=1681074767 msg="started blocks cleanup and maintenance" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=20.488996ms level=info component=cleaner run_id=1681074767 msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=24.679996ms duration_ms=24 cached=10 returned=10 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-1_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 1_of_2, blocks: 01GXKXSEVRV19R74009XVYF7YM (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GXKXSW5JPC42Y4WXTPGT4GA8 (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge-2_of_2-14400000-28800000 job="stage: merge, range start: 14400000, range end: 28800000, shard: 2_of_2, blocks: 01GXKXSN91KS863P403A4NRRH3 (min time: 1970-01-01 04:00:00 +0000 UTC, max time: 1970-01-01 06:00:00 +0000 UTC),01GXKXT1EHSFRABSPJTCWX5M6T (min time: 1970-01-01 06:00:00 +0000 UTC, max time: 1970-01-01 08:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 job="stage: split, range start: 28800000, range end: 36000000, shard: 1_of_1, blocks: 01GXKXT783WV87TX8GGMAM4JBR (min time: 1970-01-01 08:00:00 +0000 UTC, max time: 1970-01-01 10:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-50400000-57600000 job="stage: split, range start: 50400000, range end: 57600000, shard: 1_of_1, blocks: 01GXKXTD29X77XPB76QZ9HR93W (min time: 1970-01-01 14:00:00 +0000 UTC, max time: 1970-01-01 16:00:00 +0000 UTC)" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 job="stage: split, range start: 7200000, range end: 14400000, shard: 1_of_1, blocks: 01GXKXS319MHARN8TDDA0MSWXP (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC),01GXKXS93BR6P7357A11PTEPJD (min time: 1970-01-01 02:00:00 +0000 UTC, max time: 1970-01-01 04:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXS319MHARN8TDDA0MSWXP (min time: 7200000, max time: 14400000) 01GXKXS93BR6P7357A11PTEPJD (min time: 7200000, max time: 14400000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXS93BR6P7357A11PTEPJD/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXS319MHARN8TDDA0MSWXP/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXS319MHARN8TDDA0MSWXP /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXS93BR6P7357A11PTEPJD]" duration=22.163996ms duration_ms=22 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GXKXTJ3HYVC4G4M8BH1BGP1X sources="[01GXKXS319MHARN8TDDA0MSWXP 01GXKXS93BR6P7357A11PTEPJD]" duration=14.081209695s shard=1_of_2 level=info component=compactor msg="compact blocks" count=2 mint=7200000 maxt=14400000 ulid=01GXKXTJ3H2FZ2CXH5M81KRV10 sources="[01GXKXS319MHARN8TDDA0MSWXP 01GXKXS93BR6P7357A11PTEPJD]" duration=14.081384695s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compacted blocks" new="[01GXKXTJ3HYVC4G4M8BH1BGP1X 01GXKXTJ3H2FZ2CXH5M81KRV10]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXS319MHARN8TDDA0MSWXP /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXS93BR6P7357A11PTEPJD]" duration=14.081704695s duration_ms=14081 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXTJ3HYVC4G4M8BH1BGP1X/chunks/000001 dst=01GXKXTJ3HYVC4G4M8BH1BGP1X/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXTJ3HYVC4G4M8BH1BGP1X/index dst=01GXKXTJ3HYVC4G4M8BH1BGP1X/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXTJ3HYVC4G4M8BH1BGP1X duration=3.626999ms duration_ms=3 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXTJ3H2FZ2CXH5M81KRV10/chunks/000001 dst=01GXKXTJ3H2FZ2CXH5M81KRV10/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-7200000-14400000/01GXKXTJ3H2FZ2CXH5M81KRV10/index dst=01GXKXTJ3H2FZ2CXH5M81KRV10/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXTJ3H2FZ2CXH5M81KRV10 duration=11.152998ms duration_ms=11 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=21.303997ms duration_ms=21 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXS319MHARN8TDDA0MSWXP level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXS319MHARN8TDDA0MSWXP level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXS93BR6P7357A11PTEPJD level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXS93BR6P7357A11PTEPJD level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-7200000-14400000 minTime="1970-01-01 02:00:00 +0000 UTC" maxTime="1970-01-01 04:00:00 +0000 UTC" msg="compaction job succeeded" duration=14.130726686s duration_ms=14130 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=1 plan="[01GXKXT783WV87TX8GGMAM4JBR (min time: 28800000, max time: 36000000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXT783WV87TX8GGMAM4JBR/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=1 plan=[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GXKXT783WV87TX8GGMAM4JBR] duration=7.274999ms duration_ms=7 split_merge_compactor_test.go:640: expected , got Diff: --- metric output does not match expectation; want +++ got: @@ -2,3 +2,3 @@ # TYPE cortex_compactor_runs_completed_total counter -cortex_compactor_runs_completed_total 1 +cortex_compactor_runs_completed_total 0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor level=error component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-28800000-36000000 minTime="1970-01-01 08:00:00 +0000 UTC" maxTime="1970-01-01 10:00:00 +0000 UTC" msg="compaction job failed" duration=1.027536832s duration_ms=1027 err="compact blocks [/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GXKXT783WV87TX8GGMAM4JBR]: 3 errors: populate block: context canceled; context canceled; context canceled" level=error component=compactor msg="failed to compact user blocks" user=user-1 err="compaction: group 0@17241709254077376921-split-1_of_1-28800000-36000000: compact blocks [/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsmaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges1085879855/001/compact/0@17241709254077376921-split-1_of_1-28800000-36000000/01GXKXT783WV87TX8GGMAM4JBR]: 3 errors: populate block: context canceled; context canceled; context canceled" === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner run_id=1681074797 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=7.742999ms level=info component=cleaner run_id=1681074797 msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=11.582998ms duration_ms=11 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GXKXV12135231XWRY25V40K0 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GXKXV59K2J5AY5NH11Y8N9Z2 (min time: 1970-01-01 00:01:00 +0000 UTC, max time: 1970-01-01 00:07:00 +0000 UTC),01GXKXVA7NCQC0KMT3YHS7H5VW (min time: 1970-01-01 01:00:00 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=3 plan="[01GXKXV12135231XWRY25V40K0 (min time: 0, max time: 300000) 01GXKXV59K2J5AY5NH11Y8N9Z2 (min time: 60000, max time: 420000) 01GXKXVA7NCQC0KMT3YHS7H5VW (min time: 3600000, max time: 7200000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXVA7NCQC0KMT3YHS7H5VW/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXV59K2J5AY5NH11Y8N9Z2/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXV12135231XWRY25V40K0/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=3 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXV12135231XWRY25V40K0 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXV59K2J5AY5NH11Y8N9Z2 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVA7NCQC0KMT3YHS7H5VW]" duration=10.422998ms duration_ms=10 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GXKXVF1XFG6AF6DH7M9CBY69 sources="[01GXKXV12135231XWRY25V40K0 01GXKXVA7NCQC0KMT3YHS7H5VW 01GXKXV59K2J5AY5NH11Y8N9Z2]" duration=7.471397777s shard=1_of_2 level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GXKXVF1X3138MX0YT9WJQHTB sources="[01GXKXV12135231XWRY25V40K0 01GXKXVA7NCQC0KMT3YHS7H5VW 01GXKXV59K2J5AY5NH11Y8N9Z2]" duration=7.471601777s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compacted blocks" new="[01GXKXVF1XFG6AF6DH7M9CBY69 01GXKXVF1X3138MX0YT9WJQHTB]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXV12135231XWRY25V40K0 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXV59K2J5AY5NH11Y8N9Z2 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVA7NCQC0KMT3YHS7H5VW]" duration=7.472040777s duration_ms=7472 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVF1X3138MX0YT9WJQHTB/chunks/000001 dst=01GXKXVF1X3138MX0YT9WJQHTB/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVF1X3138MX0YT9WJQHTB/index dst=01GXKXVF1X3138MX0YT9WJQHTB/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXVF1X3138MX0YT9WJQHTB duration=3.706999ms duration_ms=3 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVF1XFG6AF6DH7M9CBY69/chunks/000001 dst=01GXKXVF1XFG6AF6DH7M9CBY69/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVF1XFG6AF6DH7M9CBY69/index dst=01GXKXVF1XFG6AF6DH7M9CBY69/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together268665282/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXVF1XFG6AF6DH7M9CBY69 duration=6.948999ms duration_ms=6 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=15.984997ms duration_ms=15 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXV12135231XWRY25V40K0 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXV12135231XWRY25V40K0 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXV59K2J5AY5NH11Y8N9Z2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXV59K2J5AY5NH11Y8N9Z2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXVA7NCQC0KMT3YHS7H5VW level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXVA7NCQC0KMT3YHS7H5VW level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction job succeeded" duration=7.532483767s duration_ms=7532 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=20.987996ms duration_ms=20 cached=5 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=10.204998ms duration_ms=10 cached=5 returned=2 partial=0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner run_id=1681074822 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=9.632998ms duration_ms=9 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-split-1_of_1-0-7200000 job="stage: split, range start: 0, range end: 7200000, shard: 1_of_1, blocks: 01GXKXVPNJZYG7C272JX94X6Q8 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GXKXVWTWFX8Z1EJWTQJV8C9P (min time: 1970-01-01 00:01:00 +0000 UTC, max time: 1970-01-01 00:07:00 +0000 UTC),01GXKXW1TGFVK6PFTSHNQ9WFMY (min time: 1970-01-01 01:00:00 +0000 UTC, max time: 1970-01-01 02:00:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=3 plan="[01GXKXVPNJZYG7C272JX94X6Q8 (min time: 0, max time: 300000) 01GXKXVWTWFX8Z1EJWTQJV8C9P (min time: 60000, max time: 420000) 01GXKXW1TGFVK6PFTSHNQ9WFMY (min time: 3600000, max time: 7200000)]" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=9.754998ms level=info component=cleaner run_id=1681074822 msg="successfully completed blocks cleanup and maintenance" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXW1TGFVK6PFTSHNQ9WFMY/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXVWTWFX8Z1EJWTQJV8C9P/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXVPNJZYG7C272JX94X6Q8/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=3 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVPNJZYG7C272JX94X6Q8 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVWTWFX8Z1EJWTQJV8C9P /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXW1TGFVK6PFTSHNQ9WFMY]" duration=16.370997ms duration_ms=16 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GXKXW725H75YWXGZR5XRGJFV sources="[01GXKXVPNJZYG7C272JX94X6Q8 01GXKXW1TGFVK6PFTSHNQ9WFMY 01GXKXVWTWFX8Z1EJWTQJV8C9P]" duration=7.20507182s shard=1_of_2 level=info component=compactor msg="compact blocks" count=3 mint=0 maxt=7200000 ulid=01GXKXW725JNVAF899H51SSS02 sources="[01GXKXVPNJZYG7C272JX94X6Q8 01GXKXW1TGFVK6PFTSHNQ9WFMY 01GXKXVWTWFX8Z1EJWTQJV8C9P]" duration=7.20524482s shard=2_of_2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compacted blocks" new="[01GXKXW725H75YWXGZR5XRGJFV 01GXKXW725JNVAF899H51SSS02]" blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVPNJZYG7C272JX94X6Q8 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXVWTWFX8Z1EJWTQJV8C9P /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXW1TGFVK6PFTSHNQ9WFMY]" duration=7.20565482s duration_ms=7205 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXW725JNVAF899H51SSS02/chunks/000001 dst=01GXKXW725JNVAF899H51SSS02/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXW725JNVAF899H51SSS02/index dst=01GXKXW725JNVAF899H51SSS02/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXW725JNVAF899H51SSS02 duration=4.516999ms duration_ms=4 external_labels="{__compactor_shard_id__=\"2_of_2\"}" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXW725H75YWXGZR5XRGJFV/chunks/000001 dst=01GXKXW725H75YWXGZR5XRGJFV/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded file" from=/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/001/compact/0@17241709254077376921-split-1_of_1-0-7200000/01GXKXW725H75YWXGZR5XRGJFV/index dst=01GXKXW725H75YWXGZR5XRGJFV/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactoroverlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together2610345583/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded block" result_block=01GXKXW725H75YWXGZR5XRGJFV duration=4.668999ms duration_ms=4 external_labels="{__compactor_shard_id__=\"1_of_2\"}" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="uploaded all blocks" blocks=2 duration=16.025997ms duration_ms=16 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXVPNJZYG7C272JX94X6Q8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXVPNJZYG7C272JX94X6Q8 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXVWTWFX8Z1EJWTQJV8C9P level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXVWTWFX8Z1EJWTQJV8C9P level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXW1TGFVK6PFTSHNQ9WFMY level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXW1TGFVK6PFTSHNQ9WFMY level=info component=compactor user=user-1 groupKey=0@17241709254077376921-split-1_of_1-0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 02:00:00 +0000 UTC" msg="compaction job succeeded" duration=7.246833813s duration_ms=7246 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=6.246999ms duration_ms=6 cached=5 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=19.563997ms duration_ms=19 cached=5 returned=2 partial=0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor === RUN TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_if_configured_shards_=_0 level=info component=compactor msg="ring doesn't exist in KV store yet" level=info component=compactor msg="instance not found in the ring" instance=root1 ring=compactor level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" level=info component=compactor msg="compactor is ACTIVE in the ring" level=info component=compactor msg="discovering users from bucket" level=info component=compactor msg="discovered users from bucket" users=1 level=info component=compactor msg="starting compaction of user blocks" user=user-1 level=info component=compactor user=user-1 msg="start sync of metas" level=info component=cleaner run_id=1681074846 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="started blocks cleanup and maintenance" level=info component=cleaner user=user-1 msg="completed blocks cleanup and maintenance" duration=8.596998ms level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=cleaner run_id=1681074846 msg="successfully completed blocks cleanup and maintenance" level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=52.834991ms duration_ms=52 cached=3 returned=3 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=debug component=compactor user=user-1 msg="grouper found a compactable blocks group" groupKey=0@17241709254077376921-merge--0-7200000 job="stage: merge, range start: 0, range end: 7200000, shard: , blocks: 01GXKXWEAR9JN61YN9CSPCGKH2 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:05:00 +0000 UTC),01GXKXWKMWN69QC32KXTVA0JTV (min time: 1970-01-01 00:05:00 +0000 UTC, max time: 1970-01-01 00:10:00 +0000 UTC)" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction available and planned; downloading blocks" blocks=2 plan="[01GXKXWEAR9JN61YN9CSPCGKH2 (min time: 0, max time: 300000) 01GXKXWKMWN69QC32KXTVA0JTV (min time: 300000, max time: 600000)]" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXWKMWN69QC32KXTVA0JTV/meta.json level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="not downloading again because a provided path matches this one" file=01GXKXWEAR9JN61YN9CSPCGKH2/meta.json level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="downloaded and verified blocks; compacting blocks" blocks=2 plan="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_01173818561/001/compact/0@17241709254077376921-merge--0-7200000/01GXKXWEAR9JN61YN9CSPCGKH2 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_01173818561/001/compact/0@17241709254077376921-merge--0-7200000/01GXKXWKMWN69QC32KXTVA0JTV]" duration=11.649998ms duration_ms=11 level=info component=compactor msg="Found overlapping blocks during compaction" level=info component=compactor msg="compact blocks" count=2 mint=0 maxt=600000 ulid=01GXKXWYPD7PMABHTK66EBXKAK sources="[01GXKXWKMWN69QC32KXTVA0JTV 01GXKXWEAR9JN61YN9CSPCGKH2]" duration=6.680512906s shard=1_of_1 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compacted blocks" new=[01GXKXWYPD7PMABHTK66EBXKAK] blocks="[/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_01173818561/001/compact/0@17241709254077376921-merge--0-7200000/01GXKXWEAR9JN61YN9CSPCGKH2 /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_01173818561/001/compact/0@17241709254077376921-merge--0-7200000/01GXKXWKMWN69QC32KXTVA0JTV]" duration=6.680995906s duration_ms=6680 level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_01173818561/001/compact/0@17241709254077376921-merge--0-7200000/01GXKXWYPD7PMABHTK66EBXKAK/chunks/000001" dst=01GXKXWYPD7PMABHTK66EBXKAK/chunks/000001 bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_01173818561/002" level=debug component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded file" from="/tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_01173818561/001/compact/0@17241709254077376921-merge--0-7200000/01GXKXWYPD7PMABHTK66EBXKAK/index" dst=01GXKXWYPD7PMABHTK66EBXKAK/index bucket="tracing: fs: /tmp/TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactorsplitting_should_be_disabled_if_configured_shards_=_01173818561/002" level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded block" result_block=01GXKXWYPD7PMABHTK66EBXKAK duration=12.473998ms duration_ms=12 external_labels={} level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="uploaded all blocks" blocks=1 duration=15.947997ms duration_ms=15 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXWEAR9JN61YN9CSPCGKH2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXWEAR9JN61YN9CSPCGKH2 level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="marking compacted block for deletion" old_block=01GXKXWKMWN69QC32KXTVA0JTV level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="block has been marked for deletion" block=01GXKXWKMWN69QC32KXTVA0JTV level=info component=compactor user=user-1 groupKey=0@17241709254077376921-merge--0-7200000 minTime="1970-01-01 00:00:00 +0000 UTC" maxTime="1970-01-01 00:10:00 +0000 UTC" msg="compaction job succeeded" duration=6.723174899s duration_ms=6723 level=info component=compactor user=user-1 msg="start sync of metas" level=debug component=compactor user=user-1 component=block.BaseFetcher msg="fetching meta data" concurrency=20 level=info component=compactor user=user-1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=4.927999ms duration_ms=4 cached=4 returned=2 partial=0 level=info component=compactor user=user-1 msg="start of GC" level=info component=compactor user=user-1 msg="start of compactions" level=info component=compactor user=user-1 msg="compaction iterations done" level=info component=compactor msg="successfully compacted user blocks" user=user-1 level=debug component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info component=block.BaseFetcher msg="successfully synchronized block metadata" duration=19.550997ms duration_ms=19 cached=4 returned=2 partial=0 level=info component=compactor msg="ring lifecycler is shutting down" ring=compactor level=info component=compactor msg="unregistering instance from ring" ring=compactor level=info component=compactor msg="instance removed from the ring" ring=compactor --- FAIL: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor (334.88s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_should_be_merged_and_split (21.73s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/should_correctly_handle_empty_blocks_generated_in_the_splitting_stage (9.56s) --- FAIL: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_but_already_split_blocks_should_be_merged_correctly_(respecting_the_shard)_if_configured_shards_=_0 (67.61s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_should_be_merged_and_split (15.62s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_blocks_matching_the_1st_compaction_range_with_mixed_tenant_ID_labels_should_be_merged_and_split (18.47s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(without_gaps)_should_be_merged_and_split (30.22s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/non-overlapping_blocks_matching_the_beginning_of_the_1st_compaction_range_(with_gaps)_should_be_merged_and_split (26.55s) --- FAIL: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/smaller_compaction_ranges_should_take_precedence_over_larger_ones,_and_then_re-iterate_in_subsequent_compactions_of_increasing_ranges (75.05s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_should_be_split_and_compacted_together (22.10s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/overlapping_and_non-overlapping_blocks_within_the_same_range_and_mixed_tenant_ID_label_should_be_split_and_compacted_together (24.26s) --- PASS: TestMultitenantCompactor_ShouldSupportSplitAndMergeCompactor/splitting_should_be_disabled_if_configured_shards_=_0 (23.70s) === RUN TestPlanCompaction === RUN TestPlanCompaction/should_split_a_single_block_if_<_smallest_compaction_range split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/input_blocks_have_already_been_compacted_with_the_largest_range split_merge_grouper_test.go:515: got 0 jobs: === RUN TestPlanCompaction/should_split_a_single_block_if_==_smallest_compaction_range split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_single_split_group split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/input_blocks_can_be_compacted_on_a_mix_of_1st_and_2nd_ranges,_guaranteeing_no_overlaps_and_giving_preference_to_smaller_ranges split_merge_grouper_test.go:515: got 3 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 20, range end: 40, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000050000000000000000 (min time: 1970-01-01 00:00:00.03 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 70, range end: 80, shard: 1_of_1, blocks: 00000000080000000000000000 (min time: 1970-01-01 00:00:00.07 +0000 UTC, max time: 1970-01-01 00:00:00.08 +0000 UTC),00000000090000000000000000 (min time: 1970-01-01 00:00:00.075 +0000 UTC, max time: 1970-01-01 00:00:00.08 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.007 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) === RUN TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_BE_considered_for_2nd_level_compaction split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 40, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000030000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) === RUN TestPlanCompaction/no_input_blocks split_merge_grouper_test.go:515: got 0 jobs: === RUN TestPlanCompaction/should_NOT_split_a_single_block_if_==_smallest_compaction_range_but_configured_shards_=_0 split_merge_grouper_test.go:515: got 0 jobs: === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_two_split_groups split_merge_grouper_test.go:515: got 4 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_2, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 2_of_2, blocks: 00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_2, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 2_of_2, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_split_blocks_that_can_be_compacted_on_the_2nd_range_only split_merge_grouper_test.go:515: got 3 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 20, shard: 1_of_2, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 20, shard: 2_of_2, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 20, range end: 40, shard: 1_of_2, blocks: 00000000050000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000060000000000000000 (min time: 1970-01-01 00:00:00.03 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) === RUN TestPlanCompaction/should_not_split_non-split_blocks_if_they're_>_smallest_compaction_range_(do_not_split_historical_blocks_after_enabling_splitting) split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 20, shard: 1_of_2, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 20, shard: 2_of_2, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/input_blocks_match_the_largest_range_but_can_be_compacted_because_overlapping split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 80, range end: 120, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC) === RUN TestPlanCompaction/a_range_containing_the_most_recent_block_shouldn't_be_prematurely_compacted_if_doesn't_cover_the_full_range split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 10, shard: 1_of_1, blocks: 00000000000000000000000000 (min time: 1970-01-01 00:00:00.005 +0000 UTC, max time: 1970-01-01 00:00:00.008 +0000 UTC),00000000000000000000000000 (min time: 1970-01-01 00:00:00.007 +0000 UTC, max time: 1970-01-01 00:00:00.009 +0000 UTC) === RUN TestPlanCompaction/should_not_merge_blocks_within_the_same_time_range_but_with_different_external_labels split_merge_grouper_test.go:515: got 3 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_within_the_same_time_range split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 10, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/should_merge_but_NOT_split_multiple_1st_level_blocks_in_different_time_ranges_if_configured_shards_=_0 split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 0, range end: 10, shard: , blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC),00000000020000000000000000 (min time: 1970-01-01 00:00:00 +0000 UTC, max time: 1970-01-01 00:00:00.01 +0000 UTC) split_merge_grouper_test.go:517: - stage: merge, range start: 10, range end: 20, shard: , blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) === RUN TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_be_NOT_considered_for_1st_level_splitting split_merge_grouper_test.go:515: got 2 jobs: split_merge_grouper_test.go:517: - stage: split, range start: 0, range end: 20, shard: 1_of_1, blocks: 00000000010000000000000000 (min time: 1970-01-01 00:00:00.01 +0000 UTC, max time: 1970-01-01 00:00:00.02 +0000 UTC) split_merge_grouper_test.go:517: - stage: split, range start: 20, range end: 40, shard: 1_of_1, blocks: 00000000030000000000000000 (min time: 1970-01-01 00:00:00.02 +0000 UTC, max time: 1970-01-01 00:00:00.03 +0000 UTC),00000000040000000000000000 (min time: 1970-01-01 00:00:00.03 +0000 UTC, max time: 1970-01-01 00:00:00.04 +0000 UTC) === RUN TestPlanCompaction/a_block_with_time_range_larger_then_the_largest_compaction_range_should_NOT_be_considered_for_compaction split_merge_grouper_test.go:515: got 1 jobs: split_merge_grouper_test.go:517: - stage: merge, range start: 80, range end: 120, shard: 1_of_1, blocks: 00000000040000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC),00000000050000000000000000 (min time: 1970-01-01 00:00:00.08 +0000 UTC, max time: 1970-01-01 00:00:00.12 +0000 UTC) --- PASS: TestPlanCompaction (0.04s) --- PASS: TestPlanCompaction/should_split_a_single_block_if_<_smallest_compaction_range (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges (0.00s) --- PASS: TestPlanCompaction/input_blocks_have_already_been_compacted_with_the_largest_range (0.00s) --- PASS: TestPlanCompaction/should_split_a_single_block_if_==_smallest_compaction_range (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_single_split_group (0.00s) --- PASS: TestPlanCompaction/input_blocks_can_be_compacted_on_a_mix_of_1st_and_2nd_ranges,_guaranteeing_no_overlaps_and_giving_preference_to_smaller_ranges (0.01s) --- PASS: TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_BE_considered_for_2nd_level_compaction (0.00s) --- PASS: TestPlanCompaction/no_input_blocks (0.00s) --- PASS: TestPlanCompaction/should_NOT_split_a_single_block_if_==_smallest_compaction_range_but_configured_shards_=_0 (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_in_different_time_ranges,_two_split_groups (0.00s) --- PASS: TestPlanCompaction/should_merge_split_blocks_that_can_be_compacted_on_the_2nd_range_only (0.00s) --- PASS: TestPlanCompaction/should_not_split_non-split_blocks_if_they're_>_smallest_compaction_range_(do_not_split_historical_blocks_after_enabling_splitting) (0.00s) --- PASS: TestPlanCompaction/input_blocks_match_the_largest_range_but_can_be_compacted_because_overlapping (0.00s) --- PASS: TestPlanCompaction/a_range_containing_the_most_recent_block_shouldn't_be_prematurely_compacted_if_doesn't_cover_the_full_range (0.00s) --- PASS: TestPlanCompaction/should_not_merge_blocks_within_the_same_time_range_but_with_different_external_labels (0.00s) --- PASS: TestPlanCompaction/should_merge_and_split_multiple_1st_level_blocks_within_the_same_time_range (0.00s) --- PASS: TestPlanCompaction/should_merge_but_NOT_split_multiple_1st_level_blocks_in_different_time_ranges_if_configured_shards_=_0 (0.00s) --- PASS: TestPlanCompaction/a_block_with_time_range_crossing_two_1st_level_ranges_should_be_NOT_considered_for_1st_level_splitting (0.00s) --- PASS: TestPlanCompaction/a_block_with_time_range_larger_then_the_largest_compaction_range_should_NOT_be_considered_for_compaction (0.00s) === RUN TestPlanSplitting === RUN TestPlanSplitting/should_return_nil_if_the_input_group_contains_no_non-sharded_blocks === RUN TestPlanSplitting/should_return_a_split_job_if_the_input_group_contains_1_non-sharded_block === RUN TestPlanSplitting/should_splitGroups_split_jobs_if_the_input_group_contains_multiple_non-sharded_blocks === RUN TestPlanSplitting/should_return_nil_if_the_input_group_is_empty --- PASS: TestPlanSplitting (0.00s) --- PASS: TestPlanSplitting/should_return_nil_if_the_input_group_contains_no_non-sharded_blocks (0.00s) --- PASS: TestPlanSplitting/should_return_a_split_job_if_the_input_group_contains_1_non-sharded_block (0.00s) --- PASS: TestPlanSplitting/should_splitGroups_split_jobs_if_the_input_group_contains_multiple_non-sharded_blocks (0.00s) --- PASS: TestPlanSplitting/should_return_nil_if_the_input_group_is_empty (0.00s) === RUN TestGroupBlocksByShardID === RUN TestGroupBlocksByShardID/only_1_block_in_input_without_shard_ID === RUN TestGroupBlocksByShardID/multiple_blocks_per_shard_ID === RUN TestGroupBlocksByShardID/no_input_blocks === RUN TestGroupBlocksByShardID/only_1_block_in_input_with_shard_ID --- PASS: TestGroupBlocksByShardID (0.00s) --- PASS: TestGroupBlocksByShardID/only_1_block_in_input_without_shard_ID (0.00s) --- PASS: TestGroupBlocksByShardID/multiple_blocks_per_shard_ID (0.00s) --- PASS: TestGroupBlocksByShardID/no_input_blocks (0.00s) --- PASS: TestGroupBlocksByShardID/only_1_block_in_input_with_shard_ID (0.00s) === RUN TestGroupBlocksByRange === RUN TestGroupBlocksByRange/no_input_blocks === RUN TestGroupBlocksByRange/only_1_block_in_input === RUN TestGroupBlocksByRange/only_1_block_per_range === RUN TestGroupBlocksByRange/multiple_blocks_per_range === RUN TestGroupBlocksByRange/a_block_with_time_range_larger_then_the_range_should_be_excluded === RUN TestGroupBlocksByRange/blocks_with_different_time_ranges_but_all_fitting_within_the_input_range --- PASS: TestGroupBlocksByRange (0.00s) --- PASS: TestGroupBlocksByRange/no_input_blocks (0.00s) --- PASS: TestGroupBlocksByRange/only_1_block_in_input (0.00s) --- PASS: TestGroupBlocksByRange/only_1_block_per_range (0.00s) --- PASS: TestGroupBlocksByRange/multiple_blocks_per_range (0.00s) --- PASS: TestGroupBlocksByRange/a_block_with_time_range_larger_then_the_range_should_be_excluded (0.00s) --- PASS: TestGroupBlocksByRange/blocks_with_different_time_ranges_but_all_fitting_within_the_input_range (0.00s) === RUN TestJob_conflicts === RUN TestJob_conflicts/should_conflict_if_jobs_compact_different_blocks_but_with_overlapping_time_ranges_and_same_shard === RUN TestJob_conflicts/should_NOT_conflict_if_jobs_compact_different_blocks_with_non-overlapping_time_ranges_and_same_shard === RUN TestJob_conflicts/should_NOT_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_but_different_shard === RUN TestJob_conflicts/should_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_and_different_shard_but_at_a_different_stage === RUN TestJob_conflicts/should_conflict_between_split_and_merge_jobs_with_overlapping_time_ranges === RUN TestJob_conflicts/should_NOT_conflict_between_split_and_merge_jobs_with_non-overlapping_time_ranges --- PASS: TestJob_conflicts (0.01s) --- PASS: TestJob_conflicts/should_conflict_if_jobs_compact_different_blocks_but_with_overlapping_time_ranges_and_same_shard (0.00s) --- PASS: TestJob_conflicts/should_NOT_conflict_if_jobs_compact_different_blocks_with_non-overlapping_time_ranges_and_same_shard (0.00s) --- PASS: TestJob_conflicts/should_NOT_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_but_different_shard (0.00s) --- PASS: TestJob_conflicts/should_conflict_if_jobs_compact_same_blocks_with_overlapping_time_ranges_and_different_shard_but_at_a_different_stage (0.00s) --- PASS: TestJob_conflicts/should_conflict_between_split_and_merge_jobs_with_overlapping_time_ranges (0.00s) --- PASS: TestJob_conflicts/should_NOT_conflict_between_split_and_merge_jobs_with_non-overlapping_time_ranges (0.00s) === RUN TestBlocksGroup_overlaps --- PASS: TestBlocksGroup_overlaps (0.00s) === RUN TestBlocksGroup_getNonShardedBlocks --- PASS: TestBlocksGroup_getNonShardedBlocks (0.00s) === RUN TestSplitAndMergePlanner_Plan === RUN TestSplitAndMergePlanner_Plan/a_source_block_is_larger_then_the_largest_range === RUN TestSplitAndMergePlanner_Plan/source_blocks_are_smaller_then_the_largest_range_but_compacted_block_is_larger === RUN TestSplitAndMergePlanner_Plan/source_blocks_and_compacted_block_are_smaller_then_the_largest_range_but_misaligned === RUN TestSplitAndMergePlanner_Plan/blocks_fit_within_the_largest_range === RUN TestSplitAndMergePlanner_Plan/no_blocks --- PASS: TestSplitAndMergePlanner_Plan (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/a_source_block_is_larger_then_the_largest_range (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/source_blocks_are_smaller_then_the_largest_range_but_compacted_block_is_larger (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/source_blocks_and_compacted_block_are_smaller_then_the_largest_range_but_misaligned (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/blocks_fit_within_the_largest_range (0.00s) --- PASS: TestSplitAndMergePlanner_Plan/no_blocks (0.00s) === RUN TestSyncerMetrics --- PASS: TestSyncerMetrics (0.01s) === RUN TestDeleteTenant --- PASS: TestDeleteTenant (0.14s) === RUN TestDeleteTenantStatus === RUN TestDeleteTenantStatus/empty === RUN TestDeleteTenantStatus/no_user_objects === RUN TestDeleteTenantStatus/non-block_files === RUN TestDeleteTenantStatus/block_files --- PASS: TestDeleteTenantStatus (0.25s) --- PASS: TestDeleteTenantStatus/empty (0.15s) --- PASS: TestDeleteTenantStatus/no_user_objects (0.03s) --- PASS: TestDeleteTenantStatus/non-block_files (0.04s) --- PASS: TestDeleteTenantStatus/block_files (0.03s) === CONT TestSyncer_GarbageCollect_e2e === RUN TestSyncer_GarbageCollect_e2e/inmem === CONT TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion === CONT TestMultitenantCompactor_ShouldFailCompactionOnTimeout create 00000000000000000000000000 === CONT TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning create 00000000010000000000000000 create 00000000020000000000000000 create 00000000030000000000000000 create 00000000040000000000000000 create 00000000050000000000000000 create 00000000060000000000000000 create 00000000070000000000000000 create 00000000080000000000000000 create 00000000090000000000000000 create 00000000340000000000000000 create 00000000680000000000000000 create 000000009C0000000000000000 create 00000000CG0000000000000000 create 00000000FM0000000000000000 === RUN TestSyncer_GarbageCollect_e2e/filesystem === PAUSE TestSyncer_GarbageCollect_e2e/filesystem === CONT TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning --- PASS: TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForDeletion (0.15s) === CONT TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning --- PASS: TestMultitenantCompactor_ShouldSkipCompactionForJobsNoMoreOwnedAfterPlanning (0.16s) === CONT TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion --- PASS: TestMultitenantCompactor_ShouldCompactAllUsersOnShardingEnabledButOnlyOneInstanceRunning (1.33s) === CONT TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction --- PASS: TestMultitenantCompactor_ShouldNotCompactBlocksForUsersMarkedForDeletion (1.48s) === CONT TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction --- PASS: TestMultitenantCompactor_ShouldNotCompactBlocksMarkedForNoCompaction (0.36s) === CONT TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime --- PASS: TestMultitenantCompactor_ShouldIterateOverUsersAndRunCompaction (1.08s) === CONT TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly === RUN TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/inmem create 00000000000000000000000000 create 00000000010000000000000000 create 00000000340000000000000000 level=debug msg="deleted file" file=00000000000000000000000000/meta.json bucket=inmem level=debug msg="deleted file" file=00000000000000000000000000/deletion-mark.json bucket=inmem level=debug msg="deleted file" file=00000000010000000000000000/meta.json bucket=inmem level=debug msg="deleted file" file=00000000010000000000000000/deletion-mark.json bucket=inmem === RUN TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem === PAUSE TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem === CONT TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks --- PASS: TestMultitenantCompactor_ShouldDoNothingOnNoUserBlocks (0.04s) === CONT TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant --- PASS: TestMultitenantCompactor_ShouldStopCompactingTenantOnReachingMaxCompactionTime (1.36s) === CONT TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket --- PASS: TestMultitenantCompactor_ShouldRetryCompactionOnFailureWhileDiscoveringUsersFromBucket (0.06s) === CONT TestGroupCompactE2E === RUN TestGroupCompactE2E/inmem level=info msg="start sync of metas" level=info msg="start of GC" level=info msg="start of compactions" level=info msg="compaction iterations done" --- PASS: TestMultitenantCompactor_ShouldIncrementCompactionErrorIfFailedToCompactASingleTenant (0.70s) === CONT TestSyncer_GarbageCollect_e2e/filesystem create 00000000000000000000000000 create 00000000010000000000000000 create 00000000020000000000000000 create 00000000030000000000000000 create 00000000040000000000000000 create 00000000050000000000000000 create 00000000060000000000000000 create 00000000070000000000000000 create 00000000080000000000000000 create 00000000090000000000000000 create 00000000340000000000000000 create 00000000680000000000000000 create 000000009C0000000000000000 create 00000000CG0000000000000000 create 00000000FM0000000000000000 --- PASS: TestSyncer_GarbageCollect_e2e (0.06s) --- PASS: TestSyncer_GarbageCollect_e2e/inmem (0.06s) --- PASS: TestSyncer_GarbageCollect_e2e/filesystem (0.11s) === CONT TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem create 00000000000000000000000000 create 00000000010000000000000000 create 00000000340000000000000000 level=debug msg="deleted file" file=00000000000000000000000000/meta.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem4017405627/001" level=debug msg="deleted file" file=00000000000000000000000000/deletion-mark.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem4017405627/001" level=debug msg="deleted file" file=00000000010000000000000000/meta.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem4017405627/001" level=debug msg="deleted file" file=00000000010000000000000000/deletion-mark.json bucket="fs: /tmp/TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnlyfilesystem4017405627/001" --- PASS: TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly (0.01s) --- PASS: TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/inmem (0.01s) --- PASS: TestGarbageCollectDoesntCreateEmptyBlocksWithDeletionMarksOnly/filesystem (0.06s) --- PASS: TestMultitenantCompactor_ShouldFailCompactionOnTimeout (5.01s) === NAME TestGroupCompactE2E/inmem bucket_compactor_e2e_test.go:476: Error Trace: /build/mimir/src/mimir/pkg/compactor/bucket_compactor_e2e_test.go:476 /build/mimir/src/mimir/pkg/compactor/bucket_compactor_e2e_test.go:452 /build/mimir/src/mimir/pkg/compactor/bucket_compactor_e2e_test.go:270 /build/mimir/src/mimir/pkg/compactor/bucket_compactor_e2e_test.go:592 Error: Received unexpected error: write block: 2 errors: populate block: writing block: add series: context deadline exceeded; context deadline exceeded Test: TestGroupCompactE2E/inmem --- FAIL: TestGroupCompactE2E (23.71s) --- FAIL: TestGroupCompactE2E/inmem (23.71s) --- PASS: TestMultitenantCompactor_ShouldCompactOnlyUsersOwnedByTheInstanceOnShardingEnabledAndMultipleInstancesRunning (33.78s) FAIL FAIL github.com/grafana/mimir/pkg/compactor 561.102s === RUN TestClient_WriteSeries === RUN TestClient_WriteSeries/write_series_in_a_single_batch === RUN TestClient_WriteSeries/write_series_in_multiple_batches === RUN TestClient_WriteSeries/request_failed_with_4xx_error === RUN TestClient_WriteSeries/request_failed_with_5xx_error --- PASS: TestClient_WriteSeries (0.04s) --- PASS: TestClient_WriteSeries/write_series_in_a_single_batch (0.02s) --- PASS: TestClient_WriteSeries/write_series_in_multiple_batches (0.01s) --- PASS: TestClient_WriteSeries/request_failed_with_4xx_error (0.00s) --- PASS: TestClient_WriteSeries/request_failed_with_5xx_error (0.00s) === RUN TestClient_QueryRange === RUN TestClient_QueryRange/results_cache_not_explicitly_disabled === RUN TestClient_QueryRange/results_cache_disabled --- PASS: TestClient_QueryRange (0.01s) --- PASS: TestClient_QueryRange/results_cache_not_explicitly_disabled (0.01s) --- PASS: TestClient_QueryRange/results_cache_disabled (0.00s) === RUN TestClient_Query === RUN TestClient_Query/results_cache_not_explicitly_disabled === RUN TestClient_Query/results_cache_disabled --- PASS: TestClient_Query (0.01s) --- PASS: TestClient_Query/results_cache_not_explicitly_disabled (0.00s) --- PASS: TestClient_Query/results_cache_disabled (0.00s) === RUN TestManager_PeriodicRun --- PASS: TestManager_PeriodicRun (0.05s) === RUN TestManager_SmokeTest === RUN TestManager_SmokeTest/successful_smoke_test === RUN TestManager_SmokeTest/failed_smoke_test --- PASS: TestManager_SmokeTest (0.00s) --- PASS: TestManager_SmokeTest/successful_smoke_test (0.00s) --- PASS: TestManager_SmokeTest/failed_smoke_test (0.00s) === RUN TestAlignTimestampToInterval --- PASS: TestAlignTimestampToInterval (0.00s) === RUN TestGetQueryStep === RUN TestGetQueryStep/should_return_write_interval_if_expected_number_of_samples_is_<_1000 === RUN TestGetQueryStep/should_align_step_to_write_interval_and_guarantee_no_more_than_1000_samples --- PASS: TestGetQueryStep (0.00s) --- PASS: TestGetQueryStep/should_return_write_interval_if_expected_number_of_samples_is_<_1000 (0.00s) --- PASS: TestGetQueryStep/should_align_step_to_write_interval_and_guarantee_no_more_than_1000_samples (0.00s) === RUN TestVerifySineWaveSamplesSum === RUN TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_sample === RUN TestVerifySineWaveSamplesSum/should_return_error_if_the_2nd_last_sample_has_an_unexpected_timestamp === RUN TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(1_series) === RUN TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(multiple_series) === RUN TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_series --- PASS: TestVerifySineWaveSamplesSum (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_sample (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_error_if_the_2nd_last_sample_has_an_unexpected_timestamp (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(1_series) (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_no_error_if_all_samples_value_and_timestamp_match_the_expected_one_(multiple_series) (0.00s) --- PASS: TestVerifySineWaveSamplesSum/should_return_error_if_there's_a_missing_series (0.00s) === RUN TestMinTime --- PASS: TestMinTime (0.00s) === RUN TestMaxTime --- PASS: TestMaxTime (0.00s) === RUN TestRandTime --- PASS: TestRandTime (0.00s) === RUN TestWriteReadSeriesTest_Run === RUN TestWriteReadSeriesTest_Run/should_write_series_with_current_timestamp_if_it's_already_aligned_to_write_interval === RUN TestWriteReadSeriesTest_Run/should_write_series_with_timestamp_aligned_to_write_interval === RUN TestWriteReadSeriesTest_Run/should_write_series_from_last_written_timestamp_until_now === RUN TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_network_error === RUN TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_5xx_error === RUN TestWriteReadSeriesTest_Run/should_keep_remote_writing_next_intervals_on_4xx_error === RUN TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_no_failure_if_results_match === RUN TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_failure_if_results_don't_match --- PASS: TestWriteReadSeriesTest_Run (4.18s) --- PASS: TestWriteReadSeriesTest_Run/should_write_series_with_current_timestamp_if_it's_already_aligned_to_write_interval (0.04s) --- PASS: TestWriteReadSeriesTest_Run/should_write_series_with_timestamp_aligned_to_write_interval (0.02s) --- PASS: TestWriteReadSeriesTest_Run/should_write_series_from_last_written_timestamp_until_now (2.05s) --- PASS: TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_network_error (0.00s) --- PASS: TestWriteReadSeriesTest_Run/should_stop_remote_writing_on_5xx_error (0.00s) --- PASS: TestWriteReadSeriesTest_Run/should_keep_remote_writing_next_intervals_on_4xx_error (2.01s) --- PASS: TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_no_failure_if_results_match (0.02s) --- PASS: TestWriteReadSeriesTest_Run/should_query_written_series,_compare_results_and_track_failure_if_results_don't_match (0.03s) === RUN TestWriteReadSeriesTest_Init === RUN TestWriteReadSeriesTest_Init/no_previously_written_samples_found === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-2h,_-1m] === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m] === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m]_but_last_data_point_of_previous_24h_period_is_missing === RUN TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-24h,_-1m] === RUN TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_>_24h === RUN TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_<_24h === RUN TestWriteReadSeriesTest_Init/the_most_recent_previously_written_data_point_is_older_than_1h_ago === RUN TestWriteReadSeriesTest_Init/the_first_query_fails === RUN TestWriteReadSeriesTest_Init/a_subsequent_query_fails === RUN TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_last_24h_period === RUN TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_previous_24h_period === RUN TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_exactly_at_the_beginning_of_this_24h_period --- PASS: TestWriteReadSeriesTest_Init (0.35s) --- PASS: TestWriteReadSeriesTest_Init/no_previously_written_samples_found (0.00s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-2h,_-1m] (0.00s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m] (0.07s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-36h,_-1m]_but_last_data_point_of_previous_24h_period_is_missing (0.02s) --- PASS: TestWriteReadSeriesTest_Init/previously_written_data_points_are_in_the_range_[-24h,_-1m] (0.03s) --- PASS: TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_>_24h (0.06s) --- PASS: TestWriteReadSeriesTest_Init/the_configured_query_max_age_is_<_24h (0.00s) --- PASS: TestWriteReadSeriesTest_Init/the_most_recent_previously_written_data_point_is_older_than_1h_ago (0.00s) --- PASS: TestWriteReadSeriesTest_Init/the_first_query_fails (0.00s) --- PASS: TestWriteReadSeriesTest_Init/a_subsequent_query_fails (0.02s) --- PASS: TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_last_24h_period (0.00s) --- PASS: TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_in_the_middle_of_the_previous_24h_period (0.04s) --- PASS: TestWriteReadSeriesTest_Init/the_testing_tool_has_been_restarted_with_a_different_number_of_series_exactly_at_the_beginning_of_this_24h_period (0.05s) === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_has_not_been_set_yet === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_is_older_than_max_age === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_=_max_query_time === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_1h === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_2h === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/max_query_time_is_older_than_24h_but_more_recent_than_max_query_age === RUN TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h_but_max_query_age_is_only_10m --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_has_not_been_set_yet (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min/max_query_time_is_older_than_max_age (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_=_max_query_time (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_1h (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_and_max_query_time_are_within_the_last_2h (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/max_query_time_is_older_than_24h_but_more_recent_than_max_query_age (0.00s) --- PASS: TestWriteReadSeriesTest_getRangeQueryTimeRanges/min_query_time_is_older_than_24h_but_max_query_age_is_only_10m (0.00s) PASS ok github.com/grafana/mimir/pkg/continuoustest 4.802s === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_if_the_default_shard_size_>=_0 === RUN TestConfig_Validate/default_config_should_pass === RUN TestConfig_Validate/should_fail_if_the_default_shard_size_is_negative --- PASS: TestConfig_Validate (0.02s) --- PASS: TestConfig_Validate/should_pass_if_the_default_shard_size_>=_0 (0.00s) --- PASS: TestConfig_Validate/default_config_should_pass (0.00s) --- PASS: TestConfig_Validate/should_fail_if_the_default_shard_size_is_negative (0.00s) === RUN TestDistributor_Push === RUN TestDistributor_Push/A_push_of_no_samples_shouldn't_block_or_return_error,_even_if_ingesters_are_sad === RUN TestDistributor_Push/A_push_to_2_happy_ingesters_should_succeed === RUN TestDistributor_Push/A_push_to_1_happy_ingesters_should_fail === RUN TestDistributor_Push/A_push_to_ingesters_with_an_old_sample_should_report_the_correct_metrics_with_no_metadata === RUN TestDistributor_Push/A_push_to_ingesters_without_samples_should_report_the_correct_metrics === RUN TestDistributor_Push/A_push_to_3_happy_ingesters_should_succeed === RUN TestDistributor_Push/A_push_to_0_happy_ingesters_should_fail === RUN TestDistributor_Push/A_push_exceeding_burst_size_should_fail === RUN TestDistributor_Push/A_push_to_ingesters_with_a_current_sample_should_report_the_correct_metrics_with_no_metadata === RUN TestDistributor_Push/A_timed_out_push_should_fail --- PASS: TestDistributor_Push (1.37s) --- PASS: TestDistributor_Push/A_push_of_no_samples_shouldn't_block_or_return_error,_even_if_ingesters_are_sad (0.13s) --- PASS: TestDistributor_Push/A_push_to_2_happy_ingesters_should_succeed (0.13s) --- PASS: TestDistributor_Push/A_push_to_1_happy_ingesters_should_fail (0.13s) --- PASS: TestDistributor_Push/A_push_to_ingesters_with_an_old_sample_should_report_the_correct_metrics_with_no_metadata (0.14s) --- PASS: TestDistributor_Push/A_push_to_ingesters_without_samples_should_report_the_correct_metrics (0.15s) --- PASS: TestDistributor_Push/A_push_to_3_happy_ingesters_should_succeed (0.12s) --- PASS: TestDistributor_Push/A_push_to_0_happy_ingesters_should_fail (0.13s) --- PASS: TestDistributor_Push/A_push_exceeding_burst_size_should_fail (0.17s) --- PASS: TestDistributor_Push/A_push_to_ingesters_with_a_current_sample_should_report_the_correct_metrics_with_no_metadata (0.12s) --- PASS: TestDistributor_Push/A_timed_out_push_should_fail (0.15s) === RUN TestDistributor_ContextCanceledRequest --- PASS: TestDistributor_ContextCanceledRequest (0.12s) === RUN TestDistributor_MetricsCleanup --- PASS: TestDistributor_MetricsCleanup (0.12s) === RUN TestDistributor_PushRequestRateLimiter === RUN TestDistributor_PushRequestRateLimiter/request_limit_should_be_evenly_shared_across_distributors === RUN TestDistributor_PushRequestRateLimiter/request_limit_is_disabled_when_set_to_0 === RUN TestDistributor_PushRequestRateLimiter/request_burst_should_set_to_each_distributor --- PASS: TestDistributor_PushRequestRateLimiter (0.68s) --- PASS: TestDistributor_PushRequestRateLimiter/request_limit_should_be_evenly_shared_across_distributors (0.23s) --- PASS: TestDistributor_PushRequestRateLimiter/request_limit_is_disabled_when_set_to_0 (0.23s) --- PASS: TestDistributor_PushRequestRateLimiter/request_burst_should_set_to_each_distributor (0.22s) === RUN TestDistributor_PushIngestionRateLimiter === RUN TestDistributor_PushIngestionRateLimiter/evenly_share_the_ingestion_limit_across_distributors === RUN TestDistributor_PushIngestionRateLimiter/for_each_distributor,_set_an_ingestion_burst_limit. --- PASS: TestDistributor_PushIngestionRateLimiter (0.36s) --- PASS: TestDistributor_PushIngestionRateLimiter/evenly_share_the_ingestion_limit_across_distributors (0.12s) --- PASS: TestDistributor_PushIngestionRateLimiter/for_each_distributor,_set_an_ingestion_burst_limit. (0.24s) === RUN TestDistributor_PushInstanceLimits === RUN TestDistributor_PushInstanceLimits/no_limits_limit === RUN TestDistributor_PushInstanceLimits/below_inflight_limit === RUN TestDistributor_PushInstanceLimits/hits_inflight_limit === RUN TestDistributor_PushInstanceLimits/below_ingestion_rate_limit === RUN TestDistributor_PushInstanceLimits/hits_rate_limit_on_first_request,_but_second_request_can_proceed === RUN TestDistributor_PushInstanceLimits/below_rate_limit_on_first_request,_but_hits_the_rate_limit_afterwards === RUN TestDistributor_PushInstanceLimits/below_inflight_size_limit === RUN TestDistributor_PushInstanceLimits/hits_inflight_size_limit --- PASS: TestDistributor_PushInstanceLimits (1.97s) --- PASS: TestDistributor_PushInstanceLimits/no_limits_limit (0.14s) --- PASS: TestDistributor_PushInstanceLimits/below_inflight_limit (0.16s) --- PASS: TestDistributor_PushInstanceLimits/hits_inflight_limit (0.15s) --- PASS: TestDistributor_PushInstanceLimits/below_ingestion_rate_limit (0.25s) --- PASS: TestDistributor_PushInstanceLimits/hits_rate_limit_on_first_request,_but_second_request_can_proceed (0.13s) --- PASS: TestDistributor_PushInstanceLimits/below_rate_limit_on_first_request,_but_hits_the_rate_limit_afterwards (0.82s) --- PASS: TestDistributor_PushInstanceLimits/below_inflight_size_limit (0.12s) --- PASS: TestDistributor_PushInstanceLimits/hits_inflight_size_limit (0.21s) === RUN TestDistributor_PushHAInstances === RUN TestDistributor_PushHAInstances/0 === RUN TestDistributor_PushHAInstances/1 === RUN TestDistributor_PushHAInstances/2 === RUN TestDistributor_PushHAInstances/3 --- PASS: TestDistributor_PushHAInstances (6.19s) --- PASS: TestDistributor_PushHAInstances/0 (2.01s) --- PASS: TestDistributor_PushHAInstances/1 (2.03s) --- PASS: TestDistributor_PushHAInstances/2 (0.14s) --- PASS: TestDistributor_PushHAInstances/3 (2.01s) === RUN TestDistributor_PushQuery === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) === RUN TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === PAUSE TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) === RUN TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) === PAUSE TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) === CONT TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) === CONT TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) === CONT TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) === CONT TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) === CONT TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) --- PASS: TestDistributor_PushQuery (0.20s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=9) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=9) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=4) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=5),_sample=1) (0.17s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=5)) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=9) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=3) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=9,_shuffleShardSize=0),_sample=0) (0.17s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=9,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=5) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=3) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=6) (0.22s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=1) (0.15s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=5),_sample=0) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=6) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=8) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=4) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=3) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=8) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=4) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=2) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=6,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=6,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=5,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=4,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=3,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=2,_shuffleShardSize=0)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=1,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=7,_happyIngester=0,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=3) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=9) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=6) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=6,_shuffleShardSize=0),_sample=0) (0.15s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=6,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=9) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=8) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=7) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=9,_happyIngester=8,_shuffleShardSize=0),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=9,_happyIngester=8,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=7,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=6,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=5,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=4,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=3,_shuffleShardSize=0)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=2,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=0,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=9,_happyIngester=1,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=9) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=6) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=7) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=8) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=9) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=2) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=8,_shuffleShardSize=0),_sample=1) (0.15s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=8,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=9) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=8) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=6) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=2) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=5),_sample=0) (0.19s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=3) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=1) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=8,_happyIngester=7,_shuffleShardSize=0),_sample=0) (0.17s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=8,_happyIngester=7,_shuffleShardSize=0)) (0.22s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=6,_shuffleShardSize=0)) (0.19s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=5,_shuffleShardSize=0)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=4,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=4,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=3,_shuffleShardSize=5)) (0.20s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=2,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=1,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=8,_happyIngester=0,_shuffleShardSize=5)) (0.23s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=4) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=5) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=8) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=6) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=4) (0.22s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=7,_happyIngester=7,_shuffleShardSize=0),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=7,_happyIngester=7,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=3,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=2,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=1,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=6,_happyIngester=0,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=6) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=9) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=2) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=5) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=3) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=5),_sample=0) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) (0.19s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=7) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=5) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=6) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=4) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=5,_shuffleShardSize=0),_sample=0) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=5,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=7) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=6) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=5),_sample=0) (0.21s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=9) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=7) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=2) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=5,_happyIngester=4,_shuffleShardSize=0),_sample=0) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=6) (0.15s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=5,_happyIngester=4,_shuffleShardSize=0)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=8) (0.20s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=1) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=2) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=6,_happyIngester=5,_shuffleShardSize=0),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=3,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=0)) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=2,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=1,_shuffleShardSize=5)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=9) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=5,_happyIngester=0,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=5) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=1) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=9) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=6) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=3) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=5) (0.28s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=2) (0.19s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=4,_shuffleShardSize=0),_sample=0) (0.16s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=9) (0.20s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=4,_shuffleShardSize=0)) (0.24s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=8) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=7) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=5) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=6) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=4) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=9) (0.11s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=6) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=7) (0.24s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=3) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=4,_happyIngester=3,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=4,_happyIngester=3,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=2,_shuffleShardSize=0)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=1,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=4,_happyIngester=0,_shuffleShardSize=0)) (0.21s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=8) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=9) (0.25s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=7) (0.22s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=5),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=5) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=2) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=3,_shuffleShardSize=0),_sample=0) (0.14s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=3,_shuffleShardSize=0)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=9) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=6) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=5) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=5),_sample=0) (0.13s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) (0.12s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=5)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=9) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=7) (0.11s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=8) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=6) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=3) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=1) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=3,_happyIngester=2,_shuffleShardSize=0),_sample=0) (0.12s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=3,_happyIngester=2,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=1,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=5)) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=8) (0.12s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=3,_happyIngester=0,_shuffleShardSize=0)) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=9) (0.17s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=7) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=5) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=6) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=4) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=2) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=2) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=5),_sample=1) (0.15s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=9) (0.14s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=5)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=8) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=7) (0.12s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=5) (0.14s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=4) (0.13s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=3) (0.13s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) (0.18s) --- PASS: TestDistributor_PushQuery/ReadNone(numIngester=2,_happyIngester=2,_shuffleShardSize=0)) (0.15s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=1) (0.16s) --- PASS: TestDistributor_PushQuery/ReadOne(numIngester=2,_happyIngester=2,_shuffleShardSize=0),_sample=0) (0.17s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=0)) (0.13s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=1,_shuffleShardSize=5)) (0.11s) --- PASS: TestDistributor_PushQuery/ExpectFail(numIngester=2,_happyIngester=0,_shuffleShardSize=5)) (0.16s) --- PASS: TestDistributor_PushQuery/ReadAll(numIngester=6,_happyIngester=5,_shuffleShardSize=5)) (0.23s) === RUN TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunksPerQueryLimitIsReached --- PASS: TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunksPerQueryLimitIsReached (0.19s) === RUN TestDistributor_QueryStream_ShouldReturnErrorIfMaxSeriesPerQueryLimitIsReached --- PASS: TestDistributor_QueryStream_ShouldReturnErrorIfMaxSeriesPerQueryLimitIsReached (0.12s) === RUN TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunkBytesPerQueryLimitIsReached --- PASS: TestDistributor_QueryStream_ShouldReturnErrorIfMaxChunkBytesPerQueryLimitIsReached (0.13s) === RUN TestDistributor_Push_LabelRemoval --- PASS: TestDistributor_Push_LabelRemoval (1.01s) === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_2_with_value_1 === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_2 === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1 === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_label_due_to_config === RUN TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_HA_replica_label --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime (0.72s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_2_with_value_1 (0.14s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_2 (0.13s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1 (0.20s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_label_due_to_config (0.12s) --- PASS: TestDistributor_Push_ShouldGuaranteeShardingTokenConsistencyOverTheTime/metric_1_with_value_1_and_dropped_HA_replica_label (0.14s) === RUN TestDistributor_Push_LabelNameValidation === RUN TestDistributor_Push_LabelNameValidation/label_name_validation_is_on_by_default === RUN TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_config === RUN TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_WriteRequest_parameter --- PASS: TestDistributor_Push_LabelNameValidation (0.37s) --- PASS: TestDistributor_Push_LabelNameValidation/label_name_validation_is_on_by_default (0.13s) --- PASS: TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_config (0.12s) --- PASS: TestDistributor_Push_LabelNameValidation/label_name_validation_can_be_skipped_via_WriteRequest_parameter (0.13s) === RUN TestDistributor_Push_ExemplarValidation === RUN TestDistributor_Push_ExemplarValidation/valid_exemplar === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_labels === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_timestamp === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_long_labelset === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_many_series_labels === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_duplicate_series_labels === RUN TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_empty_series_label_name --- PASS: TestDistributor_Push_ExemplarValidation (1.00s) --- PASS: TestDistributor_Push_ExemplarValidation/valid_exemplar (0.19s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_labels (0.12s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_no_timestamp (0.12s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_long_labelset (0.13s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_too_many_series_labels (0.12s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_duplicate_series_labels (0.13s) --- PASS: TestDistributor_Push_ExemplarValidation/rejects_exemplar_with_empty_series_label_name (0.19s) === RUN TestDistributor_ExemplarValidation === RUN TestDistributor_ExemplarValidation/one_old,_one_new,_separate_series === RUN TestDistributor_ExemplarValidation/multi_exemplars === RUN TestDistributor_ExemplarValidation/one_old,_one_new,_same_series === RUN TestDistributor_ExemplarValidation/disable_exemplars === RUN TestDistributor_ExemplarValidation/valid_exemplars --- PASS: TestDistributor_ExemplarValidation (0.67s) --- PASS: TestDistributor_ExemplarValidation/one_old,_one_new,_separate_series (0.11s) --- PASS: TestDistributor_ExemplarValidation/multi_exemplars (0.19s) --- PASS: TestDistributor_ExemplarValidation/one_old,_one_new,_same_series (0.11s) --- PASS: TestDistributor_ExemplarValidation/disable_exemplars (0.11s) --- PASS: TestDistributor_ExemplarValidation/valid_exemplars (0.14s) === RUN TestSlowQueries === RUN TestSlowQueries/0 === RUN TestSlowQueries/1 === RUN TestSlowQueries/2 === RUN TestSlowQueries/3 --- PASS: TestSlowQueries (0.89s) --- PASS: TestSlowQueries/0 (0.21s) --- PASS: TestSlowQueries/1 (0.23s) --- PASS: TestSlowQueries/2 (0.23s) --- PASS: TestSlowQueries/3 (0.22s) === RUN TestDistributor_MetricsForLabelMatchers === RUN TestDistributor_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match === RUN TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher === RUN TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers === RUN TestDistributor_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide === RUN TestDistributor_MetricsForLabelMatchers/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_shard_size_is_set --- PASS: TestDistributor_MetricsForLabelMatchers (0.73s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match (0.12s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher (0.12s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers (0.20s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide (0.15s) --- PASS: TestDistributor_MetricsForLabelMatchers/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_shard_size_is_set (0.13s) === RUN TestDistributor_LabelNames === RUN TestDistributor_LabelNames/should_filter_metrics_by_multiple_matchers === RUN TestDistributor_LabelNames/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled === RUN TestDistributor_LabelNames/should_return_an_empty_response_if_no_metric_match === RUN TestDistributor_LabelNames/should_filter_metrics_by_single_matcher --- PASS: TestDistributor_LabelNames (0.56s) --- PASS: TestDistributor_LabelNames/should_filter_metrics_by_multiple_matchers (0.14s) --- PASS: TestDistributor_LabelNames/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled (0.12s) --- PASS: TestDistributor_LabelNames/should_return_an_empty_response_if_no_metric_match (0.12s) --- PASS: TestDistributor_LabelNames/should_filter_metrics_by_single_matcher (0.19s) === RUN TestDistributor_MetricsMetadata === RUN TestDistributor_MetricsMetadata/should_query_all_ingesters_if_shuffle_sharding_is_enabled_but_shard_size_is_0 === RUN TestDistributor_MetricsMetadata/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled --- PASS: TestDistributor_MetricsMetadata (0.24s) --- PASS: TestDistributor_MetricsMetadata/should_query_all_ingesters_if_shuffle_sharding_is_enabled_but_shard_size_is_0 (0.12s) --- PASS: TestDistributor_MetricsMetadata/should_query_only_ingesters_belonging_to_tenant's_subring_if_shuffle_sharding_is_enabled (0.11s) === RUN TestDistributor_LabelNamesAndValuesLimitTest === RUN TestDistributor_LabelNamesAndValuesLimitTest/expected_error_if_sizeLimit_is_reached === RUN TestDistributor_LabelNamesAndValuesLimitTest/expected_no_error_if_sizeLimit_is_not_reached --- PASS: TestDistributor_LabelNamesAndValuesLimitTest (0.24s) --- PASS: TestDistributor_LabelNamesAndValuesLimitTest/expected_error_if_sizeLimit_is_reached (0.12s) --- PASS: TestDistributor_LabelNamesAndValuesLimitTest/expected_no_error_if_sizeLimit_is_not_reached (0.12s) === RUN TestDistributor_LabelNamesAndValues === RUN TestDistributor_LabelNamesAndValues/should_group_values_of_labels_by_label_name_and_return_only_distinct_label_values === RUN TestDistributor_LabelNamesAndValues/should_return_the_results_if_zone_awareness_is_enabled_and_only_2_zones_return_the_results --- PASS: TestDistributor_LabelNamesAndValues (0.31s) --- PASS: TestDistributor_LabelNamesAndValues/should_group_values_of_labels_by_label_name_and_return_only_distinct_label_values (0.19s) --- PASS: TestDistributor_LabelNamesAndValues/should_return_the_results_if_zone_awareness_is_enabled_and_only_2_zones_return_the_results (0.12s) === RUN TestDistributor_LabelValuesCardinality_ExpectedAllIngestersResponsesToBeCompleted --- PASS: TestDistributor_LabelValuesCardinality_ExpectedAllIngestersResponsesToBeCompleted (7.96s) === RUN TestDistributor_LabelNamesAndValues_ExpectedAllPossibleLabelNamesAndValuesToBeReturned --- PASS: TestDistributor_LabelNamesAndValues_ExpectedAllPossibleLabelNamesAndValuesToBeReturned (9.10s) === RUN TestDistributor_IngestionIsControlledByForwarder === RUN TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_only_samples === RUN TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_only_samples === RUN TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_metadata === RUN TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_metadata === RUN TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_exemplars === RUN TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_exemplars --- PASS: TestDistributor_IngestionIsControlledByForwarder (0.89s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_only_samples (0.12s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_only_samples (0.19s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_metadata (0.20s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_metadata (0.12s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/do_ingest_with_exemplars (0.12s) --- PASS: TestDistributor_IngestionIsControlledByForwarder/don't_ingest_with_exemplars (0.12s) === RUN TestDistributor_LabelValuesCardinality === RUN TestDistributor_LabelValuesCardinality/should_return_an_empty_map_if_no_label_names === RUN TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_a_single_label_name === RUN TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_all_the_label_names --- PASS: TestDistributor_LabelValuesCardinality (0.44s) --- PASS: TestDistributor_LabelValuesCardinality/should_return_an_empty_map_if_no_label_names (0.12s) --- PASS: TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_a_single_label_name (0.19s) --- PASS: TestDistributor_LabelValuesCardinality/should_return_a_map_with_the_label_values_and_series_occurrences_of_all_the_label_names (0.13s) === RUN TestDistributor_LabelValuesCardinalityLimit === RUN TestDistributor_LabelValuesCardinalityLimit/should_return_a_httpgrpc_error_if_the_maximum_number_of_label_names_per_request_is_reached === RUN TestDistributor_LabelValuesCardinalityLimit/should_succeed_if_the_maximum_number_of_label_names_per_request_is_not_reached --- PASS: TestDistributor_LabelValuesCardinalityLimit (0.27s) --- PASS: TestDistributor_LabelValuesCardinalityLimit/should_return_a_httpgrpc_error_if_the_maximum_number_of_label_names_per_request_is_reached (0.11s) --- PASS: TestDistributor_LabelValuesCardinalityLimit/should_succeed_if_the_maximum_number_of_label_names_per_request_is_not_reached (0.15s) === RUN TestDistributor_LabelValuesCardinality_Concurrency === RUN TestDistributor_LabelValuesCardinality_Concurrency/should_fail_with_an_error_if_at_least_one_ingester's_LabelValuesCardinality_and/or_UserStats_operations_fails --- PASS: TestDistributor_LabelValuesCardinality_Concurrency (0.12s) --- PASS: TestDistributor_LabelValuesCardinality_Concurrency/should_fail_with_an_error_if_at_least_one_ingester's_LabelValuesCardinality_and/or_UserStats_operations_fails (0.12s) === RUN TestHaDedupeMiddleware === RUN TestHaDedupeMiddleware/no_changes_on_empty_request === RUN TestHaDedupeMiddleware/no_changes_if_accept_HA_samples_is_false === RUN TestHaDedupeMiddleware/remove_replica_label_with_HA_tracker_disabled === RUN TestHaDedupeMiddleware/do_nothing_without_user_in_context,_don't_even_call_next === RUN TestHaDedupeMiddleware/perform_HA_deduplication === RUN TestHaDedupeMiddleware/exceed_max_ha_clusters_limit --- PASS: TestHaDedupeMiddleware (9.19s) --- PASS: TestHaDedupeMiddleware/no_changes_on_empty_request (2.00s) --- PASS: TestHaDedupeMiddleware/no_changes_if_accept_HA_samples_is_false (1.01s) --- PASS: TestHaDedupeMiddleware/remove_replica_label_with_HA_tracker_disabled (0.15s) --- PASS: TestHaDedupeMiddleware/do_nothing_without_user_in_context,_don't_even_call_next (2.00s) --- PASS: TestHaDedupeMiddleware/perform_HA_deduplication (2.01s) --- PASS: TestHaDedupeMiddleware/exceed_max_ha_clusters_limit (2.01s) === RUN TestInstanceLimitsBeforeHaDedupe --- PASS: TestInstanceLimitsBeforeHaDedupe (2.01s) === RUN TestRelabelMiddleware === RUN TestRelabelMiddleware/do_nothing === RUN TestRelabelMiddleware/no_user_in_context === RUN TestRelabelMiddleware/apply_a_relabel_rule === RUN TestRelabelMiddleware/drop_two_out_of_three_labels === RUN TestRelabelMiddleware/drop_entire_series_if_they_have_no_labels --- PASS: TestRelabelMiddleware (0.88s) --- PASS: TestRelabelMiddleware/do_nothing (0.20s) --- PASS: TestRelabelMiddleware/no_user_in_context (0.19s) --- PASS: TestRelabelMiddleware/apply_a_relabel_rule (0.19s) --- PASS: TestRelabelMiddleware/drop_two_out_of_three_labels (0.17s) --- PASS: TestRelabelMiddleware/drop_entire_series_if_they_have_no_labels (0.12s) === RUN TestMarkEphemeralMiddleware === RUN TestMarkEphemeralMiddleware/half_-_half === RUN TestMarkEphemeralMiddleware/no_ephemeral === RUN TestMarkEphemeralMiddleware/all_ephemeral --- PASS: TestMarkEphemeralMiddleware (0.38s) --- PASS: TestMarkEphemeralMiddleware/half_-_half (0.12s) --- PASS: TestMarkEphemeralMiddleware/no_ephemeral (0.14s) --- PASS: TestMarkEphemeralMiddleware/all_ephemeral (0.12s) === RUN TestHaDedupeAndRelabelBeforeForwarding --- PASS: TestHaDedupeAndRelabelBeforeForwarding (0.12s) === RUN TestValidationBeforeForwarding --- PASS: TestValidationBeforeForwarding (2.01s) === RUN TestDistributorValidation === RUN TestDistributorValidation/0 === RUN TestDistributorValidation/1 === RUN TestDistributorValidation/2 === RUN TestDistributorValidation/3 === RUN TestDistributorValidation/4 === RUN TestDistributorValidation/5 === RUN TestDistributorValidation/6 --- PASS: TestDistributorValidation (0.94s) --- PASS: TestDistributorValidation/0 (0.12s) --- PASS: TestDistributorValidation/1 (0.12s) --- PASS: TestDistributorValidation/2 (0.12s) --- PASS: TestDistributorValidation/3 (0.12s) --- PASS: TestDistributorValidation/4 (0.22s) --- PASS: TestDistributorValidation/5 (0.13s) --- PASS: TestDistributorValidation/6 (0.12s) === RUN TestRemoveReplicaLabel --- PASS: TestRemoveReplicaLabel (0.00s) === RUN TestShardByAllLabelsReturnsWrongResultsForUnsortedLabels --- PASS: TestShardByAllLabelsReturnsWrongResultsForUnsortedLabels (0.00s) === RUN TestSortLabels --- PASS: TestSortLabels (0.00s) === RUN TestDistributor_Push_Relabel --- PASS: TestDistributor_Push_Relabel (0.26s) === RUN TestDistributor_MetricsWithRequestModifications === RUN TestDistributor_MetricsWithRequestModifications/No_modifications === RUN TestDistributor_MetricsWithRequestModifications/Drop_samples_via_relabel_rules === RUN TestDistributor_MetricsWithRequestModifications/Drop_samples_via_drop_label_rule === RUN TestDistributor_MetricsWithRequestModifications/Drop_requests_via_ha-dedupe === RUN TestDistributor_MetricsWithRequestModifications/Some_samples_get_forwarded === RUN TestDistributor_MetricsWithRequestModifications/Drop_examplars_via_limit === RUN TestDistributor_MetricsWithRequestModifications/Drop_half_of_samples_via_label_value_length_limit === RUN TestDistributor_MetricsWithRequestModifications/Drop_metadata_via_label_value_length_limit,_except_help --- PASS: TestDistributor_MetricsWithRequestModifications (2.46s) --- PASS: TestDistributor_MetricsWithRequestModifications/No_modifications (0.12s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_samples_via_relabel_rules (0.17s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_samples_via_drop_label_rule (0.16s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_requests_via_ha-dedupe (0.15s) --- PASS: TestDistributor_MetricsWithRequestModifications/Some_samples_get_forwarded (0.12s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_examplars_via_limit (0.13s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_half_of_samples_via_label_value_length_limit (0.15s) --- PASS: TestDistributor_MetricsWithRequestModifications/Drop_metadata_via_label_value_length_limit,_except_help (0.17s) === RUN TestDistributor_CleanupIsDoneAfterLastIngesterReturns --- PASS: TestDistributor_CleanupIsDoneAfterLastIngesterReturns (0.15s) === RUN TestSeriesAreShardedToCorrectIngesters --- PASS: TestSeriesAreShardedToCorrectIngesters (0.27s) === RUN TestHATrackerConfig_Validate === PAUSE TestHATrackerConfig_Validate === RUN TestWatchPrefixAssignment --- PASS: TestWatchPrefixAssignment (0.00s) === RUN TestCheckReplicaOverwriteTimeout --- PASS: TestCheckReplicaOverwriteTimeout (2.00s) === RUN TestCheckReplicaMultiCluster --- PASS: TestCheckReplicaMultiCluster (2.00s) === RUN TestCheckReplicaMultiClusterTimeout --- PASS: TestCheckReplicaMultiClusterTimeout (2.00s) === RUN TestCheckReplicaUpdateTimeout --- PASS: TestCheckReplicaUpdateTimeout (1.00s) === RUN TestCheckReplicaMultiUser --- PASS: TestCheckReplicaMultiUser (2.00s) === RUN TestCheckReplicaUpdateTimeoutJitter === PAUSE TestCheckReplicaUpdateTimeoutJitter === RUN TestFindHALabels --- PASS: TestFindHALabels (0.00s) === RUN TestHATrackerConfig_ShouldCustomizePrefixDefaultValue --- PASS: TestHATrackerConfig_ShouldCustomizePrefixDefaultValue (0.00s) === RUN TestHAClustersLimit --- PASS: TestHAClustersLimit (0.07s) === RUN TestTooManyClustersError --- PASS: TestTooManyClustersError (0.00s) === RUN TestReplicasNotMatchError --- PASS: TestReplicasNotMatchError (0.00s) === RUN TestHATracker_MetricsCleanup --- PASS: TestHATracker_MetricsCleanup (0.00s) === RUN TestCheckReplicaCleanup --- PASS: TestCheckReplicaCleanup (2.00s) === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_but_timeout_disabled_all_instances_active === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_and_active === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_not_all_instances_active === RUN TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_all_instances_active --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_but_timeout_disabled_all_instances_active (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_and_active (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/all_instances_healthy_not_all_instances_active (0.00s) --- PASS: TestHealthyInstanceDelegate_OnRingInstanceHeartbeat/some_instances_healthy_all_instances_active (0.00s) === RUN TestMergeSamplesIntoFirstDuplicates --- PASS: TestMergeSamplesIntoFirstDuplicates (0.00s) === RUN TestMergeSamplesIntoFirst --- PASS: TestMergeSamplesIntoFirst (0.00s) === RUN TestMergeSamplesIntoFirstNilA --- PASS: TestMergeSamplesIntoFirstNilA (0.00s) === RUN TestMergeSamplesIntoFirstNilB --- PASS: TestMergeSamplesIntoFirstNilB (0.00s) === RUN TestMergeExemplars === RUN TestMergeExemplars/test0 === RUN TestMergeExemplars/test1 === RUN TestMergeExemplars/test2 === RUN TestMergeExemplars/test3 === RUN TestMergeExemplars/test4 === RUN TestMergeExemplars/test5 === RUN TestMergeExemplars/test6 --- PASS: TestMergeExemplars (0.00s) --- PASS: TestMergeExemplars/test0 (0.00s) --- PASS: TestMergeExemplars/test1 (0.00s) --- PASS: TestMergeExemplars/test2 (0.00s) --- PASS: TestMergeExemplars/test3 (0.00s) --- PASS: TestMergeExemplars/test4 (0.00s) --- PASS: TestMergeExemplars/test5 (0.00s) --- PASS: TestMergeExemplars/test6 (0.00s) === RUN TestIngestionRateStrategy === RUN TestIngestionRateStrategy/rate_limiter_should_share_the_limit_across_the_number_of_distributors === RUN TestIngestionRateStrategy/infinite_rate_limiter_should_return_unlimited_settings --- PASS: TestIngestionRateStrategy (0.00s) --- PASS: TestIngestionRateStrategy/rate_limiter_should_share_the_limit_across_the_number_of_distributors (0.00s) --- PASS: TestIngestionRateStrategy/infinite_rate_limiter_should_return_unlimited_settings (0.00s) === CONT TestHATrackerConfig_Validate === CONT TestCheckReplicaUpdateTimeoutJitter === RUN TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(with_jitter) === RUN TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(with_jitter) === RUN TestHATrackerConfig_Validate/should_pass_with_default_config === RUN TestHATrackerConfig_Validate/should_fail_if_max_update_timeout_jitter_is_negative === RUN TestHATrackerConfig_Validate/should_fail_if_failover_timeout_is_<_update_timeout_+_jitter_+_1_sec === RUN TestHATrackerConfig_Validate/should_pass_if_failover_timeout_is_>=_update_timeout_+_jitter_+_1_sec === RUN TestHATrackerConfig_Validate/should_fail_if_KV_backend_is_set_to_memberlist --- PASS: TestHATrackerConfig_Validate (0.00s) --- PASS: TestHATrackerConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestHATrackerConfig_Validate/should_fail_if_max_update_timeout_jitter_is_negative (0.00s) --- PASS: TestHATrackerConfig_Validate/should_fail_if_failover_timeout_is_<_update_timeout_+_jitter_+_1_sec (0.00s) --- PASS: TestHATrackerConfig_Validate/should_pass_if_failover_timeout_is_>=_update_timeout_+_jitter_+_1_sec (0.00s) --- PASS: TestHATrackerConfig_Validate/should_fail_if_KV_backend_is_set_to_memberlist (0.00s) === RUN TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(without_jitter) === RUN TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(without_jitter) --- PASS: TestCheckReplicaUpdateTimeoutJitter (3.01s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(with_jitter) (0.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(with_jitter) (2.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_not_refresh_the_replica_if_the_update_timeout_is_not_expired_yet_(without_jitter) (0.00s) --- PASS: TestCheckReplicaUpdateTimeoutJitter/should_refresh_the_replica_if_the_update_timeout_is_expired_(without_jitter) (1.00s) PASS ok github.com/grafana/mimir/pkg/distributor 86.485s === RUN TestForwardingSamplesSuccessfullyToSingleTarget --- PASS: TestForwardingSamplesSuccessfullyToSingleTarget (0.02s) === RUN TestForwardingOmitOldSamples === RUN TestForwardingOmitOldSamples/drop_nothing === RUN TestForwardingOmitOldSamples/drop_some_of_the_samples,_ingest_true === RUN TestForwardingOmitOldSamples/drop_some_of_the_samples,_ingest_false === RUN TestForwardingOmitOldSamples/split_one_sample_slice_in_the_middle === RUN TestForwardingOmitOldSamples/drop_all_of_the_samples --- PASS: TestForwardingOmitOldSamples (0.14s) --- PASS: TestForwardingOmitOldSamples/drop_nothing (0.05s) --- PASS: TestForwardingOmitOldSamples/drop_some_of_the_samples,_ingest_true (0.04s) --- PASS: TestForwardingOmitOldSamples/drop_some_of_the_samples,_ingest_false (0.02s) --- PASS: TestForwardingOmitOldSamples/split_one_sample_slice_in_the_middle (0.01s) --- PASS: TestForwardingOmitOldSamples/drop_all_of_the_samples (0.00s) === RUN TestForwardingEnsureThatPooledObjectsGetReturned === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_one_metric_and_don't_ingest_them === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_one_metric_and_ingest_them === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_and_don't_ingest_them === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_to_and_ingest_them === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_to_and_ingest_half_of_them_(1) === RUN TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_and_ingest_half_of_them_(2) === RUN TestForwardingEnsureThatPooledObjectsGetReturned/don't_forward_samples,_just_ingest_them --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned (0.06s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_one_metric_and_don't_ingest_them (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_one_metric_and_ingest_them (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_and_don't_ingest_them (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_to_and_ingest_them (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_to_and_ingest_half_of_them_(1) (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/forward_samples_of_four_metrics_and_ingest_half_of_them_(2) (0.01s) --- PASS: TestForwardingEnsureThatPooledObjectsGetReturned/don't_forward_samples,_just_ingest_them (0.01s) === RUN TestDropSamplesBefore === RUN TestDropSamplesBefore/no_samples === RUN TestDropSamplesBefore/all_samples_before_cutoff === RUN TestDropSamplesBefore/all_samples_after_cutoff === RUN TestDropSamplesBefore/cut_some_samples_off === RUN TestDropSamplesBefore/unsorted_sample_slice --- PASS: TestDropSamplesBefore (0.00s) --- PASS: TestDropSamplesBefore/no_samples (0.00s) --- PASS: TestDropSamplesBefore/all_samples_before_cutoff (0.00s) --- PASS: TestDropSamplesBefore/all_samples_after_cutoff (0.00s) --- PASS: TestDropSamplesBefore/cut_some_samples_off (0.00s) --- PASS: TestDropSamplesBefore/unsorted_sample_slice (0.00s) === RUN TestForwardingToHTTPGrpcTarget --- PASS: TestForwardingToHTTPGrpcTarget (0.02s) === RUN TestUsingPools --- PASS: TestUsingPools (0.00s) PASS ok github.com/grafana/mimir/pkg/distributor/forwarding 0.568s === RUN TestFrontend_RequestHostHeaderWhenDownstreamURLIsConfigured --- PASS: TestFrontend_RequestHostHeaderWhenDownstreamURLIsConfigured (0.08s) === RUN TestFrontend_LogsSlowQueriesFormValues --- PASS: TestFrontend_LogsSlowQueriesFormValues (0.02s) === RUN TestFrontend_ReturnsRequestBodyTooLargeError --- PASS: TestFrontend_ReturnsRequestBodyTooLargeError (0.02s) PASS ok github.com/grafana/mimir/pkg/frontend 0.424s === RUN TestRequest === RUN TestRequest/0 === RUN TestRequest/1 === RUN TestRequest/2 === RUN TestRequest/3 === RUN TestRequest/4 === RUN TestRequest/5 === RUN TestRequest/6 === RUN TestRequest/7 --- PASS: TestRequest (0.01s) --- PASS: TestRequest/0 (0.00s) --- PASS: TestRequest/1 (0.00s) --- PASS: TestRequest/2 (0.00s) --- PASS: TestRequest/3 (0.00s) --- PASS: TestRequest/4 (0.00s) --- PASS: TestRequest/5 (0.00s) --- PASS: TestRequest/6 (0.00s) --- PASS: TestRequest/7 (0.00s) === RUN TestDecodeFailedResponse === RUN TestDecodeFailedResponse/internal_error === RUN TestDecodeFailedResponse/too_many_requests === RUN TestDecodeFailedResponse/too_large_entry --- PASS: TestDecodeFailedResponse (0.00s) --- PASS: TestDecodeFailedResponse/internal_error (0.00s) --- PASS: TestDecodeFailedResponse/too_many_requests (0.00s) --- PASS: TestDecodeFailedResponse/too_large_entry (0.00s) === RUN TestResponseRoundtrip === RUN TestResponseRoundtrip/successful_string_response === RUN TestResponseRoundtrip/successful_scalar_response === RUN TestResponseRoundtrip/successful_instant_response === RUN TestResponseRoundtrip/successful_range_response === RUN TestResponseRoundtrip/successful_empty_matrix_response === RUN TestResponseRoundtrip/error_response --- PASS: TestResponseRoundtrip (0.01s) --- PASS: TestResponseRoundtrip/successful_string_response (0.00s) --- PASS: TestResponseRoundtrip/successful_scalar_response (0.00s) --- PASS: TestResponseRoundtrip/successful_instant_response (0.00s) --- PASS: TestResponseRoundtrip/successful_range_response (0.00s) --- PASS: TestResponseRoundtrip/successful_empty_matrix_response (0.00s) --- PASS: TestResponseRoundtrip/error_response (0.00s) === RUN TestMergeAPIResponses === RUN TestMergeAPIResponses/No_responses_shouldn't_panic_and_return_a_non-null_result_and_result_type. === RUN TestMergeAPIResponses/A_single_empty_response_shouldn't_panic. === RUN TestMergeAPIResponses/Multiple_empty_responses_shouldn't_panic. === RUN TestMergeAPIResponses/Basic_merging_of_two_responses. === RUN TestMergeAPIResponses/Merging_of_responses_when_labels_are_in_different_order. === RUN TestMergeAPIResponses/Merging_of_samples_where_there_is_single_overlap. === RUN TestMergeAPIResponses/Merging_of_samples_where_there_is_multiple_partial_overlaps. === RUN TestMergeAPIResponses/Merging_of_samples_where_there_is_complete_overlap. === RUN TestMergeAPIResponses/shouldn't_merge_unsuccessful_responses === RUN TestMergeAPIResponses/shouldn't_merge_nil_data === RUN TestMergeAPIResponses/shouldn't_merge_non-matrix_data --- PASS: TestMergeAPIResponses (0.01s) --- PASS: TestMergeAPIResponses/No_responses_shouldn't_panic_and_return_a_non-null_result_and_result_type. (0.00s) --- PASS: TestMergeAPIResponses/A_single_empty_response_shouldn't_panic. (0.00s) --- PASS: TestMergeAPIResponses/Multiple_empty_responses_shouldn't_panic. (0.00s) --- PASS: TestMergeAPIResponses/Basic_merging_of_two_responses. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_responses_when_labels_are_in_different_order. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_samples_where_there_is_single_overlap. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_samples_where_there_is_multiple_partial_overlaps. (0.00s) --- PASS: TestMergeAPIResponses/Merging_of_samples_where_there_is_complete_overlap. (0.00s) --- PASS: TestMergeAPIResponses/shouldn't_merge_unsuccessful_responses (0.00s) --- PASS: TestMergeAPIResponses/shouldn't_merge_nil_data (0.00s) --- PASS: TestMergeAPIResponses/shouldn't_merge_non-matrix_data (0.00s) === RUN Test_DecodeOptions === RUN Test_DecodeOptions/default === PAUSE Test_DecodeOptions/default === RUN Test_DecodeOptions/disable_cache === PAUSE Test_DecodeOptions/disable_cache === RUN Test_DecodeOptions/custom_sharding === PAUSE Test_DecodeOptions/custom_sharding === RUN Test_DecodeOptions/disable_sharding === PAUSE Test_DecodeOptions/disable_sharding === RUN Test_DecodeOptions/custom_instant_query_splitting === PAUSE Test_DecodeOptions/custom_instant_query_splitting === RUN Test_DecodeOptions/disable_instant_query_splitting === PAUSE Test_DecodeOptions/disable_instant_query_splitting === CONT Test_DecodeOptions/default === CONT Test_DecodeOptions/disable_cache === CONT Test_DecodeOptions/disable_instant_query_splitting === CONT Test_DecodeOptions/custom_instant_query_splitting === CONT Test_DecodeOptions/disable_sharding === CONT Test_DecodeOptions/custom_sharding --- PASS: Test_DecodeOptions (0.00s) --- PASS: Test_DecodeOptions/default (0.00s) --- PASS: Test_DecodeOptions/disable_cache (0.00s) --- PASS: Test_DecodeOptions/disable_instant_query_splitting (0.00s) --- PASS: Test_DecodeOptions/custom_instant_query_splitting (0.00s) --- PASS: Test_DecodeOptions/disable_sharding (0.00s) --- PASS: Test_DecodeOptions/custom_sharding (0.00s) === RUN TestLimitsMiddleware_MaxQueryLookback === RUN TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_if_max_lookback_is_disabled === RUN TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range === RUN TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit === RUN TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit === RUN TestLimitsMiddleware_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range === RUN TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_where_maxQueryLookback_is_past_the_retention_period --- PASS: TestLimitsMiddleware_MaxQueryLookback (0.01s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_if_max_lookback_is_disabled (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLookback/should_manipulate_a_query_where_maxQueryLookback_is_past_the_retention_period (0.00s) === RUN TestLimitsMiddleware_MaxQueryLength === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_if_total_query_length_is_higher_than_query_length_limit === RUN TestLimitsMiddleware_MaxQueryLength/should_skip_validation_if_max_length_is_disabled === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_now === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_in_the_past === RUN TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_large_time_range_close_to_the_limit,_ending_now === RUN TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_now === RUN TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_in_the_past --- PASS: TestLimitsMiddleware_MaxQueryLength (0.01s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_if_total_query_length_is_higher_than_query_length_limit (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_skip_validation_if_max_length_is_disabled (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_now (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_short_time_range,_ending_in_the_past (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_succeed_on_a_query_on_large_time_range_close_to_the_limit,_ending_now (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_now (0.00s) --- PASS: TestLimitsMiddleware_MaxQueryLength/should_fail_on_a_query_on_large_time_range_over_the_limit,_ending_in_the_past (0.00s) === RUN TestLimitsMiddleware_CreationGracePeriod === RUN TestLimitsMiddleware_CreationGracePeriod/should_not_manipulate_time_range_if_creation_grace_period_is_disabled === RUN TestLimitsMiddleware_CreationGracePeriod/should_not_manipulate_time_range_for_a_query_in_now_+_creation_grace_period === RUN TestLimitsMiddleware_CreationGracePeriod/should_manipulate_time_range_for_a_query_over_now_+_creation_grace_period --- PASS: TestLimitsMiddleware_CreationGracePeriod (0.00s) --- PASS: TestLimitsMiddleware_CreationGracePeriod/should_not_manipulate_time_range_if_creation_grace_period_is_disabled (0.00s) --- PASS: TestLimitsMiddleware_CreationGracePeriod/should_not_manipulate_time_range_for_a_query_in_now_+_creation_grace_period (0.00s) --- PASS: TestLimitsMiddleware_CreationGracePeriod/should_manipulate_time_range_for_a_query_over_now_+_creation_grace_period (0.00s) === RUN TestLimitedRoundTripper_MaxQueryParallelism --- PASS: TestLimitedRoundTripper_MaxQueryParallelism (0.24s) === RUN TestLimitedRoundTripper_MaxQueryParallelismLateScheduling --- PASS: TestLimitedRoundTripper_MaxQueryParallelismLateScheduling (0.02s) === RUN TestLimitedRoundTripper_OriginalRequestContextCancellation --- PASS: TestLimitedRoundTripper_OriginalRequestContextCancellation (0.10s) === RUN TestQueryShardingCorrectness === RUN TestQueryShardingCorrectness/min()_no_grouping === PAUSE TestQueryShardingCorrectness/min()_no_grouping === RUN TestQueryShardingCorrectness/and === PAUSE TestQueryShardingCorrectness/and === RUN TestQueryShardingCorrectness/subquery_max === PAUSE TestQueryShardingCorrectness/subquery_max === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg === PAUSE TestQueryShardingCorrectness/outer_subquery_on_top_of_avg === RUN TestQueryShardingCorrectness/sum({__name__!=""}) === PAUSE TestQueryShardingCorrectness/sum({__name__!=""}) === RUN TestQueryShardingCorrectness/avg()_no_grouping === PAUSE TestQueryShardingCorrectness/avg()_no_grouping === RUN TestQueryShardingCorrectness/avg()_grouping_'by' === PAUSE TestQueryShardingCorrectness/avg()_grouping_'by' === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() === PAUSE TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand === PAUSE TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children === PAUSE TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children === RUN TestQueryShardingCorrectness/time() === PAUSE TestQueryShardingCorrectness/time() === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) === PAUSE TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand === PAUSE TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) === PAUSE TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping === PAUSE TestQueryShardingCorrectness/sum(rate())_no_grouping === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without' === PAUSE TestQueryShardingCorrectness/sum(rate())_grouping_'without' === RUN TestQueryShardingCorrectness/triple_subquery === PAUSE TestQueryShardingCorrectness/triple_subquery === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant === PAUSE TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation === PAUSE TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation === PAUSE TestQueryShardingCorrectness/histogram_quantile_without_aggregation === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1 === PAUSE TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1 === RUN TestQueryShardingCorrectness/sum()_no_grouping === PAUSE TestQueryShardingCorrectness/sum()_no_grouping === RUN TestQueryShardingCorrectness/count()_grouping_'by' === PAUSE TestQueryShardingCorrectness/count()_grouping_'by' === RUN TestQueryShardingCorrectness/@_modifier === PAUSE TestQueryShardingCorrectness/@_modifier === RUN TestQueryShardingCorrectness/label_join === PAUSE TestQueryShardingCorrectness/label_join === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 === PAUSE TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 === RUN TestQueryShardingCorrectness/stdvar() === PAUSE TestQueryShardingCorrectness/stdvar() === RUN TestQueryShardingCorrectness/bottomk() === PAUSE TestQueryShardingCorrectness/bottomk() === RUN TestQueryShardingCorrectness/scalar(single_metric) === PAUSE TestQueryShardingCorrectness/scalar(single_metric) === RUN TestQueryShardingCorrectness/label_replace === PAUSE TestQueryShardingCorrectness/label_replace === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar === PAUSE TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) === PAUSE TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) === PAUSE TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping === PAUSE TestQueryShardingCorrectness/histogram_quantile()_no_grouping === RUN TestQueryShardingCorrectness/min()_grouping_'without' === PAUSE TestQueryShardingCorrectness/min()_grouping_'without' === RUN TestQueryShardingCorrectness/max()_grouping_'by' === PAUSE TestQueryShardingCorrectness/max()_grouping_'by' === RUN TestQueryShardingCorrectness/sum(min_over_time()) === PAUSE TestQueryShardingCorrectness/sum(min_over_time()) === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order === PAUSE TestQueryShardingCorrectness/query_with_sort()_expects_specific_order === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""}) === PAUSE TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""}) === RUN TestQueryShardingCorrectness/min()_grouping_'by' === PAUSE TestQueryShardingCorrectness/min()_grouping_'by' === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 === PAUSE TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 === RUN TestQueryShardingCorrectness/sum_of_subquery_min === PAUSE TestQueryShardingCorrectness/sum_of_subquery_min === RUN TestQueryShardingCorrectness/@_modifier_and_offset === PAUSE TestQueryShardingCorrectness/@_modifier_and_offset === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum === PAUSE TestQueryShardingCorrectness/outer_subquery_on_top_of_sum === RUN TestQueryShardingCorrectness/vector() === PAUSE TestQueryShardingCorrectness/vector() === RUN TestQueryShardingCorrectness/vector(1) === PAUSE TestQueryShardingCorrectness/vector(1) === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' === PAUSE TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' === RUN TestQueryShardingCorrectness/sum(max_over_time()) === PAUSE TestQueryShardingCorrectness/sum(max_over_time()) === RUN TestQueryShardingCorrectness/sum(avg_over_time()) === PAUSE TestQueryShardingCorrectness/sum(avg_over_time()) === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset === PAUSE TestQueryShardingCorrectness/@_modifier_and_negative_offset === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr === PAUSE TestQueryShardingCorrectness/subquery_min_over_time_with_aggr === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() === PAUSE TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by' === PAUSE TestQueryShardingCorrectness/sum(rate())_grouping_'by' === RUN TestQueryShardingCorrectness/max()_grouping_'without' === PAUSE TestQueryShardingCorrectness/max()_grouping_'without' === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) === PAUSE TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) === RUN TestQueryShardingCorrectness/nested_count() === PAUSE TestQueryShardingCorrectness/nested_count() === RUN TestQueryShardingCorrectness/double_subquery_deriv === PAUSE TestQueryShardingCorrectness/double_subquery_deriv === RUN TestQueryShardingCorrectness/string_literal === PAUSE TestQueryShardingCorrectness/string_literal === RUN TestQueryShardingCorrectness/sum()_offset === PAUSE TestQueryShardingCorrectness/sum()_offset === RUN TestQueryShardingCorrectness/count()_no_grouping === PAUSE TestQueryShardingCorrectness/count()_no_grouping === RUN TestQueryShardingCorrectness/count()_grouping_'without' === PAUSE TestQueryShardingCorrectness/count()_grouping_'without' === RUN TestQueryShardingCorrectness/subquery_min === PAUSE TestQueryShardingCorrectness/subquery_min === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar === PAUSE TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1 === PAUSE TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1 === RUN TestQueryShardingCorrectness/avg()_grouping_'without' === PAUSE TestQueryShardingCorrectness/avg()_grouping_'without' === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1) === PAUSE TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1) === RUN TestQueryShardingCorrectness/scalar(aggregation) === PAUSE TestQueryShardingCorrectness/scalar(aggregation) === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand === PAUSE TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand === RUN TestQueryShardingCorrectness/month()_>=_1_and_month() === PAUSE TestQueryShardingCorrectness/month()_>=_1_and_month() === RUN TestQueryShardingCorrectness/month(sum(metric_counter)) === PAUSE TestQueryShardingCorrectness/month(sum(metric_counter)) === RUN TestQueryShardingCorrectness/0_<_bool_1 === PAUSE TestQueryShardingCorrectness/0_<_bool_1 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m])) === PAUSE TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m])) === RUN TestQueryShardingCorrectness/sum()_negative_offset === PAUSE TestQueryShardingCorrectness/sum()_negative_offset === RUN TestQueryShardingCorrectness/sum()_grouping_'by' === PAUSE TestQueryShardingCorrectness/sum()_grouping_'by' === RUN TestQueryShardingCorrectness/sum()_grouping_'without' === PAUSE TestQueryShardingCorrectness/sum()_grouping_'without' === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/or === PAUSE TestQueryShardingCorrectness/or === RUN TestQueryShardingCorrectness/stddev() === PAUSE TestQueryShardingCorrectness/stddev() === RUN TestQueryShardingCorrectness/topk() === PAUSE TestQueryShardingCorrectness/topk() === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le === PAUSE TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' === PAUSE TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' === RUN TestQueryShardingCorrectness/max()_no_grouping === PAUSE TestQueryShardingCorrectness/max()_no_grouping === RUN TestQueryShardingCorrectness/sum(count()) === PAUSE TestQueryShardingCorrectness/sum(count()) === CONT TestQueryShardingCorrectness/min()_no_grouping === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum_of_subquery_min === CONT TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar === CONT TestQueryShardingCorrectness/sum()_no_grouping === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/subquery_min === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/count()_grouping_'without' === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/count()_no_grouping === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum()_offset === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/string_literal === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/double_subquery_deriv === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/nested_count() === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/max()_grouping_'without' === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum(rate())_grouping_'by' === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/subquery_min_over_time_with_aggr === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/@_modifier_and_negative_offset === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum(avg_over_time()) === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum(max_over_time()) === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/vector(1) === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/vector() === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/outer_subquery_on_top_of_sum === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/@_modifier_and_offset === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest === CONT TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/histogram_quantile_without_aggregation === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/triple_subquery === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum(rate())_grouping_'without' === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum(rate())_no_grouping === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum()_grouping_'by' === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/sum(count()) === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/max()_no_grouping === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/topk() === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/stddev() === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/or === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/sum()_grouping_'without' === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/min()_grouping_'by' === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""}) === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/query_with_sort()_expects_specific_order === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/sum(min_over_time()) === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/max()_grouping_'by' === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/min()_grouping_'without' === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/histogram_quantile()_no_grouping === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/stdvar() === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/label_replace === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/scalar(single_metric) === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/bottomk() === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/month()_>=_1_and_month() === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum()_negative_offset === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m])) === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/0_<_bool_1 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/month(sum(metric_counter)) === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/avg()_grouping_'by' === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/time() === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/outer_subquery_on_top_of_avg === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/avg()_no_grouping === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === CONT TestQueryShardingCorrectness/sum({__name__!=""}) === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/subquery_max === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/label_join === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === CONT TestQueryShardingCorrectness/and === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/count()_grouping_'by' === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/@_modifier === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === CONT TestQueryShardingCorrectness/scalar(aggregation) === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest === CONT TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1) === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/avg()_grouping_'without' === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === CONT TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 === RUN TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 === RUN TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 === RUN TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 --- PASS: TestQueryShardingCorrectness (1.12s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping (0.81s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.24s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.57s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/min()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.28s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping (1.49s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.52s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.97s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.28s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min (3.09s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.17s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.18s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.32s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest (2.17s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.46s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.33s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.44s) --- PASS: TestQueryShardingCorrectness/sum_of_subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.51s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping (1.33s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.45s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.87s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.22s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/count()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.18s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without' (3.84s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.59s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (3.25s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.55s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.56s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.62s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.95s) --- PASS: TestQueryShardingCorrectness/string_literal (0.03s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest (0.03s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/string_literal/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/sum()_offset (1.69s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest (0.79s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.30s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.18s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest (0.91s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/sum()_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.27s) --- PASS: TestQueryShardingCorrectness/nested_count() (2.49s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest (0.47s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.11s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest (2.02s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.50s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.34s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.32s) --- PASS: TestQueryShardingCorrectness/nested_count()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.63s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate()) (4.06s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest (1.00s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.16s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.34s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest (3.07s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.65s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.66s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.54s) --- PASS: TestQueryShardingCorrectness/sum(rate())_>_avg(rate())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.63s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without' (0.66s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.18s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.07s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (0.48s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.10s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.18s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by' (2.82s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.72s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.14s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (2.10s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.31s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.28s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.49s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.64s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month() (0.11s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest (0.03s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest (0.07s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/day_of_month()_>=_1_and_day_of_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr (3.75s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest (0.95s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.19s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.18s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest (2.80s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.69s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.54s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.49s) --- PASS: TestQueryShardingCorrectness/subquery_min_over_time_with_aggr/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.75s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset (2.08s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest (0.97s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.14s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.17s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.34s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest (1.11s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.26s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.34s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.34s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time()) (4.44s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest (0.71s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.17s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest (3.73s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.58s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.47s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.07s) --- PASS: TestQueryShardingCorrectness/sum(avg_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.74s) --- PASS: TestQueryShardingCorrectness/subquery_min (29.29s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest (2.26s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.34s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.52s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.69s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.59s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest (27.03s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (5.98s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (6.66s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (6.35s) --- PASS: TestQueryShardingCorrectness/subquery_min/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (7.30s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time()) (4.02s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest (0.82s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest (3.18s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.64s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.58s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.62s) --- PASS: TestQueryShardingCorrectness/sum(max_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.73s) --- PASS: TestQueryShardingCorrectness/vector(1) (0.07s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.02s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.00s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.00s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.03s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.00s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/vector() (0.19s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest (0.05s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest (0.14s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.03s) --- PASS: TestQueryShardingCorrectness/vector()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.00s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum (0.40s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest (0.40s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.06s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_sum/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.08s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar (31.35s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest (2.00s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.42s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.56s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.45s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.47s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest (29.35s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (6.47s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (6.86s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (7.27s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_of_a_function_result_with_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (6.54s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset (2.45s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest (0.98s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.23s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.17s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest (1.47s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.22s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.20s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/@_modifier_and_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.31s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv (29.09s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest (2.34s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.60s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.39s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.39s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.68s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest (26.75s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (6.41s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (6.31s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (6.76s) --- PASS: TestQueryShardingCorrectness/double_subquery_deriv/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (6.42s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1 (1.12s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest (0.36s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.11s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.03s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest (0.76s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/scalar(metric_counter{const="fixed"})_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter)) (9.13s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest (1.50s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.24s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.68s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest (7.63s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.66s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.28s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.07s) --- PASS: TestQueryShardingCorrectness/sum(rate(metric_counter[1m]))_/_vector(3)_^_vector(2)_+_sum(ln(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.11s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation (10.48s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest (0.39s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.07s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.09s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest (10.09s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.54s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (2.81s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (2.14s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_without_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (2.34s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by' (16.07s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (2.79s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.46s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.30s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.69s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.85s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (13.27s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (4.05s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (2.18s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.67s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.87s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without' (4.05s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.82s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.11s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.28s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.28s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (3.24s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.43s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.55s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.18s) --- PASS: TestQueryShardingCorrectness/sum(rate())_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.85s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping (1.97s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.58s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.17s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (1.38s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.36s) --- PASS: TestQueryShardingCorrectness/sum(rate())_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1) (1.07s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.31s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.07s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.13s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.75s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.16s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand (0.93s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest (0.34s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.07s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.10s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest (0.59s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.18s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_the_other_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by' (1.84s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.59s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (1.25s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.21s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.50s) --- PASS: TestQueryShardingCorrectness/sum(count()) (2.29s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.08s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.18s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest (1.90s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.30s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.41s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.30s) --- PASS: TestQueryShardingCorrectness/sum(count())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.67s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping (0.42s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.20s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.07s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.22s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/max()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without' (9.04s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (2.46s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.27s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.68s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.49s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.67s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (6.57s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.93s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.68s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.41s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.43s) --- PASS: TestQueryShardingCorrectness/triple_subquery (31.31s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest (3.32s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.45s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.85s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.40s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.62s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest (27.99s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (5.43s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (6.83s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (8.74s) --- PASS: TestQueryShardingCorrectness/triple_subquery/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (5.07s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le (9.98s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest (3.12s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.64s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.56s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.87s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.56s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest (6.86s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.24s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.90s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.89s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.18s) --- PASS: TestQueryShardingCorrectness/stddev() (1.08s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest (0.20s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.04s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest (0.89s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.17s) --- PASS: TestQueryShardingCorrectness/stddev()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.31s) --- PASS: TestQueryShardingCorrectness/topk() (4.29s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest (0.37s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.04s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.05s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest (3.92s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.35s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.31s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.57s) --- PASS: TestQueryShardingCorrectness/topk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.35s) --- PASS: TestQueryShardingCorrectness/or (1.90s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest (1.27s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.22s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.35s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.36s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest (0.63s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/or/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.27s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation (48.74s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest (3.33s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.72s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.53s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.50s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (1.21s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest (45.41s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (7.79s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (7.21s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (9.85s) --- PASS: TestQueryShardingCorrectness/histogram_quantile_with_inner_aggregation/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (9.11s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1) (0.08s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.04s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest (0.04s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/vector(1)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without' (2.87s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.58s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.23s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (2.29s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.36s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.53s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.49s) --- PASS: TestQueryShardingCorrectness/sum()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.65s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by' (0.84s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.39s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.26s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (0.45s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.13s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2 (3.06s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest (0.59s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.17s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.15s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest (2.47s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.28s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.36s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.56s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_2_^_2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.88s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant (48.75s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest (3.42s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.83s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.78s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.56s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.96s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest (45.32s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (10.72s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (10.01s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (9.28s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_non_constant/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (10.41s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order (7.36s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest (1.94s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.33s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.37s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.39s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.39s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest (5.42s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.07s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.09s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.87s) --- PASS: TestQueryShardingCorrectness/query_with_sort()_expects_specific_order/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.05s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""}) (11.76s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest (2.23s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.37s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.44s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.52s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.65s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest (9.53s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.71s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.39s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.42s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (2.37s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time()) (7.18s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest (0.96s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.44s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest (6.21s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.01s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.85s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.45s) --- PASS: TestQueryShardingCorrectness/sum(min_over_time())/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (2.46s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by' (2.72s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (2.07s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.49s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.67s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.41s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.49s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (0.65s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/max()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping (0.73s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.33s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (0.36s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.11s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.04s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without' (1.29s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.46s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.06s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (0.82s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.11s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.18s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/min()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.26s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1) (1.90s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest (0.74s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.18s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest (1.16s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.45s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/sum(metric_counter)_>_0_and_vector(1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.22s) --- PASS: TestQueryShardingCorrectness/stdvar() (1.86s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest (0.48s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.05s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest (1.36s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.30s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.24s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.16s) --- PASS: TestQueryShardingCorrectness/stdvar()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series (18.57s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.84s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.14s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.18s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.21s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest (17.73s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (3.47s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (3.03s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (5.05s) --- PASS: TestQueryShardingCorrectness/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (4.55s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric) (0.24s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest (0.10s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest (0.13s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.02s) --- PASS: TestQueryShardingCorrectness/scalar(single_metric)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month() (0.12s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest (0.05s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest (0.07s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/month()_>=_1_and_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/label_replace (1.57s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest (0.37s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.03s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.10s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.14s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest (1.20s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.17s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.28s) --- PASS: TestQueryShardingCorrectness/label_replace/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.44s) --- PASS: TestQueryShardingCorrectness/bottomk() (1.70s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest (0.26s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.06s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.06s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest (1.44s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.54s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.22s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.22s) --- PASS: TestQueryShardingCorrectness/bottomk()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.28s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset (1.49s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest (0.63s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.14s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.28s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest (0.87s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum()_negative_offset/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1 (0.15s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest (0.06s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.01s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.02s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.01s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest (0.09s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.03s) --- PASS: TestQueryShardingCorrectness/0_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter)) (2.45s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest (0.71s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.15s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest (1.72s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.44s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.27s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.46s) --- PASS: TestQueryShardingCorrectness/month(sum(metric_counter))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.34s) --- PASS: TestQueryShardingCorrectness/time() (0.33s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest (0.08s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.02s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.01s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.01s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.04s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest (0.25s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.08s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.05s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.09s) --- PASS: TestQueryShardingCorrectness/time()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.02s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by' (3.74s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (1.33s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.15s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.25s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.27s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.51s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (2.41s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.51s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.34s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.50s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.50s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar (7.42s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest (0.68s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.23s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest (6.74s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.96s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.21s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.64s) --- PASS: TestQueryShardingCorrectness/filtering_binary_operation_with_constant_scalar/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.64s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand (1.47s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.08s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.10s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.13s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest (0.92s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.19s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.23s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.16s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg (0.33s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest (0.33s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.05s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.07s) --- PASS: TestQueryShardingCorrectness/outer_subquery_on_top_of_avg/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.09s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month() (2.00s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest (0.50s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.15s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest (1.49s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.17s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.25s) --- PASS: TestQueryShardingCorrectness/sum(rate())_/_vector(3)_^_month()/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.35s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children (4.19s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest (1.93s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.40s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.62s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.21s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.24s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest (2.26s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.33s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.17s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.90s) --- PASS: TestQueryShardingCorrectness/subqueries_with_non_parallelizable_function_in_children/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.44s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping (2.78s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest (0.94s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.09s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.19s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.25s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.33s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest (1.83s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.19s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.32s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.51s) --- PASS: TestQueryShardingCorrectness/avg()_no_grouping/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.55s) --- PASS: TestQueryShardingCorrectness/label_join (2.43s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest (0.52s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.04s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.06s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.25s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest (1.90s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.30s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.49s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.40s) --- PASS: TestQueryShardingCorrectness/label_join/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.38s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m])) (14.81s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest (3.05s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.75s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.43s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.73s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.80s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest (11.76s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (2.82s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.79s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.37s) --- PASS: TestQueryShardingCorrectness/sum_by_(group_1)_(count_over_time({__name__!=""}[1m]))/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.77s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2 (5.19s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest (1.02s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.04s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.16s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.23s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.51s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest (4.17s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.79s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.70s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.71s) --- PASS: TestQueryShardingCorrectness/sum_by_(rate())_/_time()_*2/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.95s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""}) (10.37s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest (2.32s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.32s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.31s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.65s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.57s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest (8.05s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (2.09s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.20s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.24s) --- PASS: TestQueryShardingCorrectness/sum({__name__!=""})/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.88s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by' (1.70s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.60s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.15s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.12s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.19s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest (1.09s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.18s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.12s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.17s) --- PASS: TestQueryShardingCorrectness/count()_grouping_'by'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.38s) --- PASS: TestQueryShardingCorrectness/and (4.04s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest (0.79s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.24s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.10s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.11s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.18s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest (3.23s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.39s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.62s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.55s) --- PASS: TestQueryShardingCorrectness/and/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.02s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series (6.46s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.80s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.07s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.29s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.33s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest (5.66s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (1.54s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.98s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.39s) --- PASS: TestQueryShardingCorrectness/sum(rate())_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.97s) --- PASS: TestQueryShardingCorrectness/@_modifier (3.44s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest (1.75s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.25s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.18s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.55s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.35s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest (1.69s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.21s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.27s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.42s) --- PASS: TestQueryShardingCorrectness/@_modifier/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.56s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation) (1.86s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.13s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.20s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.26s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest (0.94s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.14s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.09s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.39s) --- PASS: TestQueryShardingCorrectness/scalar(aggregation)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.20s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without' (6.09s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (0.99s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.10s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.17s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.34s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.34s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest (5.08s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.90s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (1.21s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (1.06s) --- PASS: TestQueryShardingCorrectness/avg()_grouping_'without'/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (1.69s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1 (2.05s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest (0.86s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.06s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.11s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.21s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.43s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest (1.18s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (0.20s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (0.21s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (0.24s) --- PASS: TestQueryShardingCorrectness/scalar(sum(metric_counter))_<_bool_1/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (0.30s) --- PASS: TestQueryShardingCorrectness/subquery_max (34.72s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest (3.90s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (1.21s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.53s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.66s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (1.26s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest (30.80s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (10.03s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (9.39s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (6.49s) --- PASS: TestQueryShardingCorrectness/subquery_max/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (3.95s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand (33.60s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest (2.61s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (0.37s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.93s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (0.73s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (0.47s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest (30.98s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (10.57s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (5.08s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (5.20s) --- PASS: TestQueryShardingCorrectness/binary_operation_with_an_aggregation_by_some_label_on_one_hand/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (4.15s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1) (52.66s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest (5.00s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=2 (1.10s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=4 (0.75s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=8 (1.19s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusInstantQueryRequest/shards=16 (1.72s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest (47.65s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=2 (11.24s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=4 (9.22s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=8 (8.51s) --- PASS: TestQueryShardingCorrectness/sum_by(unique)_*_on_(unique)_group_left_(group_1)_avg_by_(unique,_group_1)/*querymiddleware.PrometheusRangeQueryRequest/shards=16 (9.13s) === RUN TestQueryshardingDeterminism --- PASS: TestQueryshardingDeterminism (0.73s) === RUN TestQuerySharding_FunctionCorrectness === RUN TestQuerySharding_FunctionCorrectness/(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(abs(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(avg_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(ceil(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(changes(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(count_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(days_in_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_week(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(delta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(deriv(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(exp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(floor(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(hour(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(idelta(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(increase(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(irate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(ln(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(log10(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(log2(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(max_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(min_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(minute(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(month(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(rate(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(resets(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort_desc(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sqrt(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(deg(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(asinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(rad(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(cosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(atan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(atanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(asin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sinh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(cos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(acosh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sin(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(tanh(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(tan(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(acos(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(stddev_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(stdvar_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sum_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(last_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(present_over_time(bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) === RUN TestQuerySharding_FunctionCorrectness/(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(timestamp(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(year(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(sgn(bar1{})) === RUN TestQuerySharding_FunctionCorrectness/(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/sum(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/count(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp(bar1{},5,10)) === RUN TestQuerySharding_FunctionCorrectness/(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_max(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_min(bar1{},5)) === RUN TestQuerySharding_FunctionCorrectness/(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/sum(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/count(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(predict_linear(bar1{}[1m],1)) === RUN TestQuerySharding_FunctionCorrectness/(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/sum(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/count(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(round(bar1{},20)) === RUN TestQuerySharding_FunctionCorrectness/(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/sum(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/count(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) === RUN TestQuerySharding_FunctionCorrectness/(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/sum(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/count(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) === RUN TestQuerySharding_FunctionCorrectness/(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/sum(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/count(label_join(bar1{},"fuzz",",","foo","bar")) === RUN TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) --- PASS: TestQuerySharding_FunctionCorrectness (7.74s) --- PASS: TestQuerySharding_FunctionCorrectness/(abs(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(abs(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(abs(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(abs(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(abs(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(avg_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(avg_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(avg_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(avg_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(avg_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(ceil(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(ceil(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ceil(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(ceil(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(ceil(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(changes(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(changes(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(changes(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(changes(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(changes(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(count_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(count_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(count_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(count_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(count_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(days_in_month(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(days_in_month(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(days_in_month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(days_in_month(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(days_in_month(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(day_of_month(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(day_of_month(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(day_of_month(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_month(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(day_of_week(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(day_of_week(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_week(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(day_of_week(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_week(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(day_of_year(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(day_of_year(bar1{})) (0.07s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(day_of_year(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(day_of_year(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(day_of_year(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(delta(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(delta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(delta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(delta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(delta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(deriv(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(deriv(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deriv(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(deriv(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(deriv(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(exp(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(exp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(exp(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(exp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(exp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(floor(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(floor(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(floor(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(floor(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(hour(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(hour(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(hour(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(hour(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(hour(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(idelta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(idelta(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(idelta(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(idelta(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(idelta(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(increase(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(increase(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(increase(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(increase(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(increase(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(irate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(irate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(irate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(irate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(irate(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(ln(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(ln(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(ln(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(ln(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(ln(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(log10(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(log10(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log10(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(log10(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(log10(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(log2(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(log2(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(log2(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(log2(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(log2(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(max_over_time(bar1{}[1m])) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(max_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(max_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(max_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(max_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(min_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(min_over_time(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(min_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(min_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(min_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(minute(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(minute(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(minute(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(minute(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(minute(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(month(bar1{})) (0.07s) --- PASS: TestQuerySharding_FunctionCorrectness/count(month(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(month(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(rate(bar1{}[1m])) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(rate(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rate(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(rate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(rate(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(resets(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(resets(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(resets(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(resets(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(resets(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(sort(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sort(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sort(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(sort_desc(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sort_desc(bar1{})) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sort_desc(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sort_desc(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sort_desc(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(sqrt(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sqrt(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sqrt(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sqrt(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sqrt(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(deg(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(deg(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(deg(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(deg(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(deg(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(asinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(asinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(asinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(asinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(rad(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(rad(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(rad(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(rad(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(rad(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(cosh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(cosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(cosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(cosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(atan(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(atan(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(atan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(atan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(atanh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(atanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(atanh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(atanh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(atanh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(asin(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(asin(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(asin(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(asin(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(asin(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(sinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sinh(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sinh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(cos(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(cos(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(cos(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(cos(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(cos(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(acosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(acosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acosh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(acosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(acosh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(sin(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sin(bar1{})) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sin(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sin(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sin(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(tanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(tanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(tanh(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(tanh(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(tan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(tan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(tan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(tan(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(tan(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(acos(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(acos(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(acos(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(acos(bar1{})) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(acos(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(stddev_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(stddev_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stddev_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(stddev_over_time(bar1{}[1m])) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(stddev_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(stdvar_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(stdvar_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(stdvar_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(stdvar_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(stdvar_over_time(bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(sum_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sum_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sum_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sum_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(last_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(last_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(last_over_time(bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(last_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(last_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(present_over_time(bar1{}[1m])) (0.08s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(present_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(present_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(present_over_time(bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(present_over_time(bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.5,bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.5,bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.5,bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.5,bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(quantile_over_time(0.99,bar1{}[1m])) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(quantile_over_time(0.99,bar1{}[1m])) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(quantile_over_time(0.99,bar1{}[1m])) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(quantile_over_time(0.99,bar1{}[1m])) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(timestamp(bar1{})) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(timestamp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(timestamp(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(timestamp(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(timestamp(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(year(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(year(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(year(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(year(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(year(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(sgn(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(sgn(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(sgn(bar1{})) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(sgn(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(sgn(bar1{})) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(clamp(bar1{},5,10)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(clamp(bar1{},5,10)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp(bar1{},5,10)) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(clamp(bar1{},5,10)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp(bar1{},5,10)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(clamp_max(bar1{},5)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(clamp_max(bar1{},5)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_max(bar1{},5)) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(clamp_max(bar1{},5)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_max(bar1{},5)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/(clamp_min(bar1{},5)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(clamp_min(bar1{},5)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(clamp_min(bar1{},5)) (0.06s) --- PASS: TestQuerySharding_FunctionCorrectness/count(clamp_min(bar1{},5)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(clamp_min(bar1{},5)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(predict_linear(bar1{}[1m],1)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(predict_linear(bar1{}[1m],1)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(predict_linear(bar1{}[1m],1)) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/count(predict_linear(bar1{}[1m],1)) (0.01s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(predict_linear(bar1{}[1m],1)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(round(bar1{},20)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(round(bar1{},20)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(round(bar1{},20)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(round(bar1{},20)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(round(bar1{},20)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(holt_winters(bar1{}[1m],0.5,0.7)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(holt_winters(bar1{}[1m],0.5,0.7)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count(holt_winters(bar1{}[1m],0.5,0.7)) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(holt_winters(bar1{}[1m],0.5,0.7)) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/count(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_replace(bar1{},"fuzz","$1","foo","b(.*)")) (0.04s) --- PASS: TestQuerySharding_FunctionCorrectness/(label_join(bar1{},"fuzz",",","foo","bar")) (0.03s) --- PASS: TestQuerySharding_FunctionCorrectness/sum(label_join(bar1{},"fuzz",",","foo","bar")) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/sum_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) (0.05s) --- PASS: TestQuerySharding_FunctionCorrectness/count(label_join(bar1{},"fuzz",",","foo","bar")) (0.02s) --- PASS: TestQuerySharding_FunctionCorrectness/count_by_(bar)(label_join(bar1{},"fuzz",",","foo","bar")) (0.03s) === RUN TestQuerySharding_ShouldFallbackToDownstreamHandlerOnMappingFailure --- PASS: TestQuerySharding_ShouldFallbackToDownstreamHandlerOnMappingFailure (0.00s) === RUN TestQuerySharding_ShouldSkipShardingViaOption --- PASS: TestQuerySharding_ShouldSkipShardingViaOption (0.00s) === RUN TestQuerySharding_ShouldOverrideShardingSizeViaOption --- PASS: TestQuerySharding_ShouldOverrideShardingSizeViaOption (0.28s) === RUN TestQuerySharding_ShouldSupportMaxShardedQueries === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_1_shardable_leg === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_no_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_4_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_10_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/query_sharding_is_disabled === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/query_is_not_shardable === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_1_shardable_leg === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_3_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_11_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_14_compactor_shards === RUN TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_many_shardable_legs --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries (0.32s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_1_shardable_leg (0.03s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs (0.01s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_no_compactor_shards (0.04s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_4_compactor_shards (0.03s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_10_compactor_shards (0.04s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/query_sharding_is_disabled (0.00s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/query_is_not_shardable (0.00s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_1_shardable_leg (0.01s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_3_compactor_shards (0.03s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_11_compactor_shards (0.05s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/multiple_splitted_queries,_query_has_2_shardable_legs,_14_compactor_shards (0.03s) --- PASS: TestQuerySharding_ShouldSupportMaxShardedQueries/single_splitted_query,_query_has_many_shardable_legs (0.03s) === RUN TestQuerySharding_ShouldReturnErrorOnDownstreamHandlerFailure --- PASS: TestQuerySharding_ShouldReturnErrorOnDownstreamHandlerFailure (0.00s) === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_timeout === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_sample_limit === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_timeout === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_internal_error === RUN TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_prometheus_execution_error --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat (0.71s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_timeout (0.34s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_sample_limit (0.00s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/sharding_-_timeout (0.34s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_internal_error (0.00s) --- PASS: TestQuerySharding_ShouldReturnErrorInCorrectFormat/downstream_-_storage_prometheus_execution_error (0.00s) === RUN TestQuerySharding_EngineErrorMapping --- PASS: TestQuerySharding_EngineErrorMapping (0.14s) === RUN TestQuerySharding_WrapMultipleTime --- PASS: TestQuerySharding_WrapMultipleTime (0.00s) === RUN TestPromqlResultToSampleStreams === RUN TestPromqlResultToSampleStreams/[0] === RUN TestPromqlResultToSampleStreams/[1] === RUN TestPromqlResultToSampleStreams/[2] === RUN TestPromqlResultToSampleStreams/[3] === RUN TestPromqlResultToSampleStreams/[4] --- PASS: TestPromqlResultToSampleStreams (0.00s) --- PASS: TestPromqlResultToSampleStreams/[0] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[1] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[2] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[3] (0.00s) --- PASS: TestPromqlResultToSampleStreams/[4] (0.00s) === RUN TestGenLabelsCorrectness --- PASS: TestGenLabelsCorrectness (0.00s) === RUN TestGenLabelsSize --- PASS: TestGenLabelsSize (0.01s) === RUN TestNewMockShardedqueryable --- PASS: TestNewMockShardedqueryable (0.07s) === RUN TestResultsCacheConfig_Validate === RUN TestResultsCacheConfig_Validate/should_fail_with_unsupported_backend === RUN TestResultsCacheConfig_Validate/should_pass_with_memcached_backend === RUN TestResultsCacheConfig_Validate/should_pass_with_default_config === RUN TestResultsCacheConfig_Validate/should_fail_with_invalid_memcached_config --- PASS: TestResultsCacheConfig_Validate (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_fail_with_unsupported_backend (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_pass_with_memcached_backend (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestResultsCacheConfig_Validate/should_fail_with_invalid_memcached_config (0.00s) === RUN TestIsRequestCachable === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector_with_start()_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_vector_selector_with_end()_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector_with_start()_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_matrix_selector_with_end()_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_after_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries_with_start()_before_maxCacheTime === RUN TestIsRequestCachable/@_modifier_on_subqueries_with_end()_after_maxCacheTime === RUN TestIsRequestCachable/positive_offset_on_vector_selector === RUN TestIsRequestCachable/negative_offset_on_vector_selector === RUN TestIsRequestCachable/positive_offset_on_subqueries === RUN TestIsRequestCachable/negative_offset_on_subqueries === RUN TestIsRequestCachable/request_that_is_step_aligned === RUN TestIsRequestCachable/request_that_is_NOT_step_aligned,_with_cacheStepUnaligned=false === RUN TestIsRequestCachable/request_that_is_NOT_step_aligned --- PASS: TestIsRequestCachable (0.01s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_before_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector,_after_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector_with_start()_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_vector_selector_with_end()_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_before_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector,_after_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector_with_start()_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_matrix_selector_with_end()_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_before_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries,_after_end,_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries_with_start()_before_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/@_modifier_on_subqueries_with_end()_after_maxCacheTime (0.00s) --- PASS: TestIsRequestCachable/positive_offset_on_vector_selector (0.00s) --- PASS: TestIsRequestCachable/negative_offset_on_vector_selector (0.00s) --- PASS: TestIsRequestCachable/positive_offset_on_subqueries (0.00s) --- PASS: TestIsRequestCachable/negative_offset_on_subqueries (0.00s) --- PASS: TestIsRequestCachable/request_that_is_step_aligned (0.00s) --- PASS: TestIsRequestCachable/request_that_is_NOT_step_aligned,_with_cacheStepUnaligned=false (0.00s) --- PASS: TestIsRequestCachable/request_that_is_NOT_step_aligned (0.00s) === RUN TestIsResponseCachable === RUN TestIsResponseCachable/does_not_contain_the_cacheControl_header === RUN TestIsResponseCachable/does_contain_the_cacheControl_header_which_has_the_value === RUN TestIsResponseCachable/cacheControl_header_contains_extra_values_but_still_good === RUN TestIsResponseCachable/broken_response === RUN TestIsResponseCachable/nil_headers === RUN TestIsResponseCachable/had_cacheControl_header_but_no_values --- PASS: TestIsResponseCachable (0.00s) --- PASS: TestIsResponseCachable/does_not_contain_the_cacheControl_header (0.00s) --- PASS: TestIsResponseCachable/does_contain_the_cacheControl_header_which_has_the_value (0.00s) --- PASS: TestIsResponseCachable/cacheControl_header_contains_extra_values_but_still_good (0.00s) --- PASS: TestIsResponseCachable/broken_response (0.00s) --- PASS: TestIsResponseCachable/nil_headers (0.00s) --- PASS: TestIsResponseCachable/had_cacheControl_header_but_no_values (0.00s) === RUN TestPartitionCacheExtents === RUN TestPartitionCacheExtents/Test_a_complete_hit. === RUN TestPartitionCacheExtents/Test_with_a_complete_miss. === RUN TestPartitionCacheExtents/Test_a_partial_hit. === RUN TestPartitionCacheExtents/Test_multiple_partial_hits. === RUN TestPartitionCacheExtents/Partial_hits_with_tiny_gap. === RUN TestPartitionCacheExtents/Extent_is_outside_the_range_and_the_request_has_a_single_step_(same_start_and_end). === RUN TestPartitionCacheExtents/Test_when_hit_has_a_large_step_and_only_a_single_sample_extent. === RUN TestPartitionCacheExtents/Start_time_of_all_requests_must_have_the_same_offset_into_the_step. --- PASS: TestPartitionCacheExtents (0.00s) --- PASS: TestPartitionCacheExtents/Test_a_complete_hit. (0.00s) --- PASS: TestPartitionCacheExtents/Test_with_a_complete_miss. (0.00s) --- PASS: TestPartitionCacheExtents/Test_a_partial_hit. (0.00s) --- PASS: TestPartitionCacheExtents/Test_multiple_partial_hits. (0.00s) --- PASS: TestPartitionCacheExtents/Partial_hits_with_tiny_gap. (0.00s) --- PASS: TestPartitionCacheExtents/Extent_is_outside_the_range_and_the_request_has_a_single_step_(same_start_and_end). (0.00s) --- PASS: TestPartitionCacheExtents/Test_when_hit_has_a_large_step_and_only_a_single_sample_extent. (0.00s) --- PASS: TestPartitionCacheExtents/Start_time_of_all_requests_must_have_the_same_offset_into_the_step. (0.00s) === RUN TestConstSplitter_generateCacheKey === PAUSE TestConstSplitter_generateCacheKey === RUN TestRetry === RUN TestRetry/retry_failures === RUN TestRetry/don't_retry_400s === RUN TestRetry/retry_500s === RUN TestRetry/last_error --- PASS: TestRetry (0.01s) --- PASS: TestRetry/retry_failures (0.00s) --- PASS: TestRetry/don't_retry_400s (0.00s) --- PASS: TestRetry/retry_500s (0.00s) --- PASS: TestRetry/last_error (0.00s) === RUN Test_RetryMiddlewareCancel --- PASS: Test_RetryMiddlewareCancel (0.00s) === RUN TestRangeTripperware === RUN TestRangeTripperware/0 === RUN TestRangeTripperware/1 --- PASS: TestRangeTripperware (0.01s) --- PASS: TestRangeTripperware/0 (0.00s) --- PASS: TestRangeTripperware/1 (0.00s) === RUN TestInstantTripperware === RUN TestInstantTripperware/specific_time_happy_case === RUN TestInstantTripperware/specific_time_param_with_form_being_already_parsed === RUN TestInstantTripperware/default_time_param_happy_case === RUN TestInstantTripperware/default_time_param_with_form_being_already_parsed === RUN TestInstantTripperware/post_form_time_param_takes_precedence_over_query_time_param_ --- PASS: TestInstantTripperware (0.06s) --- PASS: TestInstantTripperware/specific_time_happy_case (0.01s) --- PASS: TestInstantTripperware/specific_time_param_with_form_being_already_parsed (0.01s) --- PASS: TestInstantTripperware/default_time_param_happy_case (0.01s) --- PASS: TestInstantTripperware/default_time_param_with_form_being_already_parsed (0.01s) --- PASS: TestInstantTripperware/post_form_time_param_takes_precedence_over_query_time_param_ (0.02s) === RUN TestTripperware_Metrics === RUN TestTripperware_Metrics/start/end_is_aligned_to_step === RUN TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_disabled === RUN TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_enabled --- PASS: TestTripperware_Metrics (0.07s) --- PASS: TestTripperware_Metrics/start/end_is_aligned_to_step (0.01s) --- PASS: TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_disabled (0.01s) --- PASS: TestTripperware_Metrics/start/end_is_not_aligned_to_step,_aligning_enabled (0.04s) === RUN TestShardedQuerier_Select === RUN TestShardedQuerier_Select/errors_non_embedded_query === RUN TestShardedQuerier_Select/replaces_query === RUN TestShardedQuerier_Select/propagates_response_error === RUN TestShardedQuerier_Select/returns_SeriesSet --- PASS: TestShardedQuerier_Select (0.00s) --- PASS: TestShardedQuerier_Select/errors_non_embedded_query (0.00s) --- PASS: TestShardedQuerier_Select/replaces_query (0.00s) --- PASS: TestShardedQuerier_Select/propagates_response_error (0.00s) --- PASS: TestShardedQuerier_Select/returns_SeriesSet (0.00s) === RUN TestShardedQuerier_Select_ShouldConcurrentlyRunEmbeddedQueries --- PASS: TestShardedQuerier_Select_ShouldConcurrentlyRunEmbeddedQueries (0.00s) === RUN TestShardedQueryable_GetResponseHeaders --- PASS: TestShardedQueryable_GetResponseHeaders (0.00s) === RUN TestNewSeriesSetFromEmbeddedQueriesResults === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_add_a_stale_marker_at_the_end_even_if_if_input_samples_have_no_gaps === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_add_stale_markers_at_the_beginning_of_each_gap_and_one_at_the_end_of_the_series === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_hints_is_not_passed === RUN TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_step_==_0 --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_add_a_stale_marker_at_the_end_even_if_if_input_samples_have_no_gaps (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_add_stale_markers_at_the_beginning_of_each_gap_and_one_at_the_end_of_the_series (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_hints_is_not_passed (0.00s) --- PASS: TestNewSeriesSetFromEmbeddedQueriesResults/should_not_add_stale_markers_even_if_points_have_gaps_if_step_==_0 (0.00s) === RUN TestResponseToSamples --- PASS: TestResponseToSamples (0.00s) === RUN TestSplitAndCacheMiddleware_SplitByInterval --- PASS: TestSplitAndCacheMiddleware_SplitByInterval (0.01s) === RUN TestSplitAndCacheMiddleware_ResultsCache --- PASS: TestSplitAndCacheMiddleware_ResultsCache (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotLookupCacheIfStepIsNotAligned --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotLookupCacheIfStepIsNotAligned (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCache_EnabledCachingOfStepUnalignedRequest --- PASS: TestSplitAndCacheMiddleware_ResultsCache_EnabledCachingOfStepUnalignedRequest (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_not_cache_a_response_if_query_time_range_is_earlier_than_max_cache_freshness === RUN TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_cache_a_response_up_until_max_cache_freshness_time_ago --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_not_cache_a_response_if_query_time_range_is_earlier_than_max_cache_freshness (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ShouldNotCacheRequestEarlierThanMaxCacheFreshness/should_cache_a_response_up_until_max_cache_freshness_time_ago (0.00s) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy split_and_cache_test.go:617: random generator seed: 1681074624861946110 === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) === RUN TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) === PAUSE TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) === CONT TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy (16.25s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_10) (21.33s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_10) (21.06s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_10) (43.72s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_10) (15.39s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_1) (77.92s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/increased_max_cache_freshness_(concurrency:_1) (52.96s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/split_by_interval_disabled_(concurrency:_1) (98.76s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_10) (14.02s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/cache_unaligned_requests_(concurrency:_1) (54.32s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/default_config_(concurrency:_10) (20.23s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_10) (27.14s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/reduced_query_parallelism_(concurrency:_1) (66.39s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/results_cache_disabled_(concurrency:_1) (27.71s) --- PASS: TestSplitAndCacheMiddleware_ResultsCacheFuzzy/both_split_by_interval_and_results_cache_disabled_(concurrency:_1) (62.97s) === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_left-overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_right-overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_merge_fragmented_extents_if_request_fills_the_hole === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_left-extend_extent_if_request_starts_earlier_than_extent_in_cache === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_right-extend_extent_if_request_ends_later_than_extent_in_cache === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_completely_overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_center-overlaps_with_tiny_request === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_throw_error_if_complete-overlapped_smaller_Extent_is_erroneous === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_drop_tiny_extent_that_overlaps_with_non-tiny_request_only === RUN TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_replace_tiny_extents_that_are_cover_by_bigger_request --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases (0.02s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_left-overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_right-overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_merge_fragmented_extents_if_request_fills_the_hole (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_left-extend_extent_if_request_starts_earlier_than_extent_in_cache (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_right-extend_extent_if_request_ends_later_than_extent_in_cache (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_completely_overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_drop_tiny_extent_that_partially_center-overlaps_with_tiny_request (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_not_throw_error_if_complete-overlapped_smaller_Extent_is_erroneous (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_drop_tiny_extent_that_overlaps_with_non-tiny_request_only (0.00s) --- PASS: TestSplitAndCacheMiddleware_ResultsCache_ExtentsEdgeCases/Should_replace_tiny_extents_that_are_cover_by_bigger_request (0.00s) === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_but_empty_extents_on_cache_miss === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_and_some_extends_filled_up_on_partial_cache_hit === RUN TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_not_return_an_extent_if_its_key_doesn't_match_the_requested_one_(hash_collision) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents (0.00s) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_but_empty_extents_on_cache_miss (0.00s) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_return_a_slice_with_the_same_number_of_input_keys_and_some_extends_filled_up_on_partial_cache_hit (0.00s) --- PASS: TestSplitAndCacheMiddleware_StoreAndFetchCacheExtents/fetchCacheExtents()_should_not_return_an_extent_if_its_key_doesn't_match_the_requested_one_(hash_collision) (0.00s) === RUN TestSplitAndCacheMiddleware_WrapMultipleTimes --- PASS: TestSplitAndCacheMiddleware_WrapMultipleTimes (0.00s) === RUN TestSplitRequests_prepareDownstreamRequests === RUN TestSplitRequests_prepareDownstreamRequests/should_return_an_empty_slice_on_no_downstream_requests === RUN TestSplitRequests_prepareDownstreamRequests/should_inject_ID_and_hints_on_downstream_requests_and_return_them --- PASS: TestSplitRequests_prepareDownstreamRequests (0.00s) --- PASS: TestSplitRequests_prepareDownstreamRequests/should_return_an_empty_slice_on_no_downstream_requests (0.00s) --- PASS: TestSplitRequests_prepareDownstreamRequests/should_inject_ID_and_hints_on_downstream_requests_and_return_them (0.00s) === RUN TestSplitRequests_storeDownstreamResponses === RUN TestSplitRequests_storeDownstreamResponses/should_do_nothing_on_no_downstream_requests === RUN TestSplitRequests_storeDownstreamResponses/should_associate_downstream_responses_to_requests === RUN TestSplitRequests_storeDownstreamResponses/should_return_error_if_a_downstream_response_is_missing === RUN TestSplitRequests_storeDownstreamResponses/should_return_error_if_multiple_downstream_responses_have_the_same_ID === RUN TestSplitRequests_storeDownstreamResponses/should_return_error_if_extra_downstream_responses_are_requested_to_be_stored --- PASS: TestSplitRequests_storeDownstreamResponses (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_do_nothing_on_no_downstream_requests (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_associate_downstream_responses_to_requests (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_return_error_if_a_downstream_response_is_missing (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_return_error_if_multiple_downstream_responses_have_the_same_ID (0.00s) --- PASS: TestSplitRequests_storeDownstreamResponses/should_return_error_if_extra_downstream_responses_are_requested_to_be_stored (0.00s) === RUN TestNextIntervalBoundary === RUN TestNextIntervalBoundary/0 === RUN TestNextIntervalBoundary/1 === RUN TestNextIntervalBoundary/2 === RUN TestNextIntervalBoundary/3 === RUN TestNextIntervalBoundary/4 === RUN TestNextIntervalBoundary/5 === RUN TestNextIntervalBoundary/6 === RUN TestNextIntervalBoundary/7 === RUN TestNextIntervalBoundary/8 === RUN TestNextIntervalBoundary/9 === RUN TestNextIntervalBoundary/10 === RUN TestNextIntervalBoundary/11 === RUN TestNextIntervalBoundary/12 === RUN TestNextIntervalBoundary/13 === RUN TestNextIntervalBoundary/14 === RUN TestNextIntervalBoundary/15 --- PASS: TestNextIntervalBoundary (0.01s) --- PASS: TestNextIntervalBoundary/0 (0.00s) --- PASS: TestNextIntervalBoundary/1 (0.00s) --- PASS: TestNextIntervalBoundary/2 (0.00s) --- PASS: TestNextIntervalBoundary/3 (0.00s) --- PASS: TestNextIntervalBoundary/4 (0.00s) --- PASS: TestNextIntervalBoundary/5 (0.00s) --- PASS: TestNextIntervalBoundary/6 (0.00s) --- PASS: TestNextIntervalBoundary/7 (0.00s) --- PASS: TestNextIntervalBoundary/8 (0.00s) --- PASS: TestNextIntervalBoundary/9 (0.00s) --- PASS: TestNextIntervalBoundary/10 (0.00s) --- PASS: TestNextIntervalBoundary/11 (0.00s) --- PASS: TestNextIntervalBoundary/12 (0.00s) --- PASS: TestNextIntervalBoundary/13 (0.00s) --- PASS: TestNextIntervalBoundary/14 (0.00s) --- PASS: TestNextIntervalBoundary/15 (0.00s) === RUN TestSplitQueryByInterval === RUN TestSplitQueryByInterval/0:_start:_0,_end:_3600000,_step:_15000 === RUN TestSplitQueryByInterval/1:_start:_0,_end:_3600000,_step:_15000 === RUN TestSplitQueryByInterval/2:_start:_0,_end:_86400000,_step:_15000 === RUN TestSplitQueryByInterval/3:_start:_0,_end:_10800000,_step:_15000 === RUN TestSplitQueryByInterval/4:_start:_0,_end:_172800000,_step:_15000 === RUN TestSplitQueryByInterval/5:_start:_0,_end:_21600000,_step:_15000 === RUN TestSplitQueryByInterval/6:_start:_10800000,_end:_259200000,_step:_15000 === RUN TestSplitQueryByInterval/7:_start:_7200000,_end:_32400000,_step:_15000 === RUN TestSplitQueryByInterval/8:_start:_1634255280000,_end:_1634256180000,_step:_300000 === RUN TestSplitQueryByInterval/9:_start:_1634255280000,_end:_1634256000000,_step:_360000 === RUN TestSplitQueryByInterval/10:_start:_1634248800000,_end:_1634508000000,_step:_86400000 === RUN TestSplitQueryByInterval/11:_start:_1634256000000,_end:_1634515200000,_step:_86400000 === RUN TestSplitQueryByInterval/12:_start:_1634335200000,_end:_1634875200000,_step:_108000000 === RUN TestSplitQueryByInterval/13:_start:_1634277600000,_end:_1634479200000,_step:_43200000 === RUN TestSplitQueryByInterval/14:_start:_1634277600000,_end:_1634493600000,_step:_43200000 === RUN TestSplitQueryByInterval/15:_start:_1634277600000,_end:_1634493600000,_step:_36000000 === RUN TestSplitQueryByInterval/16:_start:_1634277600000,_end:_1634457600000,_step:_36000000 --- PASS: TestSplitQueryByInterval (0.01s) --- PASS: TestSplitQueryByInterval/0:_start:_0,_end:_3600000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/1:_start:_0,_end:_3600000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/2:_start:_0,_end:_86400000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/3:_start:_0,_end:_10800000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/4:_start:_0,_end:_172800000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/5:_start:_0,_end:_21600000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/6:_start:_10800000,_end:_259200000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/7:_start:_7200000,_end:_32400000,_step:_15000 (0.00s) --- PASS: TestSplitQueryByInterval/8:_start:_1634255280000,_end:_1634256180000,_step:_300000 (0.00s) --- PASS: TestSplitQueryByInterval/9:_start:_1634255280000,_end:_1634256000000,_step:_360000 (0.00s) --- PASS: TestSplitQueryByInterval/10:_start:_1634248800000,_end:_1634508000000,_step:_86400000 (0.00s) --- PASS: TestSplitQueryByInterval/11:_start:_1634256000000,_end:_1634515200000,_step:_86400000 (0.00s) --- PASS: TestSplitQueryByInterval/12:_start:_1634335200000,_end:_1634875200000,_step:_108000000 (0.00s) --- PASS: TestSplitQueryByInterval/13:_start:_1634277600000,_end:_1634479200000,_step:_43200000 (0.00s) --- PASS: TestSplitQueryByInterval/14:_start:_1634277600000,_end:_1634493600000,_step:_43200000 (0.00s) --- PASS: TestSplitQueryByInterval/15:_start:_1634277600000,_end:_1634493600000,_step:_36000000 (0.00s) --- PASS: TestSplitQueryByInterval/16:_start:_1634277600000,_end:_1634457600000,_step:_36000000 (0.00s) === RUN Test_evaluateAtModifier === RUN Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) === PAUSE Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) === RUN Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) === PAUSE Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) === RUN Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 === PAUSE Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 === RUN Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) === PAUSE Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) === RUN Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) === PAUSE Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) === CONT Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) === CONT Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) === CONT Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) === CONT Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 === CONT Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) --- PASS: Test_evaluateAtModifier (0.00s) --- PASS: Test_evaluateAtModifier/sum_by_(foo)_(bar[buzz]) (0.00s) --- PASS: Test_evaluateAtModifier/http_requests_total[1h]_@_10.001 (0.00s) --- PASS: Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_0)) (0.00s) --- PASS: Test_evaluateAtModifier/topk(5,_rate(http_requests_total[1h]_@_start())) (0.00s) --- PASS: Test_evaluateAtModifier/min_over_time(_____sum_by(cluster)_(______rate(http_requests_total[5m]_@_end())_____)[10m:]____)____or____max_over_time(_____stddev_over_time(______deriv(_______rate(http_requests_total[10m]_@_start())______[5m:1m])_____[2m:])____[10m:]) (0.00s) === RUN TestSplitAndCacheMiddlewareLowerTTL --- PASS: TestSplitAndCacheMiddlewareLowerTTL (0.00s) === RUN TestInstantQuerySplittingCorrectness === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time() === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start() === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end()) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate()) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end()) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate()) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time() === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start() === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without' === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round === PAUSE TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate()) === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time() === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2 === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00 === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sqrt === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sqrt === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate()_or_rate()) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_3m === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/quantile_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/resets === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/resets === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/vector(10) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-30s === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/irate === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/irate === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_max === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/exp === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/exp === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ln === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ln === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time_offset_1m_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_join === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_join === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/10_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_@_end()) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time_@_`start`_offset_1m) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(sum(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'without' === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_+_count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-2m === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/changes === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/changes === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_min === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_replace === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_30s === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_-1m === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/present_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/time() === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/time() === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(3m)_/_rate(3m)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_5m === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/holt_winters === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/floor === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/floor === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_only_'by'_le === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(avg_over_time_@_`start`) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_values(count_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/log2 === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/log2 === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_10 === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(max(rate)) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/predict_linear === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time_@_start() === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time_@_start() === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/increase === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/increase === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sgn === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sgn === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/delta === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/delta === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/deriv === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/deriv === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/round === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/round === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(1m)_/_rate(subquery)_>_0.5 === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/idelta === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/idelta === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/last_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort_desc === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate)_grouping_'by' === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_rate === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(avg_over_time) === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stdvar_over_time === PAUSE TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stdvar_over_time === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sqrt === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time_@_start() === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stdvar_over_time === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sqrt/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort_desc === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort_desc/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/last_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/last_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/idelta === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/idelta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(1m)_/_rate(subquery)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/round === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/round/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/deriv === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/deriv/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/delta === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/delta/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sgn === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sgn/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/increase === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/increase/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_+_count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/predict_linear === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/predict_linear/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(max(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_10 === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/log2 === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/log2/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_values(count_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(avg_over_time_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_only_'by'_le === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/floor === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/floor/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/holt_winters === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/holt_winters/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_5m === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(3m)_/_rate(3m)_>_0.5 === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/time() === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/time()/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/present_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/present_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_-1m === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_30s === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_replace === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_replace/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_min === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_min/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/changes === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/changes/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-2m === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/(avg_over_time) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time_offset_1m_@_`start`) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'without' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(sum(rate)) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time_@_`start`_offset_1m) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_@_end()) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/10_/_rate === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_join === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_join/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-30s === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(rate) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ln === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ln/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/exp === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/exp/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_max === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_max/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/irate === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/irate/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/resets === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/resets/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate)_grouping_'by' === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/vector(10) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/vector(10)/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/quantile_over_time === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_3m === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest === CONT TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate()_or_rate()) === RUN TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest --- PASS: TestInstantQuerySplittingCorrectness (55.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z (0.66s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_join/*querymiddleware.PrometheusInstantQueryRequest (0.34s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by' (0.45s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.45s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate) (0.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m (1.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest (1.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time (1.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.37s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time (0.79s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.79s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round (1.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/round/*querymiddleware.PrometheusInstantQueryRequest (1.40s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time (1.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time (1.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by' (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/idelta/*querymiddleware.PrometheusInstantQueryRequest (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5 (2.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (2.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time (1.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate (1.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest (1.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate) (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.46s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start() (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without' (1.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (1.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by' (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate) (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp (1.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp/*querymiddleware.PrometheusInstantQueryRequest (1.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/irate/*querymiddleware.PrometheusInstantQueryRequest (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear (0.37s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest (0.37s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time) (1.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (1.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by' (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/deriv/*querymiddleware.PrometheusInstantQueryRequest (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.74s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time (0.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`) (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase (1.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/increase/*querymiddleware.PrometheusInstantQueryRequest (1.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate()) (0.54s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest (0.54s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m (1.25s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest (1.25s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m (1.34s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest (1.34s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile (4.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest (4.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest (0.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/floor/*querymiddleware.PrometheusInstantQueryRequest (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`) (0.88s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (0.88s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())) (0.29s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest (0.29s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate)) (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10 (0.94s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest (0.94s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters (0.46s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest (0.45s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min (1.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest (1.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end()) (0.41s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest (0.41s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate) (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time() (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/time()/*querymiddleware.PrometheusInstantQueryRequest (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate) (0.25s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.25s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest (0.91s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by' (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable (0.48s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.48s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt (0.82s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest (0.82s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time) (1.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (1.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate)) (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m) (0.89s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest (0.89s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time) (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.55s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate) (0.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.52s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent (0.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/absent/*querymiddleware.PrometheusInstantQueryRequest (0.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5 (1.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (1.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate) (0.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2 (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/log2/*querymiddleware.PrometheusInstantQueryRequest (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln (1.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/ln/*querymiddleware.PrometheusInstantQueryRequest (1.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta (0.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/delta/*querymiddleware.PrometheusInstantQueryRequest (0.43s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10) (0.02s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest (0.02s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time) (0.79s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.79s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by' (0.42s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.42s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sort/*querymiddleware.PrometheusInstantQueryRequest (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sgn/*querymiddleware.PrometheusInstantQueryRequest (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace (0.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest (0.41s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s (1.16s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest (1.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by' (1.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (1.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate (1.46s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest (1.46s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/exp/*querymiddleware.PrometheusInstantQueryRequest (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate (0.60s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/rate/*querymiddleware.PrometheusInstantQueryRequest (0.60s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/changes/*querymiddleware.PrometheusInstantQueryRequest (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets (0.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/resets/*querymiddleware.PrometheusInstantQueryRequest (0.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time (0.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate) (1.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (1.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le (0.89s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00.100Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest (0.89s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent (0.04s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent/*querymiddleware.PrometheusInstantQueryRequest (0.04s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time) (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by' (0.87s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.87s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`) (0.88s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (0.87s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time) (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())) (0.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest (0.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate) (0.25s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/resets/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/present_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m) (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/changes/*querymiddleware.PrometheusInstantQueryRequest (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp (1.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/exp/*querymiddleware.PrometheusInstantQueryRequest (1.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate)) (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate)) (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ln/*querymiddleware.PrometheusInstantQueryRequest (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10 (1.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest (1.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time (0.70s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.70s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace (0.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_replace/*querymiddleware.PrometheusInstantQueryRequest (0.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate) (0.54s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.54s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate()) (0.48s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest (0.48s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/idelta/*querymiddleware.PrometheusInstantQueryRequest (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt (1.11s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sqrt/*querymiddleware.PrometheusInstantQueryRequest (1.11s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.04s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round (1.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/round/*querymiddleware.PrometheusInstantQueryRequest (1.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate (1.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest (1.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time (0.73s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/last_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.73s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without' (1.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (1.56s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max (1.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_max/*querymiddleware.PrometheusInstantQueryRequest (1.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le (1.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest (1.57s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/irate/*querymiddleware.PrometheusInstantQueryRequest (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate) (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time (0.54s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.54s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest (0.78s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate) (0.54s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.54s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start() (0.81s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest (0.81s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5 (1.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (1.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m (1.08s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest (1.08s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc (0.65s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort_desc/*querymiddleware.PrometheusInstantQueryRequest (0.65s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sgn/*querymiddleware.PrometheusInstantQueryRequest (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor (1.10s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/floor/*querymiddleware.PrometheusInstantQueryRequest (1.10s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by' (0.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time (0.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by' (0.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate) (0.45s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.45s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate (0.52s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate/*querymiddleware.PrometheusInstantQueryRequest (0.52s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time (1.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/increase/*querymiddleware.PrometheusInstantQueryRequest (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time (0.88s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.88s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`) (0.90s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (0.90s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile (3.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest (3.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters (0.42s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/holt_winters/*querymiddleware.PrometheusInstantQueryRequest (0.42s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv (0.41s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/deriv/*querymiddleware.PrometheusInstantQueryRequest (0.41s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time (0.62s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.59s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by' (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate) (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/max(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time() (0.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/time()/*querymiddleware.PrometheusInstantQueryRequest (0.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time) (1.66s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (1.66s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by' (1.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (1.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time) (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m (1.13s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest (1.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate) (0.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.24s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by' (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/label_join/*querymiddleware.PrometheusInstantQueryRequest (0.15s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10) (0.02s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/vector(10)/*querymiddleware.PrometheusInstantQueryRequest (0.02s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate (1.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest (1.12s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5 (1.28s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (1.28s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/delta/*querymiddleware.PrometheusInstantQueryRequest (0.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by' (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sort/*querymiddleware.PrometheusInstantQueryRequest (0.61s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2 (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/log2/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate) (1.91s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (1.90s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear (0.49s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/predict_linear/*querymiddleware.PrometheusInstantQueryRequest (0.49s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end()) (0.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest (0.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min (0.98s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/clamp_min/*querymiddleware.PrometheusInstantQueryRequest (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2020-01-01T03:00:00Z/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest (0.35s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00 (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stdvar_over_time (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stdvar_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.82s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(avg_over_time) (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.91s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time_@_start() (1.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time_@_start()/*querymiddleware.PrometheusInstantQueryRequest (1.31s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sqrt (1.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sqrt/*querymiddleware.PrometheusInstantQueryRequest (1.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate)_grouping_'by' (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.84s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/last_over_time (0.67s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/last_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.66s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort_desc (1.23s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort_desc/*querymiddleware.PrometheusInstantQueryRequest (1.23s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp (1.23s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp/*querymiddleware.PrometheusInstantQueryRequest (1.23s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_rate (2.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_rate/*querymiddleware.PrometheusInstantQueryRequest (2.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/idelta (0.49s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/idelta/*querymiddleware.PrometheusInstantQueryRequest (0.49s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())) (0.23s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time()))/*querymiddleware.PrometheusInstantQueryRequest (0.23s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/deriv (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/deriv/*querymiddleware.PrometheusInstantQueryRequest (0.63s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(1m)_/_rate(subquery)_>_0.5 (1.16s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(1m)_/_rate(subquery)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (1.16s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/round (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/round/*querymiddleware.PrometheusInstantQueryRequest (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/delta (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/delta/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable (0.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_right_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sgn (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sgn/*querymiddleware.PrometheusInstantQueryRequest (1.05s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/increase (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/increase/*querymiddleware.PrometheusInstantQueryRequest (0.83s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate/*querymiddleware.PrometheusInstantQueryRequest (0.97s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(max(rate)) (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(max(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.21s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_+_count_over_time) (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_+_count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.92s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/predict_linear (0.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/predict_linear/*querymiddleware.PrometheusInstantQueryRequest (0.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time (0.80s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.80s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time (0.60s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.60s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/log2 (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/log2/*querymiddleware.PrometheusInstantQueryRequest (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_10 (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate_/_10/*querymiddleware.PrometheusInstantQueryRequest (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate)_grouping_'by' (0.43s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.43s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_values(count_over_time) (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_values(count_over_time)/*querymiddleware.PrometheusInstantQueryRequest (0.58s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate)_grouping_'by' (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'by' (1.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (1.53s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate) (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(rate)/*querymiddleware.PrometheusInstantQueryRequest (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(avg_over_time_@_`start`) (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg(avg_over_time_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (0.77s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time (1.34s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.34s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev_over_time (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.85s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_only_'by'_le (1.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_only_'by'_le/*querymiddleware.PrometheusInstantQueryRequest (1.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/holt_winters (0.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/holt_winters/*querymiddleware.PrometheusInstantQueryRequest (0.95s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate)_grouping_'by' (0.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/time() (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/time()/*querymiddleware.PrometheusInstantQueryRequest (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/floor (1.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/floor/*querymiddleware.PrometheusInstantQueryRequest (1.47s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_5m (1.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_5m/*querymiddleware.PrometheusInstantQueryRequest (1.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_grouping_'by' (0.39s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/present_over_time (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/present_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.93s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(3m)_/_rate(3m)_>_0.5 (1.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/rate(3m)_/_rate(3m)_>_0.5/*querymiddleware.PrometheusInstantQueryRequest (1.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_30s (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_30s/*querymiddleware.PrometheusInstantQueryRequest (0.86s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev(rate) (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/stddev(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.38s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate) (0.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_-1m (1.10s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time[3m]_offset_-1m/*querymiddleware.PrometheusInstantQueryRequest (1.10s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_replace (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_replace/*querymiddleware.PrometheusInstantQueryRequest (0.22s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/changes (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/changes/*querymiddleware.PrometheusInstantQueryRequest (0.64s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-2m (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-2m/*querymiddleware.PrometheusInstantQueryRequest (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_min (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_min/*querymiddleware.PrometheusInstantQueryRequest (0.99s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/(avg_over_time) (1.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/(avg_over_time)/*querymiddleware.PrometheusInstantQueryRequest (1.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate) (0.66s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.66s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time_offset_1m_@_`start`) (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/min_over_time_offset_1m_@_`start`)/*querymiddleware.PrometheusInstantQueryRequest (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sort/*querymiddleware.PrometheusInstantQueryRequest (1.00s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time (0.72s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.71s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(sum(rate)) (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(sum(rate))/*querymiddleware.PrometheusInstantQueryRequest (0.26s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate) (0.27s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.27s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_@_end()) (0.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(sum_over_time_@_end())/*querymiddleware.PrometheusInstantQueryRequest (0.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'without' (1.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_grouping_'without'/*querymiddleware.PrometheusInstantQueryRequest (1.32s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time_@_`start`_offset_1m) (0.91s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max_over_time_@_`start`_offset_1m)/*querymiddleware.PrometheusInstantQueryRequest (0.90s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate) (0.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/max(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_join (0.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/label_join/*querymiddleware.PrometheusInstantQueryRequest (0.19s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable (0.49s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_only_left_leg_of_the_binary_operation_is_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.49s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/10_/_rate (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/10_/_rate/*querymiddleware.PrometheusInstantQueryRequest (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum(rate) (2.48s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum(rate)/*querymiddleware.PrometheusInstantQueryRequest (2.48s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_over_time (1.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/subquery_sum_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.20s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-30s (1.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/count_over_time[3m]_offset_-30s/*querymiddleware.PrometheusInstantQueryRequest (1.51s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time (1.70s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/avg_over_time/*querymiddleware.PrometheusInstantQueryRequest (1.70s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile()_with_no_effective_grouping_because_all_groups_have_1_series/*querymiddleware.PrometheusInstantQueryRequest (0.50s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(rate) (0.60s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/topk(rate)/*querymiddleware.PrometheusInstantQueryRequest (0.60s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ln (1.18s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ln/*querymiddleware.PrometheusInstantQueryRequest (1.17s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/exp (1.04s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/exp/*querymiddleware.PrometheusInstantQueryRequest (1.04s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable (0.37s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/ceil(sum(sum_over_time())_+_sum(sum_over_time()))_and_both_legs_of_the_binary_operation_are_splittable/*querymiddleware.PrometheusInstantQueryRequest (0.37s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/irate (0.41s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/irate/*querymiddleware.PrometheusInstantQueryRequest (0.41s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_max (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/clamp_max/*querymiddleware.PrometheusInstantQueryRequest (1.06s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent (0.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent/*querymiddleware.PrometheusInstantQueryRequest (0.07s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/vector(10) (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/vector(10)/*querymiddleware.PrometheusInstantQueryRequest (0.01s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate)_grouping_'by' (0.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate)_grouping_'by'/*querymiddleware.PrometheusInstantQueryRequest (0.14s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent_over_time (0.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/absent_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.03s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/quantile_over_time (0.34s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/quantile_over_time/*querymiddleware.PrometheusInstantQueryRequest (0.34s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile (4.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/histogram_quantile/*querymiddleware.PrometheusInstantQueryRequest (4.44s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/resets (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/resets/*querymiddleware.PrometheusInstantQueryRequest (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate()_or_rate()) (0.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum(rate()_or_rate())/*querymiddleware.PrometheusInstantQueryRequest (0.33s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_3m (0.75s) --- PASS: TestInstantQuerySplittingCorrectness/start=2023-04-10T05:13:22.928228954+08:00/sum_over_time[3m]_offset_3m/*querymiddleware.PrometheusInstantQueryRequest (0.75s) === RUN TestInstantQuerySplittingHTTPOptions === RUN TestInstantQuerySplittingHTTPOptions/should_skip_instant_query_splitting_if_disabled_via_HTTP_option === RUN TestInstantQuerySplittingHTTPOptions/should_override_instant_query_splitting_interval_specified_in_HTTP_option --- PASS: TestInstantQuerySplittingHTTPOptions (0.01s) --- PASS: TestInstantQuerySplittingHTTPOptions/should_skip_instant_query_splitting_if_disabled_via_HTTP_option (0.00s) --- PASS: TestInstantQuerySplittingHTTPOptions/should_override_instant_query_splitting_interval_specified_in_HTTP_option (0.01s) === RUN TestStepAlignMiddleware === RUN TestStepAlignMiddleware/0 === RUN TestStepAlignMiddleware/1 --- PASS: TestStepAlignMiddleware (0.00s) --- PASS: TestStepAlignMiddleware/0 (0.00s) --- PASS: TestStepAlignMiddleware/1 (0.00s) === RUN TestIsRequestStepAligned === RUN TestIsRequestStepAligned/should_return_false_if_end_is_not_aligned_to_step === RUN TestIsRequestStepAligned/should_return_true_if_step_is_0 === RUN TestIsRequestStepAligned/should_return_true_if_start_and_end_are_aligned_to_step === RUN TestIsRequestStepAligned/should_return_false_if_start_is_not_aligned_to_step --- PASS: TestIsRequestStepAligned (0.00s) --- PASS: TestIsRequestStepAligned/should_return_false_if_end_is_not_aligned_to_step (0.00s) --- PASS: TestIsRequestStepAligned/should_return_true_if_step_is_0 (0.00s) --- PASS: TestIsRequestStepAligned/should_return_true_if_start_and_end_are_aligned_to_step (0.00s) --- PASS: TestIsRequestStepAligned/should_return_false_if_start_is_not_aligned_to_step (0.00s) === CONT TestConstSplitter_generateCacheKey === RUN TestConstSplitter_generateCacheKey/0_-_30m0s === RUN TestConstSplitter_generateCacheKey/<30m_-_30m0s === RUN TestConstSplitter_generateCacheKey/30m_-_30m0s === RUN TestConstSplitter_generateCacheKey/91m_-_30m0s === RUN TestConstSplitter_generateCacheKey/91m_5m_-_30m0s === RUN TestConstSplitter_generateCacheKey/0_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/<1d_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/4d_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/3d5h_-_24h0m0s === RUN TestConstSplitter_generateCacheKey/1111m_-_1h0m0s --- PASS: TestConstSplitter_generateCacheKey (0.00s) --- PASS: TestConstSplitter_generateCacheKey/0_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/<30m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/30m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/91m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/91m_5m_-_30m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/0_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/<1d_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/4d_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/3d5h_-_24h0m0s (0.00s) --- PASS: TestConstSplitter_generateCacheKey/1111m_-_1h0m0s (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/querymiddleware 421.051s === RUN TestCloneExpr === RUN TestCloneExpr/[0] === RUN TestCloneExpr/[1] --- PASS: TestCloneExpr (0.00s) --- PASS: TestCloneExpr/[0] (0.00s) --- PASS: TestCloneExpr/[1] (0.00s) === RUN TestCloneExpr_String === RUN TestCloneExpr_String/[0] === RUN TestCloneExpr_String/[1] --- PASS: TestCloneExpr_String (0.00s) --- PASS: TestCloneExpr_String/[0] (0.00s) --- PASS: TestCloneExpr_String/[1] (0.00s) === RUN TestSharding_BinaryExpressionsDontTakeExponentialTime --- PASS: TestSharding_BinaryExpressionsDontTakeExponentialTime (0.13s) === RUN TestInstantSplitter === RUN TestInstantSplitter/avg_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/count_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/increase({app="foo"}[3m]) === RUN TestInstantSplitter/max_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/min_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/present_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/rate({app="foo"}[3m]) === RUN TestInstantSplitter/sum_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/absent(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/ceil(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/clamp(sum_over_time({app="foo"}[3m]),_1,_10) === RUN TestInstantSplitter/clamp_max(sum_over_time({app="foo"}[3m]),_10) === RUN TestInstantSplitter/clamp_min(sum_over_time({app="foo"}[3m]),_1) === RUN TestInstantSplitter/exp(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/floor(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/histogram_quantile(0.9,_sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/label_join(sum_over_time({app="foo"}[3m]),_"foo",_",",_"group_1",_"group_2",_"const") === RUN TestInstantSplitter/label_replace(sum_over_time({app="foo"}[3m]),_"foo",_"bar$1",_"group_2",_"(.*)") === RUN TestInstantSplitter/ln(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/log2(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/round(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/scalar(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sgn(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sort(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sort_desc(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sqrt(sum_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/avg(rate({app="foo"}[3m])) === RUN TestInstantSplitter/avg_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/count(rate({app="foo"}[3m])) === RUN TestInstantSplitter/count_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/max(rate({app="foo"}[3m])) === RUN TestInstantSplitter/max_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/min(rate({app="foo"}[3m])) === RUN TestInstantSplitter/min_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/sum(rate({app="foo"}[3m])) === RUN TestInstantSplitter/sum_by_(bar)_(rate({app="foo"}[3m])) === RUN TestInstantSplitter/topk(10,_rate({app="foo"}[3m])) === RUN TestInstantSplitter/topk(10,_sum(rate({app="foo"}[3m]))) === RUN TestInstantSplitter/rate({app="foo"}[3m])_/_rate({app="baz"}[6m]) === RUN TestInstantSplitter/rate({app="foo"}[3m])_/_10 === RUN TestInstantSplitter/10_/_rate({app="foo"}[3m]) === RUN TestInstantSplitter/rate({app="foo"}[3m])_/_rate({app="foo"}[3m])_>_0.5 === RUN TestInstantSplitter/sum(sum_over_time({app="foo"}[3m])_+_count_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sum(sum_over_time({app="foo"}[3m])_+_count_over_time({app="foo"}[1m])) === RUN TestInstantSplitter/sum_over_time({app="foo"}[3m])_*_count_over_time({app="foo"}[1m]) === RUN TestInstantSplitter/sum(sum_over_time({app="foo"}[1m])_+_count_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sum_over_time({app="foo"}[1m])_*_count_over_time({app="foo"}[3m]) === RUN TestInstantSplitter/(avg_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/sum(avg_over_time({app="foo"}[3m])) === RUN TestInstantSplitter/rate({app="foo"}[3m]_offset_3m) === RUN TestInstantSplitter/avg_over_time({app="foo"}[3m]_offset_5m) === RUN TestInstantSplitter/rate({app="foo"}[3m]_offset_30s) === RUN TestInstantSplitter/count_over_time({app="foo"}[3m]_offset_-3m) === RUN TestInstantSplitter/avg_over_time({app="foo"}[3m]_offset_-5m) === RUN TestInstantSplitter/count_over_time({app="foo"}[3m]_offset_-30s) === RUN TestInstantSplitter/rate({app="foo"}[3m]_@_start()) === RUN TestInstantSplitter/sum(sum_over_time({app="foo"}[3m]_@_end())) === RUN TestInstantSplitter/avg(avg_over_time({app="foo"}[3m]_@_1609746000)) === RUN TestInstantSplitter/max_over_time({app="foo"}[3m]_@_1609746000_offset_1m) === RUN TestInstantSplitter/max_over_time({app="foo"}[3m]_offset_1m_@_1609746000) === RUN TestInstantSplitter/topk(10,_histogram_quantile(0.9,_rate({app="foo"}[3m]))) === RUN TestInstantSplitter/stddev(rate(metric[3m])) === RUN TestInstantSplitter/count_values("dst",_count_over_time(metric[3m])) === RUN TestInstantSplitter/sum(max(rate({app="foo"}[3m]))) === RUN TestInstantSplitter/label_replace(sum(sum_over_time(up[1m])_+_count_over_time(up[3m])),_"dst",_"$1",_"src",_"(.*)") === RUN TestInstantSplitter/ceil(sum(sum_over_time(up[1m])_+_count_over_time(up[3m]))) --- PASS: TestInstantSplitter (0.35s) --- PASS: TestInstantSplitter/avg_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/count_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/increase({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/max_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/min_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/present_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m]) (0.01s) --- PASS: TestInstantSplitter/sum_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/absent(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/ceil(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/clamp(sum_over_time({app="foo"}[3m]),_1,_10) (0.00s) --- PASS: TestInstantSplitter/clamp_max(sum_over_time({app="foo"}[3m]),_10) (0.03s) --- PASS: TestInstantSplitter/clamp_min(sum_over_time({app="foo"}[3m]),_1) (0.00s) --- PASS: TestInstantSplitter/exp(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/floor(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/histogram_quantile(0.9,_sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/label_join(sum_over_time({app="foo"}[3m]),_"foo",_",",_"group_1",_"group_2",_"const") (0.02s) --- PASS: TestInstantSplitter/label_replace(sum_over_time({app="foo"}[3m]),_"foo",_"bar$1",_"group_2",_"(.*)") (0.00s) --- PASS: TestInstantSplitter/ln(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/log2(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/round(sum_over_time({app="foo"}[3m])) (0.02s) --- PASS: TestInstantSplitter/scalar(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sgn(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sort(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sort_desc(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sqrt(sum_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/avg(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/avg_by_(bar)_(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/count(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/count_by_(bar)_(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/max(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/max_by_(bar)_(rate({app="foo"}[3m])) (0.02s) --- PASS: TestInstantSplitter/min(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/min_by_(bar)_(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sum(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sum_by_(bar)_(rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/topk(10,_rate({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/topk(10,_sum(rate({app="foo"}[3m]))) (0.01s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m])_/_rate({app="baz"}[6m]) (0.00s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m])_/_10 (0.00s) --- PASS: TestInstantSplitter/10_/_rate({app="foo"}[3m]) (0.03s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m])_/_rate({app="foo"}[3m])_>_0.5 (0.01s) --- PASS: TestInstantSplitter/sum(sum_over_time({app="foo"}[3m])_+_count_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sum(sum_over_time({app="foo"}[3m])_+_count_over_time({app="foo"}[1m])) (0.01s) --- PASS: TestInstantSplitter/sum_over_time({app="foo"}[3m])_*_count_over_time({app="foo"}[1m]) (0.00s) --- PASS: TestInstantSplitter/sum(sum_over_time({app="foo"}[1m])_+_count_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/sum_over_time({app="foo"}[1m])_*_count_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitter/(avg_over_time({app="foo"}[3m])) (0.01s) --- PASS: TestInstantSplitter/sum(avg_over_time({app="foo"}[3m])) (0.00s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m]_offset_3m) (0.00s) --- PASS: TestInstantSplitter/avg_over_time({app="foo"}[3m]_offset_5m) (0.01s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m]_offset_30s) (0.00s) --- PASS: TestInstantSplitter/count_over_time({app="foo"}[3m]_offset_-3m) (0.00s) --- PASS: TestInstantSplitter/avg_over_time({app="foo"}[3m]_offset_-5m) (0.00s) --- PASS: TestInstantSplitter/count_over_time({app="foo"}[3m]_offset_-30s) (0.00s) --- PASS: TestInstantSplitter/rate({app="foo"}[3m]_@_start()) (0.00s) --- PASS: TestInstantSplitter/sum(sum_over_time({app="foo"}[3m]_@_end())) (0.00s) --- PASS: TestInstantSplitter/avg(avg_over_time({app="foo"}[3m]_@_1609746000)) (0.01s) --- PASS: TestInstantSplitter/max_over_time({app="foo"}[3m]_@_1609746000_offset_1m) (0.00s) --- PASS: TestInstantSplitter/max_over_time({app="foo"}[3m]_offset_1m_@_1609746000) (0.00s) --- PASS: TestInstantSplitter/topk(10,_histogram_quantile(0.9,_rate({app="foo"}[3m]))) (0.00s) --- PASS: TestInstantSplitter/stddev(rate(metric[3m])) (0.00s) --- PASS: TestInstantSplitter/count_values("dst",_count_over_time(metric[3m])) (0.00s) --- PASS: TestInstantSplitter/sum(max(rate({app="foo"}[3m]))) (0.00s) --- PASS: TestInstantSplitter/label_replace(sum(sum_over_time(up[1m])_+_count_over_time(up[3m])),_"dst",_"$1",_"src",_"(.*)") (0.00s) --- PASS: TestInstantSplitter/ceil(sum(sum_over_time(up[1m])_+_count_over_time(up[3m]))) (0.00s) === RUN TestInstantSplitterUnevenRangeInterval === RUN TestInstantSplitterUnevenRangeInterval/rate({app="foo"}[5m]) === RUN TestInstantSplitterUnevenRangeInterval/avg_over_time({app="foo"}[3m]) === RUN TestInstantSplitterUnevenRangeInterval/sum_over_time({app="foo"}[4m]_offset_1m) === RUN TestInstantSplitterUnevenRangeInterval/count_over_time({app="foo"}[3m]_offset_1m) --- PASS: TestInstantSplitterUnevenRangeInterval (0.01s) --- PASS: TestInstantSplitterUnevenRangeInterval/rate({app="foo"}[5m]) (0.00s) --- PASS: TestInstantSplitterUnevenRangeInterval/avg_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterUnevenRangeInterval/sum_over_time({app="foo"}[4m]_offset_1m) (0.00s) --- PASS: TestInstantSplitterUnevenRangeInterval/count_over_time({app="foo"}[3m]_offset_1m) (0.00s) === RUN TestInstantSplitterSkippedQueryReason === RUN TestInstantSplitterSkippedQueryReason/absent_over_time({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/changes({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/delta({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/deriv({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/holt_winters({app="foo"}[3m],_1,_10) === RUN TestInstantSplitterSkippedQueryReason/idelta({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/irate({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/last_over_time({app="foo"}[3m]) === RUN TestInstantSplitterSkippedQueryReason/predict_linear({app="foo"}[3m],_1) === RUN TestInstantSplitterSkippedQueryReason/quantile_over_time(0.95,_foo[3m]) === RUN TestInstantSplitterSkippedQueryReason/resets(foo[3m]) === RUN TestInstantSplitterSkippedQueryReason/stddev_over_time(foo[3m]) === RUN TestInstantSplitterSkippedQueryReason/stdvar_over_time(foo[3m]) === RUN TestInstantSplitterSkippedQueryReason/time() === RUN TestInstantSplitterSkippedQueryReason/vector(10) === RUN TestInstantSplitterSkippedQueryReason/topk(10,_histogram_quantile(0.9,_delta({app="foo"}[3m]))) === RUN TestInstantSplitterSkippedQueryReason/rate({app="foo"}[1m]) === RUN TestInstantSplitterSkippedQueryReason/5 === RUN TestInstantSplitterSkippedQueryReason/20_/_10 === RUN TestInstantSplitterSkippedQueryReason/(20_/_10) === RUN TestInstantSplitterSkippedQueryReason/(20)_/_(10) === RUN TestInstantSplitterSkippedQueryReason/time()_!=_bool_0 === RUN TestInstantSplitterSkippedQueryReason/rate({app="foo"}[1m])_/_rate({app="bar"}[5h:5m])_>_0.5 === RUN TestInstantSplitterSkippedQueryReason/sum(rate({app="foo"}[1h:5m])_*_60)_by_(bar) === RUN TestInstantSplitterSkippedQueryReason/sum_over_time(metric_counter[1h:5m]) === RUN TestInstantSplitterSkippedQueryReason/sum(rate(metric_counter[30m:5s])) === RUN TestInstantSplitterSkippedQueryReason/sum_over_time((metric_counter[30m:5s])) === RUN TestInstantSplitterSkippedQueryReason/sum_over_time((((metric_counter[30m:5s])))) === RUN TestInstantSplitterSkippedQueryReason/quantile_over_time(1,_metric_counter[10m:1m]) === RUN TestInstantSplitterSkippedQueryReason/sum(avg_over_time(metric_counter[1h:5m]))_by_(bar) === RUN TestInstantSplitterSkippedQueryReason/min_over_time(sum_by(group_1)_(rate(metric_counter[5m]))[10m:2m]) === RUN TestInstantSplitterSkippedQueryReason/max_over_time(stddev_over_time(deriv(rate(metric_counter[10m])[5m:1m])[2m:])[10m:]) === RUN TestInstantSplitterSkippedQueryReason/rate(sum_by(group_1)_(rate(metric_counter[5m]))[10m:]) === RUN TestInstantSplitterSkippedQueryReason/absent_over_time(rate(metric_counter[5m])[10m:]) === RUN TestInstantSplitterSkippedQueryReason/max_over_time(stddev_over_time(deriv(sort(metric_counter)[5m:1m])[2m:])[10m:]) === RUN TestInstantSplitterSkippedQueryReason/max_over_time(absent_over_time(deriv(rate(metric_counter[1m])[5m:1m])[2m:])[10m:]) --- PASS: TestInstantSplitterSkippedQueryReason (0.03s) --- PASS: TestInstantSplitterSkippedQueryReason/absent_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/changes({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/delta({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/deriv({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/holt_winters({app="foo"}[3m],_1,_10) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/idelta({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/irate({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/last_over_time({app="foo"}[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/predict_linear({app="foo"}[3m],_1) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/quantile_over_time(0.95,_foo[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/resets(foo[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/stddev_over_time(foo[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/stdvar_over_time(foo[3m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/time() (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/vector(10) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/topk(10,_histogram_quantile(0.9,_delta({app="foo"}[3m]))) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/rate({app="foo"}[1m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/5 (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/20_/_10 (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/(20_/_10) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/(20)_/_(10) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/time()_!=_bool_0 (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/rate({app="foo"}[1m])_/_rate({app="bar"}[5h:5m])_>_0.5 (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum(rate({app="foo"}[1h:5m])_*_60)_by_(bar) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum_over_time(metric_counter[1h:5m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum(rate(metric_counter[30m:5s])) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum_over_time((metric_counter[30m:5s])) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum_over_time((((metric_counter[30m:5s])))) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/quantile_over_time(1,_metric_counter[10m:1m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/sum(avg_over_time(metric_counter[1h:5m]))_by_(bar) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/min_over_time(sum_by(group_1)_(rate(metric_counter[5m]))[10m:2m]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/max_over_time(stddev_over_time(deriv(rate(metric_counter[10m])[5m:1m])[2m:])[10m:]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/rate(sum_by(group_1)_(rate(metric_counter[5m]))[10m:]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/absent_over_time(rate(metric_counter[5m])[10m:]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/max_over_time(stddev_over_time(deriv(sort(metric_counter)[5m:1m])[2m:])[10m:]) (0.00s) --- PASS: TestInstantSplitterSkippedQueryReason/max_over_time(absent_over_time(deriv(rate(metric_counter[1m])[5m:1m])[2m:])[10m:]) (0.00s) === RUN TestGetRangeIntervals === RUN TestGetRangeIntervals/time() === RUN TestGetRangeIntervals/sum(rate(metric[1m])) === RUN TestGetRangeIntervals/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) === RUN TestGetRangeIntervals/sum_over_time(rate(metric[1m])[1h:5m]) --- PASS: TestGetRangeIntervals (0.00s) --- PASS: TestGetRangeIntervals/time() (0.00s) --- PASS: TestGetRangeIntervals/sum(rate(metric[1m])) (0.00s) --- PASS: TestGetRangeIntervals/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) (0.00s) --- PASS: TestGetRangeIntervals/sum_over_time(rate(metric[1m])[1h:5m]) (0.00s) === RUN TestUpdateRangeInterval === RUN TestUpdateRangeInterval/time() === RUN TestUpdateRangeInterval/sum(rate(metric[1m])) === RUN TestUpdateRangeInterval/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*")) === RUN TestUpdateRangeInterval/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) === RUN TestUpdateRangeInterval/sum(rate(metric[1m]))#01 --- PASS: TestUpdateRangeInterval (0.00s) --- PASS: TestUpdateRangeInterval/time() (0.00s) --- PASS: TestUpdateRangeInterval/sum(rate(metric[1m])) (0.00s) --- PASS: TestUpdateRangeInterval/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*")) (0.00s) --- PASS: TestUpdateRangeInterval/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) (0.00s) --- PASS: TestUpdateRangeInterval/sum(rate(metric[1m]))#01 (0.00s) === RUN TestUpdateOffset === RUN TestUpdateOffset/time() === RUN TestUpdateOffset/sum(rate(metric[1m])) === RUN TestUpdateOffset/sum(rate(metric[1m]))#01 === RUN TestUpdateOffset/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*")) === RUN TestUpdateOffset/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*"))#01 === RUN TestUpdateOffset/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) --- PASS: TestUpdateOffset (0.00s) --- PASS: TestUpdateOffset/time() (0.00s) --- PASS: TestUpdateOffset/sum(rate(metric[1m])) (0.00s) --- PASS: TestUpdateOffset/sum(rate(metric[1m]))#01 (0.00s) --- PASS: TestUpdateOffset/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*")) (0.00s) --- PASS: TestUpdateOffset/sum(label_replace(rate(metric[1m]),_"dst",_"$1",_"src",_".*"))#01 (0.00s) --- PASS: TestUpdateOffset/sum(rate(metric[1m]))_+_sum(rate(metric[5m])) (0.00s) === RUN TestGetOffsets === RUN TestGetOffsets/time() === RUN TestGetOffsets/sum(rate(metric[5m]_offset_1m)) === RUN TestGetOffsets/sum(rate(metric[5m]_offset_3m))_+_sum(rate(metric[5m]_offset_5m)) === RUN TestGetOffsets/rate(metric[5m]_offset_5s) === RUN TestGetOffsets/avg_over_time(metric[5m]_offset_-5m) === RUN TestGetOffsets/sum_over_time(rate(metric[5m]_offset_3s)[1h:5m]_offset_1m) --- PASS: TestGetOffsets (0.00s) --- PASS: TestGetOffsets/time() (0.00s) --- PASS: TestGetOffsets/sum(rate(metric[5m]_offset_1m)) (0.00s) --- PASS: TestGetOffsets/sum(rate(metric[5m]_offset_3m))_+_sum(rate(metric[5m]_offset_5m)) (0.00s) --- PASS: TestGetOffsets/rate(metric[5m]_offset_5s) (0.00s) --- PASS: TestGetOffsets/avg_over_time(metric[5m]_offset_-5m) (0.00s) --- PASS: TestGetOffsets/sum_over_time(rate(metric[5m]_offset_3s)[1h:5m]_offset_1m) (0.00s) === RUN TestCanParallel === RUN TestCanParallel/[0] === RUN TestCanParallel/[1] === RUN TestCanParallel/[2] --- PASS: TestCanParallel (0.00s) --- PASS: TestCanParallel/[0] (0.00s) --- PASS: TestCanParallel/[1] (0.00s) --- PASS: TestCanParallel/[2] (0.00s) === RUN TestCanParallel_String === RUN TestCanParallel_String/[0] === RUN TestCanParallel_String/[1] === RUN TestCanParallel_String/[2] === RUN TestCanParallel_String/[3] === RUN TestCanParallel_String/[4] === RUN TestCanParallel_String/[5] === RUN TestCanParallel_String/[6] === RUN TestCanParallel_String/[7] === RUN TestCanParallel_String/[8] === RUN TestCanParallel_String/[9] === RUN TestCanParallel_String/[10] --- PASS: TestCanParallel_String (0.05s) --- PASS: TestCanParallel_String/[0] (0.00s) --- PASS: TestCanParallel_String/[1] (0.00s) --- PASS: TestCanParallel_String/[2] (0.00s) --- PASS: TestCanParallel_String/[3] (0.00s) --- PASS: TestCanParallel_String/[4] (0.00s) --- PASS: TestCanParallel_String/[5] (0.00s) --- PASS: TestCanParallel_String/[6] (0.00s) --- PASS: TestCanParallel_String/[7] (0.00s) --- PASS: TestCanParallel_String/[8] (0.00s) --- PASS: TestCanParallel_String/[9] (0.00s) --- PASS: TestCanParallel_String/[10] (0.00s) === RUN TestFunctionsWithDefaultsIsUpToDate === RUN TestFunctionsWithDefaultsIsUpToDate/clamp_min === RUN TestFunctionsWithDefaultsIsUpToDate/count_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/exp === RUN TestFunctionsWithDefaultsIsUpToDate/histogram_quantile === RUN TestFunctionsWithDefaultsIsUpToDate/pi === RUN TestFunctionsWithDefaultsIsUpToDate/abs === RUN TestFunctionsWithDefaultsIsUpToDate/increase === RUN TestFunctionsWithDefaultsIsUpToDate/delta === RUN TestFunctionsWithDefaultsIsUpToDate/sinh === RUN TestFunctionsWithDefaultsIsUpToDate/tan === RUN TestFunctionsWithDefaultsIsUpToDate/histogram_count === RUN TestFunctionsWithDefaultsIsUpToDate/histogram_fraction === RUN TestFunctionsWithDefaultsIsUpToDate/irate === RUN TestFunctionsWithDefaultsIsUpToDate/quantile_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/rate === RUN TestFunctionsWithDefaultsIsUpToDate/days_in_month === RUN TestFunctionsWithDefaultsIsUpToDate/idelta === RUN TestFunctionsWithDefaultsIsUpToDate/predict_linear === RUN TestFunctionsWithDefaultsIsUpToDate/floor === RUN TestFunctionsWithDefaultsIsUpToDate/last_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/year === RUN TestFunctionsWithDefaultsIsUpToDate/label_join === RUN TestFunctionsWithDefaultsIsUpToDate/sgn === RUN TestFunctionsWithDefaultsIsUpToDate/sin === RUN TestFunctionsWithDefaultsIsUpToDate/sqrt === RUN TestFunctionsWithDefaultsIsUpToDate/acosh === RUN TestFunctionsWithDefaultsIsUpToDate/asin === RUN TestFunctionsWithDefaultsIsUpToDate/minute === RUN TestFunctionsWithDefaultsIsUpToDate/min_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/sort === RUN TestFunctionsWithDefaultsIsUpToDate/stdvar_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/ceil === RUN TestFunctionsWithDefaultsIsUpToDate/cosh === RUN TestFunctionsWithDefaultsIsUpToDate/day_of_year === RUN TestFunctionsWithDefaultsIsUpToDate/deg === RUN TestFunctionsWithDefaultsIsUpToDate/ln === RUN TestFunctionsWithDefaultsIsUpToDate/time === RUN TestFunctionsWithDefaultsIsUpToDate/log2 === RUN TestFunctionsWithDefaultsIsUpToDate/max_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/resets === RUN TestFunctionsWithDefaultsIsUpToDate/changes === RUN TestFunctionsWithDefaultsIsUpToDate/clamp === RUN TestFunctionsWithDefaultsIsUpToDate/histogram_sum === RUN TestFunctionsWithDefaultsIsUpToDate/holt_winters === RUN TestFunctionsWithDefaultsIsUpToDate/label_replace === RUN TestFunctionsWithDefaultsIsUpToDate/scalar === RUN TestFunctionsWithDefaultsIsUpToDate/stddev_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/absent === RUN TestFunctionsWithDefaultsIsUpToDate/cos === RUN TestFunctionsWithDefaultsIsUpToDate/vector === RUN TestFunctionsWithDefaultsIsUpToDate/day_of_week === RUN TestFunctionsWithDefaultsIsUpToDate/sum_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/timestamp === RUN TestFunctionsWithDefaultsIsUpToDate/acos === RUN TestFunctionsWithDefaultsIsUpToDate/atanh === RUN TestFunctionsWithDefaultsIsUpToDate/log10 === RUN TestFunctionsWithDefaultsIsUpToDate/rad === RUN TestFunctionsWithDefaultsIsUpToDate/sort_desc === RUN TestFunctionsWithDefaultsIsUpToDate/day_of_month === RUN TestFunctionsWithDefaultsIsUpToDate/month === RUN TestFunctionsWithDefaultsIsUpToDate/asinh === RUN TestFunctionsWithDefaultsIsUpToDate/atan === RUN TestFunctionsWithDefaultsIsUpToDate/avg_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/hour === RUN TestFunctionsWithDefaultsIsUpToDate/tanh === RUN TestFunctionsWithDefaultsIsUpToDate/absent_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/clamp_max === RUN TestFunctionsWithDefaultsIsUpToDate/deriv === RUN TestFunctionsWithDefaultsIsUpToDate/present_over_time === RUN TestFunctionsWithDefaultsIsUpToDate/round --- PASS: TestFunctionsWithDefaultsIsUpToDate (0.04s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/clamp_min (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/count_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/exp (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/histogram_quantile (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/pi (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/abs (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/increase (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/delta (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sinh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/tan (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/histogram_count (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/histogram_fraction (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/irate (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/quantile_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/rate (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/days_in_month (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/idelta (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/predict_linear (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/floor (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/last_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/year (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/label_join (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sgn (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sin (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sqrt (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/acosh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/asin (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/minute (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/min_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sort (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/stdvar_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/ceil (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/cosh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/day_of_year (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/deg (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/ln (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/log2 (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/max_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/resets (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/changes (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/clamp (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/histogram_sum (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/holt_winters (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/label_replace (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/scalar (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/stddev_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/absent (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/cos (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/vector (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/day_of_week (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sum_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/timestamp (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/acos (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/atanh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/log10 (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/rad (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/sort_desc (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/day_of_month (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/month (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/asinh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/atan (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/avg_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/hour (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/tanh (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/absent_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/clamp_max (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/deriv (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/present_over_time (0.00s) --- PASS: TestFunctionsWithDefaultsIsUpToDate/round (0.00s) === RUN TestCountVectorSelectors === RUN TestCountVectorSelectors/input_expr_contains_a_vector_selector === RUN TestCountVectorSelectors/input_expr_contains_multiple_vector_selectors === RUN TestCountVectorSelectors/no_vector_selectors === RUN TestCountVectorSelectors/input_is_a_vector_selector --- PASS: TestCountVectorSelectors (0.00s) --- PASS: TestCountVectorSelectors/input_expr_contains_a_vector_selector (0.00s) --- PASS: TestCountVectorSelectors/input_expr_contains_multiple_vector_selectors (0.00s) --- PASS: TestCountVectorSelectors/no_vector_selectors (0.00s) --- PASS: TestCountVectorSelectors/input_is_a_vector_selector (0.00s) === RUN TestShardSummer === RUN TestShardSummer/quantile(0.9,foo) === RUN TestShardSummer/absent(foo) === RUN TestShardSummer/absent_over_time(foo[1m]) === RUN TestShardSummer/histogram_quantile(0.5,_rate(bar1{baz="blip"}[30s])) === RUN TestShardSummer/sum_by_(foo)_(histogram_quantile(0.9,_rate(http_request_duration_seconds_bucket[10m]))) === RUN TestShardSummer/sum_by_(foo,bar)_(min_over_time(bar1{baz="blip"}[1m])) === RUN TestShardSummer/sum(rate(bar1[1m]))_or_rate(bar2[1m]) === RUN TestShardSummer/sum(rate(bar1[1m]))_or_sum(rate(bar2[1m])) === RUN TestShardSummer/histogram_quantile(0.5,_sum(rate(cortex_cache_value_size_bytes_bucket[5m]))_by_(le)) === RUN TestShardSummer/sum(_______count(_________count(___________bar1_________)__by_(drive,instance)_______)__by_(instance)_____) === RUN TestShardSummer/sum(rate(foo[1m])) === RUN TestShardSummer/count(rate(foo[1m])) === RUN TestShardSummer/count(up) === RUN TestShardSummer/avg(count(test)) === RUN TestShardSummer/count_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/count_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/max(rate(foo[1m])) === RUN TestShardSummer/max_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/max_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/sum_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/sum_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/avg_without_(foo)_(rate(foo[1m])) === RUN TestShardSummer/avg_by_(foo)_(rate(foo[1m])) === RUN TestShardSummer/avg(rate(foo[1m])) === RUN TestShardSummer/topk(10,avg_by_(foo)(rate(foo[1m]))) === RUN TestShardSummer/min_over_time(metric_counter[5m]) === RUN TestShardSummer/sum_by_(user,_cluster,_namespace)_(quantile_over_time(0.99,_cortex_ingester_active_series[7d])) === RUN TestShardSummer/min_over_time(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:2m]____) === RUN TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:]) === RUN TestShardSummer/max_over_time((_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:])) === RUN TestShardSummer/rate(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:]____) === RUN TestShardSummer/absent_over_time(rate(metric_counter[5m])[10m:]) === RUN TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______sort(metric_counter)______[5m:1m])_____[2m:])____[10m:]) === RUN TestShardSummer/max_over_time(_____absent_over_time(______deriv(_______rate(metric_counter[1m])______[5m:1m])_____[2m:])____[10m:]) === RUN TestShardSummer/quantile_over_time(0.99,_cortex_ingester_active_series[1w]) === RUN TestShardSummer/ceil(sum_by_(foo)_(rate(cortex_ingester_active_series[1w]))) === RUN TestShardSummer/ln(bar)_-_resets(foo[1d]) === RUN TestShardSummer/predict_linear(foo[10m],3600) === RUN TestShardSummer/label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*") === RUN TestShardSummer/ln(exp(label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*"))) === RUN TestShardSummer/ln(_____label_replace(______sum_by_(cluster)_(up{job="api-server",service="a:c"})_____,_"foo",_"$1",_"service",_"(.*):.*")____) === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_@_end())) === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10)) === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2 === RUN TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2_^_2 === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m])_/_time()_*_2) === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time()_*2 === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time() === RUN TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_vector(3)_^_month() === RUN TestShardSummer/vector(3)_^_month() === RUN TestShardSummer/sum(rate(metric_counter[1m]))_/_vector(3)_^_year(foo) === RUN TestShardSummer/foo_>_bar === RUN TestShardSummer/foo_*_2 === RUN TestShardSummer/foo_>_0 === RUN TestShardSummer/0_<=_foo === RUN TestShardSummer/foo_>_(2_*_2) === RUN TestShardSummer/sum_by_(label)_(foo_>_0) === RUN TestShardSummer/sum_by_(label)_(foo_>_0)_>_0 === RUN TestShardSummer/sum_over_time(foo[1m])_>_(2_*_2) === RUN TestShardSummer/foo_>_sum(bar) === RUN TestShardSummer/foo_>_scalar(sum(bar)) === RUN TestShardSummer/scalar(min(foo))_>_bool_scalar(sum(bar)) === RUN TestShardSummer/foo_*_on(a,_b)_group_left(c)_avg_by(a,_b,_c)_(bar) === RUN TestShardSummer/vector(1)_>_0_and_vector(1) === RUN TestShardSummer/sum(foo)_>_0_and_vector(1) === RUN TestShardSummer/max_by(pod)_(_____________________max_without(prometheus_replica,_instance,_node)_(kube_pod_labels{namespace="test"})_____________________*_____________________on(cluster,_pod,_namespace)_group_right()_pod:container_cpu_usage:sum_____________) === RUN TestShardSummer/sum(rate(metric[1m]))_and_max(metric)_>_0 === RUN TestShardSummer/sum(rate(metric[1m]))_>_avg(rate(metric[1m])) --- PASS: TestShardSummer (0.15s) --- PASS: TestShardSummer/quantile(0.9,foo) (0.00s) --- PASS: TestShardSummer/absent(foo) (0.00s) --- PASS: TestShardSummer/absent_over_time(foo[1m]) (0.00s) --- PASS: TestShardSummer/histogram_quantile(0.5,_rate(bar1{baz="blip"}[30s])) (0.00s) --- PASS: TestShardSummer/sum_by_(foo)_(histogram_quantile(0.9,_rate(http_request_duration_seconds_bucket[10m]))) (0.00s) --- PASS: TestShardSummer/sum_by_(foo,bar)_(min_over_time(bar1{baz="blip"}[1m])) (0.00s) --- PASS: TestShardSummer/sum(rate(bar1[1m]))_or_rate(bar2[1m]) (0.00s) --- PASS: TestShardSummer/sum(rate(bar1[1m]))_or_sum(rate(bar2[1m])) (0.00s) --- PASS: TestShardSummer/histogram_quantile(0.5,_sum(rate(cortex_cache_value_size_bytes_bucket[5m]))_by_(le)) (0.00s) --- PASS: TestShardSummer/sum(_______count(_________count(___________bar1_________)__by_(drive,instance)_______)__by_(instance)_____) (0.00s) --- PASS: TestShardSummer/sum(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/count(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/count(up) (0.00s) --- PASS: TestShardSummer/avg(count(test)) (0.00s) --- PASS: TestShardSummer/count_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/count_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/max(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/max_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/max_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/sum_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/sum_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/avg_without_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/avg_by_(foo)_(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/avg(rate(foo[1m])) (0.00s) --- PASS: TestShardSummer/topk(10,avg_by_(foo)(rate(foo[1m]))) (0.00s) --- PASS: TestShardSummer/min_over_time(metric_counter[5m]) (0.00s) --- PASS: TestShardSummer/sum_by_(user,_cluster,_namespace)_(quantile_over_time(0.99,_cortex_ingester_active_series[7d])) (0.00s) --- PASS: TestShardSummer/min_over_time(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:2m]____) (0.00s) --- PASS: TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: TestShardSummer/max_over_time((_____stddev_over_time(______deriv(_______rate(metric_counter[10m])______[5m:1m])_____[2m:])____[10m:])) (0.00s) --- PASS: TestShardSummer/rate(_____sum_by(group_1)_(______rate(metric_counter[5m])_____)[10m:]____) (0.00s) --- PASS: TestShardSummer/absent_over_time(rate(metric_counter[5m])[10m:]) (0.00s) --- PASS: TestShardSummer/max_over_time(_____stddev_over_time(______deriv(_______sort(metric_counter)______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: TestShardSummer/max_over_time(_____absent_over_time(______deriv(_______rate(metric_counter[1m])______[5m:1m])_____[2m:])____[10m:]) (0.00s) --- PASS: TestShardSummer/quantile_over_time(0.99,_cortex_ingester_active_series[1w]) (0.00s) --- PASS: TestShardSummer/ceil(sum_by_(foo)_(rate(cortex_ingester_active_series[1w]))) (0.00s) --- PASS: TestShardSummer/ln(bar)_-_resets(foo[1d]) (0.00s) --- PASS: TestShardSummer/predict_linear(foo[10m],3600) (0.00s) --- PASS: TestShardSummer/label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*") (0.00s) --- PASS: TestShardSummer/ln(exp(label_replace(up{job="api-server",service="a:c"},_"foo",_"$1",_"service",_"(.*):.*"))) (0.00s) --- PASS: TestShardSummer/ln(_____label_replace(______sum_by_(cluster)_(up{job="api-server",service="a:c"})_____,_"foo",_"$1",_"service",_"(.*):.*")____) (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_@_end())) (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10)) (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2 (0.00s) --- PASS: TestShardSummer/sum_by_(job)(rate(http_requests_total[1h]_offset_1w_@_10))_/_2_^_2 (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m])_/_time()_*_2) (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time()_*2 (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_time() (0.00s) --- PASS: TestShardSummer/sum_by_(group_1)_(rate(metric_counter[1m]))_/_vector(3)_^_month() (0.00s) --- PASS: TestShardSummer/vector(3)_^_month() (0.00s) --- PASS: TestShardSummer/sum(rate(metric_counter[1m]))_/_vector(3)_^_year(foo) (0.00s) --- PASS: TestShardSummer/foo_>_bar (0.00s) --- PASS: TestShardSummer/foo_*_2 (0.00s) --- PASS: TestShardSummer/foo_>_0 (0.00s) --- PASS: TestShardSummer/0_<=_foo (0.00s) --- PASS: TestShardSummer/foo_>_(2_*_2) (0.00s) --- PASS: TestShardSummer/sum_by_(label)_(foo_>_0) (0.00s) --- PASS: TestShardSummer/sum_by_(label)_(foo_>_0)_>_0 (0.00s) --- PASS: TestShardSummer/sum_over_time(foo[1m])_>_(2_*_2) (0.00s) --- PASS: TestShardSummer/foo_>_sum(bar) (0.00s) --- PASS: TestShardSummer/foo_>_scalar(sum(bar)) (0.00s) --- PASS: TestShardSummer/scalar(min(foo))_>_bool_scalar(sum(bar)) (0.00s) --- PASS: TestShardSummer/foo_*_on(a,_b)_group_left(c)_avg_by(a,_b,_c)_(bar) (0.00s) --- PASS: TestShardSummer/vector(1)_>_0_and_vector(1) (0.00s) --- PASS: TestShardSummer/sum(foo)_>_0_and_vector(1) (0.00s) --- PASS: TestShardSummer/max_by(pod)_(_____________________max_without(prometheus_replica,_instance,_node)_(kube_pod_labels{namespace="test"})_____________________*_____________________on(cluster,_pod,_namespace)_group_right()_pod:container_cpu_usage:sum_____________) (0.00s) --- PASS: TestShardSummer/sum(rate(metric[1m]))_and_max(metric)_>_0 (0.00s) --- PASS: TestShardSummer/sum(rate(metric[1m]))_>_avg(rate(metric[1m])) (0.00s) === RUN TestShardSummerWithEncoding === RUN TestShardSummerWithEncoding/[0] --- PASS: TestShardSummerWithEncoding (0.01s) --- PASS: TestShardSummerWithEncoding/[0] (0.01s) === RUN TestIsSubqueryCall === RUN TestIsSubqueryCall/time() === RUN TestIsSubqueryCall/rate(metric[1m]) === RUN TestIsSubqueryCall/rate(metric[1h:5m]) === RUN TestIsSubqueryCall/quantile_over_time(1,_metric[1h:5m]) === RUN TestIsSubqueryCall/sum_over_time((metric_counter[30m:5s])) === RUN TestIsSubqueryCall/sum_over_time((((metric_counter[30m:5s])))) --- PASS: TestIsSubqueryCall (0.00s) --- PASS: TestIsSubqueryCall/time() (0.00s) --- PASS: TestIsSubqueryCall/rate(metric[1m]) (0.00s) --- PASS: TestIsSubqueryCall/rate(metric[1h:5m]) (0.00s) --- PASS: TestIsSubqueryCall/quantile_over_time(1,_metric[1h:5m]) (0.00s) --- PASS: TestIsSubqueryCall/sum_over_time((metric_counter[30m:5s])) (0.00s) --- PASS: TestIsSubqueryCall/sum_over_time((((metric_counter[30m:5s])))) (0.00s) === RUN TestEvalPredicate === RUN TestEvalPredicate/should_return_true_if_the_predicate_returns_true_for_at_least_1_node_in_the_subtree === RUN TestEvalPredicate/hasEmbeddedQueries() === RUN TestEvalPredicate/should_return_error_if_the_predicate_returns_error === RUN TestEvalPredicate/should_return_false_if_the_predicate_returns_false_for_all_nodes_in_the_subtree --- PASS: TestEvalPredicate (0.00s) --- PASS: TestEvalPredicate/should_return_true_if_the_predicate_returns_true_for_at_least_1_node_in_the_subtree (0.00s) --- PASS: TestEvalPredicate/hasEmbeddedQueries() (0.00s) --- PASS: TestEvalPredicate/should_return_error_if_the_predicate_returns_error (0.00s) --- PASS: TestEvalPredicate/should_return_false_if_the_predicate_returns_false_for_all_nodes_in_the_subtree (0.00s) === RUN TestSubtreeFolder === RUN TestSubtreeFolder/embed_an_entire_histogram === RUN TestSubtreeFolder/embed_a_binary_expression_across_two_functions === RUN TestSubtreeFolder/embed_one_out_of_two_legs_of_the_query_(right_leg_has_already_been_embedded) === RUN TestSubtreeFolder/should_not_embed_scalars --- PASS: TestSubtreeFolder (0.01s) --- PASS: TestSubtreeFolder/embed_an_entire_histogram (0.00s) --- PASS: TestSubtreeFolder/embed_a_binary_expression_across_two_functions (0.00s) --- PASS: TestSubtreeFolder/embed_one_out_of_two_legs_of_the_query_(right_leg_has_already_been_embedded) (0.00s) --- PASS: TestSubtreeFolder/should_not_embed_scalars (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/querymiddleware/astmapper 1.041s === RUN TestWriteError === RUN TestWriteError/unknown === RUN TestWriteError/context_deadline_exceeded === RUN TestWriteError/context_canceled === RUN TestWriteError/rpc_error:_code_=_Code(400)_desc_=_ --- PASS: TestWriteError (0.00s) --- PASS: TestWriteError/unknown (0.00s) --- PASS: TestWriteError/context_deadline_exceeded (0.00s) --- PASS: TestWriteError/context_canceled (0.00s) --- PASS: TestWriteError/rpc_error:_code_=_Code(400)_desc_=_ (0.00s) === RUN TestHandler_ServeHTTP === RUN TestHandler_ServeHTTP/handler_with_stats_enabled,_POST_request_with_params === RUN TestHandler_ServeHTTP/handler_with_stats_enabled,_GET_request_with_params === RUN TestHandler_ServeHTTP/handler_with_stats_enabled,_GET_request_without_params === RUN TestHandler_ServeHTTP/handler_with_stats_disabled,_GET_request_with_params --- PASS: TestHandler_ServeHTTP (0.35s) --- PASS: TestHandler_ServeHTTP/handler_with_stats_enabled,_POST_request_with_params (0.13s) --- PASS: TestHandler_ServeHTTP/handler_with_stats_enabled,_GET_request_with_params (0.05s) --- PASS: TestHandler_ServeHTTP/handler_with_stats_enabled,_GET_request_without_params (0.11s) --- PASS: TestHandler_ServeHTTP/handler_with_stats_disabled,_GET_request_with_params (0.04s) === RUN TestHandler_FailedRoundTrip === RUN TestHandler_FailedRoundTrip/Failed_round_trip_with_context_cancelled === RUN TestHandler_FailedRoundTrip/Failed_round_trip_with_no_query_params --- PASS: TestHandler_FailedRoundTrip (0.00s) --- PASS: TestHandler_FailedRoundTrip/Failed_round_trip_with_context_cancelled (0.00s) --- PASS: TestHandler_FailedRoundTrip/Failed_round_trip_with_no_query_params (0.00s) PASS ok github.com/grafana/mimir/pkg/frontend/transport 0.638s === RUN TestFrontend --- PASS: TestFrontend (0.17s) === RUN TestFrontendPropagateTrace --- PASS: TestFrontendPropagateTrace (0.03s) === RUN TestFrontendCheckReady === RUN TestFrontendCheckReady/connected_clients_are_ready === RUN TestFrontendCheckReady/no_url,_no_clients_is_not_ready --- PASS: TestFrontendCheckReady (0.00s) --- PASS: TestFrontendCheckReady/connected_clients_are_ready (0.00s) --- PASS: TestFrontendCheckReady/no_url,_no_clients_is_not_ready (0.00s) === RUN TestFrontendCancel --- PASS: TestFrontendCancel (0.21s) === RUN TestFrontendMetricsCleanup --- PASS: TestFrontendMetricsCleanup (0.02s) === RUN TestDequeuesExpiredRequests --- PASS: TestDequeuesExpiredRequests (1.00s) === RUN TestRoundRobinQueues --- PASS: TestRoundRobinQueues (1.01s) PASS ok github.com/grafana/mimir/pkg/frontend/v1 3.051s === RUN TestFrontendBasicWorkflow level=info msg="adding connection to query-scheduler" addr=[::]:45571 level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" --- PASS: TestFrontendBasicWorkflow (0.16s) === RUN TestFrontendRequestsPerWorkerMetric level=info msg="adding connection to query-scheduler" addr=[::]:43039 level=info msg="removing connection to query-scheduler" addr=[::]:43039 level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" --- PASS: TestFrontendRequestsPerWorkerMetric (0.12s) === RUN TestFrontendRetryEnqueue level=info msg="adding connection to query-scheduler" addr=[::]:39641 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:39641 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:39641 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:39641 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:39641 level=debug msg="stream context finished" err="context canceled" --- PASS: TestFrontendRetryEnqueue (0.12s) === RUN TestFrontendTooManyRequests level=info msg="adding connection to query-scheduler" addr=[::]:36901 level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" --- PASS: TestFrontendTooManyRequests (0.02s) === RUN TestFrontendEnqueueFailure level=info msg="adding connection to query-scheduler" addr=[::]:41169 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:41169 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:41169 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:41169 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:41169 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:41169 level=error msg="error sending requests to scheduler" err="scheduler is shutting down" addr=[::]:41169 level=debug msg="stream context finished" err="context canceled" --- PASS: TestFrontendEnqueueFailure (0.30s) === RUN TestFrontendCancellation level=info msg="adding connection to query-scheduler" addr=[::]:43687 level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" --- PASS: TestFrontendCancellation (0.24s) === RUN TestFrontendWorkerCancellation level=info msg="adding connection to query-scheduler" addr=[::]:44347 level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" --- PASS: TestFrontendWorkerCancellation (0.27s) === RUN TestFrontendFailedCancellation level=info msg="adding connection to query-scheduler" addr=[::]:44179 level=info msg="removing connection to query-scheduler" addr=[::]:44179 level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" level=debug msg="stream context finished" err="context canceled" --- PASS: TestFrontendFailedCancellation (0.24s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_with_default_config === RUN TestConfig_Validate/should_pass_if_scheduler_address_is_configured,_and_query-scheduler_discovery_mode_is_the_default_one === RUN TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_scheduler_address_is_configured --- PASS: TestConfig_Validate (0.00s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestConfig_Validate/should_pass_if_scheduler_address_is_configured,_and_query-scheduler_discovery_mode_is_the_default_one (0.00s) --- PASS: TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_scheduler_address_is_configured (0.00s) === RUN TestWithClosingGrpcServer level=info msg="adding connection to query-scheduler" addr=[::]:39731 level=error msg="error sending requests to scheduler" err=EOF addr=[::]:39731 level=debug msg="stream context finished" err="context canceled" --- PASS: TestWithClosingGrpcServer (1.42s) PASS ok github.com/grafana/mimir/pkg/frontend/v2 3.325s ? github.com/grafana/mimir/pkg/mimirtool/analyze [no test files] ? github.com/grafana/mimir/pkg/mimirtool/backfill [no test files] === RUN TestRequestActivity --- PASS: TestRequestActivity (0.00s) === RUN TestQueryRequest_CustomStringer === RUN TestQueryRequest_CustomStringer/one_matcher === RUN TestQueryRequest_CustomStringer/multiple_matchers === RUN TestQueryRequest_CustomStringer/nil_request === RUN TestQueryRequest_CustomStringer/empty_request === RUN TestQueryRequest_CustomStringer/no_matchers --- PASS: TestQueryRequest_CustomStringer (0.00s) --- PASS: TestQueryRequest_CustomStringer/one_matcher (0.00s) --- PASS: TestQueryRequest_CustomStringer/multiple_matchers (0.00s) --- PASS: TestQueryRequest_CustomStringer/nil_request (0.00s) --- PASS: TestQueryRequest_CustomStringer/empty_request (0.00s) --- PASS: TestQueryRequest_CustomStringer/no_matchers (0.00s) === RUN TestRingConfig_DefaultConfigToLifecyclerConfig --- PASS: TestRingConfig_DefaultConfigToLifecyclerConfig (0.01s) === RUN TestRingConfig_CustomConfigToLifecyclerConfig --- PASS: TestRingConfig_CustomConfigToLifecyclerConfig (0.01s) === RUN TestIngester_Push === RUN TestIngester_Push/successful_push,_active_series_disabled === RUN TestIngester_Push/should_soft_fail_on_all_samples_out_of_bound_in_a_write_request === RUN TestIngester_Push/should_soft_fail_on_two_different_sample_values_at_the_same_timestamp === RUN TestIngester_Push/should_succeed_with_a_request_containing_only_metadata === RUN TestIngester_Push/should_discard_metadata_when_max_metadata_per_metric_exceeded === RUN TestIngester_Push/should_succeed_on_valid_series_and_metadata === RUN TestIngester_Push/should_succeed_on_valid_series_with_exemplars === RUN TestIngester_Push/should_soft_fail_on_sample_out-of-order === RUN TestIngester_Push/should_soft_fail_on_some_samples_out_of_bound_in_a_write_request === RUN TestIngester_Push/should_soft_fail_on_exemplar_with_unknown_series === RUN TestIngester_Push/should_discard_metadata_when_max_metadata_per_user_exceeded --- PASS: TestIngester_Push (1.58s) --- PASS: TestIngester_Push/successful_push,_active_series_disabled (0.14s) --- PASS: TestIngester_Push/should_soft_fail_on_all_samples_out_of_bound_in_a_write_request (0.10s) --- PASS: TestIngester_Push/should_soft_fail_on_two_different_sample_values_at_the_same_timestamp (0.23s) --- PASS: TestIngester_Push/should_succeed_with_a_request_containing_only_metadata (0.03s) --- PASS: TestIngester_Push/should_discard_metadata_when_max_metadata_per_metric_exceeded (0.04s) --- PASS: TestIngester_Push/should_succeed_on_valid_series_and_metadata (0.16s) --- PASS: TestIngester_Push/should_succeed_on_valid_series_with_exemplars (0.20s) --- PASS: TestIngester_Push/should_soft_fail_on_sample_out-of-order (0.25s) --- PASS: TestIngester_Push/should_soft_fail_on_some_samples_out_of_bound_in_a_write_request (0.15s) --- PASS: TestIngester_Push/should_soft_fail_on_exemplar_with_unknown_series (0.20s) --- PASS: TestIngester_Push/should_discard_metadata_when_max_metadata_per_user_exceeded (0.05s) === RUN TestIngester_Push_ShouldCorrectlyTrackMetricsInMultiTenantScenario --- PASS: TestIngester_Push_ShouldCorrectlyTrackMetricsInMultiTenantScenario (0.28s) === RUN TestIngester_Push_DecreaseInactiveSeries --- PASS: TestIngester_Push_DecreaseInactiveSeries (0.27s) === RUN Test_Ingester_LabelNames === RUN Test_Ingester_LabelNames/without_matchers === RUN Test_Ingester_LabelNames/with_matchers --- PASS: Test_Ingester_LabelNames (0.14s) --- PASS: Test_Ingester_LabelNames/without_matchers (0.00s) --- PASS: Test_Ingester_LabelNames/with_matchers (0.00s) === RUN Test_Ingester_LabelValues --- PASS: Test_Ingester_LabelValues (0.18s) === RUN Test_Ingester_Query === RUN Test_Ingester_Query/should_return_an_empty_response_if_no_metric_matches === RUN Test_Ingester_Query/should_filter_series_by_==_matcher === RUN Test_Ingester_Query/should_filter_series_by_!=_matcher === RUN Test_Ingester_Query/should_filter_series_by_=~_matcher === RUN Test_Ingester_Query/should_filter_series_by_!~_matcher === RUN Test_Ingester_Query/should_filter_series_by_multiple_matchers === RUN Test_Ingester_Query/should_filter_series_by_matcher_and_time_range --- PASS: Test_Ingester_Query (0.21s) --- PASS: Test_Ingester_Query/should_return_an_empty_response_if_no_metric_matches (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_==_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_!=_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_=~_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_!~_matcher (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_multiple_matchers (0.00s) --- PASS: Test_Ingester_Query/should_filter_series_by_matcher_and_time_range (0.00s) === RUN TestIngester_LabelNamesCardinality === RUN TestIngester_LabelNamesCardinality/expected_all_label_with_values === RUN TestIngester_LabelNamesCardinality/expected_label_values_only_from_`metric_0` --- PASS: TestIngester_LabelNamesCardinality (0.16s) --- PASS: TestIngester_LabelNamesCardinality/expected_all_label_with_values (0.00s) --- PASS: TestIngester_LabelNamesCardinality/expected_label_values_only_from_`metric_0` (0.00s) === RUN TestIngester_LabelValuesCardinality === RUN TestIngester_LabelValuesCardinality/expected_all_label_values_cardinality === RUN TestIngester_LabelValuesCardinality/expected_status_values_cardinality_applying_matchers === RUN TestIngester_LabelValuesCardinality/empty_response_is_returned_when_no_matchers_match_the_requested_labels --- PASS: TestIngester_LabelValuesCardinality (0.23s) --- PASS: TestIngester_LabelValuesCardinality/expected_all_label_values_cardinality (0.00s) --- PASS: TestIngester_LabelValuesCardinality/expected_status_values_cardinality_applying_matchers (0.00s) --- PASS: TestIngester_LabelValuesCardinality/empty_response_is_returned_when_no_matchers_match_the_requested_labels (0.00s) === RUN TestIngester_Query_QuerySharding --- PASS: TestIngester_Query_QuerySharding (6.67s) === RUN TestIngester_Query_ShouldNotCreateTSDBIfDoesNotExists --- PASS: TestIngester_Query_ShouldNotCreateTSDBIfDoesNotExists (0.07s) === RUN TestIngester_LabelValues_ShouldNotCreateTSDBIfDoesNotExists --- PASS: TestIngester_LabelValues_ShouldNotCreateTSDBIfDoesNotExists (0.01s) === RUN TestIngester_LabelNames_ShouldNotCreateTSDBIfDoesNotExists --- PASS: TestIngester_LabelNames_ShouldNotCreateTSDBIfDoesNotExists (0.02s) === RUN TestIngester_Push_ShouldNotCreateTSDBIfNotInActiveState --- PASS: TestIngester_Push_ShouldNotCreateTSDBIfNotInActiveState (0.01s) === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_JOINING_state === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_LEAVING_state === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/allow_to_create_TSDB_if_in_ACTIVE_state === RUN TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_PENDING_state --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive (0.16s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_JOINING_state (0.01s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_LEAVING_state (0.01s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/allow_to_create_TSDB_if_in_ACTIVE_state (0.12s) --- PASS: TestIngester_getOrCreateTSDB_ShouldNotAllowToCreateTSDBIfIngesterStateIsNotActive/not_allow_to_create_TSDB_if_in_PENDING_state (0.01s) === RUN Test_Ingester_MetricsForLabelMatchers === RUN Test_Ingester_MetricsForLabelMatchers/should_not_return_duplicated_metrics_on_overlapping_matchers === RUN Test_Ingester_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide === RUN Test_Ingester_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match === RUN Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher === RUN Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers === RUN Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_time_range_to_return_nothing_when_queried_for_older_time_ranges --- PASS: Test_Ingester_MetricsForLabelMatchers (0.16s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_not_return_duplicated_metrics_on_overlapping_matchers (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_return_all_matching_metrics_even_if_their_FastFingerprint_collide (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_return_an_empty_response_if_no_metric_match (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_single_matcher (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_multiple_matchers (0.00s) --- PASS: Test_Ingester_MetricsForLabelMatchers/should_filter_metrics_by_time_range_to_return_nothing_when_queried_for_older_time_ranges (0.00s) === RUN Test_Ingester_MetricsForLabelMatchers_Deduplication --- PASS: Test_Ingester_MetricsForLabelMatchers_Deduplication (28.32s) === RUN TestIngester_QueryStream === RUN TestIngester_QueryStream/should_support_sharding_when_query_chunks === RUN TestIngester_QueryStream/should_query_chunks_by_default === RUN TestIngester_QueryStream/should_query_samples_when_configured_with_QueryStreamSamples === RUN TestIngester_QueryStream/should_query_chunks_when_configured_with_QueryStreamChunks === RUN TestIngester_QueryStream/should_support_sharding_when_query_samples --- PASS: TestIngester_QueryStream (9.00s) --- PASS: TestIngester_QueryStream/should_support_sharding_when_query_chunks (0.49s) --- PASS: TestIngester_QueryStream/should_query_chunks_by_default (0.32s) --- PASS: TestIngester_QueryStream/should_query_samples_when_configured_with_QueryStreamSamples (0.30s) --- PASS: TestIngester_QueryStream/should_query_chunks_when_configured_with_QueryStreamChunks (0.28s) --- PASS: TestIngester_QueryStream/should_support_sharding_when_query_samples (0.35s) === RUN TestIngester_QueryStreamManySamples --- PASS: TestIngester_QueryStreamManySamples (4.42s) === RUN TestIngester_QueryStreamManySamplesChunks --- PASS: TestIngester_QueryStreamManySamplesChunks (29.61s) === RUN TestIngester_OpenExistingTSDBOnStartup === PAUSE TestIngester_OpenExistingTSDBOnStartup === RUN TestIngester_shipBlocks --- PASS: TestIngester_shipBlocks (0.53s) === RUN TestIngester_dontShipBlocksWhenTenantDeletionMarkerIsPresent --- PASS: TestIngester_dontShipBlocksWhenTenantDeletionMarkerIsPresent (12.54s) === RUN TestIngester_seriesCountIsCorrectAfterClosingTSDBForDeletedTenant --- PASS: TestIngester_seriesCountIsCorrectAfterClosingTSDBForDeletedTenant (0.14s) === RUN TestIngester_closeAndDeleteUserTSDBIfIdle_shouldNotCloseTSDBIfShippingIsInProgress --- PASS: TestIngester_closeAndDeleteUserTSDBIfIdle_shouldNotCloseTSDBIfShippingIsInProgress (0.23s) === RUN TestIngester_closingAndOpeningTsdbConcurrently --- PASS: TestIngester_closingAndOpeningTsdbConcurrently (0.23s) === RUN TestIngester_idleCloseEmptyTSDB --- PASS: TestIngester_idleCloseEmptyTSDB (0.27s) === RUN TestIngester_invalidSamplesDontChangeLastUpdateTime --- PASS: TestIngester_invalidSamplesDontChangeLastUpdateTime (1.00s) === RUN TestIngester_flushing === RUN TestIngester_flushing/shutdownHandler === RUN TestIngester_flushing/flushHandler === RUN TestIngester_flushing/flushHandlerWithListOfTenants === RUN TestIngester_flushing/flushMultipleBlocksWithDataSpanning3Days === RUN TestIngester_flushing/ingesterShutdown --- PASS: TestIngester_flushing (42.17s) --- PASS: TestIngester_flushing/shutdownHandler (5.88s) --- PASS: TestIngester_flushing/flushHandler (6.80s) --- PASS: TestIngester_flushing/flushHandlerWithListOfTenants (6.14s) --- PASS: TestIngester_flushing/flushMultipleBlocksWithDataSpanning3Days (18.70s) --- PASS: TestIngester_flushing/ingesterShutdown (4.64s) === RUN TestIngester_ForFlush --- PASS: TestIngester_ForFlush (4.68s) === RUN Test_Ingester_UserStats --- PASS: Test_Ingester_UserStats (0.12s) === RUN Test_Ingester_AllUserStats --- PASS: Test_Ingester_AllUserStats (0.19s) === RUN TestIngesterCompactIdleBlock --- PASS: TestIngesterCompactIdleBlock (6.57s) === RUN TestIngesterCompactAndCloseIdleTSDB --- PASS: TestIngesterCompactAndCloseIdleTSDB (8.39s) === RUN TestHeadCompactionOnStartup --- PASS: TestHeadCompactionOnStartup (59.30s) === RUN TestIngester_CloseTSDBsOnShutdown --- PASS: TestIngester_CloseTSDBsOnShutdown (0.15s) === RUN TestIngesterNotDeleteUnshippedBlocks --- PASS: TestIngesterNotDeleteUnshippedBlocks (19.64s) === RUN TestIngesterNotDeleteShippedBlocksUntilRetentionExpires --- PASS: TestIngesterNotDeleteShippedBlocksUntilRetentionExpires (16.17s) === RUN TestIngesterWithShippingDisabledDeletesBlocksOnlyAfterRetentionExpires ingester_test.go:4371: Error Trace: /build/mimir/src/mimir/pkg/ingester/ingester_test.go:4371 Error: Not equal: expected: 3 actual : 1 Test: TestIngesterWithShippingDisabledDeletesBlocksOnlyAfterRetentionExpires --- FAIL: TestIngesterWithShippingDisabledDeletesBlocksOnlyAfterRetentionExpires (9.76s) === RUN TestIngesterPushErrorDuringForcedCompaction --- PASS: TestIngesterPushErrorDuringForcedCompaction (0.09s) === RUN TestIngesterNoFlushWithInFlightRequest --- PASS: TestIngesterNoFlushWithInFlightRequest (8.35s) === RUN TestIngester_PushInstanceLimits === RUN TestIngester_PushInstanceLimits/should_succeed_creating_one_user_and_series === RUN TestIngester_PushInstanceLimits/should_fail_creating_two_series === RUN TestIngester_PushInstanceLimits/should_fail_creating_two_users === RUN TestIngester_PushInstanceLimits/should_fail_pushing_samples_in_two_requests_due_to_rate_limit --- PASS: TestIngester_PushInstanceLimits (0.43s) --- PASS: TestIngester_PushInstanceLimits/should_succeed_creating_one_user_and_series (0.14s) --- PASS: TestIngester_PushInstanceLimits/should_fail_creating_two_series (0.08s) --- PASS: TestIngester_PushInstanceLimits/should_fail_creating_two_users (0.13s) --- PASS: TestIngester_PushInstanceLimits/should_fail_pushing_samples_in_two_requests_due_to_rate_limit (0.07s) === RUN TestIngester_instanceLimitsMetrics --- PASS: TestIngester_instanceLimitsMetrics (0.02s) === RUN TestIngester_inflightPushRequests ingester_test.go:4729: 1 100000 2.478843594s --- PASS: TestIngester_inflightPushRequests (6.95s) === RUN TestIngesterPurgeMetadata --- PASS: TestIngesterPurgeMetadata (0.05s) === RUN TestIngesterMetadataMetrics --- PASS: TestIngesterMetadataMetrics (0.07s) === RUN TestIngesterSendsOnlySeriesWithData --- PASS: TestIngesterSendsOnlySeriesWithData (0.90s) === RUN TestIngester_Push_SeriesWithBlankLabel --- PASS: TestIngester_Push_SeriesWithBlankLabel (0.07s) === RUN TestIngesterUserLimitExceeded --- PASS: TestIngesterUserLimitExceeded (0.19s) === RUN TestIngesterMetricLimitExceeded --- PASS: TestIngesterMetricLimitExceeded (0.18s) === RUN TestIngesterActiveSeries === RUN TestIngesterActiveSeries/successful_push,_active_series_disabled === RUN TestIngesterActiveSeries/successful_push,_should_count_active_series === RUN TestIngesterActiveSeries/should_cleanup_metrics_when_tsdb_closed === RUN TestIngesterActiveSeries/should_track_custom_matchers,_removing_when_zero --- PASS: TestIngesterActiveSeries (1.39s) --- PASS: TestIngesterActiveSeries/successful_push,_active_series_disabled (0.26s) --- PASS: TestIngesterActiveSeries/successful_push,_should_count_active_series (0.25s) --- PASS: TestIngesterActiveSeries/should_cleanup_metrics_when_tsdb_closed (0.47s) --- PASS: TestIngesterActiveSeries/should_track_custom_matchers,_removing_when_zero (0.39s) === RUN TestIngesterActiveSeriesConfigChanges === RUN TestIngesterActiveSeriesConfigChanges/override_flag_based_config_with_runtime_overwrite === RUN TestIngesterActiveSeriesConfigChanges/remove_runtime_overwrite_and_revert_to_flag_based_config === RUN TestIngesterActiveSeriesConfigChanges/changing_runtime_override_should_result_in_new_metrics === RUN TestIngesterActiveSeriesConfigChanges/should_cleanup_loading_metric_at_close --- PASS: TestIngesterActiveSeriesConfigChanges (0.87s) --- PASS: TestIngesterActiveSeriesConfigChanges/override_flag_based_config_with_runtime_overwrite (0.19s) --- PASS: TestIngesterActiveSeriesConfigChanges/remove_runtime_overwrite_and_revert_to_flag_based_config (0.29s) --- PASS: TestIngesterActiveSeriesConfigChanges/changing_runtime_override_should_result_in_new_metrics (0.13s) --- PASS: TestIngesterActiveSeriesConfigChanges/should_cleanup_loading_metric_at_close (0.26s) === RUN TestGetIgnoreSeriesLimitForMetricNamesMap --- PASS: TestGetIgnoreSeriesLimitForMetricNamesMap (0.00s) === RUN Test_Ingester_OutOfOrder --- PASS: Test_Ingester_OutOfOrder (4.65s) === RUN TestNewIngestErrMsgs === RUN TestNewIngestErrMsgs/newIngestErrSampleDuplicateTimestamp === RUN TestNewIngestErrMsgs/newEphemeralIngestErrSampleDuplicateTimestamp === RUN TestNewIngestErrMsgs/newIngestErrExemplarMissingSeries === RUN TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld === RUN TestNewIngestErrMsgs/newEphemeralIngestErrSampleTimestampTooOld === RUN TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld_out_of_order_enabled === RUN TestNewIngestErrMsgs/newIngestErrSampleOutOfOrder === RUN TestNewIngestErrMsgs/newEphemeralIngestErrSampleOutOfOrder --- PASS: TestNewIngestErrMsgs (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleDuplicateTimestamp (0.00s) --- PASS: TestNewIngestErrMsgs/newEphemeralIngestErrSampleDuplicateTimestamp (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrExemplarMissingSeries (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld (0.00s) --- PASS: TestNewIngestErrMsgs/newEphemeralIngestErrSampleTimestampTooOld (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleTimestampTooOld_out_of_order_enabled (0.00s) --- PASS: TestNewIngestErrMsgs/newIngestErrSampleOutOfOrder (0.00s) --- PASS: TestNewIngestErrMsgs/newEphemeralIngestErrSampleOutOfOrder (0.00s) === RUN TestIngester_PushAndQueryEphemeral === RUN TestIngester_PushAndQueryEphemeral/ephemeral_storage_disabled === RUN TestIngester_PushAndQueryEphemeral/only_allow_single_ephemeral_series === RUN TestIngester_PushAndQueryEphemeral/should_succeed_on_pushing_valid_series_to_ephemeral_storage === RUN TestIngester_PushAndQueryEphemeral/old_ephemeral_samples_are_discarded === RUN TestIngester_PushAndQueryEphemeral/should_fail_on_out-of-order_samples === RUN TestIngester_PushAndQueryEphemeral/request_with_mix_of_ephemeral_and_persistent_series,_with_some_good_and_some_bad_samples_plus_some_metadata === RUN TestIngester_PushAndQueryEphemeral/only_persistent_series_--_does_not_initialize_ephemeral_storage --- PASS: TestIngester_PushAndQueryEphemeral (0.99s) --- PASS: TestIngester_PushAndQueryEphemeral/ephemeral_storage_disabled (0.13s) --- PASS: TestIngester_PushAndQueryEphemeral/only_allow_single_ephemeral_series (0.16s) --- PASS: TestIngester_PushAndQueryEphemeral/should_succeed_on_pushing_valid_series_to_ephemeral_storage (0.14s) --- PASS: TestIngester_PushAndQueryEphemeral/old_ephemeral_samples_are_discarded (0.15s) --- PASS: TestIngester_PushAndQueryEphemeral/should_fail_on_out-of-order_samples (0.15s) --- PASS: TestIngester_PushAndQueryEphemeral/request_with_mix_of_ephemeral_and_persistent_series,_with_some_good_and_some_bad_samples_plus_some_metadata (0.15s) --- PASS: TestIngester_PushAndQueryEphemeral/only_persistent_series_--_does_not_initialize_ephemeral_storage (0.11s) === RUN TestIngesterTruncationOfEphemeralSeries --- PASS: TestIngesterTruncationOfEphemeralSeries (0.18s) === RUN TestIngesterQueryingWithStorageLabelErrorHandling === RUN TestIngesterQueryingWithStorageLabelErrorHandling/error_on_invalid_storage_label_value === RUN TestIngesterQueryingWithStorageLabelErrorHandling/error_on_invalid_matcher_type_=~ === RUN TestIngesterQueryingWithStorageLabelErrorHandling/no_real_matchers_is_fine === RUN TestIngesterQueryingWithStorageLabelErrorHandling/multiple_storage_labels_return_error === RUN TestIngesterQueryingWithStorageLabelErrorHandling/no_error_on_valid_persistent_storage_matcher === RUN TestIngesterQueryingWithStorageLabelErrorHandling/no_error_on_valid_ephemeral_storage_matcher === RUN TestIngesterQueryingWithStorageLabelErrorHandling/error_on_invalid_matcher_type_!= === RUN TestIngesterQueryingWithStorageLabelErrorHandling/error_on_invalid_matcher_type_!~ === RUN TestIngesterQueryingWithStorageLabelErrorHandling/multiple_storage_labels_return_error,_even_if_they_are_the_same === RUN TestIngesterQueryingWithStorageLabelErrorHandling/no_error_on_missing_storage_label --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling (0.03s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/error_on_invalid_storage_label_value (0.00s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/error_on_invalid_matcher_type_=~ (0.00s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/no_real_matchers_is_fine (0.00s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/multiple_storage_labels_return_error (0.00s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/no_error_on_valid_persistent_storage_matcher (0.00s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/no_error_on_valid_ephemeral_storage_matcher (0.00s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/error_on_invalid_matcher_type_!= (0.00s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/error_on_invalid_matcher_type_!~ (0.00s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/multiple_storage_labels_return_error,_even_if_they_are_the_same (0.00s) --- PASS: TestIngesterQueryingWithStorageLabelErrorHandling/no_error_on_missing_storage_label (0.00s) === RUN TestInstanceLimitsUnmarshal --- PASS: TestInstanceLimitsUnmarshal (0.00s) === RUN TestLabelNamesAndValuesAreSentInBatches --- PASS: TestLabelNamesAndValuesAreSentInBatches (0.00s) === RUN TestIngester_LabelValuesCardinality_SentInBatches --- PASS: TestIngester_LabelValuesCardinality_SentInBatches (5.16s) === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/empty_response_is_returned_when_no_labels_are_provided === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_if_response_size_is_less_then_batch_size === RUN TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/only_matching_series_are_returned_when_a_matcher_is_provided --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage (0.29s) --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/empty_response_is_returned_when_no_labels_are_provided (0.02s) --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message (0.09s) --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/all_values_returned_in_a_single_message_if_response_size_is_less_then_batch_size (0.09s) --- PASS: TestIngester_LabelValuesCardinality_AllValuesToBeReturnedInSingleMessage/only_matching_series_are_returned_when_a_matcher_is_provided (0.10s) === RUN TestLabelNamesAndValues_ContextCancellation --- PASS: TestLabelNamesAndValues_ContextCancellation (0.10s) === RUN TestCountLabelValueSeries_ContextCancellation --- PASS: TestCountLabelValueSeries_ContextCancellation (0.00s) === RUN TestIngesterRestart --- PASS: TestIngesterRestart (0.42s) === RUN TestIngester_ShutdownHandler === RUN TestIngester_ShutdownHandler/unregister=false === RUN TestIngester_ShutdownHandler/unregister=true --- PASS: TestIngester_ShutdownHandler (0.02s) --- PASS: TestIngester_ShutdownHandler/unregister=false (0.01s) --- PASS: TestIngester_ShutdownHandler/unregister=true (0.01s) === RUN TestLimiter_maxSeriesPerMetric === RUN TestLimiter_maxSeriesPerMetric/limit_is_disabled === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones --- PASS: TestLimiter_maxSeriesPerMetric (0.01s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) === RUN TestLimiter_maxMetadataPerMetric === RUN TestLimiter_maxMetadataPerMetric/limit_is_disabled === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters --- PASS: TestLimiter_maxMetadataPerMetric (0.01s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerMetric/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) === RUN TestLimiter_maxSeriesPerUser === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxSeriesPerUser/limit_is_disabled === RUN TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones --- PASS: TestLimiter_maxSeriesPerUser (0.01s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxSeriesPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) === RUN TestLimiter_maxMetadataPerUser === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 === RUN TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters === RUN TestLimiter_maxMetadataPerUser/limit_is_disabled === RUN TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 --- PASS: TestLimiter_maxMetadataPerUser (0.01s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_NOT_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_divisible_by_number_of_zones (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_5 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=3,_shard_size_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_is_0 (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/zone-awareness_enabled,_limit_enabled_and_the_shard_size_>_number_of_ingesters (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_maxMetadataPerUser/limit_is_enabled_with_replication-factor=1,_shard_size_0 (0.00s) === RUN TestLimiter_AssertMaxSeriesPerMetric === RUN TestLimiter_AssertMaxSeriesPerMetric/limit_is_disabled === RUN TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_below_the_limit === RUN TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_above_the_limit --- PASS: TestLimiter_AssertMaxSeriesPerMetric (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerMetric/current_number_of_series_is_above_the_limit (0.00s) === RUN TestLimiter_AssertMaxMetadataPerMetric === RUN TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_above_the_limit === RUN TestLimiter_AssertMaxMetadataPerMetric/limit_is_disabled === RUN TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_below_the_limit --- PASS: TestLimiter_AssertMaxMetadataPerMetric (0.00s) --- PASS: TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_above_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxMetadataPerMetric/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxMetadataPerMetric/current_number_of_metadata_is_below_the_limit (0.00s) === RUN TestLimiter_AssertMaxSeriesPerUser === RUN TestLimiter_AssertMaxSeriesPerUser/limit_is_disabled === RUN TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_below_the_limit === RUN TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_above_the_limit --- PASS: TestLimiter_AssertMaxSeriesPerUser (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxSeriesPerUser/current_number_of_series_is_above_the_limit (0.00s) === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser/limit_is_disabled === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_below_the_limit === RUN TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_above_the_limit --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser (0.00s) --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser/limit_is_disabled (0.00s) --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_below_the_limit (0.00s) --- PASS: TestLimiter_AssertMaxMetricsWithMetadataPerUser/current_number_of_metadata_is_above_the_limit (0.00s) === RUN TestLimiter_FormatError --- PASS: TestLimiter_FormatError (0.00s) === RUN TestTSDBMetrics --- PASS: TestTSDBMetrics (0.05s) === RUN TestTSDBMetricsWithRemoval --- PASS: TestTSDBMetricsWithRemoval (0.03s) === RUN TestShipper === RUN TestShipper/no_shipper_file_yet === RUN TestShipper/sync_first_block === RUN TestShipper/sync_without_any_new_block === RUN TestShipper/sync_block_without_external_labels === RUN TestShipper/sync_block_with_0_samples === RUN TestShipper/check_if_uploaded_block_has_files_set === NAME TestShipper shipper_test.go:159: level=info msg="upload new block" id=00000000010000000000000000 level=debug msg="uploaded file" from=/tmp/TestShipper865083950/001/00000000010000000000000000/index dst=00000000010000000000000000/index bucket="fs: /tmp/TestShipper865083950/002" level=info msg="upload new block" id=00000000020000000000000000 level=debug msg="uploaded file" from=/tmp/TestShipper865083950/001/00000000020000000000000000/index dst=00000000020000000000000000/index bucket="fs: /tmp/TestShipper865083950/002" level=debug msg="ignoring empty block" block=00000000030000000000000000 --- PASS: TestShipper (0.02s) --- PASS: TestShipper/no_shipper_file_yet (0.00s) --- PASS: TestShipper/sync_first_block (0.00s) --- PASS: TestShipper/sync_without_any_new_block (0.00s) --- PASS: TestShipper/sync_block_without_external_labels (0.00s) --- PASS: TestShipper/sync_block_with_0_samples (0.00s) --- PASS: TestShipper/check_if_uploaded_block_has_files_set (0.00s) === RUN TestShipper_DeceivingUploadErrors level=info msg="upload new block" id=00000000010000000000000000 level=debug msg="uploaded file" from=/tmp/TestShipper_DeceivingUploadErrors435752547/001/00000000010000000000000000/index dst=00000000010000000000000000/index bucket="fs: /tmp/TestShipper_DeceivingUploadErrors435752547/002" level=error msg="shipping failed" block=00000000010000000000000000 err="upload meta file: base name matches, will fail upload" --- PASS: TestShipper_DeceivingUploadErrors (0.01s) === RUN TestIterBlockMetas --- PASS: TestIterBlockMetas (0.00s) === RUN TestShipperAddsSegmentFiles --- PASS: TestShipperAddsSegmentFiles (0.00s) === RUN TestReadThanosMetaFile === RUN TestReadThanosMetaFile/Missing_meta_file === RUN TestReadThanosMetaFile/Non-JSON_meta_file === RUN TestReadThanosMetaFile/Wrongly_versioned_meta_file --- PASS: TestReadThanosMetaFile (0.00s) --- PASS: TestReadThanosMetaFile/Missing_meta_file (0.00s) --- PASS: TestReadThanosMetaFile/Non-JSON_meta_file (0.00s) --- PASS: TestReadThanosMetaFile/Wrongly_versioned_meta_file (0.00s) === RUN TestUserMetricsMetadata === RUN TestUserMetricsMetadata/should_succeed_for_multiple_metadata_per_metric === RUN TestUserMetricsMetadata/should_fail_when_metadata_per_user_limit_reached === RUN TestUserMetricsMetadata/should_fail_when_metadata_per_metric_limit_reached --- PASS: TestUserMetricsMetadata (0.02s) --- PASS: TestUserMetricsMetadata/should_succeed_for_multiple_metadata_per_metric (0.00s) --- PASS: TestUserMetricsMetadata/should_fail_when_metadata_per_user_limit_reached (0.01s) --- PASS: TestUserMetricsMetadata/should_fail_when_metadata_per_metric_limit_reached (0.01s) === CONT TestIngester_OpenExistingTSDBOnStartup === RUN TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_>_number_of_TSDBs === RUN TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_<_number_of_TSDBs === RUN TestIngester_OpenExistingTSDBOnStartup/should_not_load_TSDB_if_the_user_directory_is_empty === RUN TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_if_the_root_directory_is_empty === RUN TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_is_the_root_directory_is_missing === RUN TestIngester_OpenExistingTSDBOnStartup/should_load_TSDB_for_any_non-empty_user_directory === RUN TestIngester_OpenExistingTSDBOnStartup/should_load_all_TSDBs_on_concurrency_<_number_of_TSDBs --- PASS: TestIngester_OpenExistingTSDBOnStartup (0.79s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_>_number_of_TSDBs (0.24s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_fail_and_rollback_if_an_error_occur_while_loading_a_TSDB_on_concurrency_<_number_of_TSDBs (0.25s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_not_load_TSDB_if_the_user_directory_is_empty (0.01s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_if_the_root_directory_is_empty (0.01s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_not_load_any_TSDB_is_the_root_directory_is_missing (0.01s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_load_TSDB_for_any_non-empty_user_directory (0.09s) --- PASS: TestIngester_OpenExistingTSDBOnStartup/should_load_all_TSDBs_on_concurrency_<_number_of_TSDBs (0.17s) FAIL FAIL github.com/grafana/mimir/pkg/ingester 296.915s === RUN TestActiveSeries_UpdateSeries_NoMatchers --- PASS: TestActiveSeries_UpdateSeries_NoMatchers (0.00s) === RUN TestActiveSeries_UpdateSeries_WithMatchers --- PASS: TestActiveSeries_UpdateSeries_WithMatchers (0.03s) === RUN TestActiveSeries_ShouldCorrectlyHandleHashCollisions --- PASS: TestActiveSeries_ShouldCorrectlyHandleHashCollisions (0.00s) === RUN TestActiveSeries_Purge_NoMatchers === RUN TestActiveSeries_Purge_NoMatchers/ttl:_1 === RUN TestActiveSeries_Purge_NoMatchers/ttl:_2 === RUN TestActiveSeries_Purge_NoMatchers/ttl:_3 === RUN TestActiveSeries_Purge_NoMatchers/ttl:_4 --- PASS: TestActiveSeries_Purge_NoMatchers (0.02s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_1 (0.00s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_2 (0.00s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_3 (0.00s) --- PASS: TestActiveSeries_Purge_NoMatchers/ttl:_4 (0.01s) === RUN TestActiveSeries_Purge_WithMatchers === RUN TestActiveSeries_Purge_WithMatchers/ttl=1 === RUN TestActiveSeries_Purge_WithMatchers/ttl=2 === RUN TestActiveSeries_Purge_WithMatchers/ttl=3 === RUN TestActiveSeries_Purge_WithMatchers/ttl=4 --- PASS: TestActiveSeries_Purge_WithMatchers (0.01s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=1 (0.00s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=2 (0.00s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=3 (0.00s) --- PASS: TestActiveSeries_Purge_WithMatchers/ttl=4 (0.00s) === RUN TestActiveSeries_PurgeOpt --- PASS: TestActiveSeries_PurgeOpt (0.00s) === RUN TestActiveSeries_ReloadSeriesMatchers --- PASS: TestActiveSeries_ReloadSeriesMatchers (0.00s) === RUN TestActiveSeries_ReloadSeriesMatchers_LessMatchers --- PASS: TestActiveSeries_ReloadSeriesMatchers_LessMatchers (0.01s) === RUN TestActiveSeries_ReloadSeriesMatchers_SameSizeNewLabels --- PASS: TestActiveSeries_ReloadSeriesMatchers_SameSizeNewLabels (0.00s) === RUN TestCustomTrackersConfigs === RUN TestCustomTrackersConfigs/empty_flag_value_produces_empty_config === RUN TestCustomTrackersConfigs/empty_matcher_fails invalid value "foo:" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: "foo:" Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/empty_whitespace-only_matcher_fails invalid value "foo: " for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: "foo: " Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/second_empty_whitespace-only_matcher_fails invalid value "foo: ;bar:{}" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: "foo: " Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/empty_name_fails invalid value ":{}" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: ":{}" Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/empty_whitespace-only_name_fails invalid value " :{}" for flag -ingester.active-series-custom-trackers: semicolon-separated values should be :, but one of the sides was empty in the value 0: " :{}" Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/one_matcher === RUN TestCustomTrackersConfigs/whitespaces_are_trimmed_from_name_and_matcher === RUN TestCustomTrackersConfigs/two_matchers_in_one_flag_value === RUN TestCustomTrackersConfigs/two_matchers_in_two_flag_values === RUN TestCustomTrackersConfigs/two_matchers_with_same_name_in_same_flag invalid value "foo:{foo=\"bar\"};foo:{boo=\"bam\"}" for flag -ingester.active-series-custom-trackers: matcher "foo" for active series custom trackers is provided twice Usage of test: -ingester.active-series-custom-trackers value ...usage docs... === RUN TestCustomTrackersConfigs/two_matchers_with_same_name_in_separate_flags invalid value "foo:{boo=\"bam\"}" for flag -ingester.active-series-custom-trackers: matcher "foo" for active series custom trackers is provided more than once Usage of test: -ingester.active-series-custom-trackers value ...usage docs... --- PASS: TestCustomTrackersConfigs (0.02s) --- PASS: TestCustomTrackersConfigs/empty_flag_value_produces_empty_config (0.00s) --- PASS: TestCustomTrackersConfigs/empty_matcher_fails (0.00s) --- PASS: TestCustomTrackersConfigs/empty_whitespace-only_matcher_fails (0.00s) --- PASS: TestCustomTrackersConfigs/second_empty_whitespace-only_matcher_fails (0.00s) --- PASS: TestCustomTrackersConfigs/empty_name_fails (0.00s) --- PASS: TestCustomTrackersConfigs/empty_whitespace-only_name_fails (0.00s) --- PASS: TestCustomTrackersConfigs/one_matcher (0.00s) --- PASS: TestCustomTrackersConfigs/whitespaces_are_trimmed_from_name_and_matcher (0.01s) --- PASS: TestCustomTrackersConfigs/two_matchers_in_one_flag_value (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_in_two_flag_values (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_with_same_name_in_same_flag (0.00s) --- PASS: TestCustomTrackersConfigs/two_matchers_with_same_name_in_separate_flags (0.00s) === RUN TestMaximumNumberOfTrackers === RUN TestMaximumNumberOfTrackers/Flag_based_setup === RUN TestMaximumNumberOfTrackers/Map_based_setup --- PASS: TestMaximumNumberOfTrackers (2.46s) --- PASS: TestMaximumNumberOfTrackers/Flag_based_setup (1.48s) --- PASS: TestMaximumNumberOfTrackers/Map_based_setup (0.98s) === RUN TestCustomTrackerConfig_Equality === RUN TestCustomTrackerConfig_Equality/EqualityBetweenSet === RUN TestCustomTrackerConfig_Equality/EqualityBetweenSet#01 === RUN TestCustomTrackerConfig_Equality/EqualityBetweenSet#02 === RUN TestCustomTrackerConfig_Equality/NotEqualsAcrossSets --- PASS: TestCustomTrackerConfig_Equality (0.00s) --- PASS: TestCustomTrackerConfig_Equality/EqualityBetweenSet (0.00s) --- PASS: TestCustomTrackerConfig_Equality/EqualityBetweenSet#01 (0.00s) --- PASS: TestCustomTrackerConfig_Equality/EqualityBetweenSet#02 (0.00s) --- PASS: TestCustomTrackerConfig_Equality/NotEqualsAcrossSets (0.00s) === RUN TestTrackersConfigs_Deserialization === RUN TestTrackersConfigs_Deserialization/ShouldDeserializeCorrectInput === RUN TestTrackersConfigs_Deserialization/ShouldErrorOnMalformedInput --- PASS: TestTrackersConfigs_Deserialization (0.00s) --- PASS: TestTrackersConfigs_Deserialization/ShouldDeserializeCorrectInput (0.00s) --- PASS: TestTrackersConfigs_Deserialization/ShouldErrorOnMalformedInput (0.00s) === RUN TestTrackersConfigs_SerializeDeserialize === RUN TestTrackersConfigs_SerializeDeserialize/ShouldSerializeDeserializeResultsTheSame --- PASS: TestTrackersConfigs_SerializeDeserialize (0.00s) --- PASS: TestTrackersConfigs_SerializeDeserialize/ShouldSerializeDeserializeResultsTheSame (0.00s) === RUN TestMatcher_MatchesSeries === RUN TestMatcher_MatchesSeries/{baz="unrelated",_foo="true"} === RUN TestMatcher_MatchesSeries/{bar="100",_baz="unrelated",_foo="true"} === RUN TestMatcher_MatchesSeries/{bar="200",_baz="unrelated",_foo="true"} === RUN TestMatcher_MatchesSeries/{bar="200",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{bar="100",_baz="unrelated"} === RUN TestMatcher_MatchesSeries/{baz="unrelated"} --- PASS: TestMatcher_MatchesSeries (0.00s) --- PASS: TestMatcher_MatchesSeries/{baz="unrelated",_foo="true"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{bar="100",_baz="unrelated",_foo="true"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{bar="200",_baz="unrelated",_foo="true"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{bar="200",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{bar="100",_baz="unrelated"} (0.00s) --- PASS: TestMatcher_MatchesSeries/{baz="unrelated"} (0.00s) === RUN TestCustomTrackersConfigs_MalformedMatcher === RUN TestCustomTrackersConfigs_MalformedMatcher/{foo} === RUN TestCustomTrackersConfigs_MalformedMatcher/{foo=~"} --- PASS: TestCustomTrackersConfigs_MalformedMatcher (0.00s) --- PASS: TestCustomTrackersConfigs_MalformedMatcher/{foo} (0.00s) --- PASS: TestCustomTrackersConfigs_MalformedMatcher/{foo=~"} (0.00s) === RUN TestAmlabelMatchersToProm_HappyCase --- PASS: TestAmlabelMatchersToProm_HappyCase (0.00s) === RUN TestAmlabelMatchersToProm_MatchTypeValues --- PASS: TestAmlabelMatchersToProm_MatchTypeValues (0.00s) PASS ok github.com/grafana/mimir/pkg/ingester/activeseries 2.744s === RUN TestMarshall --- PASS: TestMarshall (0.00s) === RUN TestQueryRequest --- PASS: TestQueryRequest (0.00s) === RUN TestLabelNamesRequest --- PASS: TestLabelNamesRequest (0.00s) === RUN TestSendQueryStream --- PASS: TestSendQueryStream (0.11s) PASS ok github.com/grafana/mimir/pkg/ingester/client 0.325s === RUN TestMimir === RUN TestMimir/-target=all,alertmanager === RUN TestMimir/-target=write === RUN TestMimir/-target=read === RUN TestMimir/-target=backend --- PASS: TestMimir (0.87s) --- PASS: TestMimir/-target=all,alertmanager (0.33s) --- PASS: TestMimir/-target=write (0.10s) --- PASS: TestMimir/-target=read (0.14s) --- PASS: TestMimir/-target=backend (0.29s) === RUN TestMimirServerShutdownWithActivityTrackerEnabled mimir_test.go:240: Got error when checking /ready: Get "http://127.0.0.1:41331/ready": dial tcp 127.0.0.1:41331: connect: connection refused ts=2023-04-09T21:14:30.604785873Z caller=server.go:323 level=info http=127.0.0.1:41331 grpc=127.0.0.1:38993 msg="server listening on addresses" ts=2023-04-09T21:14:30.679036861Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:30.680506861Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:30.680688861Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:30.680838861Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:30.681030861Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:30.681242861Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:30.681495861Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:30.68452886Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:30.688820859Z caller=metrics.go:193 level=error msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" ts=2023-04-09T21:14:30.691393859Z caller=memberlist_client.go:437 level=info msg="Using memberlist cluster label and node name" cluster_label= node=root1-9d9484f0 ts=2023-04-09T21:14:30.691699859Z caller=log.go:194 level=debug msg="configured Transport is not a NodeAwareTransport and some features may not work as desired" ts=2023-04-09T21:14:30.699625858Z caller=tcp_transport.go:393 level=debug component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=172.24.5.22 advertisePort=7946 ts=2023-04-09T21:14:30.709121856Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_stats auth=true gzip=true ts=2023-04-09T21:14:30.712882856Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/prometheus/api/v1/read auth=true gzip=true ts=2023-04-09T21:14:30.713177855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query auth=true gzip=true ts=2023-04-09T21:14:30.713415855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_range auth=true gzip=true ts=2023-04-09T21:14:30.713692855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_exemplars auth=true gzip=true ts=2023-04-09T21:14:30.714051855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/labels auth=true gzip=true ts=2023-04-09T21:14:30.714309855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/label/{name}/values auth=true gzip=true ts=2023-04-09T21:14:30.714801855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST,DELETE path=/prometheus/api/v1/series auth=true gzip=true ts=2023-04-09T21:14:30.715098855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:30.715490855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/metadata auth=true gzip=true ts=2023-04-09T21:14:30.715708855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_names auth=true gzip=true ts=2023-04-09T21:14:30.716039855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_values auth=true gzip=true ts=2023-04-09T21:14:30.716395855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/services auth=false gzip=true ts=2023-04-09T21:14:30.716571855Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/ingester/ring auth=false gzip=true ts=2023-04-09T21:14:30.717609855Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=distributor-service waiting_for=sanity-check ts=2023-04-09T21:14:30.717762855Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=server waiting_for=activity-tracker ts=2023-04-09T21:14:30.717888855Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=memberlist-kv waiting_for=sanity-check ts=2023-04-09T21:14:30.718011855Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=ring waiting_for=usage-stats ts=2023-04-09T21:14:30.718030855Z caller=module_service.go:82 level=info msg=initialising module=activity-tracker ts=2023-04-09T21:14:30.718143855Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=store-queryable waiting_for=server ts=2023-04-09T21:14:30.718257855Z caller=module_service.go:82 level=info msg=initialising module=sanity-check ts=2023-04-09T21:14:30.718302855Z caller=module_service.go:82 level=info msg=initialising module=usage-stats ts=2023-04-09T21:14:30.718839855Z caller=sanity_check.go:32 level=info msg="Checking directories read/write access" ts=2023-04-09T21:14:30.719085855Z caller=sanity_check.go:37 level=info msg="Directories read/write access successfully checked" ts=2023-04-09T21:14:30.719177854Z caller=sanity_check.go:39 level=info msg="Checking object storage config" ts=2023-04-09T21:14:30.719385854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=ring waiting_for=activity-tracker ts=2023-04-09T21:14:30.719477854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=ring waiting_for=memberlist-kv ts=2023-04-09T21:14:30.719709854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=server waiting_for=sanity-check ts=2023-04-09T21:14:30.720422854Z caller=sanity_check.go:44 level=info msg="Object storage config successfully checked" ts=2023-04-09T21:14:30.720567854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=memberlist-kv waiting_for=server ts=2023-04-09T21:14:30.720568854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=server waiting_for=usage-stats ts=2023-04-09T21:14:30.720647854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=distributor-service waiting_for=server ts=2023-04-09T21:14:30.720676854Z caller=module_service.go:82 level=info msg=initialising module=server ts=2023-04-09T21:14:30.720934854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=distributor-service waiting_for=usage-stats ts=2023-04-09T21:14:30.721020854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=distributor-service waiting_for=activity-tracker ts=2023-04-09T21:14:30.721095854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=distributor-service waiting_for=memberlist-kv ts=2023-04-09T21:14:30.721167854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=memberlist-kv waiting_for=usage-stats ts=2023-04-09T21:14:30.721233854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=memberlist-kv waiting_for=activity-tracker ts=2023-04-09T21:14:30.721305854Z caller=module_service.go:82 level=info msg=initialising module=memberlist-kv ts=2023-04-09T21:14:30.721432854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=store-queryable waiting_for=usage-stats ts=2023-04-09T21:14:30.721518854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=store-queryable waiting_for=activity-tracker ts=2023-04-09T21:14:30.721620854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=store-queryable waiting_for=memberlist-kv ts=2023-04-09T21:14:30.721724854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=store-queryable waiting_for=sanity-check ts=2023-04-09T21:14:30.721807854Z caller=module_service.go:82 level=info msg=initialising module=store-queryable ts=2023-04-09T21:14:30.722202854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=distributor-service waiting_for=ring ts=2023-04-09T21:14:30.722310854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=ring waiting_for=sanity-check ts=2023-04-09T21:14:30.722390854Z caller=module_service.go:72 level=debug msg="module waiting for initialization" module=ring waiting_for=server ts=2023-04-09T21:14:30.722462854Z caller=module_service.go:82 level=info msg=initialising module=ring ts=2023-04-09T21:14:30.723896854Z caller=mimir.go:870 level=debug msg="some services are not Running" services="distributor-service: Starting, ring: Starting, store-queryable: Starting" ts=2023-04-09T21:14:30.724585854Z caller=tcp_transport.go:393 level=debug component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=172.24.5.22 advertisePort=7946 ts=2023-04-09T21:14:30.724663854Z caller=logging.go:76 level=debug msg="GET /ready (503) 1.26ms" ts=2023-04-09T21:14:30.726277853Z caller=ring.go:263 level=info msg="ring doesn't exist in KV store yet" ts=2023-04-09T21:14:30.726880853Z caller=ring.go:263 level=info msg="ring doesn't exist in KV store yet" ts=2023-04-09T21:14:30.727124853Z caller=module_service.go:82 level=info msg=initialising module=distributor-service ts=2023-04-09T21:14:30.727626853Z caller=mimir.go:790 level=info msg="Application started" ts=2023-04-09T21:14:30.828970837Z caller=logging.go:76 level=debug msg="GET /ready (200) 468µs" ts=2023-04-09T21:14:30.829986836Z caller=signals.go:55 level=info msg="=== received SIGINT/SIGTERM ===\n*** exiting" ts=2023-04-09T21:14:30.830932836Z caller=module_service.go:104 level=debug msg=stopping module=distributor-service ts=2023-04-09T21:14:30.831029836Z caller=module_service.go:127 level=debug msg="module waiting for" module=usage-stats waiting_for=ring ts=2023-04-09T21:14:30.831050836Z caller=module_service.go:127 level=debug msg="module waiting for" module=memberlist-kv waiting_for=distributor-service ts=2023-04-09T21:14:30.831141836Z caller=module_service.go:127 level=debug msg="module waiting for" module=ring waiting_for=distributor-service ts=2023-04-09T21:14:30.831153836Z caller=module_service.go:127 level=debug msg="module waiting for" module=server waiting_for=memberlist-kv ts=2023-04-09T21:14:30.831201836Z caller=module_service.go:127 level=debug msg="module waiting for" module=activity-tracker waiting_for=distributor-service ts=2023-04-09T21:14:30.831249836Z caller=module_service.go:104 level=debug msg=stopping module=store-queryable ts=2023-04-09T21:14:30.831300836Z caller=module_service.go:127 level=debug msg="module waiting for" module=sanity-check waiting_for=distributor-service ts=2023-04-09T21:14:30.831390836Z caller=module_service.go:114 level=info msg="module stopped" module=distributor-service ts=2023-04-09T21:14:30.831483836Z caller=module_service.go:127 level=debug msg="module waiting for" module=sanity-check waiting_for=memberlist-kv ts=2023-04-09T21:14:30.831561836Z caller=module_service.go:114 level=info msg="module stopped" module=store-queryable ts=2023-04-09T21:14:30.831568836Z caller=module_service.go:127 level=debug msg="module waiting for" module=activity-tracker waiting_for=memberlist-kv ts=2023-04-09T21:14:30.831631836Z caller=module_service.go:104 level=debug msg=stopping module=ring ts=2023-04-09T21:14:30.831679836Z caller=module_service.go:127 level=debug msg="module waiting for" module=memberlist-kv waiting_for=ring ts=2023-04-09T21:14:30.831788836Z caller=module_service.go:114 level=info msg="module stopped" module=ring ts=2023-04-09T21:14:30.831887836Z caller=module_service.go:127 level=debug msg="module waiting for" module=memberlist-kv waiting_for=store-queryable ts=2023-04-09T21:14:30.832007836Z caller=module_service.go:104 level=debug msg=stopping module=memberlist-kv ts=2023-04-09T21:14:30.832116836Z caller=memberlist_client.go:641 level=info msg="leaving memberlist cluster" ts=2023-04-09T21:14:30.832650836Z caller=module_service.go:114 level=info msg="module stopped" module=memberlist-kv ts=2023-04-09T21:14:30.832787836Z caller=module_service.go:127 level=debug msg="module waiting for" module=usage-stats waiting_for=server ts=2023-04-09T21:14:30.832920836Z caller=module_service.go:127 level=debug msg="module waiting for" module=activity-tracker waiting_for=ring ts=2023-04-09T21:14:30.833002836Z caller=module_service.go:127 level=debug msg="module waiting for" module=activity-tracker waiting_for=server ts=2023-04-09T21:14:30.833081836Z caller=module_service.go:127 level=debug msg="module waiting for" module=sanity-check waiting_for=ring ts=2023-04-09T21:14:30.833158836Z caller=module_service.go:127 level=debug msg="module waiting for" module=sanity-check waiting_for=server ts=2023-04-09T21:14:30.833233836Z caller=module_service.go:127 level=debug msg="module waiting for" module=server waiting_for=ring ts=2023-04-09T21:14:30.833309836Z caller=module_service.go:127 level=debug msg="module waiting for" module=server waiting_for=store-queryable ts=2023-04-09T21:14:30.833381836Z caller=module_service.go:127 level=debug msg="module waiting for" module=server waiting_for=distributor-service ts=2023-04-09T21:14:30.833451836Z caller=module_service.go:104 level=debug msg=stopping module=server ts=2023-04-09T21:14:30.833919836Z caller=server_service.go:55 level=info msg="server stopped" ts=2023-04-09T21:14:30.834019836Z caller=module_service.go:114 level=info msg="module stopped" module=server ts=2023-04-09T21:14:30.834134836Z caller=module_service.go:127 level=debug msg="module waiting for" module=sanity-check waiting_for=store-queryable ts=2023-04-09T21:14:30.834214836Z caller=module_service.go:104 level=debug msg=stopping module=sanity-check ts=2023-04-09T21:14:30.834315836Z caller=module_service.go:114 level=info msg="module stopped" module=sanity-check ts=2023-04-09T21:14:30.834418836Z caller=module_service.go:127 level=debug msg="module waiting for" module=activity-tracker waiting_for=store-queryable ts=2023-04-09T21:14:30.834496836Z caller=module_service.go:104 level=debug msg=stopping module=activity-tracker ts=2023-04-09T21:14:30.835743835Z caller=module_service.go:127 level=debug msg="module waiting for" module=usage-stats waiting_for=store-queryable ts=2023-04-09T21:14:30.835873835Z caller=module_service.go:127 level=debug msg="module waiting for" module=usage-stats waiting_for=distributor-service ts=2023-04-09T21:14:30.835945835Z caller=module_service.go:127 level=debug msg="module waiting for" module=usage-stats waiting_for=memberlist-kv ts=2023-04-09T21:14:30.836019835Z caller=module_service.go:104 level=debug msg=stopping module=usage-stats ts=2023-04-09T21:14:30.836144835Z caller=module_service.go:114 level=info msg="module stopped" module=usage-stats ts=2023-04-09T21:14:30.855280832Z caller=module_service.go:114 level=info msg="module stopped" module=activity-tracker --- PASS: TestMimirServerShutdownWithActivityTrackerEnabled (0.38s) === RUN TestConfigValidation === RUN TestConfigValidation/should_pass_validation_if_the_http_prefix_is_empty ts=2023-04-09T21:14:30.855947832Z caller=mimir.go:791 level=info msg="Application stopped" === RUN TestConfigValidation/S3:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage === RUN TestConfigValidation/GCS:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage === RUN TestConfigValidation/Azure:_should_fail_if_container_and_account_names_are_shared_between_alertmanager_and_blocks_storage === RUN TestConfigValidation/Azure:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage === RUN TestConfigValidation/Swift:_should_fail_if_container_and_project_names_are_shared_between_alertmanager_and_blocks_storage === RUN TestConfigValidation/Swift:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage === RUN TestConfigValidation/Alertmanager:_should_ignore_invalid_alertmanager_configuration_when_alertmanager_is_not_running === RUN TestConfigValidation/Alertmanager:_should_fail_with_invalid_alertmanager_configuration_when_alertmanager_is_not_running === RUN TestConfigValidation/S3:_should_pass_if_bucket_name_is_shared_between_alertmanager_and_ruler_storage_because_they_already_use_separate_prefixes_(rules/_and_alerts/) === RUN TestConfigValidation/should_fail_if_querier_timeout_is_bigger_than_http_server_timeout --- PASS: TestConfigValidation (0.78s) --- PASS: TestConfigValidation/should_pass_validation_if_the_http_prefix_is_empty (0.06s) --- PASS: TestConfigValidation/S3:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage (0.10s) --- PASS: TestConfigValidation/GCS:_should_fail_if_bucket_name_is_shared_between_alertmanager_and_blocks_storage (0.07s) --- PASS: TestConfigValidation/Azure:_should_fail_if_container_and_account_names_are_shared_between_alertmanager_and_blocks_storage (0.07s) --- PASS: TestConfigValidation/Azure:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage (0.08s) --- PASS: TestConfigValidation/Swift:_should_fail_if_container_and_project_names_are_shared_between_alertmanager_and_blocks_storage (0.06s) --- PASS: TestConfigValidation/Swift:_should_pass_if_only_container_name_is_shared_between_alertmanager_and_blocks_storage (0.06s) --- PASS: TestConfigValidation/Alertmanager:_should_ignore_invalid_alertmanager_configuration_when_alertmanager_is_not_running (0.08s) --- PASS: TestConfigValidation/Alertmanager:_should_fail_with_invalid_alertmanager_configuration_when_alertmanager_is_not_running (0.03s) --- PASS: TestConfigValidation/S3:_should_pass_if_bucket_name_is_shared_between_alertmanager_and_ruler_storage_because_they_already_use_separate_prefixes_(rules/_and_alerts/) (0.08s) --- PASS: TestConfigValidation/should_fail_if_querier_timeout_is_bigger_than_http_server_timeout (0.09s) === RUN TestConfig_validateFilesystemPaths === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_overlap,_but_blocks_storage_has_prefix_configured === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap === RUN TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_filesystem_backend_directory_is_equal_to_alertmanager_data_directory === RUN TestConfig_validateFilesystemPaths/should_succeed_if_alertmanager_data_directory_is_a_subdirectory_of_alertmanager_filesystem_backend_directory,_but_doesn't_match_with_the_prefix_used_to_store_alerts === RUN TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_data_directory_(relative)_is_a_subdirectory_of_alertmanager_filesystem_backend_directory_(absolute),_and_matches_with_the_prefix_used_to_store_alertmanager_config === RUN TestConfig_validateFilesystemPaths/should_fail_if_tsdb_directory_and_blocks_storage_filesystem_directory_overlap === RUN TestConfig_validateFilesystemPaths/should_fail_if_blocks_storage_filesystem_directory_overlaps_with_alertmanager_data_directory,_and_alertmanager_is_running_along_with_other_components === RUN TestConfig_validateFilesystemPaths/should_succeed_with_the_default_configuration === RUN TestConfig_validateFilesystemPaths/should_fail_if_ruler_filesystem_backend_directory_is_equal_to_ruler_data_directory === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_they're_both_child_of_the_same_directory === RUN TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_filesystem_backend_directory_is_a_subdirectory_of_alertmanager_data_directory === RUN TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_data_directory_is_a_subdirectory_of_alertmanager_filesystem_backend_directory,_and_matches_with_the_prefix_used_to_store_alerts === RUN TestConfig_validateFilesystemPaths/should_fail_if_store-gateway_and_compactor_data_directory_overlap === RUN TestConfig_validateFilesystemPaths/should_succeed_if_store-gateway_and_compactor_data_directory_overlap,_but_it's_running_only_the_store-gateway === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_one_has_the_same_prefix_of_the_other_one === RUN TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_they're_both_root_directories === RUN TestConfig_validateFilesystemPaths/should_succeed_if_blocks_storage_filesystem_directory_overlaps_with_alertmanager_data_directory,_but_we're_running_alertmanager_in_microservices_mode --- PASS: TestConfig_validateFilesystemPaths (1.16s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_overlap,_but_blocks_storage_has_prefix_configured (0.05s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap (0.04s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_filesystem_backend_directory_is_equal_to_alertmanager_data_directory (0.15s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_alertmanager_data_directory_is_a_subdirectory_of_alertmanager_filesystem_backend_directory,_but_doesn't_match_with_the_prefix_used_to_store_alerts (0.09s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_data_directory_(relative)_is_a_subdirectory_of_alertmanager_filesystem_backend_directory_(absolute),_and_matches_with_the_prefix_used_to_store_alertmanager_config (0.03s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_tsdb_directory_and_blocks_storage_filesystem_directory_overlap (0.03s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_blocks_storage_filesystem_directory_overlaps_with_alertmanager_data_directory,_and_alertmanager_is_running_along_with_other_components (0.03s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_with_the_default_configuration (0.05s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_ruler_filesystem_backend_directory_is_equal_to_ruler_data_directory (0.08s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_they're_both_child_of_the_same_directory (0.12s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_filesystem_backend_directory_is_a_subdirectory_of_alertmanager_data_directory (0.10s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_alertmanager_data_directory_is_a_subdirectory_of_alertmanager_filesystem_backend_directory,_and_matches_with_the_prefix_used_to_store_alerts (0.03s) --- PASS: TestConfig_validateFilesystemPaths/should_fail_if_store-gateway_and_compactor_data_directory_overlap (0.04s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_store-gateway_and_compactor_data_directory_overlap,_but_it's_running_only_the_store-gateway (0.06s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_one_has_the_same_prefix_of_the_other_one (0.09s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_tsdb_directory_and_blocks_storage_filesystem_directory_don't_overlap_and_they're_both_root_directories (0.06s) --- PASS: TestConfig_validateFilesystemPaths/should_succeed_if_blocks_storage_filesystem_directory_overlaps_with_alertmanager_data_directory,_but_we're_running_alertmanager_in_microservices_mode (0.06s) === RUN TestIsAbsPathOverlapping === RUN TestIsAbsPathOverlapping/check_if_"/"_overlaps_"/" === RUN TestIsAbsPathOverlapping/check_if_"/data"_overlaps_"/" === RUN TestIsAbsPathOverlapping/check_if_"/"_overlaps_"/data" === RUN TestIsAbsPathOverlapping/check_if_"/data"_overlaps_"/data-more" === RUN TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data" === RUN TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data/more" === RUN TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data-more" === RUN TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/more/data" --- PASS: TestIsAbsPathOverlapping (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/"_overlaps_"/" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/data"_overlaps_"/" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/"_overlaps_"/data" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/data"_overlaps_"/data-more" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data/more" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/data-more" (0.00s) --- PASS: TestIsAbsPathOverlapping/check_if_"/path/to/data"_overlaps_"/path/to/more/data" (0.00s) === RUN TestGrpcAuthMiddleware ts=2023-04-09T21:14:32.839250507Z caller=server_service.go:55 level=info msg="server stopped" --- PASS: TestGrpcAuthMiddleware (0.02s) === RUN TestFlagDefaults --- PASS: TestFlagDefaults (0.25s) === RUN TestAPIConfig === RUN TestAPIConfig/running_with_default_config ts=2023-04-09T21:14:33.332294427Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:33.349707424Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:33.350025424Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:33.350177424Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:33.350372424Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:33.350606424Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:33.350845424Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true === RUN TestAPIConfig/defaults_with_default_config ts=2023-04-09T21:14:33.691586368Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:33.716393364Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:33.716858364Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:33.717185364Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:33.717562364Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:33.717907363Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:33.718250363Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true === RUN TestAPIConfig/diff_with_default_config ts=2023-04-09T21:14:33.914894331Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:33.926416329Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:33.927074329Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:33.927350329Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:33.927651329Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:33.927980329Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:33.928401329Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true === RUN TestAPIConfig/running_with_changed_target_config ts=2023-04-09T21:14:34.488164237Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:34.499843235Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:34.500197235Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:34.500548235Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:34.500904235Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:34.501287235Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:34.501659235Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true === RUN TestAPIConfig/defaults_with_changed_target_config ts=2023-04-09T21:14:34.630224214Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:34.631545214Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:34.631848214Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:34.632169214Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:34.632553214Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:34.632886214Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:34.633221214Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true === RUN TestAPIConfig/diff_with_changed_target_config ts=2023-04-09T21:14:34.723057199Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:34.724283199Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:34.724573199Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:34.724865199Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:34.725226199Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:34.725604198Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:34.725999198Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true --- PASS: TestAPIConfig (2.03s) --- PASS: TestAPIConfig/running_with_default_config (0.44s) --- PASS: TestAPIConfig/defaults_with_default_config (0.21s) --- PASS: TestAPIConfig/diff_with_default_config (0.53s) --- PASS: TestAPIConfig/running_with_changed_target_config (0.21s) --- PASS: TestAPIConfig/defaults_with_changed_target_config (0.09s) --- PASS: TestAPIConfig/diff_with_changed_target_config (0.43s) === RUN TestMimir_InitRulerStorage === RUN TestMimir_InitRulerStorage/should_init_the_ruler_storage_with_target=ruler === RUN TestMimir_InitRulerStorage/should_not_init_the_ruler_storage_on_default_config_with_target=all ts=2023-04-09T21:14:35.333371099Z caller=modules.go:593 level=info msg="The ruler is not being started because you need to configure the ruler storage." === RUN TestMimir_InitRulerStorage/should_init_the_ruler_storage_on_ruler_storage_config_with_target=all --- PASS: TestMimir_InitRulerStorage (0.22s) --- PASS: TestMimir_InitRulerStorage/should_init_the_ruler_storage_with_target=ruler (0.00s) --- PASS: TestMimir_InitRulerStorage/should_not_init_the_ruler_storage_on_default_config_with_target=all (0.00s) --- PASS: TestMimir_InitRulerStorage/should_init_the_ruler_storage_on_ruler_storage_config_with_target=all (0.01s) === RUN TestMultiKVSetup === RUN TestMultiKVSetup/all time="2023-04-10T05:14:35+08:00" level=info msg="server listening on addresses" grpc="[::]:33321" http="[::]:44699" ts=2023-04-09T21:14:35.542686065Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:35.543954065Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:35.544382064Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:35.544729064Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:35.545121064Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:35.545575064Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:35.546074064Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:35.549971064Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:35.557018062Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:35.57248206Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:35.577496059Z caller=metrics.go:193 level=error msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" ts=2023-04-09T21:14:35.580349059Z caller=memberlist_client.go:437 level=info msg="Using memberlist cluster label and node name" cluster_label= node=root1-a5b5961a ts=2023-04-09T21:14:35.580878058Z caller=log.go:194 level=debug msg="configured Transport is not a NodeAwareTransport and some features may not work as desired" ts=2023-04-09T21:14:35.583408058Z caller=modules.go:593 level=info msg="The ruler is not being started because you need to configure the ruler storage." ts=2023-04-09T21:14:35.586906057Z caller=tcp_transport.go:393 level=debug component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=172.24.5.22 advertisePort=7946 ts=2023-04-09T21:14:35.595676056Z caller=tcp_transport.go:393 level=debug component="memberlist TCPTransport" msg=FinalAdvertiseAddr advertiseAddr=172.24.5.22 advertisePort=7946 ts=2023-04-09T21:14:35.609045054Z caller=inmemory.go:173 level=info msg="created in-memory index cache" maxItemSizeBytes=134217728 maxSizeBytes=1073741824 maxItems=maxInt ts=2023-04-09T21:14:35.610534054Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/store-gateway/ring auth=false gzip=true ts=2023-04-09T21:14:35.611019054Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/store-gateway/tenants auth=false gzip=true ts=2023-04-09T21:14:35.611387053Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/store-gateway/tenant/{tenant}/blocks auth=false gzip=true ts=2023-04-09T21:14:35.642098048Z caller=ingester.go:279 level=warn msg="-blocks-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" ts=2023-04-09T21:14:35.676064043Z caller=ingester.go:367 level=info msg="TSDB idle compaction timeout set" timeout=1h2m42.249414402s ts=2023-04-09T21:14:35.679132042Z caller=modules.go:603 level=info msg="RulerStorage is nil. Not starting the ruler." ts=2023-04-09T21:14:35.686416041Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/prometheus/api/v1/read auth=true gzip=true ts=2023-04-09T21:14:35.687162041Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query auth=true gzip=true ts=2023-04-09T21:14:35.687678041Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_range auth=true gzip=true ts=2023-04-09T21:14:35.688179041Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_exemplars auth=true gzip=true ts=2023-04-09T21:14:35.688805041Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/labels auth=true gzip=true ts=2023-04-09T21:14:35.689293041Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/label/{name}/values auth=true gzip=true ts=2023-04-09T21:14:35.689948041Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST,DELETE path=/prometheus/api/v1/series auth=true gzip=true ts=2023-04-09T21:14:35.69070404Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:35.69125804Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/metadata auth=true gzip=true ts=2023-04-09T21:14:35.69172804Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_names auth=true gzip=true ts=2023-04-09T21:14:35.69236904Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_values auth=true gzip=true ts=2023-04-09T21:14:35.707102038Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_stats auth=true gzip=true ts=2023-04-09T21:14:35.707579038Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/push auth=true gzip=false ts=2023-04-09T21:14:35.707901038Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/otlp/v1/metrics auth=true gzip=false ts=2023-04-09T21:14:35.708129038Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/distributor/ring auth=false gzip=true ts=2023-04-09T21:14:35.708345038Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/distributor/all_user_stats auth=false gzip=true ts=2023-04-09T21:14:35.708572038Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/distributor/ha_tracker auth=false gzip=true ts=2023-04-09T21:14:35.722558035Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/compactor/ring auth=false gzip=true ts=2023-04-09T21:14:35.722992035Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/start auth=true gzip=false ts=2023-04-09T21:14:35.723401035Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/files auth=true gzip=false ts=2023-04-09T21:14:35.723756035Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/finish auth=true gzip=false ts=2023-04-09T21:14:35.724100035Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/upload/block/{block}/check auth=true gzip=false ts=2023-04-09T21:14:35.724465035Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/compactor/delete_tenant auth=true gzip=true ts=2023-04-09T21:14:35.724741035Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/compactor/delete_tenant_status auth=true gzip=true ts=2023-04-09T21:14:35.727638034Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/ingester/flush auth=false gzip=true ts=2023-04-09T21:14:35.727980034Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/ingester/shutdown auth=false gzip=true ts=2023-04-09T21:14:35.728211034Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/ingester/push auth=true gzip=false ts=2023-04-09T21:14:35.728428034Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ingester/tsdb_metrics auth=true gzip=true ts=2023-04-09T21:14:35.731471034Z caller=modules.go:437 level=info msg="The querier worker has not been configured with either the query-frontend or query-scheduler address. Because Mimir is running in monolithic mode, it's attempting an automatic worker configuration. If queries are unresponsive, consider explicitly configuring the query-frontend or query-scheduler address for querier worker." address=127.0.0.1:0 ts=2023-04-09T21:14:35.731686034Z caller=worker.go:130 level=info msg="Starting querier worker connected to query-frontend" frontend=127.0.0.1:0 === RUN TestMultiKVSetup/alertmanager time="2023-04-10T05:14:35+08:00" level=info msg="server listening on addresses" grpc="[::]:44981" http="[::]:45907" ts=2023-04-09T21:14:35.947627998Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:35.956361997Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:35.956921997Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:35.957271997Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:35.957674997Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:35.958082997Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:35.958501997Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:35.961831996Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:35.966971995Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:35.979005993Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:35.982091993Z caller=store.go:63 level=warn msg="-alertmanager-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" ts=2023-04-09T21:14:35.986335992Z caller=metrics.go:193 level=error msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" ts=2023-04-09T21:14:35.991187991Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/multitenant_alertmanager/status auth=false gzip=true ts=2023-04-09T21:14:35.991858991Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/multitenant_alertmanager/configs auth=false gzip=true ts=2023-04-09T21:14:35.992383991Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/multitenant_alertmanager/ring auth=false gzip=true ts=2023-04-09T21:14:35.992872991Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/multitenant_alertmanager/delete_tenant_config auth=true gzip=true ts=2023-04-09T21:14:35.993380991Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/alertmanager/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:35.993854991Z caller=api.go:157 level=debug msg="api: registering route" methods= prefix=/alertmanager auth=true gzip=true ts=2023-04-09T21:14:35.994209991Z caller=api.go:199 level=debug msg="api: registering alertmanager" path_prefix=/alertmanager ts=2023-04-09T21:14:35.994410991Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/alerts auth=true gzip=true ts=2023-04-09T21:14:35.994847991Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/alerts auth=true gzip=true ts=2023-04-09T21:14:35.995211991Z caller=api.go:152 level=debug msg="api: registering route" methods=DELETE path=/api/v1/alerts auth=true gzip=true === RUN TestMultiKVSetup/store-gateway time="2023-04-10T05:14:36+08:00" level=info msg="server listening on addresses" grpc="[::]:46753" http="[::]:40925" ts=2023-04-09T21:14:36.221488954Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:36.222541953Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:36.222762953Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:36.222918953Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:36.223120953Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:36.223356953Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:36.223579953Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:36.224224953Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:36.224457953Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:36.24056795Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:36.24623895Z caller=metrics.go:193 level=error msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" ts=2023-04-09T21:14:36.268109946Z caller=inmemory.go:173 level=info msg="created in-memory index cache" maxItemSizeBytes=134217728 maxSizeBytes=1073741824 maxItems=maxInt ts=2023-04-09T21:14:36.270213946Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/store-gateway/ring auth=false gzip=true ts=2023-04-09T21:14:36.270656946Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/store-gateway/tenants auth=false gzip=true ts=2023-04-09T21:14:36.270916945Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/store-gateway/tenant/{tenant}/blocks auth=false gzip=true === RUN TestMultiKVSetup/backend time="2023-04-10T05:14:36+08:00" level=info msg="server listening on addresses" grpc="[::]:41349" http="[::]:36977" ts=2023-04-09T21:14:36.383295927Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:36.384583927Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:36.385021927Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:36.385381927Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:36.385762927Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:36.386274927Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:36.386720927Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:36.387583926Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:36.388074926Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:36.394403925Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:36.398698925Z caller=metrics.go:193 level=error msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" ts=2023-04-09T21:14:36.403094924Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/overrides-exporter/ring auth=false gzip=true ts=2023-04-09T21:14:36.445618917Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/query-scheduler/ring auth=false gzip=true ts=2023-04-09T21:14:36.460134914Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/compactor/ring auth=false gzip=true ts=2023-04-09T21:14:36.462891914Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/start auth=true gzip=false ts=2023-04-09T21:14:36.463828914Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/files auth=true gzip=false ts=2023-04-09T21:14:36.464677914Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/finish auth=true gzip=false ts=2023-04-09T21:14:36.465594914Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/upload/block/{block}/check auth=true gzip=false ts=2023-04-09T21:14:36.466436913Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/compactor/delete_tenant auth=true gzip=true ts=2023-04-09T21:14:36.467107913Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/compactor/delete_tenant_status auth=true gzip=true ts=2023-04-09T21:14:36.473911912Z caller=store.go:63 level=warn msg="-alertmanager-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" ts=2023-04-09T21:14:36.482996911Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/multitenant_alertmanager/status auth=false gzip=true ts=2023-04-09T21:14:36.48462891Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/multitenant_alertmanager/configs auth=false gzip=true ts=2023-04-09T21:14:36.48519091Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/multitenant_alertmanager/ring auth=false gzip=true ts=2023-04-09T21:14:36.48571591Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/multitenant_alertmanager/delete_tenant_config auth=true gzip=true ts=2023-04-09T21:14:36.48627191Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/alertmanager/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:36.48678391Z caller=api.go:157 level=debug msg="api: registering route" methods= prefix=/alertmanager auth=true gzip=true ts=2023-04-09T21:14:36.48710091Z caller=api.go:199 level=debug msg="api: registering alertmanager" path_prefix=/alertmanager ts=2023-04-09T21:14:36.48727991Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/alerts auth=true gzip=true ts=2023-04-09T21:14:36.48757291Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/alerts auth=true gzip=true ts=2023-04-09T21:14:36.48793091Z caller=api.go:152 level=debug msg="api: registering route" methods=DELETE path=/api/v1/alerts auth=true gzip=true ts=2023-04-09T21:14:36.503352907Z caller=inmemory.go:173 level=info msg="created in-memory index cache" maxItemSizeBytes=134217728 maxSizeBytes=1073741824 maxItems=maxInt ts=2023-04-09T21:14:36.504445907Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/store-gateway/ring auth=false gzip=true ts=2023-04-09T21:14:36.505021907Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/store-gateway/tenants auth=false gzip=true ts=2023-04-09T21:14:36.505508907Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/store-gateway/tenant/{tenant}/blocks auth=false gzip=true ts=2023-04-09T21:14:36.510235906Z caller=modules.go:593 level=info msg="The ruler is not being started because you need to configure the ruler storage." ts=2023-04-09T21:14:36.516686905Z caller=modules.go:603 level=info msg="RulerStorage is nil. Not starting the ruler." === RUN TestMultiKVSetup/ruler time="2023-04-10T05:14:36+08:00" level=info msg="server listening on addresses" grpc="[::]:38277" http="[::]:44045" ts=2023-04-09T21:14:36.60895489Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:36.61016689Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:36.61062889Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:36.61098489Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:36.61136189Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:36.61175089Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:36.61226989Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:36.613128889Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:36.613557889Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:36.619205888Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:36.623317888Z caller=metrics.go:193 level=error msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" ts=2023-04-09T21:14:36.641881885Z caller=storage.go:29 level=warn msg="-ruler-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" ts=2023-04-09T21:14:36.648053884Z caller=mapper.go:52 level=info msg="cleaning up mapped rules directory" path=./data-ruler/ ts=2023-04-09T21:14:36.651869883Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/ruler/ring auth=false gzip=true ts=2023-04-09T21:14:36.652436883Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/ruler/delete_tenant_config auth=true gzip=true ts=2023-04-09T21:14:36.652962883Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ruler/rule_groups auth=false gzip=true ts=2023-04-09T21:14:36.653439883Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/rules auth=true gzip=true ts=2023-04-09T21:14:36.653843883Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/alerts auth=true gzip=true ts=2023-04-09T21:14:36.654292883Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:36.654740883Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/config/v1/rules auth=true gzip=true ts=2023-04-09T21:14:36.655143883Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/config/v1/rules/{namespace} auth=true gzip=true ts=2023-04-09T21:14:36.655732882Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/config/v1/rules/{namespace}/{groupName} auth=true gzip=true ts=2023-04-09T21:14:36.656343882Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/prometheus/config/v1/rules/{namespace} auth=true gzip=true ts=2023-04-09T21:14:36.656851882Z caller=api.go:152 level=debug msg="api: registering route" methods=DELETE path=/prometheus/config/v1/rules/{namespace}/{groupName} auth=true gzip=true ts=2023-04-09T21:14:36.657483882Z caller=api.go:152 level=debug msg="api: registering route" methods=DELETE path=/prometheus/config/v1/rules/{namespace} auth=true gzip=true === RUN TestMultiKVSetup/distributor time="2023-04-10T05:14:36+08:00" level=info msg="server listening on addresses" grpc="[::]:35125" http="[::]:42175" ts=2023-04-09T21:14:36.763286865Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:36.764557865Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:36.765000865Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:36.765565864Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:36.766031864Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:36.766482864Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:36.766956864Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:36.771141864Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:36.774633863Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:36.775283863Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:36.780003862Z caller=metrics.go:193 level=error msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" ts=2023-04-09T21:14:36.839574852Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/push auth=true gzip=false ts=2023-04-09T21:14:36.840583852Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/otlp/v1/metrics auth=true gzip=false ts=2023-04-09T21:14:36.850119851Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/distributor/ring auth=false gzip=true ts=2023-04-09T21:14:36.850386851Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/distributor/all_user_stats auth=false gzip=true ts=2023-04-09T21:14:36.850629851Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/distributor/ha_tracker auth=false gzip=true === RUN TestMultiKVSetup/ingester time="2023-04-10T05:14:36+08:00" level=info msg="server listening on addresses" grpc="[::]:36899" http="[::]:37287" ts=2023-04-09T21:14:37.057677817Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:37.058618817Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:37.058959816Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:37.059116816Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:37.059491816Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:37.059734816Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:37.059965816Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:37.060615816Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:37.060854816Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:37.066090815Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:37.079345813Z caller=ingester.go:279 level=warn msg="-blocks-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" ts=2023-04-09T21:14:37.088295812Z caller=metrics.go:193 level=error msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" ts=2023-04-09T21:14:37.090578811Z caller=ingester.go:367 level=info msg="TSDB idle compaction timeout set" timeout=1h1m0.73634295s ts=2023-04-09T21:14:37.093366811Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/ingester/flush auth=false gzip=true ts=2023-04-09T21:14:37.093739811Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/ingester/shutdown auth=false gzip=true ts=2023-04-09T21:14:37.093981811Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/ingester/push auth=true gzip=false ts=2023-04-09T21:14:37.094179811Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ingester/tsdb_metrics auth=true gzip=true === RUN TestMultiKVSetup/querier time="2023-04-10T05:14:37+08:00" level=info msg="server listening on addresses" grpc="[::]:39809" http="[::]:38553" ts=2023-04-09T21:14:37.314083775Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:37.314992775Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:37.315200774Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:37.335622771Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:37.336027771Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:37.336293771Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:37.336555771Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:37.350920769Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:37.355175768Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:37.355565768Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:37.361210767Z caller=metrics.go:193 level=error msg="failed to register prometheus metrics for memberlist" err="duplicate metrics collector registration attempted" ts=2023-04-09T21:14:37.381832764Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_stats auth=true gzip=true ts=2023-04-09T21:14:37.385170763Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/prometheus/api/v1/read auth=true gzip=true ts=2023-04-09T21:14:37.385536763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query auth=true gzip=true ts=2023-04-09T21:14:37.385791763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_range auth=true gzip=true ts=2023-04-09T21:14:37.386065763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/query_exemplars auth=true gzip=true ts=2023-04-09T21:14:37.386356763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/labels auth=true gzip=true ts=2023-04-09T21:14:37.386600763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/label/{name}/values auth=true gzip=true ts=2023-04-09T21:14:37.387070763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST,DELETE path=/prometheus/api/v1/series auth=true gzip=true ts=2023-04-09T21:14:37.387320763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:37.387652763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/prometheus/api/v1/metadata auth=true gzip=true ts=2023-04-09T21:14:37.387901763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_names auth=true gzip=true ts=2023-04-09T21:14:37.388272763Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/prometheus/api/v1/cardinality/label_values auth=true gzip=true === RUN TestMultiKVSetup/compactor time="2023-04-10T05:14:37+08:00" level=info msg="server listening on addresses" grpc="[::]:44377" http="[::]:40365" ts=2023-04-09T21:14:37.563325734Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:37.564366734Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:37.564602734Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:37.564831734Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:37.565083734Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:37.565447734Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:37.565703733Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:37.569158733Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:37.572485732Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:37.572835732Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:37.577209732Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/compactor/ring auth=false gzip=true ts=2023-04-09T21:14:37.577554732Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/start auth=true gzip=false ts=2023-04-09T21:14:37.577976731Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/files auth=true gzip=false ts=2023-04-09T21:14:37.578385731Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/api/v1/upload/block/{block}/finish auth=true gzip=false ts=2023-04-09T21:14:37.578882731Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/upload/block/{block}/check auth=true gzip=false ts=2023-04-09T21:14:37.579280731Z caller=api.go:152 level=debug msg="api: registering route" methods=POST path=/compactor/delete_tenant auth=true gzip=true ts=2023-04-09T21:14:37.579541731Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/compactor/delete_tenant_status auth=true gzip=true === RUN TestMultiKVSetup/query-scheduler time="2023-04-10T05:14:37+08:00" level=info msg="server listening on addresses" grpc="[::]:42603" http="[::]:39219" ts=2023-04-09T21:14:37.734146706Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/config auth=false gzip=true ts=2023-04-09T21:14:37.735140706Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/ auth=false gzip=true ts=2023-04-09T21:14:37.735415706Z caller=api.go:157 level=debug msg="api: registering route" methods=GET prefix=/static/ auth=false gzip=true ts=2023-04-09T21:14:37.735587706Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/debug/fgprof auth=false gzip=true ts=2023-04-09T21:14:37.735804706Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/buildinfo auth=false gzip=true ts=2023-04-09T21:14:37.736046706Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/config auth=false gzip=true ts=2023-04-09T21:14:37.736281706Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/status/flags auth=false gzip=true ts=2023-04-09T21:14:37.749832703Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/memberlist auth=false gzip=true ts=2023-04-09T21:14:37.753323703Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/runtime_config auth=false gzip=true ts=2023-04-09T21:14:37.753643703Z caller=api.go:152 level=debug msg="api: registering route" methods=GET path=/api/v1/user_limits auth=true gzip=true ts=2023-04-09T21:14:37.7701077Z caller=api.go:152 level=debug msg="api: registering route" methods=GET,POST path=/query-scheduler/ring auth=false gzip=true --- PASS: TestMultiKVSetup (2.43s) --- PASS: TestMultiKVSetup/all (0.41s) --- PASS: TestMultiKVSetup/alertmanager (0.25s) --- PASS: TestMultiKVSetup/store-gateway (0.27s) --- PASS: TestMultiKVSetup/backend (0.24s) --- PASS: TestMultiKVSetup/ruler (0.14s) --- PASS: TestMultiKVSetup/distributor (0.19s) --- PASS: TestMultiKVSetup/ingester (0.24s) --- PASS: TestMultiKVSetup/querier (0.31s) --- PASS: TestMultiKVSetup/compactor (0.18s) --- PASS: TestMultiKVSetup/query-scheduler (0.19s) === RUN TestLoadRuntimeConfig_ShouldLoadAnchoredYAML --- PASS: TestLoadRuntimeConfig_ShouldLoadAnchoredYAML (0.00s) === RUN TestLoadRuntimeConfig_ShouldLoadEmptyFile --- PASS: TestLoadRuntimeConfig_ShouldLoadEmptyFile (0.00s) === RUN TestLoadRuntimeConfig_MissingPointerFieldsAreNil --- PASS: TestLoadRuntimeConfig_MissingPointerFieldsAreNil (0.00s) === RUN TestLoadRuntimeConfig_ShouldReturnErrorOnMultipleDocumentsInTheConfig --- PASS: TestLoadRuntimeConfig_ShouldReturnErrorOnMultipleDocumentsInTheConfig (0.00s) === RUN TestCheckObjectStoresConfig === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config === RUN TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all === PAUSE TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all === RUN TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester === PAUSE TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester === RUN TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager === PAUSE TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config === RUN TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config === PAUSE TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config === RUN TestCheckObjectStoresConfig/should_succeed_with_the_default_config === PAUSE TestCheckObjectStoresConfig/should_succeed_with_the_default_config === RUN TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) === PAUSE TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) === RUN TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler === PAUSE TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config === CONT TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler === CONT TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager === CONT TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) === CONT TestCheckObjectStoresConfig/should_succeed_with_the_default_config === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config === CONT TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester === CONT TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all === CONT TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config --- PASS: TestCheckObjectStoresConfig (0.00s) --- PASS: TestCheckObjectStoresConfig/should_check_blocks_and_ruler_storage_config_when_target=ruler (0.08s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_GCS_config (0.09s) --- PASS: TestCheckObjectStoresConfig/should_check_only_alertmanager_storage_config_when_target=alertmanager (0.10s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_Azure_config (0.13s) --- PASS: TestCheckObjectStoresConfig/should_succeed_with_the_default_config (0.22s) --- PASS: TestCheckObjectStoresConfig/should_succeed_with_filesystem_backend_and_non-existent_directory_(components_create_the_dir_at_startup) (0.23s) --- PASS: TestCheckObjectStoresConfig/should_check_only_blocks_storage_config_when_target=ingester (0.22s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_Swift_config (0.25s) --- PASS: TestCheckObjectStoresConfig/should_succeed_with_the_default_config_running_Alertmanager_along_with_target=all (0.09s) --- PASS: TestCheckObjectStoresConfig/should_fail_on_invalid_AWS_S3_config (3.56s) === RUN TestCheckDirectoryReadWriteAccess === RUN TestCheckDirectoryReadWriteAccess/store-gateway === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/compactor === RUN TestCheckDirectoryReadWriteAccess/compactor/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/compactor/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/compactor/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/compactor/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ruler === RUN TestCheckDirectoryReadWriteAccess/ruler/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ruler/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/ruler/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ruler/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ingester === RUN TestCheckDirectoryReadWriteAccess/ingester/should_fail_on_directory_without_write_access === RUN TestCheckDirectoryReadWriteAccess/ingester/should_pass_on_directory_with_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ingester/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access === RUN TestCheckDirectoryReadWriteAccess/ingester/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access --- PASS: TestCheckDirectoryReadWriteAccess (0.92s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway (0.24s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_on_directory_without_write_access (0.05s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_on_directory_with_read-write_access (0.05s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.06s) --- PASS: TestCheckDirectoryReadWriteAccess/store-gateway/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.06s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor (0.17s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_fail_on_directory_without_write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_pass_on_directory_with_read-write_access (0.06s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/compactor/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler (0.13s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_fail_on_directory_without_write_access (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_pass_on_directory_with_read-write_access (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/ruler/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager (0.14s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_on_directory_without_write_access (0.04s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_on_directory_with_read-write_access (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/alertmanager/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.03s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester (0.24s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_fail_on_directory_without_write_access (0.07s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_pass_on_directory_with_read-write_access (0.05s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_pass_if_directory_doesn't_exist_but_parent_existing_folder_has_read-write_access (0.05s) --- PASS: TestCheckDirectoryReadWriteAccess/ingester/should_fail_if_directory_doesn't_exist_and_parent_existing_folder_has_no_read-write_access (0.07s) === RUN TestServerStopViaContext ts=2023-04-09T21:14:43.080140831Z caller=server_service.go:55 level=info msg="server stopped" --- PASS: TestServerStopViaContext (0.50s) === RUN TestServerStopViaShutdown ts=2023-04-09T21:14:43.08306483Z caller=server_service.go:55 level=info msg="server stopped" --- PASS: TestServerStopViaShutdown (0.00s) === RUN TestServerStopViaStop ts=2023-04-09T21:14:43.08610283Z caller=server_service.go:55 level=info msg="server stopped" --- PASS: TestServerStopViaStop (0.00s) === RUN TestJaegerToOpenTelemetryTraceID --- PASS: TestJaegerToOpenTelemetryTraceID (0.00s) === RUN TestJaegerToOpenTelemetrySpanID --- PASS: TestJaegerToOpenTelemetrySpanID (0.00s) === RUN TestOpenTelemetrySpanBridge_RecordError === RUN TestOpenTelemetrySpanBridge_RecordError/no_attributes === RUN TestOpenTelemetrySpanBridge_RecordError/one_attribute === RUN TestOpenTelemetrySpanBridge_RecordError/multiple_attributes --- PASS: TestOpenTelemetrySpanBridge_RecordError (0.00s) --- PASS: TestOpenTelemetrySpanBridge_RecordError/no_attributes (0.00s) --- PASS: TestOpenTelemetrySpanBridge_RecordError/one_attribute (0.00s) --- PASS: TestOpenTelemetrySpanBridge_RecordError/multiple_attributes (0.00s) === RUN TestOpenTelemetrySpanBridge_AddEvent === RUN TestOpenTelemetrySpanBridge_AddEvent/no_attributes === RUN TestOpenTelemetrySpanBridge_AddEvent/one_attribute === RUN TestOpenTelemetrySpanBridge_AddEvent/multiple_attributes --- PASS: TestOpenTelemetrySpanBridge_AddEvent (0.00s) --- PASS: TestOpenTelemetrySpanBridge_AddEvent/no_attributes (0.00s) --- PASS: TestOpenTelemetrySpanBridge_AddEvent/one_attribute (0.00s) --- PASS: TestOpenTelemetrySpanBridge_AddEvent/multiple_attributes (0.00s) === RUN TestCommonConfigCanBeExtended === RUN TestCommonConfigCanBeExtended/flag_inheritance === RUN TestCommonConfigCanBeExtended/yaml_inheritance --- PASS: TestCommonConfigCanBeExtended (0.19s) --- PASS: TestCommonConfigCanBeExtended/flag_inheritance (0.07s) --- PASS: TestCommonConfigCanBeExtended/yaml_inheritance (0.12s) === RUN TestMimirConfigCanBeInlined --- PASS: TestMimirConfigCanBeInlined (0.09s) PASS ok github.com/grafana/mimir/pkg/mimir 14.405s === RUN TestJsoniterMarshalForSample --- PASS: TestJsoniterMarshalForSample (0.00s) === RUN TestStdlibJsonMarshalForSample --- PASS: TestStdlibJsonMarshalForSample (0.00s) === RUN TestJsoniterUnmarshalForSample --- PASS: TestJsoniterUnmarshalForSample (0.00s) === RUN TestStdlibJsonUnmarshalForSample --- PASS: TestStdlibJsonUnmarshalForSample (0.00s) === RUN TestMetricMetadataToMetricTypeToMetricType === RUN TestMetricMetadataToMetricTypeToMetricType/with_a_single-word_metric === RUN TestMetricMetadataToMetricTypeToMetricType/with_a_two-word_metric === RUN TestMetricMetadataToMetricTypeToMetricType/with_an_unknown_metric --- PASS: TestMetricMetadataToMetricTypeToMetricType (0.00s) --- PASS: TestMetricMetadataToMetricTypeToMetricType/with_a_single-word_metric (0.00s) --- PASS: TestMetricMetadataToMetricTypeToMetricType/with_a_two-word_metric (0.00s) --- PASS: TestMetricMetadataToMetricTypeToMetricType/with_an_unknown_metric (0.00s) === RUN TestFromLabelAdaptersToLabels --- PASS: TestFromLabelAdaptersToLabels (0.00s) === RUN TestFromLabelAdaptersToLabelsWithCopy --- PASS: TestFromLabelAdaptersToLabelsWithCopy (0.00s) === RUN TestPreallocatingMetric === RUN TestPreallocatingMetric/should_be_unmarshallable_from_the_bytes_of_a_default_Metric === RUN TestPreallocatingMetric/should_not_break_with_invalid_protobuf_bytes_(no_panic) === RUN TestPreallocatingMetric/should_correctly_preallocate_Labels_slice === RUN TestPreallocatingMetric/should_not_allocate_a_slice_when_there_are_0_Labels_(same_as_Metric's_behaviour) === RUN TestPreallocatingMetric/should_marshal_to_the_same_bytes_as_Metric --- PASS: TestPreallocatingMetric (0.00s) --- PASS: TestPreallocatingMetric/should_be_unmarshallable_from_the_bytes_of_a_default_Metric (0.00s) --- PASS: TestPreallocatingMetric/should_not_break_with_invalid_protobuf_bytes_(no_panic) (0.00s) --- PASS: TestPreallocatingMetric/should_correctly_preallocate_Labels_slice (0.00s) --- PASS: TestPreallocatingMetric/should_not_allocate_a_slice_when_there_are_0_Labels_(same_as_Metric's_behaviour) (0.00s) --- PASS: TestPreallocatingMetric/should_marshal_to_the_same_bytes_as_Metric (0.00s) === RUN TestLabelAdapter_Marshal === RUN TestLabelAdapter_Marshal/foo === RUN TestLabelAdapter_Marshal/very_long_label_name === RUN TestLabelAdapter_Marshal/#00 === RUN TestLabelAdapter_Marshal/#01 --- PASS: TestLabelAdapter_Marshal (0.00s) --- PASS: TestLabelAdapter_Marshal/foo (0.00s) --- PASS: TestLabelAdapter_Marshal/very_long_label_name (0.00s) --- PASS: TestLabelAdapter_Marshal/#00 (0.00s) --- PASS: TestLabelAdapter_Marshal/#01 (0.00s) === RUN TestPreallocTimeseriesSliceFromPool === RUN TestPreallocTimeseriesSliceFromPool/new_instance_is_provided_when_not_available_to_reuse === RUN TestPreallocTimeseriesSliceFromPool/instance_is_cleaned_before_reusing --- PASS: TestPreallocTimeseriesSliceFromPool (0.00s) --- PASS: TestPreallocTimeseriesSliceFromPool/new_instance_is_provided_when_not_available_to_reuse (0.00s) --- PASS: TestPreallocTimeseriesSliceFromPool/instance_is_cleaned_before_reusing (0.00s) === RUN TestTimeseriesFromPool === RUN TestTimeseriesFromPool/new_instance_is_provided_when_not_available_to_reuse === RUN TestTimeseriesFromPool/instance_is_cleaned_before_reusing --- PASS: TestTimeseriesFromPool (0.00s) --- PASS: TestTimeseriesFromPool/new_instance_is_provided_when_not_available_to_reuse (0.00s) --- PASS: TestTimeseriesFromPool/instance_is_cleaned_before_reusing (0.00s) === RUN TestCopyToYoloString --- PASS: TestCopyToYoloString (0.00s) === RUN TestDeepCopyTimeseries --- PASS: TestDeepCopyTimeseries (0.01s) === RUN TestDeepCopyTimeseriesExemplars --- PASS: TestDeepCopyTimeseriesExemplars (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirpb 0.159s === RUN TestBuildURL === RUN TestBuildURL/builds_the_correct_URL_with_a_trailing_slash === RUN TestBuildURL/builds_the_correct_URL_without_a_trailing_slash === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_with_trailing_slash === RUN TestBuildURL/builds_the_correct_URL_with_a_trailing_slash_and_the_target_path_contains_special_characters === RUN TestBuildURL/builds_the_correct_URL_without_a_trailing_slash_and_the_target_path_contains_special_characters === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_contains_special_characters === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_starts_with_a_escaped_slash === RUN TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_ends_with_a_escaped_slash --- PASS: TestBuildURL (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_with_a_trailing_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_without_a_trailing_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_with_trailing_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_with_a_trailing_slash_and_the_target_path_contains_special_characters (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_without_a_trailing_slash_and_the_target_path_contains_special_characters (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_contains_special_characters (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_starts_with_a_escaped_slash (0.00s) --- PASS: TestBuildURL/builds_the_correct_URL_when_the_base_url_has_a_path_and_the_target_path_ends_with_a_escaped_slash (0.00s) === RUN TestMimirClient_X === RUN TestMimirClient_X/regular-characters === RUN TestMimirClient_X/special-characters-spaces === RUN TestMimirClient_X/special-characters-slashes === RUN TestMimirClient_X/special-characters-slash-first === RUN TestMimirClient_X/special-characters-slash-last --- PASS: TestMimirClient_X (0.03s) --- PASS: TestMimirClient_X/regular-characters (0.01s) --- PASS: TestMimirClient_X/special-characters-spaces (0.00s) --- PASS: TestMimirClient_X/special-characters-slashes (0.01s) --- PASS: TestMimirClient_X/special-characters-slash-first (0.00s) --- PASS: TestMimirClient_X/special-characters-slash-last (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/client 0.307s ? github.com/grafana/mimir/pkg/mimirtool/minisdk [no test files] === RUN TestParseMetricsInBoard --- PASS: TestParseMetricsInBoard (0.04s) === RUN TestParseMetricsInBoardWithTimeseriesPanel --- PASS: TestParseMetricsInBoardWithTimeseriesPanel (0.00s) === RUN TestParseMetricsInRuleFile --- PASS: TestParseMetricsInRuleFile (0.14s) === RUN TestNewEnvVarsWithPrefix === RUN TestNewEnvVarsWithPrefix/PREFIX === RUN TestNewEnvVarsWithPrefix/PREFIX/Address === RUN TestNewEnvVarsWithPrefix/PREFIX/APIKey === RUN TestNewEnvVarsWithPrefix/PREFIX/APIUser === RUN TestNewEnvVarsWithPrefix/PREFIX/TLSCAPath === RUN TestNewEnvVarsWithPrefix/PREFIX/TLSCertPath === RUN TestNewEnvVarsWithPrefix/PREFIX/TLSKeyPath === RUN TestNewEnvVarsWithPrefix/PREFIX/TenantID === RUN TestNewEnvVarsWithPrefix/PREFIX/UseLegacyRoutes === RUN TestNewEnvVarsWithPrefix/PREFIX/AuthToken === RUN TestNewEnvVarsWithPrefix/PREFIX_ === RUN TestNewEnvVarsWithPrefix/PREFIX_/Address === RUN TestNewEnvVarsWithPrefix/PREFIX_/APIKey === RUN TestNewEnvVarsWithPrefix/PREFIX_/APIUser === RUN TestNewEnvVarsWithPrefix/PREFIX_/TLSCAPath === RUN TestNewEnvVarsWithPrefix/PREFIX_/TLSCertPath === RUN TestNewEnvVarsWithPrefix/PREFIX_/TLSKeyPath === RUN TestNewEnvVarsWithPrefix/PREFIX_/TenantID === RUN TestNewEnvVarsWithPrefix/PREFIX_/UseLegacyRoutes === RUN TestNewEnvVarsWithPrefix/PREFIX_/AuthToken === RUN TestNewEnvVarsWithPrefix/#00 === RUN TestNewEnvVarsWithPrefix/#00/Address === RUN TestNewEnvVarsWithPrefix/#00/APIKey === RUN TestNewEnvVarsWithPrefix/#00/APIUser === RUN TestNewEnvVarsWithPrefix/#00/TLSCAPath === RUN TestNewEnvVarsWithPrefix/#00/TLSCertPath === RUN TestNewEnvVarsWithPrefix/#00/TLSKeyPath === RUN TestNewEnvVarsWithPrefix/#00/TenantID === RUN TestNewEnvVarsWithPrefix/#00/UseLegacyRoutes === RUN TestNewEnvVarsWithPrefix/#00/AuthToken --- PASS: TestNewEnvVarsWithPrefix (0.06s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX (0.04s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/Address (0.03s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/APIKey (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/APIUser (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TLSCAPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TLSCertPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TLSKeyPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/TenantID (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/UseLegacyRoutes (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX/AuthToken (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_ (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/Address (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/APIKey (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/APIUser (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TLSCAPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TLSCertPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TLSKeyPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/TenantID (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/UseLegacyRoutes (0.00s) --- PASS: TestNewEnvVarsWithPrefix/PREFIX_/AuthToken (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00 (0.01s) --- PASS: TestNewEnvVarsWithPrefix/#00/Address (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/APIKey (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/APIUser (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TLSCAPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TLSCertPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TLSKeyPath (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/TenantID (0.01s) --- PASS: TestNewEnvVarsWithPrefix/#00/UseLegacyRoutes (0.00s) --- PASS: TestNewEnvVarsWithPrefix/#00/AuthToken (0.00s) === RUN TestTimeSeriesIterator === RUN TestTimeSeriesIterator/empty_time_series === RUN TestTimeSeriesIterator/simple === RUN TestTimeSeriesIterator/edge-cases --- PASS: TestTimeSeriesIterator (0.00s) --- PASS: TestTimeSeriesIterator/empty_time_series (0.00s) --- PASS: TestTimeSeriesIterator/simple (0.00s) --- PASS: TestTimeSeriesIterator/edge-cases (0.00s) === RUN TestRuleCommand_executeChanges === RUN TestRuleCommand_executeChanges/concurrency_limit_=_1 time="2023-04-10T05:15:54+08:00" level=info msg="synching created group" group=group-1 namespace=namespace-1 time="2023-04-10T05:15:54+08:00" level=info msg="synching created group" group=group-2 namespace=namespace-2 time="2023-04-10T05:15:54+08:00" level=info msg="synching updated group" group=group-3 namespace=namespace-3 time="2023-04-10T05:15:54+08:00" level=info msg="synching updated group" group=group-4 namespace=namespace-4 time="2023-04-10T05:15:54+08:00" level=info msg="synching deleted group" group=group-5 namespace=namespace-5 time="2023-04-10T05:15:54+08:00" level=info msg="synching deleted group" group=group-6 namespace=namespace-6 Sync Summary: 2 Groups Created, 2 Groups Updated, 2 Groups Deleted === RUN TestRuleCommand_executeChanges/concurrency_limit_=_6 time="2023-04-10T05:15:54+08:00" level=info msg="synching created group" group=group-1 namespace=namespace-1 time="2023-04-10T05:15:54+08:00" level=info msg="synching created group" group=group-2 namespace=namespace-2 time="2023-04-10T05:15:54+08:00" level=info msg="synching updated group" group=group-4 namespace=namespace-4 time="2023-04-10T05:15:54+08:00" level=info msg="synching updated group" group=group-3 namespace=namespace-3 time="2023-04-10T05:15:54+08:00" level=info msg="synching deleted group" group=group-5 namespace=namespace-5 time="2023-04-10T05:15:54+08:00" level=info msg="synching deleted group" group=group-6 namespace=namespace-6 Sync Summary: 2 Groups Created, 2 Groups Updated, 2 Groups Deleted --- PASS: TestRuleCommand_executeChanges (0.05s) --- PASS: TestRuleCommand_executeChanges/concurrency_limit_=_1 (0.02s) --- PASS: TestRuleCommand_executeChanges/concurrency_limit_=_6 (0.03s) === RUN TestCheckDuplicates === RUN TestCheckDuplicates/no_duplicates === RUN TestCheckDuplicates/with_duplicates --- PASS: TestCheckDuplicates (0.00s) --- PASS: TestCheckDuplicates/no_duplicates (0.00s) --- PASS: TestCheckDuplicates/with_duplicates (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/commands 3.095s === RUN TestConvert_Cortex === RUN TestConvert_Cortex/shouldn't_need_any_conversion === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion === RUN TestConvert_Cortex/shouldn't_need_any_conversion_with_flags === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion_with_flags === RUN TestConvert_Cortex/simple_rename === PAUSE TestConvert_Cortex/simple_rename === RUN TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ === PAUSE TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ === RUN TestConvert_Cortex/query_range_cache_params_are_renamed === PAUSE TestConvert_Cortex/query_range_cache_params_are_renamed === RUN TestConvert_Cortex/with_non-primitive_flags === PAUSE TestConvert_Cortex/with_non-primitive_flags === RUN TestConvert_Cortex/with_renamed_flags === PAUSE TestConvert_Cortex/with_renamed_flags === RUN TestConvert_Cortex/config_flags_have_precedence === PAUSE TestConvert_Cortex/config_flags_have_precedence === RUN TestConvert_Cortex/ruler.storage_maps_to_ruler_storage === PAUSE TestConvert_Cortex/ruler.storage_maps_to_ruler_storage === RUN TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage === PAUSE TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage === RUN TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage === PAUSE TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage === RUN TestConvert_Cortex/ruler_S3_SSE_conversion_work === PAUSE TestConvert_Cortex/ruler_S3_SSE_conversion_work === RUN TestConvert_Cortex/alertmanager_S3_SSE_conversion_work === PAUSE TestConvert_Cortex/alertmanager_S3_SSE_conversion_work === RUN TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values === PAUSE TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values === RUN TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service === PAUSE TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service === RUN TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service === PAUSE TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service === RUN TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML === PAUSE TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML === RUN TestConvert_Cortex/ingester_ring_config === PAUSE TestConvert_Cortex/ingester_ring_config === RUN TestConvert_Cortex/sharding_with_consul_enabled === PAUSE TestConvert_Cortex/sharding_with_consul_enabled === RUN TestConvert_Cortex/sharding_disabled === PAUSE TestConvert_Cortex/sharding_disabled === RUN TestConvert_Cortex/ruler_S3_URL === PAUSE TestConvert_Cortex/ruler_S3_URL === RUN TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence === PAUSE TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 === RUN TestConvert_Cortex/alertmanager_S3_URL === PAUSE TestConvert_Cortex/alertmanager_S3_URL === RUN TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten === PAUSE TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten === RUN TestConvert_Cortex/CSV_string_slice_with_single_value === PAUSE TestConvert_Cortex/CSV_string_slice_with_single_value === RUN TestConvert_Cortex/CSV_string_slice === PAUSE TestConvert_Cortex/CSV_string_slice === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === RUN TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped === PAUSE TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped === RUN TestConvert_Cortex/duration_list_flags === PAUSE TestConvert_Cortex/duration_list_flags === RUN TestConvert_Cortex/duration_list_YAML === PAUSE TestConvert_Cortex/duration_list_YAML === RUN TestConvert_Cortex/instance_id_is_preserved === PAUSE TestConvert_Cortex/instance_id_is_preserved === RUN TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true === PAUSE TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true === CONT TestConvert_Cortex/shouldn't_need_any_conversion === CONT TestConvert_Cortex/ruler_S3_URL === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays === CONT TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true === RUN TestConvert_Cortex/ruler_S3_URL/cortex->mimir === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir === RUN TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir === PAUSE TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem === RUN TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL/cortex->mimir === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem === PAUSE TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem === RUN TestConvert_Cortex/ruler_S3_URL/gem170->gem === CONT TestConvert_Cortex/instance_id_is_preserved === PAUSE TestConvert_Cortex/ruler_S3_URL/gem170->gem === CONT TestConvert_Cortex/duration_list_flags === CONT TestConvert_Cortex/duration_list_YAML === RUN TestConvert_Cortex/instance_id_is_preserved/cortex->mimir === PAUSE TestConvert_Cortex/instance_id_is_preserved/cortex->mimir === RUN TestConvert_Cortex/duration_list_YAML/cortex->mimir === RUN TestConvert_Cortex/instance_id_is_preserved/gem170->gem === PAUSE TestConvert_Cortex/duration_list_YAML/cortex->mimir === PAUSE TestConvert_Cortex/instance_id_is_preserved/gem170->gem === RUN TestConvert_Cortex/duration_list_YAML/gem170->gem === CONT TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped === PAUSE TestConvert_Cortex/duration_list_YAML/gem170->gem === RUN TestConvert_Cortex/duration_list_flags/cortex->mimir === PAUSE TestConvert_Cortex/duration_list_flags/cortex->mimir === RUN TestConvert_Cortex/duration_list_flags/gem170->gem === PAUSE TestConvert_Cortex/duration_list_flags/gem170->gem === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir === PAUSE TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir === RUN TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem === PAUSE TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir === RUN TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir === CONT TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir === CONT TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service === PAUSE TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir === CONT TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values === RUN TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir === RUN TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir === RUN TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem === RUN TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem === PAUSE TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir === CONT TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service === RUN TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem === PAUSE TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem === CONT TestConvert_Cortex/alertmanager_S3_SSE_conversion_work === RUN TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir === RUN TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir === PAUSE TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir === PAUSE TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir === RUN TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir === RUN TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem === PAUSE TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir === PAUSE TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem === RUN TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem === RUN TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem === CONT TestConvert_Cortex/ruler_S3_SSE_conversion_work === RUN TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem === CONT TestConvert_Cortex/sharding_disabled === PAUSE TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem === CONT TestConvert_Cortex/alertmanager_S3_URL === RUN TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned === RUN TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem === RUN TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir === CONT TestConvert_Cortex/CSV_string_slice === PAUSE TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir === RUN TestConvert_Cortex/alertmanager_S3_URL/gem170->gem === PAUSE TestConvert_Cortex/alertmanager_S3_URL/gem170->gem === CONT TestConvert_Cortex/CSV_string_slice_with_single_value === RUN TestConvert_Cortex/CSV_string_slice/cortex->mimir === PAUSE TestConvert_Cortex/CSV_string_slice/cortex->mimir === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir === RUN TestConvert_Cortex/CSV_string_slice/gem170->gem === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir === PAUSE TestConvert_Cortex/CSV_string_slice/gem170->gem === RUN TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten === PAUSE TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir === RUN TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem === RUN TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem === PAUSE TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem === CONT TestConvert_Cortex/sharding_with_consul_enabled === PAUSE TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem === RUN TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir === PAUSE TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir === RUN TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem === CONT TestConvert_Cortex/ingester_ring_config === PAUSE TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem === RUN TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir === PAUSE TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir === RUN TestConvert_Cortex/sharding_disabled/cortex->mimir === RUN TestConvert_Cortex/ingester_ring_config/cortex->mimir === RUN TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem === CONT TestConvert_Cortex/with_non-primitive_flags === PAUSE TestConvert_Cortex/ingester_ring_config/cortex->mimir === RUN TestConvert_Cortex/ingester_ring_config/gem170->gem === RUN TestConvert_Cortex/with_non-primitive_flags/cortex->mimir === PAUSE TestConvert_Cortex/sharding_disabled/cortex->mimir === PAUSE TestConvert_Cortex/with_non-primitive_flags/cortex->mimir === RUN TestConvert_Cortex/sharding_disabled/gem170->gem === RUN TestConvert_Cortex/with_non-primitive_flags/gem170->gem === PAUSE TestConvert_Cortex/sharding_disabled/gem170->gem === PAUSE TestConvert_Cortex/with_non-primitive_flags/gem170->gem === CONT TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML === PAUSE TestConvert_Cortex/ingester_ring_config/gem170->gem === CONT TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage === CONT TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ === RUN TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir === RUN TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir === PAUSE TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir === PAUSE TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir === RUN TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir === RUN TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem === PAUSE TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir === PAUSE TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem === RUN TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem === CONT TestConvert_Cortex/query_range_cache_params_are_renamed === PAUSE TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem === CONT TestConvert_Cortex/config_flags_have_precedence === RUN TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem === PAUSE TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem === CONT TestConvert_Cortex/ruler.storage_maps_to_ruler_storage === RUN TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir === PAUSE TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir === RUN TestConvert_Cortex/config_flags_have_precedence/cortex->mimir === RUN TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir === PAUSE TestConvert_Cortex/config_flags_have_precedence/cortex->mimir === PAUSE TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir === RUN TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem === RUN TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem === CONT TestConvert_Cortex/simple_rename === PAUSE TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem === PAUSE TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem === CONT TestConvert_Cortex/with_renamed_flags === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 === RUN TestConvert_Cortex/with_renamed_flags/cortex->mimir === PAUSE TestConvert_Cortex/with_renamed_flags/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir === RUN TestConvert_Cortex/with_renamed_flags/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir === PAUSE TestConvert_Cortex/with_renamed_flags/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem === CONT TestConvert_Cortex/shouldn't_need_any_conversion_with_flags === PAUSE TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence === RUN TestConvert_Cortex/simple_rename/cortex->mimir === RUN TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir === PAUSE TestConvert_Cortex/simple_rename/cortex->mimir === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir === RUN TestConvert_Cortex/simple_rename/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 === RUN TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir === PAUSE TestConvert_Cortex/simple_rename/gem170->gem === PAUSE TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem === RUN TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem === CONT TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir === RUN TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem === PAUSE TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL/gem170->gem === CONT TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem === CONT TestConvert_Cortex/instance_id_is_preserved/cortex->mimir === CONT TestConvert_Cortex/duration_list_YAML/cortex->mimir === CONT TestConvert_Cortex/duration_list_flags/cortex->mimir === CONT TestConvert_Cortex/instance_id_is_preserved/gem170->gem === CONT TestConvert_Cortex/duration_list_YAML/gem170->gem === CONT TestConvert_Cortex/duration_list_flags/gem170->gem === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir === CONT TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir === CONT TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir === CONT TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir === CONT TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir === CONT TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem === CONT TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir === CONT TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem === CONT TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir === CONT TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem === CONT TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir === CONT TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem === CONT TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir === CONT TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem === CONT TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem === CONT TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem === CONT TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_URL/gem170->gem === CONT TestConvert_Cortex/CSV_string_slice/cortex->mimir === CONT TestConvert_Cortex/CSV_string_slice/gem170->gem === CONT TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir === CONT TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir === CONT TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir === CONT TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem === CONT TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem === CONT TestConvert_Cortex/sharding_disabled/cortex->mimir === CONT TestConvert_Cortex/sharding_disabled/gem170->gem === CONT TestConvert_Cortex/with_non-primitive_flags/cortex->mimir === CONT TestConvert_Cortex/ingester_ring_config/cortex->mimir === CONT TestConvert_Cortex/with_non-primitive_flags/gem170->gem === CONT TestConvert_Cortex/ingester_ring_config/gem170->gem === CONT TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir === CONT TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem === CONT TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir === CONT TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem === CONT TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir === CONT TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem === CONT TestConvert_Cortex/config_flags_have_precedence/cortex->mimir === CONT TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir === CONT TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir === CONT TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem === CONT TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem === CONT TestConvert_Cortex/with_renamed_flags/cortex->mimir === CONT TestConvert_Cortex/with_renamed_flags/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem === CONT TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir === CONT TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem === CONT TestConvert_Cortex/simple_rename/cortex->mimir === CONT TestConvert_Cortex/simple_rename/gem170->gem === CONT TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir === CONT TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir === CONT TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem === CONT TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem --- PASS: TestConvert_Cortex (0.01s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays (0.00s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/cortex->mimir (0.60s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=false_stays/gem170->gem (0.73s) --- PASS: TestConvert_Cortex/ruler_S3_URL (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL/cortex->mimir (0.48s) --- PASS: TestConvert_Cortex/ruler_S3_URL/gem170->gem (0.59s) --- PASS: TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true (0.00s) --- PASS: TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/cortex->mimir (0.50s) --- PASS: TestConvert_Cortex/new_frontend.results_cache.backend_==_memcached_when_old_query_range.cache_results_==_true/gem170->gem (0.62s) --- PASS: TestConvert_Cortex/duration_list_flags (0.00s) --- PASS: TestConvert_Cortex/duration_list_flags/cortex->mimir (0.38s) --- PASS: TestConvert_Cortex/duration_list_flags/gem170->gem (0.43s) --- PASS: TestConvert_Cortex/duration_list_YAML (0.00s) --- PASS: TestConvert_Cortex/duration_list_YAML/cortex->mimir (0.39s) --- PASS: TestConvert_Cortex/duration_list_YAML/gem170->gem (0.53s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false (0.00s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/cortex->mimir (0.24s) --- PASS: TestConvert_Cortex/instance_id_is_preserved (0.00s) --- PASS: TestConvert_Cortex/instance_id_is_preserved/cortex->mimir (0.56s) --- PASS: TestConvert_Cortex/instance_id_is_preserved/gem170->gem (0.62s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true (0.00s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/cortex->mimir (0.21s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false (0.00s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/cortex->mimir (0.34s) --- PASS: TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped (0.00s) --- PASS: TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/cortex->mimir (0.41s) --- PASS: TestConvert_Cortex/flags_with_quotes_and_JSON_don't_get_interpreted_escaped/gem170->gem (0.38s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default (0.00s) --- PASS: TestConvert_Cortex/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/cortex->mimir (0.12s) --- PASS: TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service (0.00s) --- PASS: TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/cortex->mimir (0.39s) --- PASS: TestConvert_Cortex/new_memcached_addresses_is_constructed_from_old_hostname_and_service/gem170->gem (0.42s) --- PASS: TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage (0.00s) --- PASS: TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/cortex->mimir (0.48s) --- PASS: TestConvert_Cortex/alertmanager.storage_has_precedence_over_alertmanager_storage/gem170->gem (0.56s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion (0.00s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion/cortex->mimir (0.32s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion/gem170->gem (0.38s) --- PASS: TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service (0.00s) --- PASS: TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/cortex->mimir (0.30s) --- PASS: TestConvert_Cortex/old_memcached_addresses_take_precedence_over_hostname_and_service/gem170->gem (0.50s) --- PASS: TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values (0.00s) --- PASS: TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/cortex->mimir (0.50s) --- PASS: TestConvert_Cortex/S3_SSE_conversion_doesn't_overwrite_existing_values/gem170->gem (0.46s) --- PASS: TestConvert_Cortex/ruler_S3_SSE_conversion_work (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_SSE_conversion_work/cortex->mimir (0.42s) --- PASS: TestConvert_Cortex/ruler_S3_SSE_conversion_work/gem170->gem (0.43s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL (0.00s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL/cortex->mimir (0.29s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL/gem170->gem (0.39s) --- PASS: TestConvert_Cortex/alertmanager_S3_SSE_conversion_work (0.00s) --- PASS: TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/cortex->mimir (0.38s) --- PASS: TestConvert_Cortex/alertmanager_S3_SSE_conversion_work/gem170->gem (0.53s) --- PASS: TestConvert_Cortex/CSV_string_slice (0.00s) --- PASS: TestConvert_Cortex/CSV_string_slice/cortex->mimir (0.38s) --- PASS: TestConvert_Cortex/CSV_string_slice/gem170->gem (0.39s) --- PASS: TestConvert_Cortex/CSV_string_slice_with_single_value (0.00s) --- PASS: TestConvert_Cortex/CSV_string_slice_with_single_value/cortex->mimir (0.41s) --- PASS: TestConvert_Cortex/CSV_string_slice_with_single_value/gem170->gem (0.47s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten (0.00s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/cortex->mimir (0.32s) --- PASS: TestConvert_Cortex/alertmanager_S3_URL:_existing_endpoint_isn't_overwritten/gem170->gem (0.35s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned (0.00s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/cortex->mimir (0.38s) --- PASS: TestConvert_Cortex/instance_interface_names_using_explicit_old_default_and_useNewDefaults=true_gets_pruned/gem170->gem (0.51s) --- PASS: TestConvert_Cortex/sharding_disabled (0.00s) --- PASS: TestConvert_Cortex/sharding_disabled/cortex->mimir (0.46s) --- PASS: TestConvert_Cortex/sharding_disabled/gem170->gem (0.60s) --- PASS: TestConvert_Cortex/with_non-primitive_flags (0.00s) --- PASS: TestConvert_Cortex/with_non-primitive_flags/cortex->mimir (0.33s) --- PASS: TestConvert_Cortex/with_non-primitive_flags/gem170->gem (0.46s) --- PASS: TestConvert_Cortex/ingester_ring_config (0.00s) --- PASS: TestConvert_Cortex/ingester_ring_config/cortex->mimir (0.42s) --- PASS: TestConvert_Cortex/ingester_ring_config/gem170->gem (0.53s) --- PASS: TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML (0.00s) --- PASS: TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/cortex->mimir (0.37s) --- PASS: TestConvert_Cortex/not-in-yaml_flags_don't_show_in_output_YAML/gem170->gem (0.37s) --- PASS: TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_ (0.00s) --- PASS: TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/cortex->mimir (0.31s) --- PASS: TestConvert_Cortex/alertmanager_URL_has_dnssrvnoa+_prepended_if_alertmanager_discovery_/gem170->gem (0.44s) --- PASS: TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage (0.00s) --- PASS: TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/cortex->mimir (0.38s) --- PASS: TestConvert_Cortex/ruler_storage_has_precedence_over_ruler.storage/gem170->gem (0.40s) --- PASS: TestConvert_Cortex/config_flags_have_precedence (0.00s) --- PASS: TestConvert_Cortex/config_flags_have_precedence/cortex->mimir (0.42s) --- PASS: TestConvert_Cortex/query_range_cache_params_are_renamed (0.00s) --- PASS: TestConvert_Cortex/query_range_cache_params_are_renamed/cortex->mimir (0.25s) --- PASS: TestConvert_Cortex/query_range_cache_params_are_renamed/gem170->gem (0.35s) --- PASS: TestConvert_Cortex/ruler.storage_maps_to_ruler_storage (0.00s) --- PASS: TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/cortex->mimir (0.53s) --- PASS: TestConvert_Cortex/ruler.storage_maps_to_ruler_storage/gem170->gem (0.59s) --- PASS: TestConvert_Cortex/with_renamed_flags (0.00s) --- PASS: TestConvert_Cortex/with_renamed_flags/cortex->mimir (0.52s) --- PASS: TestConvert_Cortex/with_renamed_flags/gem170->gem (0.55s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2 (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/cortex->mimir (0.52s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.2/gem170->gem (0.46s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3 (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/cortex->mimir (0.33s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.3/gem170->gem (0.72s) --- PASS: TestConvert_Cortex/sharding_with_consul_enabled (0.00s) --- PASS: TestConvert_Cortex/sharding_with_consul_enabled/cortex->mimir (0.70s) --- PASS: TestConvert_Cortex/sharding_with_consul_enabled/gem170->gem (0.79s) --- PASS: TestConvert_Cortex/simple_rename (0.00s) --- PASS: TestConvert_Cortex/simple_rename/cortex->mimir (0.57s) --- PASS: TestConvert_Cortex/simple_rename/gem170->gem (0.78s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion_with_flags (0.00s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/cortex->mimir (0.78s) --- PASS: TestConvert_Cortex/shouldn't_need_any_conversion_with_flags/gem170->gem (0.87s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence (0.00s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/cortex->mimir (0.71s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_existing_access_key_and_secret_key_take_precedence/gem170->gem (0.33s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1 (0.01s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/cortex->mimir (0.45s) --- PASS: TestConvert_Cortex/ruler_S3_URL:_non-trivial_user_part,_pt.1/gem170->gem (0.39s) === RUN TestConvert_GEM === RUN TestConvert_GEM/proxy_targets_get_translated === PAUSE TestConvert_GEM/proxy_targets_get_translated === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/instance_id_is_preserved === PAUSE TestConvert_GEM/instance_id_is_preserved === CONT TestConvert_GEM/proxy_targets_get_translated === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/proxy_targets_get_translated/gem170->gem === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem === PAUSE TestConvert_GEM/proxy_targets_get_translated/gem170->gem === CONT TestConvert_GEM/proxy_targets_get_translated/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem === CONT TestConvert_GEM/instance_id_is_preserved === RUN TestConvert_GEM/instance_id_is_preserved/gem170->gem === PAUSE TestConvert_GEM/instance_id_is_preserved/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true === RUN TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem === PAUSE TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem === CONT TestConvert_GEM/instance_id_is_preserved/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem === CONT TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem --- PASS: TestConvert_GEM (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_but_are_with_random_values_are_retained_with_useNewDefaults=false/gem170->gem (0.26s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false (0.01s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_with_useNewDefaults=false/gem170->gem (0.28s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_printed_even_when_implicitly_using_the_old_default/gem170->gem (0.30s) --- PASS: TestConvert_GEM/proxy_targets_get_translated (0.00s) --- PASS: TestConvert_GEM/proxy_targets_get_translated/gem170->gem (0.58s) --- PASS: TestConvert_GEM/instance_id_is_preserved (0.00s) --- PASS: TestConvert_GEM/instance_id_is_preserved/gem170->gem (0.64s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true (0.00s) --- PASS: TestConvert_GEM/values_where_the_old_default_should_be_retained_are_retained_even_with_useNewDefaults=true/gem170->gem (0.39s) === RUN TestConvert_InvalidConfigs === RUN TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory === RUN TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets === CONT TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory === CONT TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets === RUN TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir === RUN TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem === CONT TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir === RUN TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir === RUN TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem === PAUSE TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem === CONT TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir === CONT TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem === CONT TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem --- PASS: TestConvert_InvalidConfigs (0.00s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory (0.00s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/gem170->gem (0.08s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_URL_cannot_contain_inmemory/cortex->mimir (0.09s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets (0.01s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/cortex->mimir (0.11s) --- PASS: TestConvert_InvalidConfigs/alertmanager_S3_bucketnames_contains_multiple_buckets/gem170->gem (0.14s) === RUN TestReportDeletedFlags === RUN TestReportDeletedFlags/no_unsupported_options === RUN TestReportDeletedFlags/unsupported_config_option === RUN TestReportDeletedFlags/unsupported_CLI_flag === RUN TestReportDeletedFlags/unsupported_config_options_and_flags === RUN TestReportDeletedFlags/flags_without_YAML_equivalents --- PASS: TestReportDeletedFlags (0.10s) --- PASS: TestReportDeletedFlags/no_unsupported_options (0.02s) --- PASS: TestReportDeletedFlags/unsupported_config_option (0.02s) --- PASS: TestReportDeletedFlags/unsupported_CLI_flag (0.02s) --- PASS: TestReportDeletedFlags/unsupported_config_options_and_flags (0.02s) --- PASS: TestReportDeletedFlags/flags_without_YAML_equivalents (0.02s) === RUN TestChangedCortexDefaults === RUN TestChangedCortexDefaults/cortex->mimir === PAUSE TestChangedCortexDefaults/cortex->mimir === CONT TestChangedCortexDefaults/cortex->mimir --- PASS: TestChangedCortexDefaults (0.11s) --- PASS: TestChangedCortexDefaults/cortex->mimir (0.32s) === RUN TestChangedGEMDefaults === RUN TestChangedGEMDefaults/gem170->gem === PAUSE TestChangedGEMDefaults/gem170->gem === CONT TestChangedGEMDefaults/gem170->gem --- PASS: TestChangedGEMDefaults (0.16s) --- PASS: TestChangedGEMDefaults/gem170->gem (0.45s) === RUN TestConvert_UseNewDefaults === RUN TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true === PAUSE TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true === CONT TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true === RUN TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir === RUN TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem === PAUSE TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem === CONT TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir === CONT TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir === RUN TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem === PAUSE TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem === CONT TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem --- PASS: TestConvert_UseNewDefaults (0.00s) --- PASS: TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true (0.00s) --- PASS: TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/cortex->mimir (0.47s) --- PASS: TestConvert_UseNewDefaults/replaces_explicitly_set_old_defaults_when_useNewDefaults=true/gem170->gem (0.59s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true (0.00s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/cortex->mimir (0.33s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_non-default_value_when_useNewDefaults=true/gem170->gem (0.32s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false (0.00s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/cortex->mimir (0.33s) --- PASS: TestConvert_UseNewDefaults/keeps_explicitly_set_old_defaults_useNewDefaults=false/gem170->gem (0.41s) === RUN TestConvert_NotInYAMLIsNotPrinted === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir === RUN TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem === PAUSE TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir === CONT TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem --- PASS: TestConvert_NotInYAMLIsNotPrinted (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/cortex->mimir (0.32s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=true/gem170->gem (0.44s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/cortex->mimir (0.43s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=true/gem170->gem (0.48s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false (0.00s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/cortex->mimir (0.39s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=true_showDefaults=false/gem170->gem (0.33s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false (0.01s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/cortex->mimir (0.33s) --- PASS: TestConvert_NotInYAMLIsNotPrinted/useNewDefault=false_showDefaults=false/gem170->gem (0.37s) === RUN TestConvert_PassingOnlyYAMLReturnsOnlyYAML === RUN TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir === PAUSE TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir === RUN TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem === PAUSE TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem === CONT TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir === CONT TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem --- PASS: TestConvert_PassingOnlyYAMLReturnsOnlyYAML (0.00s) --- PASS: TestConvert_PassingOnlyYAMLReturnsOnlyYAML/cortex->mimir (0.20s) --- PASS: TestConvert_PassingOnlyYAMLReturnsOnlyYAML/gem170->gem (0.27s) === RUN TestConvert_PassingOnlyFlagsReturnsOnlyFlags === RUN TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir === PAUSE TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir === RUN TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem === PAUSE TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem === CONT TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir === CONT TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem --- PASS: TestConvert_PassingOnlyFlagsReturnsOnlyFlags (0.00s) --- PASS: TestConvert_PassingOnlyFlagsReturnsOnlyFlags/cortex->mimir (0.18s) --- PASS: TestConvert_PassingOnlyFlagsReturnsOnlyFlags/gem170->gem (0.26s) === RUN TestRemovedParamsAndFlagsAreCorrect === PAUSE TestRemovedParamsAndFlagsAreCorrect === RUN TestInspectedEntry_SetThenGet === RUN TestInspectedEntry_SetThenGet/a_simple_field === RUN TestInspectedEntry_SetThenGet/a_field_within_a_struct === RUN TestInspectedEntry_SetThenGet/fails_with_a_non-existent_field === RUN TestInspectedEntry_SetThenGet/a_field_within_an_inlined_struct --- PASS: TestInspectedEntry_SetThenGet (0.00s) --- PASS: TestInspectedEntry_SetThenGet/a_simple_field (0.00s) --- PASS: TestInspectedEntry_SetThenGet/a_field_within_a_struct (0.00s) --- PASS: TestInspectedEntry_SetThenGet/fails_with_a_non-existent_field (0.00s) --- PASS: TestInspectedEntry_SetThenGet/a_field_within_an_inlined_struct (0.00s) === RUN TestInspectedEntry_Walk === RUN TestInspectedEntry_Walk/no_recursion === RUN TestInspectedEntry_Walk/with_an_inlined_field === RUN TestInspectedEntry_Walk/with_a_skipped_struct === RUN TestInspectedEntry_Walk/with_a_skipped_field --- PASS: TestInspectedEntry_Walk (0.00s) --- PASS: TestInspectedEntry_Walk/no_recursion (0.00s) --- PASS: TestInspectedEntry_Walk/with_an_inlined_field (0.00s) --- PASS: TestInspectedEntry_Walk/with_a_skipped_struct (0.00s) --- PASS: TestInspectedEntry_Walk/with_a_skipped_field (0.00s) === RUN TestInspectedEntry_Delete === RUN TestInspectedEntry_Delete/deletes_a_path === RUN TestInspectedEntry_Delete/fails_to_delete_a_non-existent_path === RUN TestInspectedEntry_Delete/cleans_up_empty_fields === RUN TestInspectedEntry_Delete/deletes_subtree --- PASS: TestInspectedEntry_Delete (0.00s) --- PASS: TestInspectedEntry_Delete/deletes_a_path (0.00s) --- PASS: TestInspectedEntry_Delete/fails_to_delete_a_non-existent_path (0.00s) --- PASS: TestInspectedEntry_Delete/cleans_up_empty_fields (0.00s) --- PASS: TestInspectedEntry_Delete/deletes_subtree (0.00s) === RUN TestInspectedConfig_MarshalThenUnmarshalRetainsTypeInformation --- PASS: TestInspectedConfig_MarshalThenUnmarshalRetainsTypeInformation (0.30s) === RUN TestInspectedEntry_MarshalYAML --- PASS: TestInspectedEntry_MarshalYAML (0.13s) === RUN TestInspectConfig_HasDefaultValues --- PASS: TestInspectConfig_HasDefaultValues (0.14s) === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/int === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/[]string === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/duration === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/bool === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/float === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/string === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/time === RUN TestInspectConfig_LoadingAConfigHasCorrectTypes/url --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes (0.03s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/int (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/[]string (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/duration (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/bool (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/float (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/string (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/time (0.00s) --- PASS: TestInspectConfig_LoadingAConfigHasCorrectTypes/url (0.00s) === RUN TestDecodeDurationInVariousFormats === RUN TestDecodeDurationInVariousFormats/number === RUN TestDecodeDurationInVariousFormats/time.Duration === RUN TestDecodeDurationInVariousFormats/model.Duration --- PASS: TestDecodeDurationInVariousFormats (0.45s) --- PASS: TestDecodeDurationInVariousFormats/number (0.13s) --- PASS: TestDecodeDurationInVariousFormats/time.Duration (0.13s) --- PASS: TestDecodeDurationInVariousFormats/model.Duration (0.19s) === CONT TestRemovedParamsAndFlagsAreCorrect --- PASS: TestRemovedParamsAndFlagsAreCorrect (2.06s) PASS ok github.com/grafana/mimir/pkg/mimirtool/config 19.004s ? github.com/grafana/mimir/pkg/mimirtool/rules/rwrulefmt [no test files] ? github.com/grafana/mimir/pkg/mimirtool/version [no test files] === RUN TestPrintRuleSet === RUN TestPrintRuleSet/prints_colorless_json === RUN TestPrintRuleSet/prints_colorful_json === RUN TestPrintRuleSet/prints_colorless_yaml === RUN TestPrintRuleSet/prints_colorful_yaml === RUN TestPrintRuleSet/defaults_to_tabwriter --- PASS: TestPrintRuleSet (0.03s) --- PASS: TestPrintRuleSet/prints_colorless_json (0.00s) --- PASS: TestPrintRuleSet/prints_colorful_json (0.00s) --- PASS: TestPrintRuleSet/prints_colorless_yaml (0.00s) --- PASS: TestPrintRuleSet/prints_colorful_yaml (0.00s) --- PASS: TestPrintRuleSet/defaults_to_tabwriter (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/printer 0.337s === RUN TestNamespaceChange_ToOperations --- PASS: TestNamespaceChange_ToOperations (0.00s) === RUN Test_rulesEqual === RUN Test_rulesEqual/rule_node_identical === RUN Test_rulesEqual/rule_node_diff === RUN Test_rulesEqual/rule_node_annotations_diff === RUN Test_rulesEqual/rule_node_annotations_nil_diff === RUN Test_rulesEqual/rule_node_yaml_diff --- PASS: Test_rulesEqual (0.00s) --- PASS: Test_rulesEqual/rule_node_identical (0.00s) --- PASS: Test_rulesEqual/rule_node_diff (0.00s) --- PASS: Test_rulesEqual/rule_node_annotations_diff (0.00s) --- PASS: Test_rulesEqual/rule_node_annotations_nil_diff (0.00s) --- PASS: Test_rulesEqual/rule_node_yaml_diff (0.00s) === RUN TestCompareGroups === RUN TestCompareGroups/identical_configs === RUN TestCompareGroups/differently_ordered_source_tenants_(should_still_be_equivalent) === RUN TestCompareGroups/different_rule_length === RUN TestCompareGroups/identical_rw_configs === RUN TestCompareGroups/different_rw_config_lengths === RUN TestCompareGroups/different_rw_configs === RUN TestCompareGroups/different_source_tenants === RUN TestCompareGroups/repeated_subset_of_source_tenants === RUN TestCompareGroups/repeated_single_tenant_(tenants_should_be_deduplicated) --- PASS: TestCompareGroups (0.00s) --- PASS: TestCompareGroups/identical_configs (0.00s) --- PASS: TestCompareGroups/differently_ordered_source_tenants_(should_still_be_equivalent) (0.00s) --- PASS: TestCompareGroups/different_rule_length (0.00s) --- PASS: TestCompareGroups/identical_rw_configs (0.00s) --- PASS: TestCompareGroups/different_rw_config_lengths (0.00s) --- PASS: TestCompareGroups/different_rw_configs (0.00s) --- PASS: TestCompareGroups/different_source_tenants (0.00s) --- PASS: TestCompareGroups/repeated_subset_of_source_tenants (0.00s) --- PASS: TestCompareGroups/repeated_single_tenant_(tenants_should_be_deduplicated) (0.00s) === RUN TestParseFiles === RUN TestParseFiles/basic_file === RUN TestParseFiles/file_namespace_overlap time="2023-04-10T05:16:16+08:00" level=error msg="repeated namespace attempted to be loaded" file=testdata/basic_namespace_repeated.yaml namespace=example_namespace === RUN TestParseFiles/multiple_namespace_file === RUN TestParseFiles/federated_rule_groups --- PASS: TestParseFiles (0.01s) --- PASS: TestParseFiles/basic_file (0.01s) --- PASS: TestParseFiles/file_namespace_overlap (0.00s) --- PASS: TestParseFiles/multiple_namespace_file (0.00s) --- PASS: TestParseFiles/federated_rule_groups (0.00s) === RUN TestAggregateBy === RUN TestAggregateBy/with_no_rules === RUN TestAggregateBy/no_modification === RUN TestAggregateBy/no_change_in_the_query_but_lints_with_'without'_in_the_aggregation === RUN TestAggregateBy/with_an_aggregation_modification === RUN TestAggregateBy/with_'count'_as_the_aggregation === RUN TestAggregateBy/with_vector_matching_in_binary_operations === RUN TestAggregateBy/with_a_query_skipped --- PASS: TestAggregateBy (0.01s) --- PASS: TestAggregateBy/with_no_rules (0.00s) --- PASS: TestAggregateBy/no_modification (0.00s) --- PASS: TestAggregateBy/no_change_in_the_query_but_lints_with_'without'_in_the_aggregation (0.00s) --- PASS: TestAggregateBy/with_an_aggregation_modification (0.00s) --- PASS: TestAggregateBy/with_'count'_as_the_aggregation (0.00s) --- PASS: TestAggregateBy/with_vector_matching_in_binary_operations (0.00s) --- PASS: TestAggregateBy/with_a_query_skipped (0.00s) === RUN TestLintExpressions === RUN TestLintExpressions/it_lints_simple_expressions === RUN TestLintExpressions/it_lints_aggregations_expressions === RUN TestLintExpressions/with_no_opinion === RUN TestLintExpressions/with_a_complex_expression === RUN TestLintExpressions/with_an_invalid_expression --- PASS: TestLintExpressions (0.00s) --- PASS: TestLintExpressions/it_lints_simple_expressions (0.00s) --- PASS: TestLintExpressions/it_lints_aggregations_expressions (0.00s) --- PASS: TestLintExpressions/with_no_opinion (0.00s) --- PASS: TestLintExpressions/with_a_complex_expression (0.00s) --- PASS: TestLintExpressions/with_an_invalid_expression (0.00s) === RUN TestCheckRecordingRules === RUN TestCheckRecordingRules/follows_rule_name_conventions === RUN TestCheckRecordingRules/doesn't_follow_rule_name_conventions time="2023-04-10T05:16:16+08:00" level=error msg="bad recording rule name" error="recording rule name does not match level:metric:operation format, must contain at least one colon" file= rule=level_metric_operation ruleGroup= === RUN TestCheckRecordingRules/almost_follows_rule_name_conventions time="2023-04-10T05:16:16+08:00" level=error msg="bad recording rule name" error="recording rule name does not match level:metric:operation format, must contain at least one colon" file= rule="level:metric_operation" ruleGroup= === RUN TestCheckRecordingRules/almost_follows_rule_name_conventions#01 === RUN TestCheckRecordingRules/follows_rule_name_conventions_extra --- PASS: TestCheckRecordingRules (0.00s) --- PASS: TestCheckRecordingRules/follows_rule_name_conventions (0.00s) --- PASS: TestCheckRecordingRules/doesn't_follow_rule_name_conventions (0.00s) --- PASS: TestCheckRecordingRules/almost_follows_rule_name_conventions (0.00s) --- PASS: TestCheckRecordingRules/almost_follows_rule_name_conventions#01 (0.00s) --- PASS: TestCheckRecordingRules/follows_rule_name_conventions_extra (0.00s) PASS ok github.com/grafana/mimir/pkg/mimirtool/rules 0.299s === RUN TestBlockQuerierSeries === PAUSE TestBlockQuerierSeries === RUN TestBlockQuerierSeriesSet === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() === RUN TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() === PAUSE TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() === RUN TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() === PAUSE TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() === CONT TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() --- PASS: TestBlockQuerierSeriesSet (0.00s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_100th_call_to_.Seek()_or_.Next() (5.50s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1000th_call_to_.Seek() (5.91s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Seek()_or_.Next() (6.21s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1000th_call_to_.Next() (5.20s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_971th_call_to_.Seek()_or_.Next() (4.99s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_971th_call_to_.Seek() (5.36s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_1th_call_to_.Next() (13.08s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_971th_call_to_.Next() (4.93s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_100th_call_to_.Seek() (4.77s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_100th_call_to_.Next() (4.61s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_3th_call_to_.Seek() (7.31s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_3th_call_to_.Seek()_or_.Next() (6.93s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Next()_method,_perform_.At()_after_every_3th_call_to_.Next() (5.95s) --- PASS: TestBlockQuerierSeriesSet/consume_with_alternating_calls_to_.Seek()_and_.Next()_method,_perform_.At()_after_every_1th_call_to_.Seek()_or_.Next() (9.92s) --- PASS: TestBlockQuerierSeriesSet/consume_with_.Seek()_method,_perform_.At()_after_every_1th_call_to_.Seek() (9.59s) === RUN TestBlocksConsistencyChecker_Check === RUN TestBlocksConsistencyChecker_Check/no_known_blocks === RUN TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_a_single_store-gateway === RUN TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_multiple_store-gateway === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_more_blocks_than_expected === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected,_but_the_missing_block_has_been_recently_uploaded === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_recently_marked_for_deletion === RUN TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_marked_for_deletion_long_time_ago --- PASS: TestBlocksConsistencyChecker_Check (0.01s) --- PASS: TestBlocksConsistencyChecker_Check/no_known_blocks (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_a_single_store-gateway (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/all_known_blocks_have_been_queried_from_multiple_store-gateway (0.01s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_more_blocks_than_expected (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected,_but_the_missing_block_has_been_recently_uploaded (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_recently_marked_for_deletion (0.00s) --- PASS: TestBlocksConsistencyChecker_Check/store-gateway_has_queried_less_blocks_than_expected_and_the_missing_block_has_been_marked_for_deletion_long_time_ago (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_within_multiple_blocks === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block === RUN TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low === RUN TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high === RUN TestBucketIndexBlocksFinder_GetBlocks/matching_all_blocks === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT === RUN TestBucketIndexBlocksFinder_GetBlocks/query_range_within_a_single_block --- PASS: TestBucketIndexBlocksFinder_GetBlocks (0.02s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_within_multiple_blocks (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/matching_all_blocks (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT (0.00s) --- PASS: TestBucketIndexBlocksFinder_GetBlocks/query_range_within_a_single_block (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks_BucketIndexDoesNotExist --- PASS: TestBucketIndexBlocksFinder_GetBlocks_BucketIndexDoesNotExist (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsCorrupted --- PASS: TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsCorrupted (0.00s) === RUN TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsTooOld --- PASS: TestBucketIndexBlocksFinder_GetBlocks_BucketIndexIsTooOld (0.01s) === RUN TestBlocksFinderBucketIndexErrMsgs === RUN TestBlocksFinderBucketIndexErrMsgs/newBucketIndexTooOldError --- PASS: TestBlocksFinderBucketIndexErrMsgs (0.00s) --- PASS: TestBlocksFinderBucketIndexErrMsgs/newBucketIndexTooOldError (0.00s) === RUN TestBucketScanBlocksFinder_InitialScan --- PASS: TestBucketScanBlocksFinder_InitialScan (0.03s) === RUN TestBucketScanBlocksFinder_InitialScanFailure --- PASS: TestBucketScanBlocksFinder_InitialScanFailure (3.81s) === RUN TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyTenants level=debug user=1 component=block.BaseFetcher msg="fetching meta data" concurrency=1 level=info user=1 component=block.BaseFetcher msg="successfully synchronized block metadata" duration=1.002427836s duration_ms=1002 cached=0 returned=0 partial=0 level=error msg="unable to run the initial blocks scan" err="context canceled" --- PASS: TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyTenants (1.02s) === RUN TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyBlocks level=error msg="unable to run the initial blocks scan" err="context canceled" --- PASS: TestBucketScanBlocksFinder_StopWhileRunningTheInitialScanOnManyBlocks (1.00s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsNewUser --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsNewUser (0.03s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsNewBlock --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsNewBlock (0.05s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsBlockMarkedForDeletion --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsBlockMarkedForDeletion (0.03s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsDeletedBlock --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsDeletedBlock (0.03s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsDeletedUser --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsDeletedUser (0.02s) === RUN TestBucketScanBlocksFinder_PeriodicScanFindsUserWhichWasPreviouslyDeleted --- PASS: TestBucketScanBlocksFinder_PeriodicScanFindsUserWhichWasPreviouslyDeleted (0.03s) === RUN TestBucketScanBlocksFinder_GetBlocks === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_within_multiple_blocks === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block === RUN TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low === RUN TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high === RUN TestBucketScanBlocksFinder_GetBlocks/matching_all_blocks === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT === RUN TestBucketScanBlocksFinder_GetBlocks/query_range_within_a_single_block --- PASS: TestBucketScanBlocksFinder_GetBlocks (0.02s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_within_multiple_blocks (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_matching_exactly_a_single_block (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_low (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/no_matching_block_because_the_range_is_too_high (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/matching_all_blocks (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_starting_at_a_block_maxT (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_ending_at_a_block_minT (0.00s) --- PASS: TestBucketScanBlocksFinder_GetBlocks/query_range_within_a_single_block (0.00s) === RUN TestBlocksStoreQuerier_Select === RUN TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(single_returned_series) === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series_(single_returned_series) === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt === RUN TestBlocksStoreQuerier_Select/no_block_in_the_storage_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Select/error_while_getting_clients_to_query_the_store-gateway === RUN TestBlocksStoreQuerier_Select/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return === RUN TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_greater_then_the_number_of_chunks_fetched === RUN TestBlocksStoreQuerier_Select/max_series_per_query_limit_hit_while_fetching_chunks === RUN TestBlocksStoreQuerier_Select/all_blocks_are_queried_if_shards_don't_match === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts === RUN TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt_-_global_limit === RUN TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts_-_global === RUN TestBlocksStoreQuerier_Select/max_chunk_bytes_per_query_limit_hit_while_fetching_chunks === RUN TestBlocksStoreQuerier_Select/blocks_with_non-matching_shard_are_filtered_out === RUN TestBlocksStoreQuerier_Select/error_while_finding_blocks_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(multiple_returned_series) --- PASS: TestBlocksStoreQuerier_Select (0.87s) --- PASS: TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(single_returned_series) (0.06s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series_(single_returned_series) (0.04s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) (0.06s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts (0.10s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt (0.02s) --- PASS: TestBlocksStoreQuerier_Select/no_block_in_the_storage_matching_the_query_time_range (0.00s) --- PASS: TestBlocksStoreQuerier_Select/error_while_getting_clients_to_query_the_store-gateway (0.00s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return (0.04s) --- PASS: TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) (0.04s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_greater_then_the_number_of_chunks_fetched (0.04s) --- PASS: TestBlocksStoreQuerier_Select/max_series_per_query_limit_hit_while_fetching_chunks (0.02s) --- PASS: TestBlocksStoreQuerier_Select/all_blocks_are_queried_if_shards_don't_match (0.05s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) (0.03s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts (0.08s) --- PASS: TestBlocksStoreQuerier_Select/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) (0.05s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_at_first_attempt_-_global_limit (0.02s) --- PASS: TestBlocksStoreQuerier_Select/max_chunks_per_query_limit_hit_while_fetching_chunks_during_subsequent_attempts_-_global (0.08s) --- PASS: TestBlocksStoreQuerier_Select/max_chunk_bytes_per_query_limit_hit_while_fetching_chunks (0.01s) --- PASS: TestBlocksStoreQuerier_Select/blocks_with_non-matching_shard_are_filtered_out (0.05s) --- PASS: TestBlocksStoreQuerier_Select/error_while_finding_blocks_matching_the_query_time_range (0.00s) --- PASS: TestBlocksStoreQuerier_Select/a_single_store-gateway_instance_holds_the_required_blocks_(multiple_returned_series) (0.06s) === RUN TestBlocksStoreQuerier_Select_cancelledContext === RUN TestBlocksStoreQuerier_Select_cancelledContext/canceled_request_on_series_stream === RUN TestBlocksStoreQuerier_Select_cancelledContext/canceled_request_on_receiving_series_stream --- PASS: TestBlocksStoreQuerier_Select_cancelledContext (0.00s) --- PASS: TestBlocksStoreQuerier_Select_cancelledContext/canceled_request_on_series_stream (0.00s) --- PASS: TestBlocksStoreQuerier_Select_cancelledContext/canceled_request_on_receiving_series_stream (0.00s) === RUN TestBlocksStoreQuerier_Labels === RUN TestBlocksStoreQuerier_Labels/no_block_in_the_storage_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Labels/error_while_finding_blocks_matching_the_query_time_range === RUN TestBlocksStoreQuerier_Labels/error_while_getting_clients_to_query_the_store-gateway === RUN TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_holds_the_required_blocks === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) === RUN TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) === RUN TestBlocksStoreQuerier_Labels/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return === RUN TestBlocksStoreQuerier_Labels/canceled_request === RUN TestBlocksStoreQuerier_Labels/canceled_request/LabelNames === RUN TestBlocksStoreQuerier_Labels/canceled_request/LabelValues --- PASS: TestBlocksStoreQuerier_Labels (0.11s) --- PASS: TestBlocksStoreQuerier_Labels/no_block_in_the_storage_matching_the_query_time_range (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/error_while_finding_blocks_matching_the_query_time_range (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/error_while_getting_clients_to_query_the_store-gateway (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_holds_the_required_blocks (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(multiple_returned_series) (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/a_single_store-gateway_instance_has_some_missing_blocks_(consistency_check_failed) (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_(consistency_check_failed) (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_have_some_missing_blocks_but_queried_from_a_replica_during_subsequent_attempts (0.01s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_without_overlapping_series (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateway_instances_holds_the_required_blocks_with_overlapping_series_(single_returned_series) (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/multiple_store-gateways_have_the_block,_but_one_of_them_fails_to_return (0.02s) --- PASS: TestBlocksStoreQuerier_Labels/canceled_request (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/canceled_request/LabelNames (0.00s) --- PASS: TestBlocksStoreQuerier_Labels/canceled_request/LabelValues (0.00s) === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_disabled === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_enabled_but_query_max_time_is_older === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_manipulate_query_time_range_if_queryStoreAfter_is_enabled_and_query_max_time_is_recent === RUN TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_skip_the_query_if_the_query_min_time_is_more_recent_than_queryStoreAfter --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_disabled (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_not_manipulate_query_time_range_if_queryStoreAfter_is_enabled_but_query_max_time_is_older (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_manipulate_query_time_range_if_queryStoreAfter_is_enabled_and_query_max_time_is_recent (0.00s) --- PASS: TestBlocksStoreQuerier_SelectSortedShouldHonorQueryStoreAfter/should_skip_the_query_if_the_query_min_time_is_more_recent_than_queryStoreAfter (0.00s) === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_disabled === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_but_query_fits_within === RUN TestBlocksStoreQuerier_MaxLabelsQueryRange/should_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_and_query_overlaps --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange (0.02s) --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_disabled (0.01s) --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange/should_not_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_but_query_fits_within (0.00s) --- PASS: TestBlocksStoreQuerier_MaxLabelsQueryRange/should_manipulate_query_time_range_if_maxLabelsQueryLength_is_enabled_and_query_overlaps (0.00s) === RUN TestBlocksStoreQuerier_PromQLExecution === RUN TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_chunks_in_the_right_order === RUN TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_out-of-order_chunks --- PASS: TestBlocksStoreQuerier_PromQLExecution (0.10s) --- PASS: TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_chunks_in_the_right_order (0.05s) --- PASS: TestBlocksStoreQuerier_PromQLExecution/should_query_metrics_with_out-of-order_chunks (0.05s) === RUN TestCanBlockWithCompactorShardIdContainQueryShard --- PASS: TestCanBlockWithCompactorShardIdContainQueryShard (35.45s) === RUN TestFilterBlocksByShard === RUN TestFilterBlocksByShard/non-divisible_number_of_shards_(less_than_compactor_shards) === RUN TestFilterBlocksByShard/non-divisible_number_of_shards_(higher_than_compactor_shards) === RUN TestFilterBlocksByShard/equal_number_of_query_shards === RUN TestFilterBlocksByShard/less_query_shards_than_compactor_shards_1 === RUN TestFilterBlocksByShard/double_the_equal_number_of_query_shards_1 === RUN TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2_(2nd_test) === RUN TestFilterBlocksByShard/less_query_shards_than_compactor_shards_2 === RUN TestFilterBlocksByShard/double_the_equal_number_of_query_shards_2 === RUN TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2 --- PASS: TestFilterBlocksByShard (0.02s) --- PASS: TestFilterBlocksByShard/non-divisible_number_of_shards_(less_than_compactor_shards) (0.00s) --- PASS: TestFilterBlocksByShard/non-divisible_number_of_shards_(higher_than_compactor_shards) (0.00s) --- PASS: TestFilterBlocksByShard/equal_number_of_query_shards (0.00s) --- PASS: TestFilterBlocksByShard/less_query_shards_than_compactor_shards_1 (0.00s) --- PASS: TestFilterBlocksByShard/double_the_equal_number_of_query_shards_1 (0.00s) --- PASS: TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2_(2nd_test) (0.00s) --- PASS: TestFilterBlocksByShard/less_query_shards_than_compactor_shards_2 (0.00s) --- PASS: TestFilterBlocksByShard/double_the_equal_number_of_query_shards_2 (0.00s) --- PASS: TestFilterBlocksByShard/query_shard_using_shard_count_which_isn't_power_of_2 (0.00s) === RUN TestBlocksStoreQueryableErrMsgs === RUN TestBlocksStoreQueryableErrMsgs/newStoreConsistencyCheckFailedError --- PASS: TestBlocksStoreQueryableErrMsgs (0.00s) --- PASS: TestBlocksStoreQueryableErrMsgs/newStoreConsistencyCheckFailedError (0.00s) === RUN TestBlocksStoreReplicationSet_GetClientsFor === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded === RUN TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 === PAUSE TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded === CONT TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available --- PASS: TestBlocksStoreReplicationSet_GetClientsFor (0.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_single_instance_in_the_ring_with_RF_=_2 (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_multiple_instances_in_the_ring_with_RF_=_1 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1_but_excluded (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1,_but_store-gateway_excluded (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_are_JOINING,_the_requested_block_+_its_replicas_only_belongs_to_JOINING_instances (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_4,_multiple_instances_in_the_ring_with_RF_=_1 (2.01s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_shuffle_sharding,_multiple_instances_in_the_ring_with_RF_=_1 (1.03s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_multiple_requested_blocks_belonging_to_the_same_store-gateway_and_RF_=_2 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_SS_=_2_with_excluded_blocks_and_no_replacement_available (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_1,_single_instance_in_the_ring_with_RF_=_1 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_1 (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1 (1.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_multiple_instances_in_the_ring_with_each_requested_block_belonging_to_a_different_store-gateway_and_RF_=_2_and_some_blocks_excluded_but_with_replacement_available (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded_for_non_queried_block (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_2 (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_0,_single_instance_in_the_ring_with_RF_=_1_but_excluded (2.00s) --- PASS: TestBlocksStoreReplicationSet_GetClientsFor/shard_size_2,_multiple_instances_in_the_ring_with_RF_=_2,_with_excluded_blocks_but_some_replacement_available (2.00s) === RUN TestBlocksStoreReplicationSet_GetClientsFor_ShouldSupportRandomLoadBalancingStrategy --- PASS: TestBlocksStoreReplicationSet_GetClientsFor_ShouldSupportRandomLoadBalancingStrategy (2.00s) === RUN TestLabelNamesCardinalityHandler --- PASS: TestLabelNamesCardinalityHandler (0.00s) === RUN TestLabelNamesCardinalityHandler_MatchersTest === RUN TestLabelNamesCardinalityHandler_MatchersTest/expected_selector_to_be_parsed === RUN TestLabelNamesCardinalityHandler_MatchersTest/expected_no_error_if_selector_is_missed === RUN TestLabelNamesCardinalityHandler_MatchersTest/selector_with_metric_name_to_be_parse === RUN TestLabelNamesCardinalityHandler_MatchersTest/selector_with_two_matchers_to_be_parse --- PASS: TestLabelNamesCardinalityHandler_MatchersTest (0.01s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/expected_selector_to_be_parsed (0.00s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/expected_no_error_if_selector_is_missed (0.00s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/selector_with_metric_name_to_be_parse (0.00s) --- PASS: TestLabelNamesCardinalityHandler_MatchersTest/selector_with_two_matchers_to_be_parse (0.00s) === RUN TestLabelNamesCardinalityHandler_LimitTest === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_10_labels_in_response_if_limit_param_is_10 === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_default_limit_20_to_be_applied_if_limit_param_is_not_defined === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_all_items_in_response_if_limit_param_is_greater_than_count_of_items === RUN TestLabelNamesCardinalityHandler_LimitTest/expected_empty_items_list_in_response_if_limit_param_is_0 --- PASS: TestLabelNamesCardinalityHandler_LimitTest (0.01s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_10_labels_in_response_if_limit_param_is_10 (0.01s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_default_limit_20_to_be_applied_if_limit_param_is_not_defined (0.00s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_all_items_in_response_if_limit_param_is_greater_than_count_of_items (0.00s) --- PASS: TestLabelNamesCardinalityHandler_LimitTest/expected_empty_items_list_in_response_if_limit_param_is_0 (0.00s) === RUN TestLabelNamesCardinalityHandler_DistributorError === RUN TestLabelNamesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error === RUN TestLabelNamesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor --- PASS: TestLabelNamesCardinalityHandler_DistributorError (0.00s) --- PASS: TestLabelNamesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error (0.00s) --- PASS: TestLabelNamesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor (0.00s) === RUN TestLabelNamesCardinalityHandler_NegativeTests === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative#01 === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_tenantId_is_not_defined === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_multiple_limits_are_sent === RUN TestLabelNamesCardinalityHandler_NegativeTests/expected_error_that_cardinality_analysis_feature_is_disabled --- PASS: TestLabelNamesCardinalityHandler_NegativeTests (0.01s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_`limit`_param_is_negative#01 (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_tenantId_is_not_defined (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_if_multiple_limits_are_sent (0.00s) --- PASS: TestLabelNamesCardinalityHandler_NegativeTests/expected_error_that_cardinality_analysis_feature_is_disabled (0.00s) === RUN TestLabelValuesCardinalityHandler_Success === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order === RUN TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count === RUN TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count --- PASS: TestLabelValuesCardinalityHandler_Success (0.04s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_series_count_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_sorted_by_label_name_in_ascending_order_for_label_values_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_all_the_label_values_cardinality_array_if_the_number_of_label_values_is_equal_to_the_specified_limit (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_array_limited_by_the_limit_param (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_name_with_matching_selector (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_descending_order (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/GET_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count (0.00s) --- PASS: TestLabelValuesCardinalityHandler_Success/POST_request_should_return_the_label_values_cardinality_for_the_specified_label_names_in_ascending_order_for_label_names_with_the_same_series_count (0.00s) === RUN TestLabelValuesCardinalityHandler_FeatureFlag === RUN TestLabelValuesCardinalityHandler_FeatureFlag/should_return_an_error_if_the_cardinality_analysis_feature_is_disabled_by_default === RUN TestLabelValuesCardinalityHandler_FeatureFlag/should_succeed_if_the_cardinality_analysis_feature_is_enabled_by_default --- PASS: TestLabelValuesCardinalityHandler_FeatureFlag (0.00s) --- PASS: TestLabelValuesCardinalityHandler_FeatureFlag/should_return_an_error_if_the_cardinality_analysis_feature_is_disabled_by_default (0.00s) --- PASS: TestLabelValuesCardinalityHandler_FeatureFlag/should_succeed_if_the_cardinality_analysis_feature_is_enabled_by_default (0.00s) === RUN TestLabelValuesCardinalityHandler_ParseError === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_no_tenant_id_is_provided === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_ === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_a_negative_number === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_exceeds_the_maximum_limit_parameter === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_empty === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_invalid === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/multiple_selector_params_are_provided === RUN TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_not_a_number --- PASS: TestLabelValuesCardinalityHandler_ParseError (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_no_tenant_id_is_provided (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_ (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_a_negative_number (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_exceeds_the_maximum_limit_parameter (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_empty (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/label_names_param_is_invalid (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/multiple_selector_params_are_provided (0.00s) --- PASS: TestLabelValuesCardinalityHandler_ParseError/should_return_bad_request_if_/limit_param_is_not_a_number (0.00s) === RUN TestLabelValuesCardinalityHandler_DistributorError === RUN TestLabelValuesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor === RUN TestLabelValuesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error --- PASS: TestLabelValuesCardinalityHandler_DistributorError (0.00s) --- PASS: TestLabelValuesCardinalityHandler_DistributorError/should_return_an_HTTP_response_with_status_code_and_response_body_of_the_httpgrpc_error_returned_by_the_distributor (0.00s) --- PASS: TestLabelValuesCardinalityHandler_DistributorError/should_return_internal_server_error_if_the_distributor_returns_a_non_httpgrpc_error (0.00s) === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_disabled === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_but_query_min_time_is_newer === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_min_time_is_older === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_skip_the_query_if_the_query_max_time_is_older_than_queryIngestersWithin === RUN TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_max_time_is_older,_but_the_query_is_for_/series --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin (0.01s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_disabled (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_not_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_but_query_min_time_is_newer (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_min_time_is_older (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_skip_the_query_if_the_query_max_time_is_older_than_queryIngestersWithin (0.00s) --- PASS: TestDistributorQuerier_SelectShouldHonorQueryIngestersWithin/should_manipulate_query_time_range_if_queryIngestersWithin_is_enabled_and_query_max_time_is_older,_but_the_query_is_for_/series (0.00s) === RUN TestDistributorQueryableFilter --- PASS: TestDistributorQueryableFilter (0.00s) === RUN TestIngesterStreaming --- PASS: TestIngesterStreaming (0.00s) === RUN TestIngesterStreamingMixedResults --- PASS: TestIngesterStreamingMixedResults (0.00s) === RUN TestDistributorQuerier_LabelNames === RUN TestDistributorQuerier_LabelNames/with_matchers === RUN TestDistributorQuerier_LabelNames/with_matchers/queryLabelNamesWithMatchers=true --- PASS: TestDistributorQuerier_LabelNames (0.00s) --- PASS: TestDistributorQuerier_LabelNames/with_matchers (0.00s) --- PASS: TestDistributorQuerier_LabelNames/with_matchers/queryLabelNamesWithMatchers=true (0.00s) === RUN TestDuplicatesSamples --- PASS: TestDuplicatesSamples (0.01s) === RUN TestApiStatusCodes === RUN TestApiStatusCodes/error_from_queryable/0 === RUN TestApiStatusCodes/error_from_querier/0 === RUN TestApiStatusCodes/error_from_seriesset/0 === RUN TestApiStatusCodes/error_from_queryable/1 === RUN TestApiStatusCodes/error_from_querier/1 === RUN TestApiStatusCodes/error_from_seriesset/1 === RUN TestApiStatusCodes/error_from_querier/2 === RUN TestApiStatusCodes/error_from_seriesset/2 === RUN TestApiStatusCodes/error_from_queryable/2 === RUN TestApiStatusCodes/error_from_queryable/3 === RUN TestApiStatusCodes/error_from_querier/3 === RUN TestApiStatusCodes/error_from_seriesset/3 === RUN TestApiStatusCodes/error_from_queryable/4 === RUN TestApiStatusCodes/error_from_querier/4 === RUN TestApiStatusCodes/error_from_seriesset/4 === RUN TestApiStatusCodes/error_from_queryable/5 === RUN TestApiStatusCodes/error_from_querier/5 === RUN TestApiStatusCodes/error_from_seriesset/5 === RUN TestApiStatusCodes/error_from_queryable/6 === RUN TestApiStatusCodes/error_from_querier/6 === RUN TestApiStatusCodes/error_from_seriesset/6 === RUN TestApiStatusCodes/error_from_queryable/7 === RUN TestApiStatusCodes/error_from_querier/7 === RUN TestApiStatusCodes/error_from_seriesset/7 === RUN TestApiStatusCodes/error_from_queryable/8 === RUN TestApiStatusCodes/error_from_querier/8 === RUN TestApiStatusCodes/error_from_seriesset/8 === RUN TestApiStatusCodes/error_from_queryable/9 === RUN TestApiStatusCodes/error_from_querier/9 === RUN TestApiStatusCodes/error_from_seriesset/9 === RUN TestApiStatusCodes/error_from_querier/10 === RUN TestApiStatusCodes/error_from_seriesset/10 === RUN TestApiStatusCodes/error_from_queryable/10 --- PASS: TestApiStatusCodes (0.14s) --- PASS: TestApiStatusCodes/error_from_queryable/0 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/0 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/0 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/1 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/1 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/1 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/2 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/2 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/2 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/3 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/3 (0.01s) --- PASS: TestApiStatusCodes/error_from_seriesset/3 (0.01s) --- PASS: TestApiStatusCodes/error_from_queryable/4 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/4 (0.01s) --- PASS: TestApiStatusCodes/error_from_seriesset/4 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/5 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/5 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/5 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/6 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/6 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/6 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/7 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/7 (0.01s) --- PASS: TestApiStatusCodes/error_from_seriesset/7 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/8 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/8 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/8 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/9 (0.00s) --- PASS: TestApiStatusCodes/error_from_querier/9 (0.00s) --- PASS: TestApiStatusCodes/error_from_seriesset/9 (0.01s) --- PASS: TestApiStatusCodes/error_from_querier/10 (0.01s) --- PASS: TestApiStatusCodes/error_from_seriesset/10 (0.00s) --- PASS: TestApiStatusCodes/error_from_queryable/10 (0.00s) === RUN TestMetadataHandler_Success --- PASS: TestMetadataHandler_Success (0.00s) === RUN TestMetadataHandler_Error --- PASS: TestMetadataHandler_Error (0.00s) === RUN TestPartitionChunksOutputIsSortedByLabels --- PASS: TestPartitionChunksOutputIsSortedByLabels (1.13s) === RUN TestQuerier === RUN TestQuerier/rate(foo[1m])/iterators=false === RUN TestQuerier/rate(foo[1m])/iterators=true === RUN TestQuerier/foo/iterators=false === RUN TestQuerier/foo/iterators=true === RUN TestQuerier/rate(foo[1m])/iterators=false#01 === RUN TestQuerier/rate(foo[1m])/iterators=true#01 === RUN TestQuerier/foo/iterators=false#01 === RUN TestQuerier/foo/iterators=true#01 --- PASS: TestQuerier (0.73s) --- PASS: TestQuerier/rate(foo[1m])/iterators=false (0.06s) --- PASS: TestQuerier/rate(foo[1m])/iterators=true (0.06s) --- PASS: TestQuerier/foo/iterators=false (0.05s) --- PASS: TestQuerier/foo/iterators=true (0.06s) --- PASS: TestQuerier/rate(foo[1m])/iterators=false#01 (0.02s) --- PASS: TestQuerier/rate(foo[1m])/iterators=true#01 (0.02s) --- PASS: TestQuerier/foo/iterators=false#01 (0.02s) --- PASS: TestQuerier/foo/iterators=true#01 (0.02s) === RUN TestQuerier_QueryableReturnsChunksOutsideQueriedRange --- PASS: TestQuerier_QueryableReturnsChunksOutsideQueriedRange (0.01s) === RUN TestQuerier_QueryIngestersWithinConfig === RUN TestQuerier_QueryIngestersWithinConfig/hit-test1 === RUN TestQuerier_QueryIngestersWithinConfig/hit-test2 === RUN TestQuerier_QueryIngestersWithinConfig/hit-test2#01 === RUN TestQuerier_QueryIngestersWithinConfig/dont-hit-test1 === RUN TestQuerier_QueryIngestersWithinConfig/dont-hit-test2 --- PASS: TestQuerier_QueryIngestersWithinConfig (0.03s) --- PASS: TestQuerier_QueryIngestersWithinConfig/hit-test1 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/hit-test2 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/hit-test2#01 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/dont-hit-test1 (0.00s) --- PASS: TestQuerier_QueryIngestersWithinConfig/dont-hit-test2 (0.00s) === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_manipulate_query_if_end_time_is_after_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_far_in_the_future_but_limit_is_disabled === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_in_the_future_but_below_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_skip_executing_a_query_outside_the_allowed_time_range --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture (0.03s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_manipulate_query_if_end_time_is_after_the_limit (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_far_in_the_future_but_limit_is_disabled (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_not_manipulate_query_if_end_time_is_in_the_future_but_below_the_limit (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryIntoFuture/should_skip_executing_a_query_outside_the_allowed_time_range (0.00s) === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_short_time_range_and_rate_time_window_close_to_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_short_time_range_and_rate_time_window_over_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_large_time_range_over_the_limit_and_short_rate_time_window --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength (0.07s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_short_time_range_and_rate_time_window_close_to_the_limit (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_allow_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window (0.04s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_short_time_range_and_rate_time_window_over_the_limit (0.02s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLength/should_forbid_query_on_large_time_range_over_the_limit_and_short_rate_time_window (0.01s) === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_values === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/query_range === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/series === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_names === RUN TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_values --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback (0.10s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window (0.02s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/query_range (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_a_query_on_large_time_range_close_to_the_limit_and_short_rate_time_window/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit (0.02s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_short_time_range_and_rate_time_window_over_the_limit/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window (0.03s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/query_range (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_manipulate_a_query_on_large_time_range_over_the_limit_and_short_rate_time_window/label_values (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_skip_executing_a_query_outside_the_allowed_time_range/label_values (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit (0.01s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/query_range (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/series (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_names (0.00s) --- PASS: TestQuerier_ValidateQueryTimeRange_MaxQueryLookback/should_not_manipulate_time_range_for_a_query_on_short_time_range_and_rate_time_window_close_to_the_limit/label_values (0.00s) === RUN TestQuerier_MaxLabelsQueryRange === RUN TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit === RUN TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit/series --- PASS: TestQuerier_MaxLabelsQueryRange (0.00s) --- PASS: TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit (0.00s) --- PASS: TestQuerier_MaxLabelsQueryRange/should_manipulate_series_query_on_large_time_range_over_the_limit/series (0.00s) === RUN TestQuerier_QueryStoreAfterConfig === RUN TestQuerier_QueryStoreAfterConfig/hit_only_ingester === RUN TestQuerier_QueryStoreAfterConfig/hit_both === RUN TestQuerier_QueryStoreAfterConfig/hit_only_storage --- PASS: TestQuerier_QueryStoreAfterConfig (0.11s) --- PASS: TestQuerier_QueryStoreAfterConfig/hit_only_ingester (0.03s) --- PASS: TestQuerier_QueryStoreAfterConfig/hit_both (0.04s) --- PASS: TestQuerier_QueryStoreAfterConfig/hit_only_storage (0.04s) === RUN TestUseAlwaysQueryable --- PASS: TestUseAlwaysQueryable (0.00s) === RUN TestUseBeforeTimestamp --- PASS: TestUseBeforeTimestamp (0.00s) === RUN TestStoreQueryable --- PASS: TestStoreQueryable (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_with_default_config === RUN TestConfig_Validate/should_pass_if_'query_store_after'_is_enabled_and_shuffle-sharding_is_disabled === RUN TestConfig_Validate/should_pass_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_<_'query_ingesters_within' === RUN TestConfig_Validate/should_fail_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_>_'query_ingesters_within' --- PASS: TestConfig_Validate (0.00s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestConfig_Validate/should_pass_if_'query_store_after'_is_enabled_and_shuffle-sharding_is_disabled (0.00s) --- PASS: TestConfig_Validate/should_pass_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_<_'query_ingesters_within' (0.00s) --- PASS: TestConfig_Validate/should_fail_if_both_'query_store_after'_and_'query_ingesters_within'_are_set_and_'query_store_after'_>_'query_ingesters_within' (0.00s) === RUN TestSampledRemoteRead --- PASS: TestSampledRemoteRead (0.00s) === RUN TestStreamedRemoteRead === RUN TestStreamedRemoteRead/with_120_samples,_we_expect_1_frame_with_1_chunk === RUN TestStreamedRemoteRead/with_121_samples,_we_expect_1_frame_with_2_chunks === RUN TestStreamedRemoteRead/with_241_samples,_we_expect_1_frame_with_2_chunks,_and_1_frame_with_1_chunk_due_to_frame_limit --- PASS: TestStreamedRemoteRead (0.00s) --- PASS: TestStreamedRemoteRead/with_120_samples,_we_expect_1_frame_with_1_chunk (0.00s) --- PASS: TestStreamedRemoteRead/with_121_samples,_we_expect_1_frame_with_2_chunks (0.00s) --- PASS: TestStreamedRemoteRead/with_241_samples,_we_expect_1_frame_with_2_chunks,_and_1_frame_with_1_chunk_due_to_frame_limit (0.00s) === RUN Test_newStoreGatewayClientFactory --- PASS: Test_newStoreGatewayClientFactory (0.04s) === RUN TestTimeSeriesSeriesSet --- PASS: TestTimeSeriesSeriesSet (0.00s) === RUN TestTimeSeriesIterator --- PASS: TestTimeSeriesIterator (0.00s) === CONT TestBlockQuerierSeries === RUN TestBlockQuerierSeries/empty_series === RUN TestBlockQuerierSeries/should_return_series_on_success === RUN TestBlockQuerierSeries/should_return_error_on_failure_while_reading_encoded_chunk_data --- PASS: TestBlockQuerierSeries (0.00s) --- PASS: TestBlockQuerierSeries/empty_series (0.00s) --- PASS: TestBlockQuerierSeries/should_return_series_on_success (0.00s) --- PASS: TestBlockQuerierSeries/should_return_error_on_failure_while_reading_encoded_chunk_data (0.00s) PASS ok github.com/grafana/mimir/pkg/querier 84.573s === RUN TestSeekCorrectlyDealWithSinglePointChunks --- PASS: TestSeekCorrectlyDealWithSinglePointChunks (0.00s) === RUN TestChunkIter --- PASS: TestChunkIter (0.01s) === RUN TestSeek --- PASS: TestSeek (0.00s) === RUN TestMergeIter --- PASS: TestMergeIter (0.03s) === RUN TestMergeHarder --- PASS: TestMergeHarder (2.56s) === RUN TestNonOverlappingIter --- PASS: TestNonOverlappingIter (0.12s) === RUN TestNonOverlappingIterSparse --- PASS: TestNonOverlappingIterSparse (0.01s) === RUN TestStream === RUN TestStream/0 === RUN TestStream/1 === RUN TestStream/2 === RUN TestStream/3 === RUN TestStream/4 --- PASS: TestStream (0.00s) --- PASS: TestStream/0 (0.00s) --- PASS: TestStream/1 (0.00s) --- PASS: TestStream/2 (0.00s) --- PASS: TestStream/3 (0.00s) --- PASS: TestStream/4 (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/batch 2.803s === RUN TestQueryTrackerUnlimitedMaxConcurrency --- PASS: TestQueryTrackerUnlimitedMaxConcurrency (0.00s) === RUN TestQueryTrackerWithNilActivityTrackerInsertDoesntAllocate --- PASS: TestQueryTrackerWithNilActivityTrackerInsertDoesntAllocate (0.01s) === RUN TestActivityDescription --- PASS: TestActivityDescription (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/engine 0.228s === RUN TestChunkMergeIterator === RUN TestChunkMergeIterator/0 === RUN TestChunkMergeIterator/1 === RUN TestChunkMergeIterator/2 === RUN TestChunkMergeIterator/3 --- PASS: TestChunkMergeIterator (0.04s) --- PASS: TestChunkMergeIterator/0 (0.00s) --- PASS: TestChunkMergeIterator/1 (0.00s) --- PASS: TestChunkMergeIterator/2 (0.00s) --- PASS: TestChunkMergeIterator/3 (0.00s) === RUN TestChunkMergeIteratorSeek --- PASS: TestChunkMergeIteratorSeek (0.01s) PASS ok github.com/grafana/mimir/pkg/querier/iterators 0.130s === RUN TestStats_WallTime === RUN TestStats_WallTime/add_and_load_wall_time === RUN TestStats_WallTime/add_and_load_wall_time_nil_receiver --- PASS: TestStats_WallTime (0.00s) --- PASS: TestStats_WallTime/add_and_load_wall_time (0.00s) --- PASS: TestStats_WallTime/add_and_load_wall_time_nil_receiver (0.00s) === RUN TestStats_AddFetchedSeries === RUN TestStats_AddFetchedSeries/add_and_load_series === RUN TestStats_AddFetchedSeries/add_and_load_series_nil_receiver --- PASS: TestStats_AddFetchedSeries (0.00s) --- PASS: TestStats_AddFetchedSeries/add_and_load_series (0.00s) --- PASS: TestStats_AddFetchedSeries/add_and_load_series_nil_receiver (0.00s) === RUN TestStats_AddFetchedChunkBytes === RUN TestStats_AddFetchedChunkBytes/add_and_load_bytes === RUN TestStats_AddFetchedChunkBytes/add_and_load_bytes_nil_receiver --- PASS: TestStats_AddFetchedChunkBytes (0.00s) --- PASS: TestStats_AddFetchedChunkBytes/add_and_load_bytes (0.00s) --- PASS: TestStats_AddFetchedChunkBytes/add_and_load_bytes_nil_receiver (0.00s) === RUN TestStats_AddFetchedChunks === RUN TestStats_AddFetchedChunks/add_and_load_chunks === RUN TestStats_AddFetchedChunks/add_and_load_chunks_nil_receiver --- PASS: TestStats_AddFetchedChunks (0.01s) --- PASS: TestStats_AddFetchedChunks/add_and_load_chunks (0.00s) --- PASS: TestStats_AddFetchedChunks/add_and_load_chunks_nil_receiver (0.00s) === RUN TestStats_AddShardedQueries === RUN TestStats_AddShardedQueries/add_and_load_sharded_queries === RUN TestStats_AddShardedQueries/add_and_load_sharded_queries_nil_receiver --- PASS: TestStats_AddShardedQueries (0.00s) --- PASS: TestStats_AddShardedQueries/add_and_load_sharded_queries (0.00s) --- PASS: TestStats_AddShardedQueries/add_and_load_sharded_queries_nil_receiver (0.00s) === RUN TestStats_AddSplitQueries === RUN TestStats_AddSplitQueries/add_and_load_split_queries === RUN TestStats_AddSplitQueries/add_and_load_split_queries_nil_receiver --- PASS: TestStats_AddSplitQueries (0.00s) --- PASS: TestStats_AddSplitQueries/add_and_load_split_queries (0.00s) --- PASS: TestStats_AddSplitQueries/add_and_load_split_queries_nil_receiver (0.00s) === RUN TestStats_Merge === RUN TestStats_Merge/merge_two_stats_objects === RUN TestStats_Merge/merge_two_nil_stats_objects --- PASS: TestStats_Merge (0.00s) --- PASS: TestStats_Merge/merge_two_stats_objects (0.00s) --- PASS: TestStats_Merge/merge_two_nil_stats_objects (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/stats 0.184s === RUN TestMergeExemplarQueryable_ExemplarQuerier === RUN TestMergeExemplarQueryable_ExemplarQuerier/error_getting_tenant_IDs === RUN TestMergeExemplarQueryable_ExemplarQuerier/error_getting_upstream_querier === RUN TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_bypass_single_querier_happy_path === RUN TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_federated_happy_path === RUN TestMergeExemplarQueryable_ExemplarQuerier/multi_tenant_federated_happy_path --- PASS: TestMergeExemplarQueryable_ExemplarQuerier (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/error_getting_tenant_IDs (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/error_getting_upstream_querier (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_bypass_single_querier_happy_path (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/single_tenant_federated_happy_path (0.00s) --- PASS: TestMergeExemplarQueryable_ExemplarQuerier/multi_tenant_federated_happy_path (0.00s) === RUN TestMergeExemplarQuerier_Select === RUN TestMergeExemplarQuerier_Select/two_tenants_one_filtered === RUN TestMergeExemplarQuerier_Select/two_tenants_no_filtering === RUN TestMergeExemplarQuerier_Select/two_tenants_two_groups_of_matchers_filtering === RUN TestMergeExemplarQuerier_Select/no_matchers_to_filter === RUN TestMergeExemplarQuerier_Select/upstream_error --- PASS: TestMergeExemplarQuerier_Select (0.00s) --- PASS: TestMergeExemplarQuerier_Select/two_tenants_one_filtered (0.00s) --- PASS: TestMergeExemplarQuerier_Select/two_tenants_no_filtering (0.00s) --- PASS: TestMergeExemplarQuerier_Select/two_tenants_two_groups_of_matchers_filtering (0.00s) --- PASS: TestMergeExemplarQuerier_Select/no_matchers_to_filter (0.00s) --- PASS: TestMergeExemplarQuerier_Select/upstream_error (0.00s) === RUN TestMergeMetadataSupplier_MetricsMetadata === RUN TestMergeMetadataSupplier_MetricsMetadata/invalid_tenant_IDs === RUN TestMergeMetadataSupplier_MetricsMetadata/single_tenant_bypass logger.go:22: user team-a method mergeMetadataSupplier.MetricsMetadata level debug msg only a single tenant, bypassing federated metadata supplier === RUN TestMergeMetadataSupplier_MetricsMetadata/multiple_tenants_no_duplicates logger.go:22: method mergeMetadataSupplier.MetricsMetadata level debug msg adding results for tenant to merged results user team-a results 1 logger.go:22: method mergeMetadataSupplier.MetricsMetadata level debug msg adding results for tenant to merged results user team-b results 1 === RUN TestMergeMetadataSupplier_MetricsMetadata/multiple_tenants_with_duplicates logger.go:22: method mergeMetadataSupplier.MetricsMetadata level debug msg adding results for tenant to merged results user team-a results 1 logger.go:22: method mergeMetadataSupplier.MetricsMetadata level debug msg adding results for tenant to merged results user team-b results 2 --- PASS: TestMergeMetadataSupplier_MetricsMetadata (0.00s) --- PASS: TestMergeMetadataSupplier_MetricsMetadata/invalid_tenant_IDs (0.00s) --- PASS: TestMergeMetadataSupplier_MetricsMetadata/single_tenant_bypass (0.00s) --- PASS: TestMergeMetadataSupplier_MetricsMetadata/multiple_tenants_no_duplicates (0.00s) --- PASS: TestMergeMetadataSupplier_MetricsMetadata/multiple_tenants_with_duplicates (0.00s) === RUN TestMergeQueryable_Querier === RUN TestMergeQueryable_Querier/querying_without_a_tenant_specified_should_error --- PASS: TestMergeQueryable_Querier (0.00s) --- PASS: TestMergeQueryable_Querier/querying_without_a_tenant_specified_should_error (0.00s) === RUN TestMergeQueryable_Select === RUN TestMergeQueryable_Select/three_tenants === RUN TestMergeQueryable_Select/three_tenants/should_return_all_series_when_no_matchers_are_provided === RUN TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_the_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_the_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants/should_return_one_series_for_each_tenant_when_there_is_an_equals_matcher_for_the_host1_instance === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_no_matchers_are_provided === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_with_not-equals_matcher_for_the_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_where_there_are_conflicting_tenant_matchers === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_an_equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_a_regexp_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label === RUN TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_when_there_is_a_not-equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label === RUN TestMergeQueryable_Select/three_tenants,_two_with_warnings === RUN TestMergeQueryable_Select/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables === RUN TestMergeQueryable_Select/three_tenants,_one_erroring === RUN TestMergeQueryable_Select/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant --- PASS: TestMergeQueryable_Select (0.01s) --- PASS: TestMergeQueryable_Select/three_tenants (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_all_series_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_the_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_the_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants/should_return_one_series_for_each_tenant_when_there_is_an_equals_matcher_for_the_host1_instance (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set (0.01s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-a_and_team-c_tenants_when_there_is_with_not-equals_matcher_for_the_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_where_there_are_conflicting_tenant_matchers (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_only_series_for_team-b_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_an_equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_all_series_when_there_is_a_regexp_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants_and_the___tenant_id___label_set/should_return_no_series_when_there_is_a_not-equals_matcher_for_the_original_value_of___tenant_id___using_the_revised_tenant_label (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_two_with_warnings (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_one_erroring (0.00s) --- PASS: TestMergeQueryable_Select/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant (0.00s) === RUN TestMergeQueryable_LabelNames === RUN TestMergeQueryable_LabelNames/single_tenant === RUN TestMergeQueryable_LabelNames/single_tenant/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed === RUN TestMergeQueryable_LabelNames/single_tenant#01 === RUN TestMergeQueryable_LabelNames/single_tenant#01/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed_with_matchers === RUN TestMergeQueryable_LabelNames/single_tenant_without_bypass === RUN TestMergeQueryable_LabelNames/single_tenant_without_bypass/should_return_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed === RUN TestMergeQueryable_LabelNames/three_tenants === RUN TestMergeQueryable_LabelNames/three_tenants/should_return_the___tenant_id___label_and_all_tenant_team_labels === RUN TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set === RUN TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set/should_return__the___tenant_id___label_and_all_tenant_team_labels,_and_the___original_tenant_id___label === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables === RUN TestMergeQueryable_LabelNames/three_tenants,_one_erroring === RUN TestMergeQueryable_LabelNames/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01/should_propagate_non-tenant_matchers_to_downstream_queriers === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03/should_only_query_tenant-b_and_tenant-c_when_there_is_an_regex_matcher_for_team-b|team-c_tenant === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04 === RUN TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04/only_tenant-b_is_selected_and_it_already_has_a_defaultTenantLabel_which_is_prepended_with_original__prefix --- PASS: TestMergeQueryable_LabelNames (0.01s) --- PASS: TestMergeQueryable_LabelNames/single_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant#01 (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant#01/should_not_return_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed_with_matchers (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant_without_bypass (0.00s) --- PASS: TestMergeQueryable_LabelNames/single_tenant_without_bypass/should_return_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants/should_return_the___tenant_id___label_and_all_tenant_team_labels (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants_and_the___tenant_id___label_set/should_return__the___tenant_id___label_and_all_tenant_team_labels,_and_the___original_tenant_id___label (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_one_erroring (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#01/should_propagate_non-tenant_matchers_to_downstream_queriers (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#02/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#03/should_only_query_tenant-b_and_tenant-c_when_there_is_an_regex_matcher_for_team-b|team-c_tenant (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04 (0.00s) --- PASS: TestMergeQueryable_LabelNames/three_tenants,_two_with_warnings#04/only_tenant-b_is_selected_and_it_already_has_a_defaultTenantLabel_which_is_prepended_with_original__prefix (0.00s) === RUN TestMergeQueryable_LabelValues === RUN TestMergeQueryable_LabelValues/single_tenant === RUN TestMergeQueryable_LabelValues/single_tenant/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/single_tenant/should_return_no_tenant_values_for_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed === RUN TestMergeQueryable_LabelValues/single_tenant_without_bypass === RUN TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_a_tenant_team_value_for_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed === RUN TestMergeQueryable_LabelValues/three_tenants === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants/should_propagate_non-tenant_matchers_to_downstream_queriers === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_no_values_for_the_instance_label_when_there_are_conflicting_tenant_matchers === RUN TestMergeQueryable_LabelValues/three_tenants/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_all_tenant_team_values_for_the___tenant_id___label_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-b_tenant_when_there_is_an_equals_matcher_for_team-b_tenant === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_label_values_for_instance_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_tenant_values_for___tenant_id___label_name === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_when_no_matchers_are_provided === RUN TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_with_matchers === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01 === RUN TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01/should_not_return_warnings_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01 === RUN TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01/should_not_return_errors_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label --- PASS: TestMergeQueryable_LabelValues (0.05s) --- PASS: TestMergeQueryable_LabelValues/single_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant/should_return_no_tenant_values_for_the___tenant_id___label_as_the_MergeQueryable_has_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant_without_bypass (0.03s) --- PASS: TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/single_tenant_without_bypass/should_return_a_tenant_team_value_for_the___tenant_id___label_as_the_MergeQueryable_has_not_been_bypassed (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_propagate_non-tenant_matchers_to_downstream_queriers (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_no_values_for_the_instance_label_when_there_are_conflicting_tenant_matchers (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_only_query_tenant-b_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_all_tenant_team_values_for_the___tenant_id___label_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-a_and_team-c_tenants_when_there_is_a_not-equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants/should_return_only_label_values_for_team-b_tenant_when_there_is_an_equals_matcher_for_team-b_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_label_values_for_instance_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_all_tenant_values_for___tenant_id___label_name (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_when_no_matchers_are_provided (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants_and_the___tenant_id___label_set/should_return_the_original_value_for_the_revised_tenant_label_name_with_matchers (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings/should_return_warnings_from_all_tenant_queryables (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01 (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_two_with_warnings#01/should_not_return_warnings_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring/should_return_any_error_encountered_with_any_tenant (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01 (0.00s) --- PASS: TestMergeQueryable_LabelValues/three_tenants,_one_erroring#01/should_not_return_errors_as_the_underlying_queryables_are_not_queried_in_requests_for_the___tenant_id___label (0.00s) === RUN TestSetLabelsRetainExisting --- PASS: TestSetLabelsRetainExisting (0.00s) === RUN TestTracingMergeQueryable --- PASS: TestTracingMergeQueryable (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/tenantfederation 0.449s === RUN TestFrontendProcessor_processQueriesOnSingleStream === RUN TestFrontendProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query === RUN TestFrontendProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled --- PASS: TestFrontendProcessor_processQueriesOnSingleStream (1.02s) --- PASS: TestFrontendProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query (0.01s) --- PASS: TestFrontendProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled (1.01s) === RUN TestRecvFailDoesntCancelProcess --- PASS: TestRecvFailDoesntCancelProcess (0.12s) === RUN TestContextCancelStopsProcess --- PASS: TestContextCancelStopsProcess (0.02s) === RUN TestSchedulerProcessor_processQueriesOnSingleStream === RUN TestSchedulerProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query === RUN TestSchedulerProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled === RUN TestSchedulerProcessor_processQueriesOnSingleStream/should_not_log_an_error_when_the_query-scheduler_is_terminates_while_waiting_for_the_next_query_to_run --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream (1.12s) --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream/should_immediately_return_if_worker_context_is_canceled_and_there's_no_inflight_query (0.00s) --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream/should_wait_until_inflight_query_execution_is_completed_before_returning_when_worker_context_is_canceled (1.11s) --- PASS: TestSchedulerProcessor_processQueriesOnSingleStream/should_not_log_an_error_when_the_query-scheduler_is_terminates_while_waiting_for_the_next_query_to_run (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_with_default_config === RUN TestConfig_Validate/should_pass_if_frontend_address_is_configured,_but_not_scheduler_address === RUN TestConfig_Validate/should_pass_if_scheduler_address_is_configured,_but_not_frontend_address === RUN TestConfig_Validate/should_fail_if_both_scheduler_and_frontend_address_are_configured === RUN TestConfig_Validate/should_pass_if_query-scheduler_service_discovery_is_set_to_ring,_and_no_frontend_and_scheduler_address_is_configured === RUN TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_frontend_address_is_configured === RUN TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_scheduler_address_is_configured --- PASS: TestConfig_Validate (0.00s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestConfig_Validate/should_pass_if_frontend_address_is_configured,_but_not_scheduler_address (0.00s) --- PASS: TestConfig_Validate/should_pass_if_scheduler_address_is_configured,_but_not_frontend_address (0.00s) --- PASS: TestConfig_Validate/should_fail_if_both_scheduler_and_frontend_address_are_configured (0.00s) --- PASS: TestConfig_Validate/should_pass_if_query-scheduler_service_discovery_is_set_to_ring,_and_no_frontend_and_scheduler_address_is_configured (0.00s) --- PASS: TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_frontend_address_is_configured (0.00s) --- PASS: TestConfig_Validate/should_fail_if_query-scheduler_service_discovery_is_set_to_ring,_and_scheduler_address_is_configured (0.00s) === RUN TestConfig_IsFrontendOrSchedulerConfigured === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_0 === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_1 === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_2 === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_3 === RUN TestConfig_IsFrontendOrSchedulerConfigured/Test:_4 --- PASS: TestConfig_IsFrontendOrSchedulerConfigured (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_0 (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_1 (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_2 (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_3 (0.00s) --- PASS: TestConfig_IsFrontendOrSchedulerConfigured/Test:_4 (0.00s) === RUN TestResetConcurrency === RUN TestResetConcurrency/Create_at_least_one_processor_per_target_if_max_concurrent_=_0,_with_all_targets_in_use === RUN TestResetConcurrency/Create_at_least_one_processor_per_target_if_max_concurrent_=_0,_with_some_targets_in_use === RUN TestResetConcurrency/Max_concurrent_dividing_with_a_remainder,_with_all_targets_in_use === RUN TestResetConcurrency/Max_concurrent_dividing_with_a_remainder,_with_some_targets_in_use === RUN TestResetConcurrency/Max_concurrent_dividing_evenly,_with_all_targets_in_use === RUN TestResetConcurrency/Max_concurrent_dividing_evenly,_with_some_targets_in_use --- PASS: TestResetConcurrency (0.04s) --- PASS: TestResetConcurrency/Create_at_least_one_processor_per_target_if_max_concurrent_=_0,_with_all_targets_in_use (0.01s) --- PASS: TestResetConcurrency/Create_at_least_one_processor_per_target_if_max_concurrent_=_0,_with_some_targets_in_use (0.00s) --- PASS: TestResetConcurrency/Max_concurrent_dividing_with_a_remainder,_with_all_targets_in_use (0.01s) --- PASS: TestResetConcurrency/Max_concurrent_dividing_with_a_remainder,_with_some_targets_in_use (0.01s) --- PASS: TestResetConcurrency/Max_concurrent_dividing_evenly,_with_all_targets_in_use (0.01s) --- PASS: TestResetConcurrency/Max_concurrent_dividing_evenly,_with_some_targets_in_use (0.01s) === RUN TestQuerierWorker_getDesiredConcurrency === RUN TestQuerierWorker_getDesiredConcurrency/should_return_empty_map_on_no_instances === RUN TestQuerierWorker_getDesiredConcurrency/should_divide_the_max_concurrency_between_in-use_instances,_and_create_1_connection_for_each_instance_not_in-use === RUN TestQuerierWorker_getDesiredConcurrency/should_create_1_connection_for_each_instance_if_max_concurrency_is_set_to_0 === RUN TestQuerierWorker_getDesiredConcurrency/should_create_1_connection_for_each_instance_if_max_concurrency_is_>_0_but_less_than_the_number_of_in-use_instances --- PASS: TestQuerierWorker_getDesiredConcurrency (0.00s) --- PASS: TestQuerierWorker_getDesiredConcurrency/should_return_empty_map_on_no_instances (0.00s) --- PASS: TestQuerierWorker_getDesiredConcurrency/should_divide_the_max_concurrency_between_in-use_instances,_and_create_1_connection_for_each_instance_not_in-use (0.00s) --- PASS: TestQuerierWorker_getDesiredConcurrency/should_create_1_connection_for_each_instance_if_max_concurrency_is_set_to_0 (0.00s) --- PASS: TestQuerierWorker_getDesiredConcurrency/should_create_1_connection_for_each_instance_if_max_concurrency_is_>_0_but_less_than_the_number_of_in-use_instances (0.00s) PASS ok github.com/grafana/mimir/pkg/querier/worker 2.551s === RUN TestRuler === RUN TestRuler/should_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant3887683773/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="filtered out rules because evaluation is disabled for the tenant" user=user1 removed_rules=1 recording_rules_enabled=true alerting_rules_enabled=false level=info msg="updating rule file" file=/tmp/TestRulershould_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant3887683773/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant3887683773/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler/should_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant1996461212/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="filtered out rules because evaluation is disabled for the tenant" user=user1 removed_rules=1 recording_rules_enabled=false alerting_rules_enabled=true level=info msg="updating rule file" file=/tmp/TestRulershould_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant1996461212/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant1996461212/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler/should_load_and_evaluate_no_rules_if_rules_evaluation_is_disabled_for_the_tenant level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_no_rules_if_rules_evaluation_is_disabled_for_the_tenant35836836/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="filtered out all rules because evaluation is disabled for the tenant" user=user1 recording_rules_enabled=false alerting_rules_enabled=false level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_no_rules_if_rules_evaluation_is_disabled_for_the_tenant35836836/001 level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler/should_load_and_evaluate_the_configured_rules_with_special_characters level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_the_configured_rules_with_special_characters171142383/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRulershould_load_and_evaluate_the_configured_rules_with_special_characters171142383/001/user1/%29%28_+%3F%2F%7Cnamespace1+%2F%3F level=info user=user1 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_the_configured_rules_with_special_characters171142383/001 level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler/should_support_federated_rules level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_support_federated_rules4040433721/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRulershould_support_federated_rules4040433721/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_support_federated_rules4040433721/001 === RUN TestRuler/should_load_and_evaluate_the_configured_rules level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_the_configured_rules2656417677/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRulershould_load_and_evaluate_the_configured_rules2656417677/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulershould_load_and_evaluate_the_configured_rules2656417677/001 --- PASS: TestRuler (0.55s) --- PASS: TestRuler/should_load_and_evaluate_only_recording_rules_if_alerting_rules_evaluation_is_disabled_for_the_tenant (0.07s) --- PASS: TestRuler/should_load_and_evaluate_only_alerting_rules_if_recording_rules_evaluation_is_disabled_for_the_tenant (0.12s) --- PASS: TestRuler/should_load_and_evaluate_no_rules_if_rules_evaluation_is_disabled_for_the_tenant (0.01s) --- PASS: TestRuler/should_load_and_evaluate_the_configured_rules_with_special_characters (0.06s) --- PASS: TestRuler/should_support_federated_rules (0.06s) --- PASS: TestRuler/should_load_and_evaluate_the_configured_rules (0.21s) === RUN TestRuler_alerts level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_alerts2802741396/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_alerts2802741396/001/user2/namespace1 level=info msg="updating rule file" file=/tmp/TestRuler_alerts2802741396/001/user1/namespace1 level=info user=user2 msg="Starting rule manager..." level=info user=user1 msg="Starting rule manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user2 msg="Stopping notification manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info msg="unregistering instance from ring" ring=ruler level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_alerts2802741396/001 level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_alerts (0.07s) === RUN TestRuler_Create level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Create3954022984/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" === RUN TestRuler_Create/with_an_empty_payload === RUN TestRuler_Create/with_no_rule_group_name === RUN TestRuler_Create/with_no_rules === RUN TestRuler_Create/with_a_a_valid_rules_file level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Create3954022984/001 level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_Create (0.02s) --- PASS: TestRuler_Create/with_an_empty_payload (0.00s) --- PASS: TestRuler_Create/with_no_rule_group_name (0.00s) --- PASS: TestRuler_Create/with_no_rules (0.00s) --- PASS: TestRuler_Create/with_a_a_valid_rules_file (0.00s) === RUN TestRuler_DeleteNamespace level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_DeleteNamespace738462359/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info msg="updating rule file" file=/tmp/TestRuler_DeleteNamespace738462359/001/user1/namespace2 level=info user=user1 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_DeleteNamespace738462359/001 --- PASS: TestRuler_DeleteNamespace (0.03s) === RUN TestRuler_LimitsPerGroup level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_LimitsPerGroup1872869765/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" === RUN TestRuler_LimitsPerGroup/when_exceeding_the_rules_per_rule_group_limit level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_LimitsPerGroup1872869765/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_LimitsPerGroup (0.17s) --- PASS: TestRuler_LimitsPerGroup/when_exceeding_the_rules_per_rule_group_limit (0.00s) === RUN TestRuler_RulerGroupLimits level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_RulerGroupLimits3221769635/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" === RUN TestRuler_RulerGroupLimits/when_pushing_the_first_group_within_bounds_of_the_limit === RUN TestRuler_RulerGroupLimits/when_exceeding_the_rule_group_limit_after_sending_the_first_group level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_RulerGroupLimits3221769635/001 level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_RulerGroupLimits (0.03s) --- PASS: TestRuler_RulerGroupLimits/when_pushing_the_first_group_within_bounds_of_the_limit (0.00s) --- PASS: TestRuler_RulerGroupLimits/when_exceeding_the_rule_group_limit_after_sending_the_first_group (0.00s) === RUN Test_newRulerClientFactory --- PASS: Test_newRulerClientFactory (0.06s) === RUN TestPusherAppendable === RUN TestPusherAppendable/tenant_without_delay,_normal_value === RUN TestPusherAppendable/tenant_without_delay,_stale_nan_value === RUN TestPusherAppendable/ALERTS,_normal_value === RUN TestPusherAppendable/ALERTS,_stale_nan_value --- PASS: TestPusherAppendable (0.00s) --- PASS: TestPusherAppendable/tenant_without_delay,_normal_value (0.00s) --- PASS: TestPusherAppendable/tenant_without_delay,_stale_nan_value (0.00s) --- PASS: TestPusherAppendable/ALERTS,_normal_value (0.00s) --- PASS: TestPusherAppendable/ALERTS,_stale_nan_value (0.00s) === RUN TestPusherErrors === RUN TestPusherErrors/no_error === RUN TestPusherErrors/400_error === RUN TestPusherErrors/500_error === RUN TestPusherErrors/unknown_error --- PASS: TestPusherErrors (0.01s) --- PASS: TestPusherErrors/no_error (0.00s) --- PASS: TestPusherErrors/400_error (0.00s) --- PASS: TestPusherErrors/500_error (0.00s) --- PASS: TestPusherErrors/unknown_error (0.00s) === RUN TestMetricsQueryFuncErrors === RUN TestMetricsQueryFuncErrors/unknown_but_non-queryable_error === RUN TestMetricsQueryFuncErrors/promql.ErrStorage === RUN TestMetricsQueryFuncErrors/promql.ErrTooManySamples === RUN TestMetricsQueryFuncErrors/unknown_error === RUN TestMetricsQueryFuncErrors/no_error === RUN TestMetricsQueryFuncErrors/httpgrpc_400_error === RUN TestMetricsQueryFuncErrors/httpgrpc_500_error === RUN TestMetricsQueryFuncErrors/promql.ErrQueryCanceled === RUN TestMetricsQueryFuncErrors/promql.ErrQueryTimeout --- PASS: TestMetricsQueryFuncErrors (0.00s) --- PASS: TestMetricsQueryFuncErrors/unknown_but_non-queryable_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrStorage (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrTooManySamples (0.00s) --- PASS: TestMetricsQueryFuncErrors/unknown_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/no_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/httpgrpc_400_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/httpgrpc_500_error (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrQueryCanceled (0.00s) --- PASS: TestMetricsQueryFuncErrors/promql.ErrQueryTimeout (0.00s) === RUN TestRecordAndReportRuleQueryMetrics --- PASS: TestRecordAndReportRuleQueryMetrics (1.00s) === RUN TestManagerFactory_CorrectQueryableUsed === RUN TestManagerFactory_CorrectQueryableUsed/regular_rule_group_(without_source_tenants)_uses_regular_querier level=info msg="cleaning up mapped rules directory" path=/tmp/TestManagerFactory_CorrectQueryableUsedregular_rule_group_(without_source_tenants)_uses_regular_querier2403377023/001 level=info msg="updating rule file" file=/tmp/TestManagerFactory_CorrectQueryableUsedregular_rule_group_(without_source_tenants)_uses_regular_querier2403377023/001/tenant-1/namespace level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" === RUN TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_single_source_tenant_uses_federated_querier level=info msg="cleaning up mapped rules directory" path=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_single_source_tenant_uses_federated_querier3395091050/001 level=info msg="updating rule file" file=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_single_source_tenant_uses_federated_querier3395091050/001/tenant-1/namespace level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" === RUN TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_multiple_source_tenants_uses_federated_querier level=info msg="cleaning up mapped rules directory" path=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_multiple_source_tenants_uses_federated_querier2847280298/001 level=info msg="updating rule file" file=/tmp/TestManagerFactory_CorrectQueryableUsedfederated_rule_group_with_multiple_source_tenants_uses_federated_querier2847280298/001/tenant-1/namespace level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" --- PASS: TestManagerFactory_CorrectQueryableUsed (0.06s) --- PASS: TestManagerFactory_CorrectQueryableUsed/regular_rule_group_(without_source_tenants)_uses_regular_querier (0.02s) --- PASS: TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_single_source_tenant_uses_federated_querier (0.03s) --- PASS: TestManagerFactory_CorrectQueryableUsed/federated_rule_group_with_multiple_source_tenants_uses_federated_querier (0.02s) === RUN TestRulerShutdown level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulerShutdown377274515/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info msg="updating rule file" file=/tmp/TestRulerShutdown377274515/001/user2/namespace1 level=info msg="updating rule file" file=/tmp/TestRulerShutdown377274515/001/user1/namespace1 level=info user=user2 msg="Stopping notification manager..." level=info user=user2 msg="Starting rule manager..." level=info user=user1 msg="Starting rule manager..." level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRulerShutdown377274515/001 --- PASS: TestRulerShutdown (0.05s) === RUN TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances3915941963/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances3915941963/001/user2/namespace1 level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances3915941963/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=warn msg="auto-forgetting instance from the ring because it is unhealthy for a long time" instance=unhealthy-id last_heartbeat="2023-04-10 05:15:36 +0800 CST" forget_period=2m0s level=info user=user2 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances3915941963/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler --- PASS: TestRuler_RingLifecyclerShouldAutoForgetUnhealthyInstances (0.25s) === RUN TestManagerMetrics --- PASS: TestManagerMetrics (0.06s) === RUN TestMetricsArePerUser --- PASS: TestMetricsArePerUser (0.01s) === RUN TestSyncRuleGroups --- PASS: TestSyncRuleGroups (0.02s) === RUN Test_mapper_MapRules === RUN Test_mapper_MapRules/basic_rulegroup level=info msg="updating rule file" file=/rules/user1/file%20%2Fone === RUN Test_mapper_MapRules/identical_rulegroup === RUN Test_mapper_MapRules/out_of_order_identical_rulegroup === RUN Test_mapper_MapRules/updated_rulegroup level=info msg="updating rule file" file=/rules/user1/file%20%2Fone --- PASS: Test_mapper_MapRules (0.00s) --- PASS: Test_mapper_MapRules/basic_rulegroup (0.00s) --- PASS: Test_mapper_MapRules/identical_rulegroup (0.00s) --- PASS: Test_mapper_MapRules/out_of_order_identical_rulegroup (0.00s) --- PASS: Test_mapper_MapRules/updated_rulegroup (0.00s) === RUN Test_mapper_MapRulesMultipleFiles === RUN Test_mapper_MapRulesMultipleFiles/basic_rulegroup level=info msg="updating rule file" file=/rules/user1/file%20%2Fone === RUN Test_mapper_MapRulesMultipleFiles/add_a_file level=info msg="updating rule file" file=/rules/user1/file%20%2Ftwo === RUN Test_mapper_MapRulesMultipleFiles/update_one_file level=info msg="updating rule file" file=/rules/user1/file%20%2Ftwo === RUN Test_mapper_MapRulesMultipleFiles/delete_one_file --- PASS: Test_mapper_MapRulesMultipleFiles (0.01s) --- PASS: Test_mapper_MapRulesMultipleFiles/basic_rulegroup (0.00s) --- PASS: Test_mapper_MapRulesMultipleFiles/add_a_file (0.00s) --- PASS: Test_mapper_MapRulesMultipleFiles/update_one_file (0.00s) --- PASS: Test_mapper_MapRulesMultipleFiles/delete_one_file (0.00s) === RUN Test_mapper_MapRulesSpecialCharNamespace === RUN Test_mapper_MapRulesSpecialCharNamespace/create_special_characters_rulegroup level=info msg="updating rule file" file=/rules/user1/+A_%2FReallyStrange%3C%3ENAME:SPACE%2F%3F === RUN Test_mapper_MapRulesSpecialCharNamespace/delete_special_characters_rulegroup --- PASS: Test_mapper_MapRulesSpecialCharNamespace (0.00s) --- PASS: Test_mapper_MapRulesSpecialCharNamespace/create_special_characters_rulegroup (0.00s) --- PASS: Test_mapper_MapRulesSpecialCharNamespace/delete_special_characters_rulegroup (0.00s) === RUN Test_mapper_CleanupShouldNotFailIfPathDoesNotExist --- PASS: Test_mapper_CleanupShouldNotFailIfPathDoesNotExist (0.00s) === RUN TestBuildNotifierConfig === RUN TestBuildNotifierConfig/with_no_valid_hosts,_returns_an_empty_config === RUN TestBuildNotifierConfig/with_a_single_URL_and_no_service_discovery === RUN TestBuildNotifierConfig/with_a_single_URL,_v2_API,_and_no_service_discovery === RUN TestBuildNotifierConfig/with_a_SRV_URL_but_no_service_discovery_(missing_dns+_prefix) === RUN TestBuildNotifierConfig/with_multiple_URLs_and_no_service_discovery === RUN TestBuildNotifierConfig/with_basic_authentication_URL_and_no_service_discovery === RUN TestBuildNotifierConfig/with_basic_authentication_URL_and_service_discovery === RUN TestBuildNotifierConfig/with_basic_authentication_URL,_no_service_discovery,_and_explicit_config === RUN TestBuildNotifierConfig/with_multiple_URLs_and_service_discovery === RUN TestBuildNotifierConfig/with_DNS_service_discovery_and_missing_scheme === RUN TestBuildNotifierConfig/with_only_dns+_prefix === RUN TestBuildNotifierConfig/misspelled_DNS_SD_format_prefix_(dnsserv+_vs_dnssrv+) --- PASS: TestBuildNotifierConfig (0.01s) --- PASS: TestBuildNotifierConfig/with_no_valid_hosts,_returns_an_empty_config (0.00s) --- PASS: TestBuildNotifierConfig/with_a_single_URL_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_a_single_URL,_v2_API,_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_a_SRV_URL_but_no_service_discovery_(missing_dns+_prefix) (0.00s) --- PASS: TestBuildNotifierConfig/with_multiple_URLs_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_basic_authentication_URL_and_no_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_basic_authentication_URL_and_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_basic_authentication_URL,_no_service_discovery,_and_explicit_config (0.00s) --- PASS: TestBuildNotifierConfig/with_multiple_URLs_and_service_discovery (0.00s) --- PASS: TestBuildNotifierConfig/with_DNS_service_discovery_and_missing_scheme (0.00s) --- PASS: TestBuildNotifierConfig/with_only_dns+_prefix (0.00s) --- PASS: TestBuildNotifierConfig/misspelled_DNS_SD_format_prefix_(dnsserv+_vs_dnssrv+) (0.00s) === RUN TestRemoteQuerier_ReadReq --- PASS: TestRemoteQuerier_ReadReq (0.00s) === RUN TestRemoteQuerier_ReadReqTimeout --- PASS: TestRemoteQuerier_ReadReqTimeout (1.00s) === RUN TestRemoteQuerier_QueryReq --- PASS: TestRemoteQuerier_QueryReq (0.00s) === RUN TestRemoteQuerier_QueryReqTimeout --- PASS: TestRemoteQuerier_QueryReqTimeout (1.00s) === RUN TestRemoteQuerier_BackoffRetry === RUN TestRemoteQuerier_BackoffRetry/succeed_on_failed_requests_<=_max_retries === RUN TestRemoteQuerier_BackoffRetry/fail_on_failed_requests_>_max_retries === RUN TestRemoteQuerier_BackoffRetry/return_last_known_error_on_context_cancellation --- PASS: TestRemoteQuerier_BackoffRetry (0.99s) --- PASS: TestRemoteQuerier_BackoffRetry/succeed_on_failed_requests_<=_max_retries (0.45s) --- PASS: TestRemoteQuerier_BackoffRetry/fail_on_failed_requests_>_max_retries (0.50s) --- PASS: TestRemoteQuerier_BackoffRetry/return_last_known_error_on_context_cancellation (0.05s) === RUN TestRemoteQuerier_StatusErrorResponses --- PASS: TestRemoteQuerier_StatusErrorResponses (0.00s) === RUN TestNotifierSendsUserIDHeader level=info msg="cleaning up mapped rules directory" path=/tmp/TestNotifierSendsUserIDHeader3348898387/001 level=info user=1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestNotifierSendsUserIDHeader3348898387/001 --- PASS: TestNotifierSendsUserIDHeader (5.02s) === RUN TestRuler_Rules === RUN TestRuler_Rules/rules_-_user1 level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesrules_-_user11700980170/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_Rulesrules_-_user11700980170/001/user2/namespace1 level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestRuler_Rulesrules_-_user11700980170/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info user=user2 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesrules_-_user11700980170/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler_Rules/rules_-_user2 level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesrules_-_user23184213326/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_Rulesrules_-_user23184213326/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestRuler_Rulesrules_-_user23184213326/001/user2/namespace1 level=info user=user2 msg="Starting rule manager..." level=info user=user2 msg="Stopping notification manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user2 msg="Stopping rule manager..." level=info user=user2 msg="Rule manager stopped" level=info user=user1 msg="Stopping rule manager..." level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesrules_-_user23184213326/001 level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler === RUN TestRuler_Rules/federated_rule_group level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesfederated_rule_group2692893533/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="ring doesn't exist in KV store yet" level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="updating rule file" file=/tmp/TestRuler_Rulesfederated_rule_group2692893533/001/user1/namespace1 level=info user=user1 msg="Starting rule manager..." level=info msg="ring lifecycler is shutting down" ring=ruler level=info user=user1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=user1 msg="Stopping rule manager..." level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=info user=user1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_Rulesfederated_rule_group2692893533/001 --- PASS: TestRuler_Rules (0.14s) --- PASS: TestRuler_Rules/rules_-_user1 (0.06s) --- PASS: TestRuler_Rules/rules_-_user2 (0.06s) --- PASS: TestRuler_Rules/federated_rule_group (0.02s) === RUN TestGetRules === RUN TestGetRules/Shuffle_Shard_Size_0 level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_01568975260/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_01568975260/002 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_01568975260/003 level=info msg="ring doesn't exist in KV store yet" level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_01568975260/001/user2/namespace level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_01568975260/002/user3/namespace level=info user=user3 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_01568975260/002/user1/namespace level=info user=user1 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_01568975260/002/user2/namespace level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_01568975260/003/user2/namespace level=info user=user2 msg="Starting rule manager..." === RUN TestGetRules/Shuffle_Shard_Size_2 level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_21658771974/001 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_21658771974/002 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path=/tmp/TestGetRulesShuffle_Shard_Size_21658771974/003 level=info msg="ring doesn't exist in KV store yet" level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_21658771974/002/user1/namespace level=info user=user1 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_21658771974/002/user2/namespace level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_21658771974/003/user2/namespace level=info user=user2 msg="Starting rule manager..." level=info msg="updating rule file" file=/tmp/TestGetRulesShuffle_Shard_Size_21658771974/003/user3/namespace level=info user=user3 msg="Starting rule manager..." --- PASS: TestGetRules (0.35s) --- PASS: TestGetRules/Shuffle_Shard_Size_0 (0.16s) --- PASS: TestGetRules/Shuffle_Shard_Size_2 (0.19s) === RUN TestSharding === RUN TestSharding/shard_size_0,_single_ruler level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_1,_multiple_rulers level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_1,_two_rulers,_distributed_users level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_2,_three_rulers,_ruler2_has_no_users level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_enabled_user level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 === RUN TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_disabled_user level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 === RUN TestSharding/shard_size_0,_JOINING_ruler level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_2,_three_rulers level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/single_ruler,_with_ring_setup level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/single_ruler,_with_ring_setup,_single_user_enabled level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 === RUN TestSharding/shard_size_2,_two_rulers level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/single_ruler_with_ring_setup,_single_user_disabled level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 === RUN TestSharding/shard_size_0,_unhealthy_ACTIVE_ruler level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= level=error msg="failed to check if the ruler replica owns the rule group" user=user1 namespace=namespace group=second err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" level=error msg="failed to check if the ruler replica owns the rule group" user=user3 namespace=namespace group=first err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" level=error msg="failed to check if the ruler replica owns the rule group" user=user1 namespace=namespace group=second err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" level=error msg="failed to check if the ruler replica owns the rule group" user=user3 namespace=namespace group=first err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: 2.2.2.2:9999" === RUN TestSharding/shard_size_2,_three_rulers,_single_disabled_user level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using disabled users" disabled=user1 === RUN TestSharding/shard_size_0,_multiple_ACTIVE_rulers level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_0,_LEAVING_ruler level=info msg="cleaning up mapped rules directory" path= level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="cleaning up mapped rules directory" path= === RUN TestSharding/shard_size_2,_three_rulers,_single_enabled_user level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="ring doesn't exist in KV store yet" level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 level=info msg="cleaning up mapped rules directory" path= level=info msg="ruler using enabled users" enabled=user1 --- PASS: TestSharding (2.19s) --- PASS: TestSharding/shard_size_0,_single_ruler (0.13s) --- PASS: TestSharding/shard_size_1,_multiple_rulers (0.13s) --- PASS: TestSharding/shard_size_1,_two_rulers,_distributed_users (0.13s) --- PASS: TestSharding/shard_size_2,_three_rulers,_ruler2_has_no_users (0.12s) --- PASS: TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_enabled_user (0.12s) --- PASS: TestSharding/shard_size_0,_multiple_ACTIVE_rulers,_single_disabled_user (0.12s) --- PASS: TestSharding/shard_size_0,_JOINING_ruler (0.14s) --- PASS: TestSharding/shard_size_2,_three_rulers (0.13s) --- PASS: TestSharding/single_ruler,_with_ring_setup (0.12s) --- PASS: TestSharding/single_ruler,_with_ring_setup,_single_user_enabled (0.12s) --- PASS: TestSharding/shard_size_2,_two_rulers (0.12s) --- PASS: TestSharding/single_ruler_with_ring_setup,_single_user_disabled (0.15s) --- PASS: TestSharding/shard_size_0,_unhealthy_ACTIVE_ruler (0.15s) --- PASS: TestSharding/shard_size_2,_three_rulers,_single_disabled_user (0.12s) --- PASS: TestSharding/shard_size_0,_multiple_ACTIVE_rulers (0.17s) --- PASS: TestSharding/shard_size_0,_LEAVING_ruler (0.12s) --- PASS: TestSharding/shard_size_2,_three_rulers,_single_enabled_user (0.12s) === RUN TestDeleteTenantRuleGroups --- PASS: TestDeleteTenantRuleGroups (0.01s) === RUN TestRuler_ListAllRules level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_ListAllRules4020368075/001 level=info msg="instance not found in the ring" instance=localhost ring=ruler level=info msg="waiting until ruler is ACTIVE in the ring" level=info msg="ruler is ACTIVE in the ring" level=info msg="ruler up and running" level=info msg="ring lifecycler is shutting down" ring=ruler level=info msg="unregistering instance from ring" ring=ruler level=info msg="instance removed from the ring" ring=ruler level=error msg="failed to check if the ruler replica owns the rule group" user=user2 namespace=namespace1 group=group1 err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: localhost:0" level=error msg="failed to check if the ruler replica owns the rule group" user=user1 namespace=namespace1 group=group1 err="error reading ring to verify rule group ownership: at least 1 healthy replica required, could only find 0 - unhealthy instances: localhost:0" level=info msg="stopping user managers" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_ListAllRules4020368075/001 --- PASS: TestRuler_ListAllRules (0.04s) === RUN TestSendAlerts === RUN TestSendAlerts/0 === RUN TestSendAlerts/1 === RUN TestSendAlerts/2 --- PASS: TestSendAlerts (0.00s) --- PASS: TestSendAlerts/0 (0.00s) --- PASS: TestSendAlerts/1 (0.00s) --- PASS: TestSendAlerts/2 (0.00s) === RUN TestFilterRuleGroupsByEnabled === RUN TestFilterRuleGroupsByEnabled/should_remove_alerting_rules_if_disabled_for_a_given_tenant === RUN TestFilterRuleGroupsByEnabled/should_remove_recording_rules_if_disabled_for_a_given_tenant === RUN TestFilterRuleGroupsByEnabled/should_remove_all_config_for_a_user_if_both_recording_and_alerting_rules_are_disabled === RUN TestFilterRuleGroupsByEnabled/should_remove_configs_for_all_users_if_both_recording_and_alerting_rules_are_disabled_for_every_user === RUN TestFilterRuleGroupsByEnabled/should_return_an_empty_map_on_empty_input --- PASS: TestFilterRuleGroupsByEnabled (0.01s) --- PASS: TestFilterRuleGroupsByEnabled/should_remove_alerting_rules_if_disabled_for_a_given_tenant (0.00s) --- PASS: TestFilterRuleGroupsByEnabled/should_remove_recording_rules_if_disabled_for_a_given_tenant (0.00s) --- PASS: TestFilterRuleGroupsByEnabled/should_remove_all_config_for_a_user_if_both_recording_and_alerting_rules_are_disabled (0.00s) --- PASS: TestFilterRuleGroupsByEnabled/should_remove_configs_for_all_users_if_both_recording_and_alerting_rules_are_disabled_for_every_user (0.00s) --- PASS: TestFilterRuleGroupsByEnabled/should_return_an_empty_map_on_empty_input (0.00s) === RUN TestConfig_TranslatesToPrometheusTargetGroup === RUN TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_single_address === RUN TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_multiple_addresses === RUN TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_no_addresses --- PASS: TestConfig_TranslatesToPrometheusTargetGroup (0.01s) --- PASS: TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_single_address (0.00s) --- PASS: TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_multiple_addresses (0.00s) --- PASS: TestConfig_TranslatesToPrometheusTargetGroup/happy_flow_no_addresses (0.00s) === RUN TestConfig_ConstructsLookupNamesCorrectly === RUN TestConfig_ConstructsLookupNamesCorrectly/dns+ === RUN TestConfig_ConstructsLookupNamesCorrectly/dnssrv+ === RUN TestConfig_ConstructsLookupNamesCorrectly/dnssrvnoa+ --- PASS: TestConfig_ConstructsLookupNamesCorrectly (0.01s) --- PASS: TestConfig_ConstructsLookupNamesCorrectly/dns+ (0.00s) --- PASS: TestConfig_ConstructsLookupNamesCorrectly/dnssrv+ (0.00s) --- PASS: TestConfig_ConstructsLookupNamesCorrectly/dnssrvnoa+ (0.00s) === RUN TestRuler_TenantFederationFlag === RUN TestRuler_TenantFederationFlag/tenant_federation_disabled level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled1854289980/001 level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled1854289980/001 === RUN TestRuler_TenantFederationFlag/tenant_federation_disabled_with_a_federated_rules_and_a_regular_rule level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled_with_a_federated_rules_and_a_regular_rule3078564895/001 level=info msg="updating rule file" file=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled_with_a_federated_rules_and_a_regular_rule3078564895/001/tenant-1/ns level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_disabled_with_a_federated_rules_and_a_regular_rule3078564895/001 === RUN TestRuler_TenantFederationFlag/tenant_federation_enabled_only_with_federated_groups level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_only_with_federated_groups2312219334/001 level=info msg="updating rule file" file=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_only_with_federated_groups2312219334/001/tenant-1/ns level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_only_with_federated_groups2312219334/001 === RUN TestRuler_TenantFederationFlag/tenant_federation_enabled_with_federated_and_regular_groups level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_with_federated_and_regular_groups1813113268/001 level=info msg="updating rule file" file=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_with_federated_and_regular_groups1813113268/001/tenant-1/ns level=info user=tenant-1 msg="Starting rule manager..." level=info user=tenant-1 msg="Stopping notification manager..." level=info msg="stopping user managers" level=info user=tenant-1 msg="Stopping rule manager..." level=info user=tenant-1 msg="Rule manager stopped" level=info msg="all user managers stopped" level=info msg="cleaning up mapped rules directory" path=/tmp/TestRuler_TenantFederationFlagtenant_federation_enabled_with_federated_and_regular_groups1813113268/001 --- PASS: TestRuler_TenantFederationFlag (0.05s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_disabled (0.01s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_disabled_with_a_federated_rules_and_a_regular_rule (0.01s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_enabled_only_with_federated_groups (0.01s) --- PASS: TestRuler_TenantFederationFlag/tenant_federation_enabled_with_federated_and_regular_groups (0.01s) PASS ok github.com/grafana/mimir/pkg/ruler 13.746s === RUN TestRoundtrip === RUN TestRoundtrip/no_eval_delay === RUN TestRoundtrip/with_eval_delay === RUN TestRoundtrip/with_eval_delay_and_source_tenants === RUN TestRoundtrip/with_eval_delay_and_source_tenants_and_align_of_execution_time --- PASS: TestRoundtrip (0.01s) --- PASS: TestRoundtrip/no_eval_delay (0.00s) --- PASS: TestRoundtrip/with_eval_delay (0.00s) --- PASS: TestRoundtrip/with_eval_delay_and_source_tenants (0.00s) --- PASS: TestRoundtrip/with_eval_delay_and_source_tenants_and_align_of_execution_time (0.00s) === RUN TestZeroEvalDelayIsIgnored --- PASS: TestZeroEvalDelayIsIgnored (0.00s) PASS ok github.com/grafana/mimir/pkg/ruler/rulespb 0.365s === RUN TestIsDefaults === RUN TestIsDefaults/should_return_true_if_the_config_only_contains_default_values === RUN TestIsDefaults/should_return_false_if_the_config_contains_zero_values === RUN TestIsDefaults/should_return_false_if_the_config_contains_default_values_and_some_overrides === RUN TestIsDefaults/should_return_true_if_only_a_non-config_field_has_changed --- PASS: TestIsDefaults (0.01s) --- PASS: TestIsDefaults/should_return_true_if_the_config_only_contains_default_values (0.00s) --- PASS: TestIsDefaults/should_return_false_if_the_config_contains_zero_values (0.00s) --- PASS: TestIsDefaults/should_return_false_if_the_config_contains_default_values_and_some_overrides (0.00s) --- PASS: TestIsDefaults/should_return_true_if_only_a_non-config_field_has_changed (0.00s) PASS ok github.com/grafana/mimir/pkg/ruler/rulestore 0.541s === RUN TestListRules --- PASS: TestListRules (0.01s) === RUN TestLoadRules --- PASS: TestLoadRules (0.00s) === RUN TestDelete --- PASS: TestDelete (0.00s) === RUN TestParseRuleGroupObjectKey === RUN TestParseRuleGroupObjectKey/empty_object_key === RUN TestParseRuleGroupObjectKey/invalid_object_key_pattern === RUN TestParseRuleGroupObjectKey/empty_namespace === RUN TestParseRuleGroupObjectKey/invalid_namespace_encoding === RUN TestParseRuleGroupObjectKey/empty_group === RUN TestParseRuleGroupObjectKey/invalid_group_encoding === RUN TestParseRuleGroupObjectKey/valid_object_key --- PASS: TestParseRuleGroupObjectKey (0.00s) --- PASS: TestParseRuleGroupObjectKey/empty_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKey/invalid_object_key_pattern (0.00s) --- PASS: TestParseRuleGroupObjectKey/empty_namespace (0.00s) --- PASS: TestParseRuleGroupObjectKey/invalid_namespace_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKey/empty_group (0.00s) --- PASS: TestParseRuleGroupObjectKey/invalid_group_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKey/valid_object_key (0.00s) === RUN TestParseRuleGroupObjectKeyWithUser === RUN TestParseRuleGroupObjectKeyWithUser/invalid_group_encoding === RUN TestParseRuleGroupObjectKeyWithUser/valid_object_key === RUN TestParseRuleGroupObjectKeyWithUser/empty_object_key === RUN TestParseRuleGroupObjectKeyWithUser/invalid_object_key_pattern === RUN TestParseRuleGroupObjectKeyWithUser/empty_user === RUN TestParseRuleGroupObjectKeyWithUser/empty_namespace === RUN TestParseRuleGroupObjectKeyWithUser/invalid_namespace_encoding === RUN TestParseRuleGroupObjectKeyWithUser/empty_group_name --- PASS: TestParseRuleGroupObjectKeyWithUser (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/invalid_group_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/valid_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_object_key (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/invalid_object_key_pattern (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_user (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_namespace (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/invalid_namespace_encoding (0.00s) --- PASS: TestParseRuleGroupObjectKeyWithUser/empty_group_name (0.00s) === RUN TestListAllRuleGroupsWithNoNamespaceOrGroup --- PASS: TestListAllRuleGroupsWithNoNamespaceOrGroup (0.00s) PASS ok github.com/grafana/mimir/pkg/ruler/rulestore/bucketclient 0.479s === RUN TestClient_LoadAllRuleGroups --- PASS: TestClient_LoadAllRuleGroups (0.01s) PASS ok github.com/grafana/mimir/pkg/ruler/rulestore/local 0.315s === RUN TestSchedulerBasicEnqueue --- PASS: TestSchedulerBasicEnqueue (0.05s) === RUN TestSchedulerEnqueueWithCancel --- PASS: TestSchedulerEnqueueWithCancel (0.51s) === RUN TestSchedulerEnqueueByMultipleFrontendsWithCancel --- PASS: TestSchedulerEnqueueByMultipleFrontendsWithCancel (0.52s) === RUN TestSchedulerEnqueueWithFrontendDisconnect --- PASS: TestSchedulerEnqueueWithFrontendDisconnect (0.52s) === RUN TestCancelRequestInProgress --- PASS: TestCancelRequestInProgress (0.51s) === RUN TestTracingContext --- PASS: TestTracingContext (0.05s) === RUN TestSchedulerShutdown_FrontendLoop --- PASS: TestSchedulerShutdown_FrontendLoop (0.01s) === RUN TestSchedulerShutdown_QuerierLoop --- PASS: TestSchedulerShutdown_QuerierLoop (0.01s) === RUN TestSchedulerMaxOutstandingRequests --- PASS: TestSchedulerMaxOutstandingRequests (0.02s) === RUN TestSchedulerForwardsErrorToFrontend --- PASS: TestSchedulerForwardsErrorToFrontend (0.03s) === RUN TestSchedulerMetrics --- PASS: TestSchedulerMetrics (0.01s) PASS ok github.com/grafana/mimir/pkg/scheduler 2.492s === RUN TestRequestQueue_GetNextRequestForQuerier_ShouldGetRequestAfterReshardingBecauseQuerierHasBeenForgotten --- PASS: TestRequestQueue_GetNextRequestForQuerier_ShouldGetRequestAfterReshardingBecauseQuerierHasBeenForgotten (5.00s) === RUN TestContextCond === RUN TestContextCond/wait_until_broadcast === PAUSE TestContextCond/wait_until_broadcast === RUN TestContextCond/wait_until_context_deadline === PAUSE TestContextCond/wait_until_context_deadline === RUN TestContextCond/wait_on_already_canceled_context === PAUSE TestContextCond/wait_on_already_canceled_context === RUN TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait === PAUSE TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait === RUN TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel === PAUSE TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel === CONT TestContextCond/wait_until_broadcast === CONT TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel === CONT TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait === CONT TestContextCond/wait_on_already_canceled_context === CONT TestContextCond/wait_until_context_deadline --- PASS: TestContextCond (0.00s) --- PASS: TestContextCond/wait_on_already_canceled_context (0.00s) --- PASS: TestContextCond/wait_until_broadcast (0.10s) --- PASS: TestContextCond/wait_until_context_deadline (0.10s) --- PASS: TestContextCond/lots_of_goroutines_waiting_at_the_same_time,_none_of_them_misses_it's_broadcast_from_cancel (0.14s) --- PASS: TestContextCond/wait_on_already_canceled_context,_but_it_takes_a_while_to_wait (0.25s) === RUN TestQueues --- PASS: TestQueues (0.00s) === RUN TestQueuesOnTerminatingQuerier --- PASS: TestQueuesOnTerminatingQuerier (0.00s) === RUN TestQueuesWithQueriers user_queues_test.go:171: mean: 166.66666666666666 stddev: 11.178352094810558 --- PASS: TestQueuesWithQueriers (0.36s) === RUN TestQueuesConsistency === RUN TestQueuesConsistency/without_forget_delay === RUN TestQueuesConsistency/with_forget_delay --- PASS: TestQueuesConsistency (0.41s) --- PASS: TestQueuesConsistency/without_forget_delay (0.21s) --- PASS: TestQueuesConsistency/with_forget_delay (0.20s) === RUN TestQueues_ForgetDelay --- PASS: TestQueues_ForgetDelay (0.07s) === RUN TestQueues_ForgetDelay_ShouldCorrectlyHandleQuerierReconnectingBeforeForgetDelayIsPassed --- PASS: TestQueues_ForgetDelay_ShouldCorrectlyHandleQuerierReconnectingBeforeForgetDelayIsPassed (0.03s) === RUN TestShuffleQueriers --- PASS: TestShuffleQueriers (0.00s) === RUN TestShuffleQueriersCorrectness --- PASS: TestShuffleQueriersCorrectness (0.92s) PASS ok github.com/grafana/mimir/pkg/scheduler/queue 7.212s ? github.com/grafana/mimir/pkg/scheduler/schedulerpb [no test files] === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_with_default_config === RUN TestConfig_Validate/should_fail_if_service_discovery_mode_is_invalid === RUN TestConfig_Validate/should_fail_if_service_discovery_mode_is_set_to_DNS_and_max_used_instances_has_been_configured === RUN TestConfig_Validate/should_pass_if_service_discovery_mode_is_set_to_ring_and_max_used_instances_has_been_configured === RUN TestConfig_Validate/should_fail_if_service_discovery_mode_is_set_to_ring_but_max_used_instances_is_negative --- PASS: TestConfig_Validate (0.02s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestConfig_Validate/should_fail_if_service_discovery_mode_is_invalid (0.00s) --- PASS: TestConfig_Validate/should_fail_if_service_discovery_mode_is_set_to_DNS_and_max_used_instances_has_been_configured (0.00s) --- PASS: TestConfig_Validate/should_pass_if_service_discovery_mode_is_set_to_ring_and_max_used_instances_has_been_configured (0.00s) --- PASS: TestConfig_Validate/should_fail_if_service_discovery_mode_is_set_to_ring_but_max_used_instances_is_negative (0.00s) === RUN TestRingConfig_DefaultConfigToBasicLifecyclerConfig --- PASS: TestRingConfig_DefaultConfigToBasicLifecyclerConfig (0.00s) === RUN TestRingConfig_CustomConfigToBasicLifecyclerConfig --- PASS: TestRingConfig_CustomConfigToBasicLifecyclerConfig (0.00s) PASS ok github.com/grafana/mimir/pkg/scheduler/schedulerdiscovery 0.212s ? github.com/grafana/mimir/pkg/storage/bucket/filesystem [no test files] ? github.com/grafana/mimir/pkg/storage/bucket/gcs [no test files] === RUN TestDeletePrefix --- PASS: TestDeletePrefix (0.00s) === RUN TestNewClient === PAUSE TestNewClient === RUN TestClientMock_MockGet --- PASS: TestClientMock_MockGet (0.73s) === RUN TestClient_ConfigValidation === RUN TestClient_ConfigValidation/valid_storage_prefix === RUN TestClient_ConfigValidation/storage_prefix_non-alphanumeric_characters === RUN TestClient_ConfigValidation/storage_prefix_suffixed_with_a_slash_(non-alphanumeric) === RUN TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(..) === RUN TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(.) === RUN TestClient_ConfigValidation/unsupported_backend --- PASS: TestClient_ConfigValidation (0.00s) --- PASS: TestClient_ConfigValidation/valid_storage_prefix (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_non-alphanumeric_characters (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_suffixed_with_a_slash_(non-alphanumeric) (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(..) (0.00s) --- PASS: TestClient_ConfigValidation/storage_prefix_that_has_some_character_strings_that_have_a_meaning_in_unix_paths_(.) (0.00s) --- PASS: TestClient_ConfigValidation/unsupported_backend (0.00s) === RUN TestNewPrefixedBucketClient === RUN TestNewPrefixedBucketClient/with_prefix === RUN TestNewPrefixedBucketClient/without_prefix --- PASS: TestNewPrefixedBucketClient (0.00s) --- PASS: TestNewPrefixedBucketClient/with_prefix (0.00s) --- PASS: TestNewPrefixedBucketClient/without_prefix (0.00s) === RUN TestPrefixedBucketClient === RUN TestPrefixedBucketClient/Upload prefixed_bucket_client_test.go:25: PASS: Upload(string,string,string) === RUN TestPrefixedBucketClient/Delete prefixed_bucket_client_test.go:32: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:32: PASS: Delete(string,string) === RUN TestPrefixedBucketClient/Iter prefixed_bucket_client_test.go:42: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:42: PASS: Delete(string,string) prefixed_bucket_client_test.go:42: PASS: Iter(string,string,string,string) === RUN TestPrefixedBucketClient/Get prefixed_bucket_client_test.go:53: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:53: PASS: Delete(string,string) prefixed_bucket_client_test.go:53: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:53: PASS: Get(string,string) === RUN TestPrefixedBucketClient/GetRange prefixed_bucket_client_test.go:64: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:64: PASS: Delete(string,string) prefixed_bucket_client_test.go:64: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:64: PASS: Get(string,string) prefixed_bucket_client_test.go:64: PASS: GetRange(string,string,string,string) === RUN TestPrefixedBucketClient/Exists prefixed_bucket_client_test.go:72: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:72: PASS: Delete(string,string) prefixed_bucket_client_test.go:72: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:72: PASS: Get(string,string) prefixed_bucket_client_test.go:72: PASS: GetRange(string,string,string,string) prefixed_bucket_client_test.go:72: PASS: Exists(string,string) === RUN TestPrefixedBucketClient/Attributes prefixed_bucket_client_test.go:79: PASS: Upload(string,string,string) prefixed_bucket_client_test.go:79: PASS: Delete(string,string) prefixed_bucket_client_test.go:79: PASS: Iter(string,string,string,string) prefixed_bucket_client_test.go:79: PASS: Get(string,string) prefixed_bucket_client_test.go:79: PASS: GetRange(string,string,string,string) prefixed_bucket_client_test.go:79: PASS: Exists(string,string) prefixed_bucket_client_test.go:79: PASS: Attributes(string,string) --- PASS: TestPrefixedBucketClient (0.01s) --- PASS: TestPrefixedBucketClient/Upload (0.00s) --- PASS: TestPrefixedBucketClient/Delete (0.00s) --- PASS: TestPrefixedBucketClient/Iter (0.00s) --- PASS: TestPrefixedBucketClient/Get (0.00s) --- PASS: TestPrefixedBucketClient/GetRange (0.00s) --- PASS: TestPrefixedBucketClient/Exists (0.00s) --- PASS: TestPrefixedBucketClient/Attributes (0.00s) === RUN TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig === RUN TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/default_client === RUN TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/client_with_expected_errors --- PASS: TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig (0.06s) --- PASS: TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/default_client (0.03s) --- PASS: TestSSEBucketClient_Upload_ShouldInjectCustomSSEConfig/client_with_expected_errors (0.03s) === CONT TestNewClient === RUN TestNewClient/should_return_error_on_unknown_backend === RUN TestNewClient/should_create_an_S3_bucket === RUN TestNewClient/should_create_a_GCS_bucket --- PASS: TestNewClient (0.02s) --- PASS: TestNewClient/should_return_error_on_unknown_backend (0.00s) --- PASS: TestNewClient/should_create_an_S3_bucket (0.00s) --- PASS: TestNewClient/should_create_a_GCS_bucket (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/bucket 1.060s === RUN TestNewBucketClient === RUN TestNewBucketClient/empty_endpoint_should_be_replaced_with_default === RUN TestNewBucketClient/non-empty_endpoint_should_be_kept --- PASS: TestNewBucketClient (0.01s) --- PASS: TestNewBucketClient/empty_endpoint_should_be_replaced_with_default (0.00s) --- PASS: TestNewBucketClient/non-empty_endpoint_should_be_kept (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/bucket/azure 0.116s ? github.com/grafana/mimir/pkg/storage/bucket/swift [no test files] ? github.com/grafana/mimir/pkg/storage/lazyquery [no test files] === RUN TestSSEConfig_Validate === RUN TestSSEConfig_Validate/should_pass_with_default_config === RUN TestSSEConfig_Validate/should_fail_on_invalid_SSE_type === RUN TestSSEConfig_Validate/should_fail_on_invalid_SSE_KMS_encryption_context === RUN TestSSEConfig_Validate/should_pass_on_valid_SSE_KMS_encryption_context --- PASS: TestSSEConfig_Validate (0.00s) --- PASS: TestSSEConfig_Validate/should_pass_with_default_config (0.00s) --- PASS: TestSSEConfig_Validate/should_fail_on_invalid_SSE_type (0.00s) --- PASS: TestSSEConfig_Validate/should_fail_on_invalid_SSE_KMS_encryption_context (0.00s) --- PASS: TestSSEConfig_Validate/should_pass_on_valid_SSE_KMS_encryption_context (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_fail_on_invalid_endpoint_prefix === RUN TestConfig_Validate/should_pass_with_default_config --- PASS: TestConfig_Validate (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_endpoint_prefix (0.00s) --- PASS: TestConfig_Validate/should_pass_with_default_config (0.00s) === RUN TestSSEConfig_BuildMinioConfig === RUN TestSSEConfig_BuildMinioConfig/SSE_KMS_without_encryption_context === RUN TestSSEConfig_BuildMinioConfig/SSE_KMS_with_encryption_context --- PASS: TestSSEConfig_BuildMinioConfig (0.00s) --- PASS: TestSSEConfig_BuildMinioConfig/SSE_KMS_without_encryption_context (0.00s) --- PASS: TestSSEConfig_BuildMinioConfig/SSE_KMS_with_encryption_context (0.00s) === RUN TestParseKMSEncryptionContext --- PASS: TestParseKMSEncryptionContext (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/bucket/s3 0.136s === RUN TestLen --- PASS: TestLen (0.00s) === RUN TestChunk === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/204 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/204 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/204 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/204 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/408 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/408 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/408 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/408 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/612 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/612 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/612 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/612 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/816 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/816 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/816 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/816 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1020 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1020 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1020 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1020 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1224 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1224 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1224 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1224 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1428 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1428 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1428 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1428 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1632 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1632 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1632 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1632 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/1836 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/1836 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/1836 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/1836 === RUN TestChunk/testChunkEncoding/PrometheusXorChunk/2040 === RUN TestChunk/testChunkSeek/PrometheusXorChunk/2040 === RUN TestChunk/testChunkSeekForward/PrometheusXorChunk/2040 === RUN TestChunk/testChunkBatch/PrometheusXorChunk/2040 --- PASS: TestChunk (10.06s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/204 (0.01s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/204 (0.03s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/204 (0.01s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/204 (0.01s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/408 (0.03s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/408 (0.07s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/408 (0.03s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/408 (0.05s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/612 (0.14s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/612 (0.20s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/612 (0.07s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/612 (0.07s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/816 (0.10s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/816 (0.17s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/816 (0.09s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/816 (0.11s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1020 (0.17s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1020 (0.22s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1020 (0.20s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1020 (0.21s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1224 (0.25s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1224 (0.30s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1224 (0.25s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1224 (0.18s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1428 (0.30s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1428 (0.44s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1428 (0.25s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1428 (0.25s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1632 (0.32s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1632 (0.72s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1632 (0.41s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1632 (0.37s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/1836 (0.48s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/1836 (0.57s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/1836 (0.42s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/1836 (0.38s) --- PASS: TestChunk/testChunkEncoding/PrometheusXorChunk/2040 (0.48s) --- PASS: TestChunk/testChunkSeek/PrometheusXorChunk/2040 (0.68s) --- PASS: TestChunk/testChunkSeekForward/PrometheusXorChunk/2040 (0.48s) --- PASS: TestChunk/testChunkBatch/PrometheusXorChunk/2040 (0.46s) PASS ok github.com/grafana/mimir/pkg/storage/chunk 10.140s === RUN TestConcreteSeriesSet --- PASS: TestConcreteSeriesSet (0.00s) === RUN TestMatrixToSeriesSetSortsMetricLabels --- PASS: TestMatrixToSeriesSetSortsMetricLabels (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/series 0.117s === RUN TestParseShard === RUN TestParseShard/should_return_error_on_invalid_format === RUN TestParseShard/should_return_error_on_invalid_index_(not_an_integer) === RUN TestParseShard/should_return_error_on_invalid_index_(not_positive) === RUN TestParseShard/should_return_error_on_invalid_index_(too_small) === RUN TestParseShard/should_return_error_on_invalid_separator === RUN TestParseShard/should_succeed_on_valid_last_shard_selector === RUN TestParseShard/should_return_error_on_invalid_count_(not_positive) === RUN TestParseShard/should_return_error_on_invalid_index_(too_large) === RUN TestParseShard/should_succeed_on_valid_first_shard_ID --- PASS: TestParseShard (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_format (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(not_an_integer) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(not_positive) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(too_small) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_separator (0.00s) --- PASS: TestParseShard/should_succeed_on_valid_last_shard_selector (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_count_(not_positive) (0.00s) --- PASS: TestParseShard/should_return_error_on_invalid_index_(too_large) (0.00s) --- PASS: TestParseShard/should_succeed_on_valid_first_shard_ID (0.00s) === RUN TestRemoveShardFromMatchers === RUN TestRemoveShardFromMatchers/should_return_no_shard_on_empty_label_matchers === RUN TestRemoveShardFromMatchers/should_return_no_shard_on_no_shard_label_matcher === RUN TestRemoveShardFromMatchers/should_return_matching_shard_and_filter_out_its_matcher --- PASS: TestRemoveShardFromMatchers (0.00s) --- PASS: TestRemoveShardFromMatchers/should_return_no_shard_on_empty_label_matchers (0.00s) --- PASS: TestRemoveShardFromMatchers/should_return_no_shard_on_no_shard_label_matcher (0.00s) --- PASS: TestRemoveShardFromMatchers/should_return_matching_shard_and_filter_out_its_matcher (0.00s) === RUN TestShardFromMatchers === RUN TestShardFromMatchers/0 === RUN TestShardFromMatchers/1 === RUN TestShardFromMatchers/2 --- PASS: TestShardFromMatchers (0.00s) --- PASS: TestShardFromMatchers/0 (0.00s) --- PASS: TestShardFromMatchers/1 (0.00s) --- PASS: TestShardFromMatchers/2 (0.00s) === RUN TestFormatAndParseShardId --- PASS: TestFormatAndParseShardId (0.04s) PASS ok github.com/grafana/mimir/pkg/storage/sharding 0.138s === RUN TestIsTenantDir --- PASS: TestIsTenantDir (0.00s) === RUN TestIsBucketIndexFile --- PASS: TestIsBucketIndexFile (0.00s) === RUN TestIsBlockIndexFile --- PASS: TestIsBlockIndexFile (0.00s) === RUN TestConfig_Validate === PAUSE TestConfig_Validate === RUN TestConfig_DurationList === PAUSE TestConfig_DurationList === RUN TestIndexCacheConfig_Validate === RUN TestIndexCacheConfig_Validate/one_memcached_address_should_pass === RUN TestIndexCacheConfig_Validate/default_config_should_pass === RUN TestIndexCacheConfig_Validate/unsupported_backend_should_fail === RUN TestIndexCacheConfig_Validate/no_memcached_addresses_should_fail --- PASS: TestIndexCacheConfig_Validate (0.00s) --- PASS: TestIndexCacheConfig_Validate/one_memcached_address_should_pass (0.00s) --- PASS: TestIndexCacheConfig_Validate/default_config_should_pass (0.00s) --- PASS: TestIndexCacheConfig_Validate/unsupported_backend_should_fail (0.00s) --- PASS: TestIndexCacheConfig_Validate/no_memcached_addresses_should_fail (0.00s) === RUN TestTenantDeletionMarkExists === RUN TestTenantDeletionMarkExists/empty === RUN TestTenantDeletionMarkExists/mark_doesn't_exist === RUN TestTenantDeletionMarkExists/mark_exists --- PASS: TestTenantDeletionMarkExists (0.00s) --- PASS: TestTenantDeletionMarkExists/empty (0.00s) --- PASS: TestTenantDeletionMarkExists/mark_doesn't_exist (0.00s) --- PASS: TestTenantDeletionMarkExists/mark_exists (0.00s) === RUN TestUsersScanner_ScanUsers_ShouldReturnedOwnedUsersOnly --- PASS: TestUsersScanner_ScanUsers_ShouldReturnedOwnedUsersOnly (0.00s) === RUN TestUsersScanner_ScanUsers_ShouldReturnUsersForWhichOwnerCheckOrTenantDeletionCheckFailed --- PASS: TestUsersScanner_ScanUsers_ShouldReturnUsersForWhichOwnerCheckOrTenantDeletionCheckFailed (0.00s) === RUN TestUsersScanner_ScanUsers_ShouldNotReturnPrefixedUsedByMimirInternals --- PASS: TestUsersScanner_ScanUsers_ShouldNotReturnPrefixedUsedByMimirInternals (0.00s) === RUN TestHashBlockID --- PASS: TestHashBlockID (0.00s) === CONT TestConfig_Validate === CONT TestConfig_DurationList === RUN TestConfig_Validate/should_fail_on_empty_block_ranges === RUN TestConfig_DurationList/default_to_2h === RUN TestConfig_Validate/should_fail_on_invalid_compaction_interval === RUN TestConfig_Validate/should_fail_on_stripe_size_0 === RUN TestConfig_DurationList/parse_ranges_correctly === RUN TestConfig_DurationList/handle_multiple_flag_parse === RUN TestConfig_Validate/should_fail_on_negative_stripe_size === RUN TestConfig_Validate/should_fail_on_stripe_size_1 === RUN TestConfig_Validate/should_pass_on_valid_stripe_size === RUN TestConfig_Validate/should_pass_on_S3_backend === RUN TestConfig_Validate/should_pass_on_GCS_backend === RUN TestConfig_Validate/should_fail_on_unknown_storage_backend === RUN TestConfig_Validate/should_pass_on_invalid_ship_concurrency_but_shipping_is_disabled === RUN TestConfig_Validate/should_fail_on_invalid_opening_concurrency === RUN TestConfig_Validate/should_fail_on_invalid_ship_concurrency === RUN TestConfig_Validate/should_fail_on_too_high_compaction_interval === RUN TestConfig_Validate/should_fail_on_invalid_compaction_concurrency --- PASS: TestConfig_DurationList (0.04s) --- PASS: TestConfig_DurationList/default_to_2h (0.00s) --- PASS: TestConfig_DurationList/parse_ranges_correctly (0.00s) --- PASS: TestConfig_DurationList/handle_multiple_flag_parse (0.03s) === RUN TestConfig_Validate/should_pass_on_valid_compaction_concurrency === RUN TestConfig_Validate/should_fail_on_invalid_TSDB_WAL_segment_size --- PASS: TestConfig_Validate (0.06s) --- PASS: TestConfig_Validate/should_fail_on_empty_block_ranges (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_compaction_interval (0.00s) --- PASS: TestConfig_Validate/should_fail_on_stripe_size_0 (0.00s) --- PASS: TestConfig_Validate/should_fail_on_negative_stripe_size (0.00s) --- PASS: TestConfig_Validate/should_fail_on_stripe_size_1 (0.00s) --- PASS: TestConfig_Validate/should_pass_on_valid_stripe_size (0.00s) --- PASS: TestConfig_Validate/should_pass_on_S3_backend (0.00s) --- PASS: TestConfig_Validate/should_pass_on_GCS_backend (0.00s) --- PASS: TestConfig_Validate/should_fail_on_unknown_storage_backend (0.00s) --- PASS: TestConfig_Validate/should_pass_on_invalid_ship_concurrency_but_shipping_is_disabled (0.02s) --- PASS: TestConfig_Validate/should_fail_on_invalid_opening_concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_ship_concurrency (0.00s) --- PASS: TestConfig_Validate/should_fail_on_too_high_compaction_interval (0.00s) --- PASS: TestConfig_Validate/should_fail_on_invalid_compaction_concurrency (0.01s) --- PASS: TestConfig_Validate/should_pass_on_valid_compaction_concurrency (0.01s) --- PASS: TestConfig_Validate/should_fail_on_invalid_TSDB_WAL_segment_size (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb 0.330s ? github.com/grafana/mimir/pkg/storage/tsdb/metadata [no test files] ? github.com/grafana/mimir/pkg/storage/tsdb/testutil [no test files] === RUN TestIsBlockDir === RUN TestIsBlockDir/#00 === RUN TestIsBlockDir/something === RUN TestIsBlockDir/00000000010000000000000000 === RUN TestIsBlockDir//00000000020000000000000000 === RUN TestIsBlockDir/some/path/00000000030000000000000000 === RUN TestIsBlockDir/00000000040000000000000000/something --- PASS: TestIsBlockDir (0.00s) --- PASS: TestIsBlockDir/#00 (0.00s) --- PASS: TestIsBlockDir/something (0.00s) --- PASS: TestIsBlockDir/00000000010000000000000000 (0.00s) --- PASS: TestIsBlockDir//00000000020000000000000000 (0.00s) --- PASS: TestIsBlockDir/some/path/00000000030000000000000000 (0.00s) --- PASS: TestIsBlockDir/00000000040000000000000000/something (0.00s) === RUN TestDelete --- PASS: TestDelete (6.18s) === RUN TestUpload === RUN TestUpload/wrong_dir === RUN TestUpload/wrong_existing_dir_(not_a_block) === RUN TestUpload/empty_block_dir === RUN TestUpload/missing_chunks === RUN TestUpload/missing_index_file === RUN TestUpload/missing_meta.json_file === RUN TestUpload/missing_meta.json_file,_but_valid_metadata_supplied_as_argument === RUN TestUpload/full_block === RUN TestUpload/upload_is_idempotent === RUN TestUpload/upload_with_no_external_labels_works_just_fine === RUN TestUpload/upload_with_supplied_meta.json --- PASS: TestUpload (9.32s) --- PASS: TestUpload/wrong_dir (0.00s) --- PASS: TestUpload/wrong_existing_dir_(not_a_block) (0.00s) --- PASS: TestUpload/empty_block_dir (0.00s) --- PASS: TestUpload/missing_chunks (0.00s) --- PASS: TestUpload/missing_index_file (0.00s) --- PASS: TestUpload/missing_meta.json_file (0.00s) --- PASS: TestUpload/missing_meta.json_file,_but_valid_metadata_supplied_as_argument (0.00s) --- PASS: TestUpload/full_block (0.00s) --- PASS: TestUpload/upload_is_idempotent (0.00s) --- PASS: TestUpload/upload_with_no_external_labels_works_just_fine (3.12s) --- PASS: TestUpload/upload_with_supplied_meta.json (3.04s) === RUN TestMarkForDeletion === RUN TestMarkForDeletion/block_marked_for_deletion === RUN TestMarkForDeletion/block_with_deletion_mark_already,_expected_log_and_no_metric_increment --- PASS: TestMarkForDeletion (8.40s) --- PASS: TestMarkForDeletion/block_marked_for_deletion (3.36s) --- PASS: TestMarkForDeletion/block_with_deletion_mark_already,_expected_log_and_no_metric_increment (5.04s) === RUN TestMarkForNoCompact === RUN TestMarkForNoCompact/block_marked === RUN TestMarkForNoCompact/block_with_no-compact_mark_already,_expected_log_and_no_metric_increment --- PASS: TestMarkForNoCompact (8.78s) --- PASS: TestMarkForNoCompact/block_marked (4.37s) --- PASS: TestMarkForNoCompact/block_with_no-compact_mark_already,_expected_log_and_no_metric_increment (4.41s) === RUN TestUploadCleanup --- PASS: TestUploadCleanup (3.31s) === RUN Test_ParseRelabelConfig --- PASS: Test_ParseRelabelConfig (0.00s) === RUN TestRewrite --- PASS: TestRewrite (6.13s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb/block 42.292s === RUN TestChunksCaching === RUN TestChunksCaching/basic_test === RUN TestChunksCaching/same_request_will_hit_all_subranges_in_the_cache === RUN TestChunksCaching/request_data_close_to_the_end_of_object === RUN TestChunksCaching/another_request_data_close_to_the_end_of_object,_cached_by_previous_test === RUN TestChunksCaching/entire_object,_combination_of_cached_and_uncached_subranges === RUN TestChunksCaching/entire_object_again,_everything_is_cached === RUN TestChunksCaching/entire_object_again,_nothing_is_cached === RUN TestChunksCaching/missing_first_subranges === RUN TestChunksCaching/missing_last_subranges === RUN TestChunksCaching/missing_middle_subranges === RUN TestChunksCaching/missing_everything_except_middle_subranges === RUN TestChunksCaching/missing_everything_except_middle_subranges,_one_subrequest_only === RUN TestChunksCaching/missing_everything_except_middle_subranges,_two_subrequests --- PASS: TestChunksCaching (0.97s) --- PASS: TestChunksCaching/basic_test (0.01s) --- PASS: TestChunksCaching/same_request_will_hit_all_subranges_in_the_cache (0.01s) --- PASS: TestChunksCaching/request_data_close_to_the_end_of_object (0.00s) --- PASS: TestChunksCaching/another_request_data_close_to_the_end_of_object,_cached_by_previous_test (0.00s) --- PASS: TestChunksCaching/entire_object,_combination_of_cached_and_uncached_subranges (0.18s) --- PASS: TestChunksCaching/entire_object_again,_everything_is_cached (0.18s) --- PASS: TestChunksCaching/entire_object_again,_nothing_is_cached (0.18s) --- PASS: TestChunksCaching/missing_first_subranges (0.02s) --- PASS: TestChunksCaching/missing_last_subranges (0.02s) --- PASS: TestChunksCaching/missing_middle_subranges (0.02s) --- PASS: TestChunksCaching/missing_everything_except_middle_subranges (0.02s) --- PASS: TestChunksCaching/missing_everything_except_middle_subranges,_one_subrequest_only (0.04s) --- PASS: TestChunksCaching/missing_everything_except_middle_subranges,_two_subrequests (0.02s) === RUN TestMergeRanges === RUN TestMergeRanges/0 === RUN TestMergeRanges/1 === RUN TestMergeRanges/2 === RUN TestMergeRanges/3 --- PASS: TestMergeRanges (0.00s) --- PASS: TestMergeRanges/0 (0.00s) --- PASS: TestMergeRanges/1 (0.00s) --- PASS: TestMergeRanges/2 (0.00s) --- PASS: TestMergeRanges/3 (0.00s) === RUN TestInvalidOffsetAndLength --- PASS: TestInvalidOffsetAndLength (0.00s) === RUN TestCachedIter --- PASS: TestCachedIter (0.00s) === RUN TestExists --- PASS: TestExists (0.00s) === RUN TestExistsCachingDisabled --- PASS: TestExistsCachingDisabled (0.00s) === RUN TestGet --- PASS: TestGet (0.00s) === RUN TestGetTooBigObject --- PASS: TestGetTooBigObject (0.00s) === RUN TestGetPartialRead --- PASS: TestGetPartialRead (0.00s) === RUN TestAttributes --- PASS: TestAttributes (0.00s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb/bucketcache 1.105s === RUN TestIndex_RemoveBlock --- PASS: TestIndex_RemoveBlock (0.00s) === RUN TestDetectBlockSegmentsFormat === RUN TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits === RUN TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits_but_non_consecutive === RUN TestDetectBlockSegmentsFormat/meta.json_without_SegmentFiles_and_Files === RUN TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_0_based_6_digits === RUN TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits === RUN TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits_but_non_consecutive === RUN TestDetectBlockSegmentsFormat/meta.json_with_Files,_0_based_6_digits --- PASS: TestDetectBlockSegmentsFormat (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_Files,_1_based_6_digits_but_non_consecutive (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_without_SegmentFiles_and_Files (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_0_based_6_digits (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_SegmentFiles,_1_based_6_digits_but_non_consecutive (0.00s) --- PASS: TestDetectBlockSegmentsFormat/meta.json_with_Files,_0_based_6_digits (0.00s) === RUN TestBlockFromThanosMeta === RUN TestBlockFromThanosMeta/meta.json_without_SegmentFiles_and_Files === RUN TestBlockFromThanosMeta/meta.json_with_SegmentFiles === RUN TestBlockFromThanosMeta/meta.json_with_Files === RUN TestBlockFromThanosMeta/meta.json_with_external_labels,_no_compactor_shard_ID === RUN TestBlockFromThanosMeta/meta.json_with_external_labels,_with_compactor_shard_ID === RUN TestBlockFromThanosMeta/meta.json_with_external_labels,_with_invalid_shard_ID --- PASS: TestBlockFromThanosMeta (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_without_SegmentFiles_and_Files (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_SegmentFiles (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_Files (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_external_labels,_no_compactor_shard_ID (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_external_labels,_with_compactor_shard_ID (0.00s) --- PASS: TestBlockFromThanosMeta/meta.json_with_external_labels,_with_invalid_shard_ID (0.00s) === RUN TestBlock_Within --- PASS: TestBlock_Within (0.00s) === RUN TestBlock_ThanosMeta === RUN TestBlock_ThanosMeta/block_with_segment_files_format_1_based_6_digits === RUN TestBlock_ThanosMeta/block_with_unknown_segment_files_format --- PASS: TestBlock_ThanosMeta (0.00s) --- PASS: TestBlock_ThanosMeta/block_with_segment_files_format_1_based_6_digits (0.00s) --- PASS: TestBlock_ThanosMeta/block_with_unknown_segment_files_format (0.00s) === RUN TestBlockDeletionMark_ThanosDeletionMark --- PASS: TestBlockDeletionMark_ThanosDeletionMark (0.00s) === RUN TestBlockDeletionMarks_Clone --- PASS: TestBlockDeletionMarks_Clone (0.00s) === RUN TestLoader_GetIndex_ShouldLazyLoadBucketIndex --- PASS: TestLoader_GetIndex_ShouldLazyLoadBucketIndex (0.01s) === RUN TestLoader_GetIndex_ShouldCacheError --- PASS: TestLoader_GetIndex_ShouldCacheError (0.00s) === RUN TestLoader_GetIndex_ShouldCacheIndexNotFoundError --- PASS: TestLoader_GetIndex_ShouldCacheIndexNotFoundError (0.00s) === RUN TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadSuccess --- PASS: TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadSuccess (1.06s) === RUN TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadFailure --- PASS: TestLoader_ShouldUpdateIndexInBackgroundOnPreviousLoadFailure (0.99s) === RUN TestLoader_ShouldUpdateIndexInBackgroundOnPreviousIndexNotFound --- PASS: TestLoader_ShouldUpdateIndexInBackgroundOnPreviousIndexNotFound (0.89s) === RUN TestLoader_ShouldNotCacheCriticalErrorOnBackgroundUpdates --- PASS: TestLoader_ShouldNotCacheCriticalErrorOnBackgroundUpdates (0.92s) === RUN TestLoader_ShouldCacheIndexNotFoundOnBackgroundUpdates --- PASS: TestLoader_ShouldCacheIndexNotFoundOnBackgroundUpdates (1.02s) === RUN TestLoader_ShouldOffloadIndexIfNotFoundDuringBackgroundUpdates --- PASS: TestLoader_ShouldOffloadIndexIfNotFoundDuringBackgroundUpdates (1.11s) === RUN TestLoader_ShouldOffloadIndexIfIdleTimeoutIsReachedDuringBackgroundUpdates --- PASS: TestLoader_ShouldOffloadIndexIfIdleTimeoutIsReachedDuringBackgroundUpdates (0.90s) === RUN TestGlobalMarkersBucket_Delete_ShouldSucceedIfDeletionMarkDoesNotExistInTheBlockButExistInTheGlobalLocation --- PASS: TestGlobalMarkersBucket_Delete_ShouldSucceedIfDeletionMarkDoesNotExistInTheBlockButExistInTheGlobalLocation (0.00s) === RUN TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist === RUN TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/deletion_mark === RUN TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/no_compact --- PASS: TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist (0.01s) --- PASS: TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/deletion_mark (0.00s) --- PASS: TestGlobalMarkersBucket_DeleteShouldDeleteGlobalMarkIfBlockMarkerDoesntExist/no_compact (0.00s) === RUN TestUploadToGlobalMarkerPath === RUN TestUploadToGlobalMarkerPath/deletion_mark === RUN TestUploadToGlobalMarkerPath/no_compact --- PASS: TestUploadToGlobalMarkerPath (0.01s) --- PASS: TestUploadToGlobalMarkerPath/deletion_mark (0.00s) --- PASS: TestUploadToGlobalMarkerPath/no_compact (0.00s) === RUN TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist === RUN TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/deletion_mark === RUN TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/no_compact --- PASS: TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist (0.01s) --- PASS: TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/deletion_mark (0.00s) --- PASS: TestGlobalMarkersBucket_ExistShouldReportTrueOnlyIfBothExist/no_compact (0.00s) === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/#00 === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/index === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/deletion-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/no-compact-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json === RUN TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/no-compact-mark.json --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark (0.01s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/#00 (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/index (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark//path/to/01FV060K6XXCS8BCD2CH6C3GBR/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_getGlobalMarkPathFromBlockMark/invalid-block-id/no-compact-mark.json (0.00s) === RUN TestGlobalMarkersBucket_isBlockDeletionMark === RUN TestGlobalMarkersBucket_isBlockDeletionMark/#00 === RUN TestGlobalMarkersBucket_isBlockDeletionMark/deletion-mark.json === RUN TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/index === RUN TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/deletion-mark.json === RUN TestGlobalMarkersBucket_isBlockDeletionMark//path/to/00000000010000000000000000/deletion-mark.json --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/#00 (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/index (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark/00000000010000000000000000/deletion-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isBlockDeletionMark//path/to/00000000010000000000000000/deletion-mark.json (0.00s) === RUN TestGlobalMarkersBucket_isNoCompactMark === RUN TestGlobalMarkersBucket_isNoCompactMark/#00 === RUN TestGlobalMarkersBucket_isNoCompactMark/no-compact-mark.json === RUN TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/index === RUN TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/no-compact-mark.json === RUN TestGlobalMarkersBucket_isNoCompactMark//path/to/00000000010000000000000000/no-compact-mark.json --- PASS: TestGlobalMarkersBucket_isNoCompactMark (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/#00 (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/index (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark/00000000010000000000000000/no-compact-mark.json (0.00s) --- PASS: TestGlobalMarkersBucket_isNoCompactMark//path/to/00000000010000000000000000/no-compact-mark.json (0.00s) === RUN TestBucketWithGlobalMarkers_ShouldWorkCorrectlyWithBucketMetrics --- PASS: TestBucketWithGlobalMarkers_ShouldWorkCorrectlyWithBucketMetrics (0.01s) === RUN TestBlockDeletionMarkFilepath --- PASS: TestBlockDeletionMarkFilepath (0.00s) === RUN TestIsBlockDeletionMarkFilename --- PASS: TestIsBlockDeletionMarkFilename (0.00s) === RUN TestNoCompactMarkFilepath --- PASS: TestNoCompactMarkFilepath (0.00s) === RUN TestIsNoCompactMarkFilename --- PASS: TestIsNoCompactMarkFilename (0.00s) === RUN TestReadIndex_ShouldReturnErrorIfIndexDoesNotExist --- PASS: TestReadIndex_ShouldReturnErrorIfIndexDoesNotExist (0.00s) === RUN TestReadIndex_ShouldReturnErrorIfIndexIsCorrupted --- PASS: TestReadIndex_ShouldReturnErrorIfIndexIsCorrupted (0.00s) === RUN TestReadIndex_ShouldReturnTheParsedIndexOnSuccess --- PASS: TestReadIndex_ShouldReturnTheParsedIndexOnSuccess (0.03s) === RUN TestDeleteIndex_ShouldNotReturnErrorIfIndexDoesNotExist --- PASS: TestDeleteIndex_ShouldNotReturnErrorIfIndexDoesNotExist (0.00s) === RUN TestUpdater_UpdateIndex --- PASS: TestUpdater_UpdateIndex (0.01s) === RUN TestUpdater_UpdateIndex_ShouldSkipPartialBlocks --- PASS: TestUpdater_UpdateIndex_ShouldSkipPartialBlocks (0.01s) === RUN TestUpdater_UpdateIndex_ShouldSkipBlocksWithCorruptedMeta --- PASS: TestUpdater_UpdateIndex_ShouldSkipBlocksWithCorruptedMeta (0.01s) === RUN TestUpdater_UpdateIndex_ShouldSkipCorruptedDeletionMarks --- PASS: TestUpdater_UpdateIndex_ShouldSkipCorruptedDeletionMarks (0.01s) === RUN TestUpdater_UpdateIndex_NoTenantInTheBucket --- PASS: TestUpdater_UpdateIndex_NoTenantInTheBucket (0.00s) === RUN TestUpdater_UpdateIndexFromVersion1ToVersion2 --- PASS: TestUpdater_UpdateIndexFromVersion1ToVersion2 (0.01s) PASS ok github.com/grafana/mimir/pkg/storage/tsdb/bucketindex 7.345s ? github.com/grafana/mimir/pkg/storegateway/hintspb [no test files] ? github.com/grafana/mimir/pkg/storegateway/indexheader/fileutil [no test files] ? github.com/grafana/mimir/pkg/storegateway/storegatewaypb [no test files] ? github.com/grafana/mimir/pkg/storegateway/storepb [no test files] ? github.com/grafana/mimir/pkg/storegateway/testhelper [no test files] ? github.com/grafana/mimir/pkg/util/chunkcompat [no test files] ? github.com/grafana/mimir/pkg/util/extprom [no test files] ? github.com/grafana/mimir/pkg/util/extract [no test files] ? github.com/grafana/mimir/pkg/util/fieldcategory [no test files] ? github.com/grafana/mimir/pkg/util/fs [no test files] ? github.com/grafana/mimir/pkg/util/listblocks [no test files] ? github.com/grafana/mimir/pkg/util/noauth [no test files] ? github.com/grafana/mimir/pkg/util/spanlogger [no test files] ? github.com/grafana/mimir/pkg/util/test [no test files] ? github.com/grafana/mimir/pkg/util/usage [no test files] ? github.com/grafana/mimir/tools/add-license [no test files] ? github.com/grafana/mimir/tools/compaction-planner [no test files] ? github.com/grafana/mimir/tools/copyblocks [no test files] ? github.com/grafana/mimir/tools/doc-generator [no test files] ? github.com/grafana/mimir/tools/list-deduplicated-blocks [no test files] ? github.com/grafana/mimir/tools/listblocks [no test files] ? github.com/grafana/mimir/tools/markblocks [no test files] ? github.com/grafana/mimir/tools/pre-pull-images [no test files] ? github.com/grafana/mimir/tools/query-step-alignment-analysis [no test files] ? github.com/grafana/mimir/tools/tenant-injector [no test files] ? github.com/grafana/mimir/tools/trafficdump [no test files] ? github.com/grafana/mimir/tools/tsdb-chunks [no test files] ? github.com/grafana/mimir/tools/tsdb-compact [no test files] ? github.com/grafana/mimir/tools/tsdb-index [no test files] ? github.com/grafana/mimir/tools/tsdb-index-health [no test files] ? github.com/grafana/mimir/tools/tsdb-index-toc [no test files] ? github.com/grafana/mimir/tools/tsdb-print-chunk [no test files] ? github.com/grafana/mimir/tools/tsdb-symbols [no test files] ? github.com/grafana/mimir/tools/ulidtime [no test files] === RUN TestBucketStore_e2e === PAUSE TestBucketStore_e2e === RUN TestBucketStore_ManyParts_e2e === PAUSE TestBucketStore_ManyParts_e2e === RUN TestBucketStore_Series_ChunksLimiter_e2e === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_series_limit_is_exceeded_-_422 === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_succeed_if_the_max_chunks_limit_is_not_exceeded === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_ResourceExhausted === RUN TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_422 --- PASS: TestBucketStore_Series_ChunksLimiter_e2e (88.57s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_series_limit_is_exceeded_-_422 (21.75s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_succeed_if_the_max_chunks_limit_is_not_exceeded (24.35s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_ResourceExhausted (21.03s) --- PASS: TestBucketStore_Series_ChunksLimiter_e2e/should_fail_if_the_max_chunks_limit_is_exceeded_-_422 (21.45s) === RUN TestBucketStore_LabelNames_e2e === PAUSE TestBucketStore_LabelNames_e2e === RUN TestBucketStore_LabelValues_e2e === PAUSE TestBucketStore_LabelValues_e2e === RUN TestBucketIndexMetadataFetcher_Fetch --- PASS: TestBucketIndexMetadataFetcher_Fetch (0.01s) === RUN TestBucketIndexMetadataFetcher_Fetch_NoBucketIndex --- PASS: TestBucketIndexMetadataFetcher_Fetch_NoBucketIndex (0.01s) === RUN TestBucketIndexMetadataFetcher_Fetch_CorruptedBucketIndex --- PASS: TestBucketIndexMetadataFetcher_Fetch_CorruptedBucketIndex (0.01s) === RUN TestBigEndianPostingsCount --- PASS: TestBigEndianPostingsCount (0.00s) === RUN TestBucketStores_InitialSync --- PASS: TestBucketStores_InitialSync (7.66s) === RUN TestBucketStores_InitialSyncShouldRetryOnFailure --- PASS: TestBucketStores_InitialSyncShouldRetryOnFailure (4.70s) === RUN TestBucketStores_SyncBlocks --- PASS: TestBucketStores_SyncBlocks (7.21s) === RUN TestBucketStores_syncUsersBlocks === RUN TestBucketStores_syncUsersBlocks/when_sharding_is_disabled_all_users_should_be_synced === RUN TestBucketStores_syncUsersBlocks/when_sharding_is_enabled_only_stores_for_filtered_users_should_be_created --- PASS: TestBucketStores_syncUsersBlocks (0.02s) --- PASS: TestBucketStores_syncUsersBlocks/when_sharding_is_disabled_all_users_should_be_synced (0.01s) --- PASS: TestBucketStores_syncUsersBlocks/when_sharding_is_enabled_only_stores_for_filtered_users_should_be_created (0.01s) === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_end_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_entire_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_beginning_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_middle_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_entire_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_beginning_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_middle_of_the_block === RUN TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_end_of_the_block --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks (6.75s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true (3.43s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_end_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_entire_block (0.01s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_beginning_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_true/query_the_middle_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false (3.32s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_entire_block (0.01s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_beginning_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_middle_of_the_block (0.00s) --- PASS: TestBucketStores_Series_ShouldCorrectlyQuerySeriesSpanningMultipleChunks/lazy_loading_enabled_=_false/query_the_end_of_the_block (0.00s) === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_2nd_(out_of_order)_chunk_only === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_all_samples === RUN TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_1st_chunk_only --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks (3.18s) --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_2nd_(out_of_order)_chunk_only (0.00s) --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_all_samples (0.00s) --- PASS: TestBucketStore_Series_ShouldQueryBlockWithOutOfOrderChunks/query_samples_from_1st_chunk_only (0.00s) === RUN TestBucketStores_deleteLocalFilesForExcludedTenants --- PASS: TestBucketStores_deleteLocalFilesForExcludedTenants (7.29s) === RUN TestBucketBlock_matchLabels --- PASS: TestBucketBlock_matchLabels (0.00s) === RUN TestBucketBlockSet_remove --- PASS: TestBucketBlockSet_remove (0.00s) === RUN TestReadIndexCache_LoadSeries --- PASS: TestReadIndexCache_LoadSeries (0.00s) === RUN TestBlockLabelNames === RUN TestBlockLabelNames/happy_case_with_no_matchers === RUN TestBlockLabelNames/index_reader_error_with_no_matchers === RUN TestBlockLabelNames/happy_case_cached_with_no_matchers === RUN TestBlockLabelNames/error_with_matchers === RUN TestBlockLabelNames/happy_case_cached_with_matchers --- PASS: TestBlockLabelNames (3.34s) --- PASS: TestBlockLabelNames/happy_case_with_no_matchers (0.00s) --- PASS: TestBlockLabelNames/index_reader_error_with_no_matchers (0.00s) --- PASS: TestBlockLabelNames/happy_case_cached_with_no_matchers (0.00s) --- PASS: TestBlockLabelNames/error_with_matchers (0.00s) --- PASS: TestBlockLabelNames/happy_case_cached_with_matchers (0.05s) === RUN TestBlockLabelValues === RUN TestBlockLabelValues/happy_case_with_no_matchers === RUN TestBlockLabelValues/index_reader_error_with_no_matchers === RUN TestBlockLabelValues/happy_case_cached_with_no_matchers === RUN TestBlockLabelValues/error_with_matchers === RUN TestBlockLabelValues/happy_case_cached_with_matchers --- PASS: TestBlockLabelValues (3.53s) --- PASS: TestBlockLabelValues/happy_case_with_no_matchers (0.00s) --- PASS: TestBlockLabelValues/index_reader_error_with_no_matchers (0.00s) --- PASS: TestBlockLabelValues/happy_case_cached_with_no_matchers (0.00s) --- PASS: TestBlockLabelValues/error_with_matchers (0.00s) --- PASS: TestBlockLabelValues/happy_case_cached_with_matchers (0.01s) === RUN TestBucketIndexReader_ExpandedPostings === RUN TestBucketIndexReader_ExpandedPostings/happy_cases === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="X" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="X",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="X",j!="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/j=~"XXX|YYY" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/j=~"X.+" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"X|Y|Z" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/j="foo",n="1" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j!="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".+" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"^.+$",j=~"X.+" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i!="" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="X",i=~"^.+$",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",i!="2",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j=~"X.+" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j=~"XXX|YYY" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~"X|Y|Z",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~"1.+",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!="2",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!~"2.*",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/n="X",i=~"^.+$",i!~"^.*2.*$",j="foo" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"0xxx|1xxx|2xxx" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"(0|1|2)xxx" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"[0-2]xxx" === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i!~[0-2]xxx === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*",_i!~[0-2]xxx === RUN TestBucketIndexReader_ExpandedPostings/happy_cases/p!="" === RUN TestBucketIndexReader_ExpandedPostings/corrupted_or_undecodable_postings_cache_doesn't_fail === RUN TestBucketIndexReader_ExpandedPostings/promise === RUN TestBucketIndexReader_ExpandedPostings/cached === RUN TestBucketIndexReader_ExpandedPostings/corrupt_cached_expanded_postings_don't_make_request_fail === RUN TestBucketIndexReader_ExpandedPostings/expandedPostings_returning_error_is_not_cached === RUN TestBucketIndexReader_ExpandedPostings/requesting_a_label_value_that_doesn't_exist_doesn't_reach_the_cache_or_the_bucket === RUN TestBucketIndexReader_ExpandedPostings/requesting_a_label_value_(with_regex)_that_doesn't_exist_doesn't_reach_the_cache_or_the_bucket --- PASS: TestBucketIndexReader_ExpandedPostings (3.94s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases (0.13s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="X" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="X",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="X",j!="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/j=~"XXX|YYY" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/j=~"X.+" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"X|Y|Z" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/j="foo",n="1" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",j!="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".+" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"^.+$",j=~"X.+" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i!="" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="X",i=~"^.+$",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".*",i!="2",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="" (0.01s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j="foo" (0.01s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j=~"X.+" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i!="",j=~"XXX|YYY" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~"X|Y|Z",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~"1.+",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!="2",j="foo" (0.01s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="1",i=~".+",i!~"2.*",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/n="X",i=~"^.+$",i!~"^.*2.*$",j="foo" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"0xxx|1xxx|2xxx" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"(0|1|2)xxx" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~"[0-2]xxx" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i!~[0-2]xxx (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/i=~".*",_i!~[0-2]xxx (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/happy_cases/p!="" (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/corrupted_or_undecodable_postings_cache_doesn't_fail (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/promise (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/cached (0.01s) --- PASS: TestBucketIndexReader_ExpandedPostings/corrupt_cached_expanded_postings_don't_make_request_fail (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/expandedPostings_returning_error_is_not_cached (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/requesting_a_label_value_that_doesn't_exist_doesn't_reach_the_cache_or_the_bucket (0.00s) --- PASS: TestBucketIndexReader_ExpandedPostings/requesting_a_label_value_(with_regex)_that_doesn't_exist_doesn't_reach_the_cache_or_the_bucket (0.00s) === RUN TestBucket_Series === RUN TestBucket_Series/10000SeriesWith1Samples bucket_test.go:2555: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucket_Series10000SeriesWith1Samples247927271/001/0 bucket_test.go:2555: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucket_Series10000SeriesWith1Samples247927271/001/1 bucket_test.go:2555: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucket_Series10000SeriesWith1Samples247927271/001/2 bucket_test.go:2555: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucket_Series10000SeriesWith1Samples247927271/001/3 === RUN TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_and_index_cache_(1K_per_batch) === RUN TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 === RUN TestBucket_Series/10000SeriesWith1Samples/with_default_options === RUN TestBucket_Series/10000SeriesWith1Samples/with_default_options/10000of10000 === RUN TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_(1K_per_batch) === RUN TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_(1K_per_batch)/10000of10000 === RUN TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_(10K_per_batch) === RUN TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_(10K_per_batch)/10000of10000 === RUN TestBucket_Series/1000SeriesWith10Samples bucket_test.go:2555: Creating 250 2-sample series with 1ms interval in /tmp/TestBucket_Series1000SeriesWith10Samples2633281368/001/0 bucket_test.go:2555: Creating 250 2-sample series with 1ms interval in /tmp/TestBucket_Series1000SeriesWith10Samples2633281368/001/1 bucket_test.go:2555: Creating 250 2-sample series with 1ms interval in /tmp/TestBucket_Series1000SeriesWith10Samples2633281368/001/2 bucket_test.go:2555: Creating 250 2-sample series with 1ms interval in /tmp/TestBucket_Series1000SeriesWith10Samples2633281368/001/3 === RUN TestBucket_Series/1000SeriesWith10Samples/with_default_options === RUN TestBucket_Series/1000SeriesWith10Samples/with_default_options/10000of10000 === RUN TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_(1K_per_batch) === RUN TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_(1K_per_batch)/10000of10000 === RUN TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_(10K_per_batch) === RUN TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_(10K_per_batch)/10000of10000 === RUN TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_and_index_cache_(1K_per_batch) === RUN TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 === RUN TestBucket_Series/1SeriesWith10000Samples bucket_test.go:2555: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucket_Series1SeriesWith10000Samples4037745444/001/0 bucket_test.go:2555: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucket_Series1SeriesWith10000Samples4037745444/001/1 bucket_test.go:2555: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucket_Series1SeriesWith10000Samples4037745444/001/2 bucket_test.go:2555: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucket_Series1SeriesWith10000Samples4037745444/001/3 === RUN TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_and_index_cache_(1K_per_batch) === RUN TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 === RUN TestBucket_Series/1SeriesWith10000Samples/with_default_options === RUN TestBucket_Series/1SeriesWith10000Samples/with_default_options/10000of10000 === RUN TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_(1K_per_batch) === RUN TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_(1K_per_batch)/10000of10000 === RUN TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_(10K_per_batch) === RUN TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_(10K_per_batch)/10000of10000 --- PASS: TestBucket_Series (47.28s) --- PASS: TestBucket_Series/10000SeriesWith1Samples (18.14s) --- PASS: TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_and_index_cache_(1K_per_batch) (0.90s) --- PASS: TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 (0.84s) --- PASS: TestBucket_Series/10000SeriesWith1Samples/with_default_options (0.62s) --- PASS: TestBucket_Series/10000SeriesWith1Samples/with_default_options/10000of10000 (0.60s) --- PASS: TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_(1K_per_batch) (0.80s) --- PASS: TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_(1K_per_batch)/10000of10000 (0.74s) --- PASS: TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_(10K_per_batch) (0.83s) --- PASS: TestBucket_Series/10000SeriesWith1Samples/with_series_streaming_(10K_per_batch)/10000of10000 (0.80s) --- PASS: TestBucket_Series/1000SeriesWith10Samples (13.91s) --- PASS: TestBucket_Series/1000SeriesWith10Samples/with_default_options (0.09s) --- PASS: TestBucket_Series/1000SeriesWith10Samples/with_default_options/10000of10000 (0.07s) --- PASS: TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_(1K_per_batch) (0.16s) --- PASS: TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_(1K_per_batch)/10000of10000 (0.14s) --- PASS: TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_(10K_per_batch) (0.10s) --- PASS: TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_(10K_per_batch)/10000of10000 (0.09s) --- PASS: TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_and_index_cache_(1K_per_batch) (0.16s) --- PASS: TestBucket_Series/1000SeriesWith10Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 (0.13s) --- PASS: TestBucket_Series/1SeriesWith10000Samples (15.07s) --- PASS: TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_and_index_cache_(1K_per_batch) (0.03s) --- PASS: TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 (0.01s) --- PASS: TestBucket_Series/1SeriesWith10000Samples/with_default_options (0.04s) --- PASS: TestBucket_Series/1SeriesWith10000Samples/with_default_options/10000of10000 (0.04s) --- PASS: TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_(1K_per_batch) (0.02s) --- PASS: TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_(1K_per_batch)/10000of10000 (0.01s) --- PASS: TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_(10K_per_batch) (0.05s) --- PASS: TestBucket_Series/1SeriesWith10000Samples/with_series_streaming_(10K_per_batch)/10000of10000 (0.03s) === RUN TestBucket_Series_WithSkipChunks === RUN TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples bucket_test.go:2555: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks10000SeriesWith1Samples782387743/001/0 bucket_test.go:2555: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks10000SeriesWith1Samples782387743/001/1 bucket_test.go:2555: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks10000SeriesWith1Samples782387743/001/2 bucket_test.go:2555: Creating 2500 1-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks10000SeriesWith1Samples782387743/001/3 === RUN TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_and_index_cache_(1K_per_batch) === RUN TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 === RUN TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_default_options === RUN TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_default_options/10000of10000 === RUN TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_(1K_per_batch) === RUN TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_(1K_per_batch)/10000of10000 === RUN TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_(10K_per_batch) === RUN TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_(10K_per_batch)/10000of10000 === RUN TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples bucket_test.go:2555: Creating 250 2-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks1000SeriesWith10Samples2177086754/001/0 bucket_test.go:2555: Creating 250 2-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks1000SeriesWith10Samples2177086754/001/1 bucket_test.go:2555: Creating 250 2-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks1000SeriesWith10Samples2177086754/001/2 bucket_test.go:2555: Creating 250 2-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks1000SeriesWith10Samples2177086754/001/3 === RUN TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_(1K_per_batch) === RUN TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_(1K_per_batch)/10000of10000 === RUN TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_(10K_per_batch) === RUN TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_(10K_per_batch)/10000of10000 === RUN TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_and_index_cache_(1K_per_batch) === RUN TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 === RUN TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_default_options === RUN TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_default_options/10000of10000 === RUN TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples bucket_test.go:2555: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks1SeriesWith10000Samples1544865284/001/0 bucket_test.go:2555: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks1SeriesWith10000Samples1544865284/001/1 bucket_test.go:2555: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks1SeriesWith10000Samples1544865284/001/2 bucket_test.go:2555: Creating 1 2500-sample series with 1ms interval in /tmp/TestBucket_Series_WithSkipChunks1SeriesWith10000Samples1544865284/001/3 === RUN TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_(1K_per_batch) === RUN TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_(1K_per_batch)/10000of10000 === RUN TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_(10K_per_batch) === RUN TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_(10K_per_batch)/10000of10000 === RUN TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_and_index_cache_(1K_per_batch) === RUN TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 === RUN TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_default_options === RUN TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_default_options/10000of10000 --- PASS: TestBucket_Series_WithSkipChunks (43.52s) --- PASS: TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples (17.86s) --- PASS: TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_and_index_cache_(1K_per_batch) (0.94s) --- PASS: TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 (0.89s) --- PASS: TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_default_options (0.62s) --- PASS: TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_default_options/10000of10000 (0.59s) --- PASS: TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_(1K_per_batch) (0.53s) --- PASS: TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_(1K_per_batch)/10000of10000 (0.50s) --- PASS: TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_(10K_per_batch) (0.55s) --- PASS: TestBucket_Series_WithSkipChunks/10000SeriesWith1Samples/with_series_streaming_(10K_per_batch)/10000of10000 (0.52s) --- PASS: TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples (13.11s) --- PASS: TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_(1K_per_batch) (0.07s) --- PASS: TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_(1K_per_batch)/10000of10000 (0.05s) --- PASS: TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_(10K_per_batch) (0.08s) --- PASS: TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_(10K_per_batch)/10000of10000 (0.07s) --- PASS: TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_and_index_cache_(1K_per_batch) (0.09s) --- PASS: TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 (0.08s) --- PASS: TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_default_options (0.10s) --- PASS: TestBucket_Series_WithSkipChunks/1000SeriesWith10Samples/with_default_options/10000of10000 (0.09s) --- PASS: TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples (12.46s) --- PASS: TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_(1K_per_batch) (0.02s) --- PASS: TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_(1K_per_batch)/10000of10000 (0.01s) --- PASS: TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_(10K_per_batch) (0.01s) --- PASS: TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_(10K_per_batch)/10000of10000 (0.01s) --- PASS: TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_and_index_cache_(1K_per_batch) (0.01s) --- PASS: TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_series_streaming_and_index_cache_(1K_per_batch)/10000of10000 (0.01s) --- PASS: TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_default_options (0.01s) --- PASS: TestBucket_Series_WithSkipChunks/1SeriesWith10000Samples/with_default_options/10000of10000 (0.00s) === RUN TestBucket_Series_Concurrency bucket_test.go:1249: generating test blocks bucket_test.go:2555: Creating 100 200-sample series with 1ms interval in /tmp/TestBucket_Series_Concurrency3699210895/001/0 bucket_test.go:2555: Creating 100 200-sample series with 1ms interval in /tmp/TestBucket_Series_Concurrency3699210895/001/1 bucket_test.go:2555: Creating 100 200-sample series with 1ms interval in /tmp/TestBucket_Series_Concurrency3699210895/001/2 bucket_test.go:2555: Creating 100 200-sample series with 1ms interval in /tmp/TestBucket_Series_Concurrency3699210895/001/3 bucket_test.go:1268: generated test blocks === RUN TestBucket_Series_Concurrency/batch_size:_4 === RUN TestBucket_Series_Concurrency/batch_size:_800 --- PASS: TestBucket_Series_Concurrency (164.63s) --- PASS: TestBucket_Series_Concurrency/batch_size:_4 (117.55s) --- PASS: TestBucket_Series_Concurrency/batch_size:_800 (33.41s) === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_one_block._Fill_the_cache_on_the_way. === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_second_block._This_should_revoke_previous_cache. === RUN TestBucketSeries_OneBlock_InMemIndexCacheSegfault/remove_second_block._Cache_stays._Ask_for_first_again. --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault (6.46s) --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_one_block._Fill_the_cache_on_the_way. (0.07s) --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault/invoke_series_for_second_block._This_should_revoke_previous_cache. (0.01s) --- PASS: TestBucketSeries_OneBlock_InMemIndexCacheSegfault/remove_second_block._Cache_stays._Ask_for_first_again. (0.01s) === RUN TestSeries_RequestAndResponseHints === RUN TestSeries_RequestAndResponseHints/with_default_options bucket_test.go:2555: Creating 2 1-sample series with 1ms interval in /tmp/TestSeries_RequestAndResponseHintswith_default_options1834883646/001/0 bucket_test.go:2555: Creating 2 1-sample series with 1ms interval in /tmp/TestSeries_RequestAndResponseHintswith_default_options1834883646/001/1 === RUN TestSeries_RequestAndResponseHints/with_default_options/querying_a_range_containing_1_block_should_return_1_block_in_the_response_hints === RUN TestSeries_RequestAndResponseHints/with_default_options/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints === RUN TestSeries_RequestAndResponseHints/with_default_options/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block === RUN TestSeries_RequestAndResponseHints/with_series_streaming bucket_test.go:2555: Creating 2 1-sample series with 1ms interval in /tmp/TestSeries_RequestAndResponseHintswith_series_streaming1716559525/001/0 bucket_test.go:2555: Creating 2 1-sample series with 1ms interval in /tmp/TestSeries_RequestAndResponseHintswith_series_streaming1716559525/001/1 === RUN TestSeries_RequestAndResponseHints/with_series_streaming/querying_a_range_containing_1_block_should_return_1_block_in_the_response_hints === RUN TestSeries_RequestAndResponseHints/with_series_streaming/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints === RUN TestSeries_RequestAndResponseHints/with_series_streaming/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block --- PASS: TestSeries_RequestAndResponseHints (12.26s) --- PASS: TestSeries_RequestAndResponseHints/with_default_options (6.06s) --- PASS: TestSeries_RequestAndResponseHints/with_default_options/querying_a_range_containing_1_block_should_return_1_block_in_the_response_hints (0.00s) --- PASS: TestSeries_RequestAndResponseHints/with_default_options/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints (0.00s) --- PASS: TestSeries_RequestAndResponseHints/with_default_options/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block (0.00s) --- PASS: TestSeries_RequestAndResponseHints/with_series_streaming (6.20s) --- PASS: TestSeries_RequestAndResponseHints/with_series_streaming/querying_a_range_containing_1_block_should_return_1_block_in_the_response_hints (0.00s) --- PASS: TestSeries_RequestAndResponseHints/with_series_streaming/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints (0.01s) --- PASS: TestSeries_RequestAndResponseHints/with_series_streaming/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block (0.00s) === RUN TestSeries_ErrorUnmarshallingRequestHints --- PASS: TestSeries_ErrorUnmarshallingRequestHints (0.00s) === RUN TestSeries_CanceledRequest --- PASS: TestSeries_CanceledRequest (0.00s) === RUN TestSeries_InvalidRequest --- PASS: TestSeries_InvalidRequest (0.00s) === RUN TestSeries_BlockWithMultipleChunks === RUN TestSeries_BlockWithMultipleChunks/query_the_entire_block === RUN TestSeries_BlockWithMultipleChunks/query_the_beginning_of_the_block === RUN TestSeries_BlockWithMultipleChunks/query_the_middle_of_the_block === RUN TestSeries_BlockWithMultipleChunks/query_the_end_of_the_block --- PASS: TestSeries_BlockWithMultipleChunks (4.23s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_entire_block (0.01s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_beginning_of_the_block (0.00s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_middle_of_the_block (0.00s) --- PASS: TestSeries_BlockWithMultipleChunks/query_the_end_of_the_block (0.00s) === RUN TestLabelNamesAndValuesHints bucket_test.go:2555: Creating 2 1-sample series with 1ms interval in /tmp/TestLabelNamesAndValuesHints2998521589/001/0 bucket_test.go:2555: Creating 2 1-sample series with 1ms interval in /tmp/TestLabelNamesAndValuesHints2998521589/001/1 === RUN TestLabelNamesAndValuesHints/querying_a_range_containing_1_block_should_return_1_block_in_the_labels_hints === RUN TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints === RUN TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block --- PASS: TestLabelNamesAndValuesHints (6.22s) --- PASS: TestLabelNamesAndValuesHints/querying_a_range_containing_1_block_should_return_1_block_in_the_labels_hints (0.00s) --- PASS: TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_should_return_multiple_blocks_in_the_response_hints (0.00s) --- PASS: TestLabelNamesAndValuesHints/querying_a_range_containing_multiple_blocks_but_filtering_a_specific_block_should_query_only_the_requested_block (0.00s) === RUN TestBlockSeries_skipChunks_ignoresMintMaxt --- PASS: TestBlockSeries_skipChunks_ignoresMintMaxt (3.07s) === RUN TestBlockSeries_Cache === RUN TestBlockSeries_Cache/does_not_update_cache_on_error === RUN TestBlockSeries_Cache/caches_series --- PASS: TestBlockSeries_Cache (3.13s) --- PASS: TestBlockSeries_Cache/does_not_update_cache_on_error (0.00s) --- PASS: TestBlockSeries_Cache/caches_series (0.01s) === RUN TestFilterPostingsByCachedShardHash === RUN TestFilterPostingsByCachedShardHash/should_be_a_noop_if_the_cache_is_empty === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_beginning_of_the_slice === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_in_the_middle_of_the_slice === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_end_of_the_slice === RUN TestFilterPostingsByCachedShardHash/should_filter_postings_when_all_postings_are_in_the_cache --- PASS: TestFilterPostingsByCachedShardHash (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_be_a_noop_if_the_cache_is_empty (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_beginning_of_the_slice (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_in_the_middle_of_the_slice (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_at_the_end_of_the_slice (0.00s) --- PASS: TestFilterPostingsByCachedShardHash/should_filter_postings_when_all_postings_are_in_the_cache (0.00s) === RUN TestFilterPostingsByCachedShardHash_NoAllocations --- PASS: TestFilterPostingsByCachedShardHash_NoAllocations (0.00s) === RUN TestChunkBytesPool_Get --- PASS: TestChunkBytesPool_Get (0.00s) === RUN TestIsHealthyForStoreGatewayOperations === PAUSE TestIsHealthyForStoreGatewayOperations === RUN TestUnregisterOnShutdownFlag --- PASS: TestUnregisterOnShutdownFlag (0.00s) === RUN TestConfig_Validate === RUN TestConfig_Validate/should_pass_by_default === RUN TestConfig_Validate/should_fail_if_shard_size_is_negative === RUN TestConfig_Validate/should_pass_if_shard_size_has_been_set --- PASS: TestConfig_Validate (0.01s) --- PASS: TestConfig_Validate/should_pass_by_default (0.00s) --- PASS: TestConfig_Validate/should_fail_if_shard_size_is_negative (0.00s) --- PASS: TestConfig_Validate/should_pass_if_shard_size_has_been_set (0.00s) === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_not_in_the_ring === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_PENDING_state_and_has_no_tokens === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_JOINING_state_and_has_some_tokens === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_ACTIVE_state_and_has_all_tokens === RUN TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_LEAVING_state_and_has_all_tokens --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled (1.93s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_not_in_the_ring (0.34s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_PENDING_state_and_has_no_tokens (0.27s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_JOINING_state_and_has_some_tokens (0.21s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_ACTIVE_state_and_has_all_tokens (0.58s) --- PASS: TestStoreGateway_InitialSyncWithDefaultShardingEnabled/instance_already_in_the_ring_with_LEAVING_state_and_has_all_tokens (0.51s) === RUN TestStoreGateway_InitialSyncFailure --- PASS: TestStoreGateway_InitialSyncFailure (4.44s) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) === RUN TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) === PAUSE TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) === NAME TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1681075813925990419 === NAME TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1681075813926072419 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1681075813926584419 === NAME TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1681075813926034419 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1681075818372496691 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1681075820493562344 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1681075822930089945 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1681075827398839213 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1681075827446517205 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1681075828810983982 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1681075831699889509 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1681075833038204290 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) gateway_test.go:301: random generator seed: 1681075833138646273 === CONT TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) gateway_test.go:301: random generator seed: 1681075834054309124 --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability (73.66s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) (4.45s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_false) (6.57s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_false) (4.56s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_5_gateways,_RF_=_2_(bucket_index_enabled_=_true) (6.89s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) (4.52s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_false) (14.88s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_1,_1_gateway,_RF_=_1_(bucket_index_enabled_=_true) (4.30s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_3,_20_gateways,_RF_=_3_(bucket_index_enabled_=_true) (19.11s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_false) (4.33s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_5_gateways,_RF_=_3_(bucket_index_enabled_=_true) (6.61s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_false) (4.63s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_1_gateway,_RF_=_1_(bucket_index_enabled_=_false) (4.34s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_2_gateways,_RF_=_1_(bucket_index_enabled_=_true) (5.37s) --- PASS: TestStoreGateway_InitialSyncWithWaitRingTokensStability/shard_size_0,_3_gateways,_RF_=_2_(bucket_index_enabled_=_true) (6.41s) === RUN TestStoreGateway_BlocksSyncWithDefaultSharding_RingTopologyChangedAfterScaleUp panic: test timed out after 10m0s running tests: TestStoreGateway_BlocksSyncWithDefaultSharding_RingTopologyChangedAfterScaleUp (1m7s) goroutine 658376 [running]: testing.(*M).startAlarm.func1() /usr/lib/go/src/testing/testing.go:2241 +0x300 created by time.goFunc /usr/lib/go/src/time/sleep.go:176 +0x50 goroutine 1 [chan receive, 1 minutes]: testing.(*T).Run(0x3f6830c4e0, {0xf3c439?, 0xa0b20?}, 0xf5b6e8) /usr/lib/go/src/testing/testing.go:1630 +0x3b4 testing.runTests.func1(0x30?) /usr/lib/go/src/testing/testing.go:2036 +0x54 testing.tRunner(0x3f6830c4e0, 0x3f686ffca0) /usr/lib/go/src/testing/testing.go:1576 +0x11c testing.runTests(0x3f685b30e0?, {0x1bc6fa0, 0x55, 0x55}, {0x1d828?, 0x3f6c1b56c8?, 0x1c3efc0?}) /usr/lib/go/src/testing/testing.go:2034 +0x424 testing.(*M).Run(0x3f685b30e0) /usr/lib/go/src/testing/testing.go:1906 +0x560 main.main() _testmain.go:241 +0x1a8 goroutine 51 [select]: go.opencensus.io/stats/view.(*worker).start(0x3f682d2b80) /build/mimir/src/mimir/vendor/go.opencensus.io/stats/view/worker.go:292 +0x94 created by go.opencensus.io/stats/view.init.0 /build/mimir/src/mimir/vendor/go.opencensus.io/stats/view/worker.go:34 +0xa0 goroutine 53 [chan receive, 10 minutes]: testing.(*T).Parallel(0x3f6830c680) /usr/lib/go/src/testing/testing.go:1384 +0x1ac github.com/grafana/mimir/pkg/storegateway.foreachStore(0x64332c6a?, 0xf5b498) /build/mimir/src/mimir/pkg/storegateway/bucket_e2e_test.go:877 +0x38 github.com/grafana/mimir/pkg/storegateway.TestBucketStore_e2e(0x0?) /build/mimir/src/mimir/pkg/storegateway/bucket_e2e_test.go:546 +0x30 testing.tRunner(0x3f6830c680, 0xf5b4a0) /usr/lib/go/src/testing/testing.go:1576 +0x11c created by testing.(*T).Run /usr/lib/go/src/testing/testing.go:1629 +0x3a0 goroutine 54 [chan receive, 10 minutes]: testing.(*T).Parallel(0x3f6830c9c0) /usr/lib/go/src/testing/testing.go:1384 +0x1ac github.com/grafana/mimir/pkg/storegateway.foreachStore(0x64332c6a?, 0xf5b478) /build/mimir/src/mimir/pkg/storegateway/bucket_e2e_test.go:877 +0x38 github.com/grafana/mimir/pkg/storegateway.TestBucketStore_ManyParts_e2e(0x0?) /build/mimir/src/mimir/pkg/storegateway/bucket_e2e_test.go:597 +0x30 testing.tRunner(0x3f6830c9c0, 0xf5b480) /usr/lib/go/src/testing/testing.go:1576 +0x11c created by testing.(*T).Run /usr/lib/go/src/testing/testing.go:1629 +0x3a0 goroutine 759 [chan receive, 8 minutes]: testing.(*T).Parallel(0x3f3c3224e0) /usr/lib/go/src/testing/testing.go:1384 +0x1ac github.com/grafana/mimir/pkg/storegateway.foreachStore(0x64332cc3?, 0xf5b450) /build/mimir/src/mimir/pkg/storegateway/bucket_e2e_test.go:877 +0x38 github.com/grafana/mimir/pkg/storegateway.TestBucketStore_LabelNames_e2e(0x7e3e4?) /build/mimir/src/mimir/pkg/storegateway/bucket_e2e_test.go:686 +0x30 testing.tRunner(0x3f3c3224e0, 0xf5b458) /usr/lib/go/src/testing/testing.go:1576 +0x11c created by testing.(*T).Run /usr/lib/go/src/testing/testing.go:1629 +0x3a0 goroutine 760 [chan receive, 8 minutes]: testing.(*T).Parallel(0x3f3c322680) /usr/lib/go/src/testing/testing.go:1384 +0x1ac github.com/grafana/mimir/pkg/storegateway.foreachStore(0x64332cc3?, 0xf5b460) /build/mimir/src/mimir/pkg/storegateway/bucket_e2e_test.go:877 +0x38 github.com/grafana/mimir/pkg/storegateway.TestBucketStore_LabelValues_e2e(0x7e3e4?) /build/mimir/src/mimir/pkg/storegateway/bucket_e2e_test.go:783 +0x30 testing.tRunner(0x3f3c322680, 0xf5b468) /usr/lib/go/src/testing/testing.go:1576 +0x11c created by testing.(*T).Run /usr/lib/go/src/testing/testing.go:1629 +0x3a0 goroutine 912 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 1637 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 920 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 658370 [select]: github.com/prometheus/prometheus/tsdb.(*DB).run(0x3f3d3ec5a0) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/db.go:921 +0x10c created by github.com/prometheus/prometheus/tsdb.open /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/db.go:868 +0xe44 goroutine 634958 [chan receive, 2 minutes]: testing.(*T).Parallel(0x3f3c298340) /usr/lib/go/src/testing/testing.go:1384 +0x1ac github.com/grafana/mimir/pkg/storegateway.TestIsHealthyForStoreGatewayOperations(0x7e3e4?) /build/mimir/src/mimir/pkg/storegateway/gateway_ring_test.go:19 +0x30 testing.tRunner(0x3f3c298340, 0xf5b598) /usr/lib/go/src/testing/testing.go:1576 +0x11c created by testing.(*T).Run /usr/lib/go/src/testing/testing.go:1629 +0x3a0 goroutine 655915 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 1759 [select]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635523 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 1645 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 655276 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635483 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 658319 [syscall]: syscall.Syscall(0x0?, 0xb9828?, 0xb61dc?, 0x36?) /usr/lib/go/src/syscall/syscall_linux.go:69 +0x20 syscall.Ftruncate(0x0?, 0xbb470?) /usr/lib/go/src/syscall/zsyscall_linux_riscv64.go:1138 +0x40 internal/poll.(*FD).Ftruncate.func1(...) /usr/lib/go/src/internal/poll/fd_posix.go:50 internal/poll.ignoringEINTR(...) /usr/lib/go/src/internal/poll/fd_posix.go:74 internal/poll.(*FD).Ftruncate(0x3f3d022cc0, 0x36) /usr/lib/go/src/internal/poll/fd_posix.go:49 +0x124 os.(*File).Truncate(0x3f3e902028, 0x3f3cb4c260?) /usr/lib/go/src/os/file_posix.go:155 +0x68 github.com/prometheus/prometheus/tsdb/chunks.(*Writer).finalizeTail(0x3f3cb4c260?) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/chunks/chunks.go:265 +0x88 github.com/prometheus/prometheus/tsdb/chunks.(*Writer).Close(0x3f3d37e500) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/chunks/chunks.go:466 +0x2c github.com/prometheus/prometheus/tsdb.(*preventDoubleCloseChunkWriter).Close(0x1?) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/async_block_writer.go:172 +0x64 github.com/prometheus/prometheus/tsdb.(*asyncBlockWriter).loop(0x3f3d82c000) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/async_block_writer.go:98 +0x288 created by github.com/prometheus/prometheus/tsdb.newAsyncBlockWriter /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/async_block_writer.go:55 +0x1b4 goroutine 1629 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 1427 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 655908 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635638 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 2126 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 658325 [select]: github.com/prometheus/prometheus/tsdb/wlog.(*WL).run(0x3f3c032000) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/wlog/wlog.go:336 +0x94 created by github.com/prometheus/prometheus/tsdb/wlog.NewSize /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/wlog/wlog.go:305 +0x408 goroutine 1656 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657995 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 656662 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 1169 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 2585 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635204 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657462 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 658237 [chan receive]: github.com/prometheus/prometheus/tsdb.(*asyncBlockWriter).waitFinished(...) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/async_block_writer.go:137 github.com/prometheus/prometheus/tsdb.(*LeveledCompactor).populateBlock(0x3f3d82c600, {0x3f3c131698, 0x1, 0x93?}, 0x187666d1a98, 0x18766bee800, {0x3f3c1316c8, 0x1, 0x1}) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/compact.go:1125 +0x1258 github.com/prometheus/prometheus/tsdb.(*LeveledCompactor).write(0x3f3d82c600, {0x3f3cb6c150, 0x61}, {0x3f3c1316c8?, 0x1, 0x1}, {0x3f3c131698, 0x1, 0x1}) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/compact.go:817 +0x784 github.com/prometheus/prometheus/tsdb.(*LeveledCompactor).Write(0x3f3d82c600, {0x3f3cb6c150, 0x61}, {0x1248e80, 0x3f3cb4cba0}, 0x187666d1a98, 0x18766bee800, 0x0) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/compact.go:694 +0x280 github.com/prometheus/prometheus/tsdb.(*DB).compactHead(0x3f3d3ec5a0, 0x3f3cb4cba0) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/db.go:1252 +0x74 github.com/prometheus/prometheus/tsdb.(*DB).Compact(0x3f3d3ec5a0) /build/mimir/src/mimir/vendor/github.com/prometheus/prometheus/tsdb/db.go:1106 +0x260 github.com/grafana/mimir/pkg/storegateway.mockTSDB.func1(0x15) /build/mimir/src/mimir/pkg/storegateway/gateway_test.go:1423 +0x170 github.com/grafana/mimir/pkg/storegateway.mockTSDB(0x3f3c299520, {0x3f3cb6c0e0, 0x68}, 0x18, 0xc, 0x18762c74418, 0x18767eda018) /build/mimir/src/mimir/pkg/storegateway/gateway_test.go:1429 +0x204 github.com/grafana/mimir/pkg/storegateway.TestStoreGateway_BlocksSyncWithDefaultSharding_RingTopologyChangedAfterScaleUp(0x3f3c299520) /build/mimir/src/mimir/pkg/storegateway/gateway_test.go:393 +0x298 testing.tRunner(0x3f3c299520, 0xf5b6e8) /usr/lib/go/src/testing/testing.go:1576 +0x11c created by testing.(*T).Run /usr/lib/go/src/testing/testing.go:1629 +0x3a0 goroutine 657454 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635060 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635363 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 656715 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 1664 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635010 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 658005 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635646 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657400 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657615 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635164 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 635323 [select, 2 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657608 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657345 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 654527 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 654394 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 654551 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 656654 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 655800 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 653419 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657685 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 654458 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 643180 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 647595 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 643207 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 655820 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 655813 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644119 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 648212 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657388 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644148 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644575 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644567 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 648044 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644267 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644307 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644726 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644415 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 650109 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 646196 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644423 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 646125 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 653761 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 646249 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657692 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 647634 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 656596 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 656723 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 646227 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 654512 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 648162 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 647885 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 644734 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 646278 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 654536 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 650045 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 647919 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 646325 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 647982 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 648189 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 646344 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 650080 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 647775 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 654376 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 654421 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 646400 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 647457 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 647259 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 646734 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 657338 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 648273 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 656635 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 goroutine 649999 [select, 1 minutes]: github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool.func1() /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:71 +0x88 created by github.com/grafana/mimir/pkg/storegateway/indexheader.NewReaderPool /build/mimir/src/mimir/pkg/storegateway/indexheader/reader_pool.go:69 +0x184 FAIL github.com/grafana/mimir/pkg/storegateway 600.737s === RUN TestCanonicalLabelMatchersKey --- PASS: TestCanonicalLabelMatchersKey (0.00s) === RUN TestUnsafeCastPostingsToBytes === RUN TestUnsafeCastPostingsToBytes/base_case === RUN TestUnsafeCastPostingsToBytes/zero-length_postings === RUN TestUnsafeCastPostingsToBytes/nil_postings === RUN TestUnsafeCastPostingsToBytes/more_than_256_postings --- PASS: TestUnsafeCastPostingsToBytes (0.00s) --- PASS: TestUnsafeCastPostingsToBytes/base_case (0.00s) --- PASS: TestUnsafeCastPostingsToBytes/zero-length_postings (0.00s) --- PASS: TestUnsafeCastPostingsToBytes/nil_postings (0.00s) --- PASS: TestUnsafeCastPostingsToBytes/more_than_256_postings (0.00s) === RUN TestCanonicalPostingsKey === RUN TestCanonicalPostingsKey/same_length_postings_have_different_hashes === RUN TestCanonicalPostingsKey/when_postings_are_a_subset_of_each_other,_they_still_have_different_hashes === RUN TestCanonicalPostingsKey/same_postings_with_different_slice_capacities_have_same_hashes === RUN TestCanonicalPostingsKey/postings_key_is_a_base64-encoded_string_(i.e._is_printable) --- PASS: TestCanonicalPostingsKey (0.00s) --- PASS: TestCanonicalPostingsKey/same_length_postings_have_different_hashes (0.00s) --- PASS: TestCanonicalPostingsKey/when_postings_are_a_subset_of_each_other,_they_still_have_different_hashes (0.00s) --- PASS: TestCanonicalPostingsKey/same_postings_with_different_slice_capacities_have_same_hashes (0.00s) --- PASS: TestCanonicalPostingsKey/postings_key_is_a_base64-encoded_string_(i.e._is_printable) (0.00s) === RUN TestNewInMemoryIndexCache --- PASS: TestNewInMemoryIndexCache (0.00s) === RUN TestInMemoryIndexCache_AvoidsDeadlock --- PASS: TestInMemoryIndexCache_AvoidsDeadlock (0.00s) === RUN TestInMemoryIndexCache_UpdateItem === RUN TestInMemoryIndexCache_UpdateItem/Postings === RUN TestInMemoryIndexCache_UpdateItem/SeriesForRef === RUN TestInMemoryIndexCache_UpdateItem/ExpandedPostings === RUN TestInMemoryIndexCache_UpdateItem/Series === RUN TestInMemoryIndexCache_UpdateItem/SeriesForPostings === RUN TestInMemoryIndexCache_UpdateItem/LabelNames === RUN TestInMemoryIndexCache_UpdateItem/LabelValues --- PASS: TestInMemoryIndexCache_UpdateItem (0.01s) --- PASS: TestInMemoryIndexCache_UpdateItem/Postings (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/SeriesForRef (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/ExpandedPostings (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/Series (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/SeriesForPostings (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/LabelNames (0.00s) --- PASS: TestInMemoryIndexCache_UpdateItem/LabelValues (0.00s) === RUN TestInMemoryIndexCache_MaxNumberOfItemsHit --- PASS: TestInMemoryIndexCache_MaxNumberOfItemsHit (0.00s) === RUN TestInMemoryIndexCache_Eviction_WithMetrics --- PASS: TestInMemoryIndexCache_Eviction_WithMetrics (0.02s) === RUN TestMemcachedIndexCache_FetchMultiPostings === PAUSE TestMemcachedIndexCache_FetchMultiPostings === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef === PAUSE TestMemcachedIndexCache_FetchMultiSeriesForRef === RUN TestMemcachedIndexCache_FetchExpandedPostings === PAUSE TestMemcachedIndexCache_FetchExpandedPostings === RUN TestMemcachedIndexCache_FetchSeriesForPostings === PAUSE TestMemcachedIndexCache_FetchSeriesForPostings === RUN TestMemcachedIndexCache_FetchSeries === PAUSE TestMemcachedIndexCache_FetchSeries === RUN TestMemcachedIndexCache_FetchLabelNames === PAUSE TestMemcachedIndexCache_FetchLabelNames === RUN TestMemcachedIndexCache_FetchLabelValues === PAUSE TestMemcachedIndexCache_FetchLabelValues === RUN TestStringCacheKeys_Values === PAUSE TestStringCacheKeys_Values === RUN TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength === PAUSE TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength === CONT TestMemcachedIndexCache_FetchMultiPostings === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_empty_cache === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_no_misses_on_100%_hit_ratio === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_hits_and_misses_on_partial_hits === RUN TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_memcached_error --- PASS: TestMemcachedIndexCache_FetchMultiPostings (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_no_misses_on_100%_hit_ratio (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_hits_and_misses_on_partial_hits (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiPostings/should_return_no_hits_on_memcached_error (0.00s) === CONT TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength === CONT TestMemcachedIndexCache_FetchSeries === RUN TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_postings === RUN TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_series --- PASS: TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength (0.00s) --- PASS: TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_postings (0.00s) --- PASS: TestStringCacheKeys_ShouldGuaranteeReasonablyShortKeysLength/should_guarantee_reasonably_short_key_length_for_series (0.00s) === CONT TestMemcachedIndexCache_FetchSeriesForPostings === RUN TestMemcachedIndexCache_FetchSeriesForPostings/should_return_no_hit_on_empty_cache === RUN TestMemcachedIndexCache_FetchSeriesForPostings/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchSeriesForPostings/should_return_no_hit_on_memcached_error --- PASS: TestMemcachedIndexCache_FetchSeriesForPostings (0.00s) --- PASS: TestMemcachedIndexCache_FetchSeriesForPostings/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchSeriesForPostings/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchSeriesForPostings/should_return_no_hit_on_memcached_error (0.00s) === CONT TestMemcachedIndexCache_FetchExpandedPostings === RUN TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_empty_cache === RUN TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_memcached_error === CONT TestMemcachedIndexCache_FetchLabelValues === RUN TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_empty_cache === RUN TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_empty_cache === RUN TestMemcachedIndexCache_FetchLabelValues/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchSeries/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_memcached_error --- PASS: TestMemcachedIndexCache_FetchSeries (0.01s) --- PASS: TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_memcached_error (0.00s) --- PASS: TestMemcachedIndexCache_FetchSeries/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchSeries/should_return_no_miss_on_hit (0.00s) === CONT TestStringCacheKeys_Values --- PASS: TestMemcachedIndexCache_FetchLabelValues (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelValues/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelValues/should_return_no_hit_on_memcached_error (0.00s) === CONT TestMemcachedIndexCache_FetchLabelNames === CONT TestMemcachedIndexCache_FetchMultiSeriesForRef === RUN TestStringCacheKeys_Values/should_stringify_postings_cache_key === RUN TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_empty_cache === RUN TestStringCacheKeys_Values/should_stringify_series_cache_key --- PASS: TestStringCacheKeys_Values (0.00s) --- PASS: TestStringCacheKeys_Values/should_stringify_postings_cache_key (0.00s) --- PASS: TestStringCacheKeys_Values/should_stringify_series_cache_key (0.00s) === RUN TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_memcached_error --- PASS: TestMemcachedIndexCache_FetchExpandedPostings (0.01s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchExpandedPostings/should_return_no_hit_on_memcached_error (0.00s) === RUN TestMemcachedIndexCache_FetchLabelNames/should_return_no_miss_on_hit === RUN TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_memcached_error --- PASS: TestMemcachedIndexCache_FetchLabelNames (0.01s) --- PASS: TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelNames/should_return_no_miss_on_hit (0.00s) --- PASS: TestMemcachedIndexCache_FetchLabelNames/should_return_no_hit_on_memcached_error (0.00s) === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_memcached_error === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_empty_cache === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_misses_on_100%_hit_ratio === RUN TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_hits_and_misses_on_partial_hits --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef (0.02s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_memcached_error (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_hits_on_empty_cache (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_no_misses_on_100%_hit_ratio (0.00s) --- PASS: TestMemcachedIndexCache_FetchMultiSeriesForRef/should_return_hits_and_misses_on_partial_hits (0.00s) PASS ok github.com/grafana/mimir/pkg/storegateway/indexcache 0.231s === RUN TestReaders === RUN TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV === RUN TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV/binary_reader === RUN TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV/binary_reader_with_map_populate === RUN TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV/lazy_binary_reader === RUN TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV/stream_binary_reader === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader_with_map_populate === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/lazy_binary_reader === RUN TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/stream_binary_reader --- PASS: TestReaders (3.60s) --- PASS: TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV (0.04s) --- PASS: TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV/binary_reader (0.00s) --- PASS: TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV/binary_reader_with_map_populate (0.00s) --- PASS: TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV/lazy_binary_reader (0.00s) --- PASS: TestReaders/01GXKYB07YXNFTEXFBEJQPGDDV/stream_binary_reader (0.02s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ (0.07s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader (0.01s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/binary_reader_with_map_populate (0.02s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/lazy_binary_reader (0.01s) --- PASS: TestReaders/01DXXFZDYD1MQW6079WK0K6EDQ/stream_binary_reader (0.04s) === RUN TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader === RUN TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader/BinaryReader === RUN TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader/StreamBinaryReader --- PASS: TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader (0.00s) --- PASS: TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader/BinaryReader (0.00s) --- PASS: TestNewLazyBinaryReader_ShouldFailIfUnableToBuildIndexHeader/StreamBinaryReader (0.00s) === RUN TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket === RUN TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket/BinaryReader === RUN TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket/StreamBinaryReader --- PASS: TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket (3.34s) --- PASS: TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket/BinaryReader (0.00s) --- PASS: TestNewLazyBinaryReader_ShouldBuildIndexHeaderFromBucket/StreamBinaryReader (0.03s) === RUN TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader === RUN TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader/BinaryReader === RUN TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader/StreamBinaryReader --- PASS: TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader (3.22s) --- PASS: TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader/BinaryReader (0.00s) --- PASS: TestNewLazyBinaryReader_ShouldRebuildCorruptedIndexHeader/StreamBinaryReader (0.01s) === RUN TestLazyBinaryReader_ShouldReopenOnUsageAfterClose === RUN TestLazyBinaryReader_ShouldReopenOnUsageAfterClose/BinaryReader === RUN TestLazyBinaryReader_ShouldReopenOnUsageAfterClose/StreamBinaryReader --- PASS: TestLazyBinaryReader_ShouldReopenOnUsageAfterClose (3.20s) --- PASS: TestLazyBinaryReader_ShouldReopenOnUsageAfterClose/BinaryReader (0.00s) --- PASS: TestLazyBinaryReader_ShouldReopenOnUsageAfterClose/StreamBinaryReader (0.05s) === RUN TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle === RUN TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle/BinaryReader === RUN TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle/StreamBinaryReader --- PASS: TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle (3.86s) --- PASS: TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle/BinaryReader (0.00s) --- PASS: TestLazyBinaryReader_unload_ShouldReturnErrorIfNotIdle/StreamBinaryReader (0.02s) === RUN TestLazyBinaryReader_LoadUnloadRaceCondition === RUN TestLazyBinaryReader_LoadUnloadRaceCondition/BinaryReader === RUN TestLazyBinaryReader_LoadUnloadRaceCondition/StreamBinaryReader --- PASS: TestLazyBinaryReader_LoadUnloadRaceCondition (14.92s) --- PASS: TestLazyBinaryReader_LoadUnloadRaceCondition/BinaryReader (5.00s) --- PASS: TestLazyBinaryReader_LoadUnloadRaceCondition/StreamBinaryReader (5.02s) === RUN TestReaderPool_NewBinaryReader === RUN TestReaderPool_NewBinaryReader/lazy_reader_is_disabled === RUN TestReaderPool_NewBinaryReader/lazy_reader_is_enabled_but_close_on_idle_timeout_is_disabled === RUN TestReaderPool_NewBinaryReader/lazy_reader_and_close_on_idle_timeout_are_both_enabled --- PASS: TestReaderPool_NewBinaryReader (4.59s) --- PASS: TestReaderPool_NewBinaryReader/lazy_reader_is_disabled (0.00s) --- PASS: TestReaderPool_NewBinaryReader/lazy_reader_is_enabled_but_close_on_idle_timeout_is_disabled (0.00s) --- PASS: TestReaderPool_NewBinaryReader/lazy_reader_and_close_on_idle_timeout_are_both_enabled (0.00s) === RUN TestReaderPool_ShouldCloseIdleLazyReaders --- PASS: TestReaderPool_ShouldCloseIdleLazyReaders (5.61s) PASS ok github.com/grafana/mimir/pkg/storegateway/indexheader 42.547s === RUN TestDecbuf_Be32HappyPath === RUN TestDecbuf_Be32HappyPath/0 === RUN TestDecbuf_Be32HappyPath/1 === RUN TestDecbuf_Be32HappyPath/4294967295 --- PASS: TestDecbuf_Be32HappyPath (0.01s) --- PASS: TestDecbuf_Be32HappyPath/0 (0.00s) --- PASS: TestDecbuf_Be32HappyPath/1 (0.00s) --- PASS: TestDecbuf_Be32HappyPath/4294967295 (0.00s) === RUN TestDecbuf_Be32InsufficientBuffer --- PASS: TestDecbuf_Be32InsufficientBuffer (0.00s) === RUN TestDecbuf_Be32intHappyPath === RUN TestDecbuf_Be32intHappyPath/0 === RUN TestDecbuf_Be32intHappyPath/1 === RUN TestDecbuf_Be32intHappyPath/4294967295 --- PASS: TestDecbuf_Be32intHappyPath (0.00s) --- PASS: TestDecbuf_Be32intHappyPath/0 (0.00s) --- PASS: TestDecbuf_Be32intHappyPath/1 (0.00s) --- PASS: TestDecbuf_Be32intHappyPath/4294967295 (0.00s) === RUN TestDecbuf_Be32intInsufficientBuffer --- PASS: TestDecbuf_Be32intInsufficientBuffer (0.00s) === RUN TestDecbuf_Be64HappyPath === RUN TestDecbuf_Be64HappyPath/0 === RUN TestDecbuf_Be64HappyPath/1 === RUN TestDecbuf_Be64HappyPath/18446744073709551615 --- PASS: TestDecbuf_Be64HappyPath (0.01s) --- PASS: TestDecbuf_Be64HappyPath/0 (0.00s) --- PASS: TestDecbuf_Be64HappyPath/1 (0.00s) --- PASS: TestDecbuf_Be64HappyPath/18446744073709551615 (0.00s) === RUN TestDecbuf_Be64InsufficientBuffer --- PASS: TestDecbuf_Be64InsufficientBuffer (0.00s) === RUN TestDecbuf_SkipHappyPath --- PASS: TestDecbuf_SkipHappyPath (0.00s) === RUN TestDecbuf_SkipMultipleBufferReads --- PASS: TestDecbuf_SkipMultipleBufferReads (0.00s) === RUN TestDecbuf_SkipInsufficientBuffer --- PASS: TestDecbuf_SkipInsufficientBuffer (0.00s) === RUN TestDecbuf_SkipUvarintBytesHappyPath --- PASS: TestDecbuf_SkipUvarintBytesHappyPath (0.00s) === RUN TestDecbuf_SkipUvarintBytesEndOfFile --- PASS: TestDecbuf_SkipUvarintBytesEndOfFile (0.00s) === RUN TestDecbuf_SkipUvarintBytesOnlyHaveLength --- PASS: TestDecbuf_SkipUvarintBytesOnlyHaveLength (0.00s) === RUN TestDecbuf_SkipUvarintBytesPartialValue --- PASS: TestDecbuf_SkipUvarintBytesPartialValue (0.00s) === RUN TestDecbuf_UvarintHappyPath === RUN TestDecbuf_UvarintHappyPath/0 === RUN TestDecbuf_UvarintHappyPath/1 === RUN TestDecbuf_UvarintHappyPath/127 === RUN TestDecbuf_UvarintHappyPath/128 === RUN TestDecbuf_UvarintHappyPath/4294967295 --- PASS: TestDecbuf_UvarintHappyPath (0.01s) --- PASS: TestDecbuf_UvarintHappyPath/0 (0.00s) --- PASS: TestDecbuf_UvarintHappyPath/1 (0.00s) --- PASS: TestDecbuf_UvarintHappyPath/127 (0.00s) --- PASS: TestDecbuf_UvarintHappyPath/128 (0.00s) --- PASS: TestDecbuf_UvarintHappyPath/4294967295 (0.00s) === RUN TestDecbuf_UvarintInsufficientBuffer --- PASS: TestDecbuf_UvarintInsufficientBuffer (0.00s) === RUN TestDecbuf_Uvarint64HappyPath === RUN TestDecbuf_Uvarint64HappyPath/0 === RUN TestDecbuf_Uvarint64HappyPath/1 === RUN TestDecbuf_Uvarint64HappyPath/127 === RUN TestDecbuf_Uvarint64HappyPath/128 === RUN TestDecbuf_Uvarint64HappyPath/4294967295 === RUN TestDecbuf_Uvarint64HappyPath/18446744073709551615 --- PASS: TestDecbuf_Uvarint64HappyPath (0.01s) --- PASS: TestDecbuf_Uvarint64HappyPath/0 (0.00s) --- PASS: TestDecbuf_Uvarint64HappyPath/1 (0.00s) --- PASS: TestDecbuf_Uvarint64HappyPath/127 (0.00s) --- PASS: TestDecbuf_Uvarint64HappyPath/128 (0.00s) --- PASS: TestDecbuf_Uvarint64HappyPath/4294967295 (0.00s) --- PASS: TestDecbuf_Uvarint64HappyPath/18446744073709551615 (0.00s) === RUN TestDecbuf_Uvarint64InsufficientBuffer --- PASS: TestDecbuf_Uvarint64InsufficientBuffer (0.00s) === RUN TestDecbuf_UnsafeUvarintBytesHappyPath === RUN TestDecbuf_UnsafeUvarintBytesHappyPath/nil_slice === RUN TestDecbuf_UnsafeUvarintBytesHappyPath/empty_slice === RUN TestDecbuf_UnsafeUvarintBytesHappyPath/single_byte === RUN TestDecbuf_UnsafeUvarintBytesHappyPath/127_bytes === RUN TestDecbuf_UnsafeUvarintBytesHappyPath/128_bytes --- PASS: TestDecbuf_UnsafeUvarintBytesHappyPath (0.01s) --- PASS: TestDecbuf_UnsafeUvarintBytesHappyPath/nil_slice (0.00s) --- PASS: TestDecbuf_UnsafeUvarintBytesHappyPath/empty_slice (0.00s) --- PASS: TestDecbuf_UnsafeUvarintBytesHappyPath/single_byte (0.00s) --- PASS: TestDecbuf_UnsafeUvarintBytesHappyPath/127_bytes (0.00s) --- PASS: TestDecbuf_UnsafeUvarintBytesHappyPath/128_bytes (0.00s) === RUN TestDecbuf_UnsafeUvarintBytesInsufficientBuffer --- PASS: TestDecbuf_UnsafeUvarintBytesInsufficientBuffer (0.00s) === RUN TestDecbuf_UnsafeUvarintBytesSkipDoesNotCauseBufferFill --- PASS: TestDecbuf_UnsafeUvarintBytesSkipDoesNotCauseBufferFill (0.34s) === RUN TestDecbuf_UvarintStrHappyPath === RUN TestDecbuf_UvarintStrHappyPath/empty_string === RUN TestDecbuf_UvarintStrHappyPath/single_byte === RUN TestDecbuf_UvarintStrHappyPath/127_bytes === RUN TestDecbuf_UvarintStrHappyPath/128_bytes --- PASS: TestDecbuf_UvarintStrHappyPath (0.01s) --- PASS: TestDecbuf_UvarintStrHappyPath/empty_string (0.00s) --- PASS: TestDecbuf_UvarintStrHappyPath/single_byte (0.00s) --- PASS: TestDecbuf_UvarintStrHappyPath/127_bytes (0.00s) --- PASS: TestDecbuf_UvarintStrHappyPath/128_bytes (0.00s) === RUN TestDecbuf_UvarintStrInsufficientBuffer --- PASS: TestDecbuf_UvarintStrInsufficientBuffer (0.00s) === RUN TestDecbuf_Crc32 === RUN TestDecbuf_Crc32/matches_checksum_(small_buffer) === RUN TestDecbuf_Crc32/matches_checksum_(buffer_larger_than_single_read) === RUN TestDecbuf_Crc32/does_not_match_checksum_(small_buffer) === RUN TestDecbuf_Crc32/does_not_match_checksum_(buffer_larger_than_single_read) === RUN TestDecbuf_Crc32/buffer_only_contains_checksum === RUN TestDecbuf_Crc32/buffer_too_short_for_checksum --- PASS: TestDecbuf_Crc32 (1.89s) --- PASS: TestDecbuf_Crc32/matches_checksum_(small_buffer) (0.00s) --- PASS: TestDecbuf_Crc32/matches_checksum_(buffer_larger_than_single_read) (1.05s) --- PASS: TestDecbuf_Crc32/does_not_match_checksum_(small_buffer) (0.01s) --- PASS: TestDecbuf_Crc32/does_not_match_checksum_(buffer_larger_than_single_read) (0.83s) --- PASS: TestDecbuf_Crc32/buffer_only_contains_checksum (0.00s) --- PASS: TestDecbuf_Crc32/buffer_too_short_for_checksum (0.00s) === RUN TestDecbufFactory_NewDecbufAtChecked_InvalidCRC === RUN TestDecbufFactory_NewDecbufAtChecked_InvalidCRC/pooling_file_handles === RUN TestDecbufFactory_NewDecbufAtChecked_InvalidCRC/no_pooling_file_handles --- PASS: TestDecbufFactory_NewDecbufAtChecked_InvalidCRC (0.02s) --- PASS: TestDecbufFactory_NewDecbufAtChecked_InvalidCRC/pooling_file_handles (0.01s) --- PASS: TestDecbufFactory_NewDecbufAtChecked_InvalidCRC/no_pooling_file_handles (0.01s) === RUN TestDecbufFactory_NewDecbufAtChecked_InvalidLength === RUN TestDecbufFactory_NewDecbufAtChecked_InvalidLength/pooling_file_handles === RUN TestDecbufFactory_NewDecbufAtChecked_InvalidLength/no_pooling_file_handles --- PASS: TestDecbufFactory_NewDecbufAtChecked_InvalidLength (0.01s) --- PASS: TestDecbufFactory_NewDecbufAtChecked_InvalidLength/pooling_file_handles (0.01s) --- PASS: TestDecbufFactory_NewDecbufAtChecked_InvalidLength/no_pooling_file_handles (0.01s) === RUN TestDecbufFactory_NewDecbufAtChecked_HappyPath === RUN TestDecbufFactory_NewDecbufAtChecked_HappyPath/pooling_file_handles === RUN TestDecbufFactory_NewDecbufAtChecked_HappyPath/no_pooling_file_handles --- PASS: TestDecbufFactory_NewDecbufAtChecked_HappyPath (0.02s) --- PASS: TestDecbufFactory_NewDecbufAtChecked_HappyPath/pooling_file_handles (0.01s) --- PASS: TestDecbufFactory_NewDecbufAtChecked_HappyPath/no_pooling_file_handles (0.01s) === RUN TestDecbufFactory_NewDecbufAtChecked_MultipleInstances --- PASS: TestDecbufFactory_NewDecbufAtChecked_MultipleInstances (0.02s) === RUN TestDecbufFactory_NewDecbufAtChecked_Concurrent === RUN TestDecbufFactory_NewDecbufAtChecked_Concurrent/pooling_file_handles === RUN TestDecbufFactory_NewDecbufAtChecked_Concurrent/no_pooling_file_handles --- PASS: TestDecbufFactory_NewDecbufAtChecked_Concurrent (9.31s) --- PASS: TestDecbufFactory_NewDecbufAtChecked_Concurrent/pooling_file_handles (4.55s) --- PASS: TestDecbufFactory_NewDecbufAtChecked_Concurrent/no_pooling_file_handles (4.76s) === RUN TestDecbufFactory_NewDecbufAtUnchecked_HappyPath === RUN TestDecbufFactory_NewDecbufAtUnchecked_HappyPath/pooling_file_handles === RUN TestDecbufFactory_NewDecbufAtUnchecked_HappyPath/no_pooling_file_handles --- PASS: TestDecbufFactory_NewDecbufAtUnchecked_HappyPath (0.01s) --- PASS: TestDecbufFactory_NewDecbufAtUnchecked_HappyPath/pooling_file_handles (0.00s) --- PASS: TestDecbufFactory_NewDecbufAtUnchecked_HappyPath/no_pooling_file_handles (0.00s) === RUN TestDecbufFactory_NewDecbufRaw_HappyPath === RUN TestDecbufFactory_NewDecbufRaw_HappyPath/pooling_file_handles === RUN TestDecbufFactory_NewDecbufRaw_HappyPath/no_pooling_file_handles --- PASS: TestDecbufFactory_NewDecbufRaw_HappyPath (0.01s) --- PASS: TestDecbufFactory_NewDecbufRaw_HappyPath/pooling_file_handles (0.00s) --- PASS: TestDecbufFactory_NewDecbufRaw_HappyPath/no_pooling_file_handles (0.00s) === RUN TestDecbufFactory_Stop === RUN TestDecbufFactory_Stop/pooling_file_handles === RUN TestDecbufFactory_Stop/no_pooling_file_handles --- PASS: TestDecbufFactory_Stop (0.01s) --- PASS: TestDecbufFactory_Stop/pooling_file_handles (0.00s) --- PASS: TestDecbufFactory_Stop/no_pooling_file_handles (0.00s) === RUN TestReaders_Read === RUN TestReaders_Read/FileReaderWithZeroOffset === RUN TestReaders_Read/FileReaderWithNonZeroOffset --- PASS: TestReaders_Read (0.01s) --- PASS: TestReaders_Read/FileReaderWithZeroOffset (0.01s) --- PASS: TestReaders_Read/FileReaderWithNonZeroOffset (0.00s) === RUN TestReaders_ReadInto === RUN TestReaders_ReadInto/FileReaderWithZeroOffset === RUN TestReaders_ReadInto/FileReaderWithNonZeroOffset --- PASS: TestReaders_ReadInto (0.00s) --- PASS: TestReaders_ReadInto/FileReaderWithZeroOffset (0.00s) --- PASS: TestReaders_ReadInto/FileReaderWithNonZeroOffset (0.00s) === RUN TestReaders_Peek === RUN TestReaders_Peek/FileReaderWithZeroOffset === RUN TestReaders_Peek/FileReaderWithNonZeroOffset --- PASS: TestReaders_Peek (0.00s) --- PASS: TestReaders_Peek/FileReaderWithZeroOffset (0.00s) --- PASS: TestReaders_Peek/FileReaderWithNonZeroOffset (0.00s) === RUN TestReaders_Reset === RUN TestReaders_Reset/FileReaderWithZeroOffset === RUN TestReaders_Reset/FileReaderWithNonZeroOffset --- PASS: TestReaders_Reset (0.01s) --- PASS: TestReaders_Reset/FileReaderWithZeroOffset (0.00s) --- PASS: TestReaders_Reset/FileReaderWithNonZeroOffset (0.00s) === RUN TestReaders_ResetAt === RUN TestReaders_ResetAt/FileReaderWithZeroOffset === RUN TestReaders_ResetAt/FileReaderWithNonZeroOffset --- PASS: TestReaders_ResetAt (0.01s) --- PASS: TestReaders_ResetAt/FileReaderWithZeroOffset (0.00s) --- PASS: TestReaders_ResetAt/FileReaderWithNonZeroOffset (0.00s) === RUN TestReaders_Skip === RUN TestReaders_Skip/FileReaderWithZeroOffset === RUN TestReaders_Skip/FileReaderWithNonZeroOffset --- PASS: TestReaders_Skip (0.00s) --- PASS: TestReaders_Skip/FileReaderWithZeroOffset (0.00s) --- PASS: TestReaders_Skip/FileReaderWithNonZeroOffset (0.00s) === RUN TestReaders_Len === RUN TestReaders_Len/FileReaderWithZeroOffset === RUN TestReaders_Len/FileReaderWithNonZeroOffset --- PASS: TestReaders_Len (0.00s) --- PASS: TestReaders_Len/FileReaderWithZeroOffset (0.00s) --- PASS: TestReaders_Len/FileReaderWithNonZeroOffset (0.00s) === RUN TestReaders_Position === RUN TestReaders_Position/FileReaderWithZeroOffset === RUN TestReaders_Position/FileReaderWithNonZeroOffset --- PASS: TestReaders_Position (0.00s) --- PASS: TestReaders_Position/FileReaderWithZeroOffset (0.00s) --- PASS: TestReaders_Position/FileReaderWithNonZeroOffset (0.00s) === RUN TestReaders_CreationWithEmptyContents === RUN TestReaders_CreationWithEmptyContents/fileReader --- PASS: TestReaders_CreationWithEmptyContents (0.00s) --- PASS: TestReaders_CreationWithEmptyContents/fileReader (0.00s) === RUN FuzzDecbuf_Be32 === RUN FuzzDecbuf_Be32/seed#0 === RUN FuzzDecbuf_Be32/seed#1 === RUN FuzzDecbuf_Be32/seed#2 --- PASS: FuzzDecbuf_Be32 (0.01s) --- PASS: FuzzDecbuf_Be32/seed#0 (0.00s) --- PASS: FuzzDecbuf_Be32/seed#1 (0.00s) --- PASS: FuzzDecbuf_Be32/seed#2 (0.00s) === RUN FuzzDecbuf_Be32int === RUN FuzzDecbuf_Be32int/seed#0 === RUN FuzzDecbuf_Be32int/seed#1 === RUN FuzzDecbuf_Be32int/seed#2 --- PASS: FuzzDecbuf_Be32int (0.01s) --- PASS: FuzzDecbuf_Be32int/seed#0 (0.00s) --- PASS: FuzzDecbuf_Be32int/seed#1 (0.00s) --- PASS: FuzzDecbuf_Be32int/seed#2 (0.00s) === RUN FuzzDecbuf_Be64 === RUN FuzzDecbuf_Be64/seed#0 === RUN FuzzDecbuf_Be64/seed#1 === RUN FuzzDecbuf_Be64/seed#2 --- PASS: FuzzDecbuf_Be64 (0.01s) --- PASS: FuzzDecbuf_Be64/seed#0 (0.00s) --- PASS: FuzzDecbuf_Be64/seed#1 (0.00s) --- PASS: FuzzDecbuf_Be64/seed#2 (0.00s) === RUN FuzzDecbuf_Uvarint === RUN FuzzDecbuf_Uvarint/seed#0 === RUN FuzzDecbuf_Uvarint/seed#1 === RUN FuzzDecbuf_Uvarint/seed#2 --- PASS: FuzzDecbuf_Uvarint (0.01s) --- PASS: FuzzDecbuf_Uvarint/seed#0 (0.00s) --- PASS: FuzzDecbuf_Uvarint/seed#1 (0.00s) --- PASS: FuzzDecbuf_Uvarint/seed#2 (0.00s) === RUN FuzzDecbuf_Uvarint64 === RUN FuzzDecbuf_Uvarint64/seed#0 === RUN FuzzDecbuf_Uvarint64/seed#1 === RUN FuzzDecbuf_Uvarint64/seed#2 === RUN FuzzDecbuf_Uvarint64/seed#3 === RUN FuzzDecbuf_Uvarint64/seed#4 === RUN FuzzDecbuf_Uvarint64/seed#5 --- PASS: FuzzDecbuf_Uvarint64 (0.01s) --- PASS: FuzzDecbuf_Uvarint64/seed#0 (0.00s) --- PASS: FuzzDecbuf_Uvarint64/seed#1 (0.00s) --- PASS: FuzzDecbuf_Uvarint64/seed#2 (0.00s) --- PASS: FuzzDecbuf_Uvarint64/seed#3 (0.00s) --- PASS: FuzzDecbuf_Uvarint64/seed#4 (0.00s) --- PASS: FuzzDecbuf_Uvarint64/seed#5 (0.00s) === RUN FuzzDecbuf_UnsafeUvarintBytes === RUN FuzzDecbuf_UnsafeUvarintBytes/seed#0 === RUN FuzzDecbuf_UnsafeUvarintBytes/seed#1 === RUN FuzzDecbuf_UnsafeUvarintBytes/seed#2 === RUN FuzzDecbuf_UnsafeUvarintBytes/seed#3 --- PASS: FuzzDecbuf_UnsafeUvarintBytes (0.01s) --- PASS: FuzzDecbuf_UnsafeUvarintBytes/seed#0 (0.00s) --- PASS: FuzzDecbuf_UnsafeUvarintBytes/seed#1 (0.00s) --- PASS: FuzzDecbuf_UnsafeUvarintBytes/seed#2 (0.00s) --- PASS: FuzzDecbuf_UnsafeUvarintBytes/seed#3 (0.00s) === RUN FuzzDecbuf_UvarintStr === RUN FuzzDecbuf_UvarintStr/seed#0 === RUN FuzzDecbuf_UvarintStr/seed#1 === RUN FuzzDecbuf_UvarintStr/seed#2 === RUN FuzzDecbuf_UvarintStr/seed#3 --- PASS: FuzzDecbuf_UvarintStr (0.02s) --- PASS: FuzzDecbuf_UvarintStr/seed#0 (0.01s) --- PASS: FuzzDecbuf_UvarintStr/seed#1 (0.00s) --- PASS: FuzzDecbuf_UvarintStr/seed#2 (0.00s) --- PASS: FuzzDecbuf_UvarintStr/seed#3 (0.00s) PASS ok github.com/grafana/mimir/pkg/storegateway/indexheader/encoding 11.974s === RUN TestSymbols --- PASS: TestSymbols (0.08s) PASS ok github.com/grafana/mimir/pkg/storegateway/indexheader/index 0.307s === RUN TestBuildReport --- PASS: TestBuildReport (0.00s) === RUN TestConfigValidation === RUN TestConfigValidation/valid_config === RUN TestConfigValidation/valid_config_with_helm_installation_mode === RUN TestConfigValidation/valid_config_with_jsonnet_installation_mode === RUN TestConfigValidation/invalid_config_with_unknown_installation_mode --- PASS: TestConfigValidation (0.00s) --- PASS: TestConfigValidation/valid_config (0.00s) --- PASS: TestConfigValidation/valid_config_with_helm_installation_mode (0.00s) --- PASS: TestConfigValidation/valid_config_with_jsonnet_installation_mode (0.00s) --- PASS: TestConfigValidation/invalid_config_with_unknown_installation_mode (0.00s) === RUN TestGetNextReportAt === RUN TestGetNextReportAt/createdAt_not_aligned === RUN TestGetNextReportAt/createdAt_aligned_with_interval_and_now === RUN TestGetNextReportAt/createdAt_aligned_with_interval --- PASS: TestGetNextReportAt (0.00s) --- PASS: TestGetNextReportAt/createdAt_not_aligned (0.00s) --- PASS: TestGetNextReportAt/createdAt_aligned_with_interval_and_now (0.00s) --- PASS: TestGetNextReportAt/createdAt_aligned_with_interval (0.00s) === RUN TestSendReport === RUN TestSendReport/server_returns_2xx === RUN TestSendReport/server_returns_5xx === RUN TestSendReport/server_is_not_running --- PASS: TestSendReport (0.03s) --- PASS: TestSendReport/server_returns_2xx (0.01s) --- PASS: TestSendReport/server_returns_5xx (0.01s) --- PASS: TestSendReport/server_is_not_running (0.01s) === RUN TestReporter_SendReportPeriodically === RUN TestReporter_SendReportPeriodically/all_requests_to_stats_server_succeed === PAUSE TestReporter_SendReportPeriodically/all_requests_to_stats_server_succeed === RUN TestReporter_SendReportPeriodically/some_requests_to_stats_server_fail_and_they_get_retried === PAUSE TestReporter_SendReportPeriodically/some_requests_to_stats_server_fail_and_they_get_retried === CONT TestReporter_SendReportPeriodically/all_requests_to_stats_server_succeed === CONT TestReporter_SendReportPeriodically/some_requests_to_stats_server_fail_and_they_get_retried --- PASS: TestReporter_SendReportPeriodically (0.00s) --- PASS: TestReporter_SendReportPeriodically/all_requests_to_stats_server_succeed (4.05s) --- PASS: TestReporter_SendReportPeriodically/some_requests_to_stats_server_fail_and_they_get_retried (4.15s) === RUN TestReporter_SendReportShouldSkipToNextReportOnLongFailure === PAUSE TestReporter_SendReportShouldSkipToNextReportOnLongFailure === RUN TestReadSeedFile === RUN TestReadSeedFile/the_seed_file_is_corrupted === RUN TestReadSeedFile/the_seed_file_is_read_successfully === RUN TestReadSeedFile/the_seed_file_does_not_exist === RUN TestReadSeedFile/an_error_occurred_while_reading_the_seed_file --- PASS: TestReadSeedFile (0.02s) --- PASS: TestReadSeedFile/the_seed_file_is_corrupted (0.00s) --- PASS: TestReadSeedFile/the_seed_file_is_read_successfully (0.00s) --- PASS: TestReadSeedFile/the_seed_file_does_not_exist (0.01s) --- PASS: TestReadSeedFile/an_error_occurred_while_reading_the_seed_file (0.00s) === RUN TestWriteSeedFile === RUN TestWriteSeedFile/an_error_occurred_while_writing_the_seed_file === RUN TestWriteSeedFile/the_seed_file_is_written_successfully --- PASS: TestWriteSeedFile (0.01s) --- PASS: TestWriteSeedFile/an_error_occurred_while_writing_the_seed_file (0.01s) --- PASS: TestWriteSeedFile/the_seed_file_is_written_successfully (0.00s) === RUN TestWaitSeedFileStability === RUN TestWaitSeedFileStability/should_immediately_return_if_seed_file_is_corrupted === PAUSE TestWaitSeedFileStability/should_immediately_return_if_seed_file_is_corrupted === RUN TestWaitSeedFileStability/should_immediately_return_if_seed_file_was_created_more_than_'min_stability'_time_ago === PAUSE TestWaitSeedFileStability/should_immediately_return_if_seed_file_was_created_more_than_'min_stability'_time_ago === RUN TestWaitSeedFileStability/should_wait_for_'min_stability'_and_return_the_seed_file_if_was_created_less_than_'min_stability'_time_ago === PAUSE TestWaitSeedFileStability/should_wait_for_'min_stability'_and_return_the_seed_file_if_was_created_less_than_'min_stability'_time_ago === RUN TestWaitSeedFileStability/should_immediately_return_if_seed_file_does_not_exist === PAUSE TestWaitSeedFileStability/should_immediately_return_if_seed_file_does_not_exist === CONT TestWaitSeedFileStability/should_immediately_return_if_seed_file_is_corrupted === CONT TestWaitSeedFileStability/should_wait_for_'min_stability'_and_return_the_seed_file_if_was_created_less_than_'min_stability'_time_ago === CONT TestWaitSeedFileStability/should_immediately_return_if_seed_file_was_created_more_than_'min_stability'_time_ago === CONT TestWaitSeedFileStability/should_immediately_return_if_seed_file_does_not_exist --- PASS: TestWaitSeedFileStability (0.00s) --- PASS: TestWaitSeedFileStability/should_immediately_return_if_seed_file_does_not_exist (0.00s) --- PASS: TestWaitSeedFileStability/should_immediately_return_if_seed_file_was_created_more_than_'min_stability'_time_ago (0.00s) --- PASS: TestWaitSeedFileStability/should_immediately_return_if_seed_file_is_corrupted (0.01s) --- PASS: TestWaitSeedFileStability/should_wait_for_'min_stability'_and_return_the_seed_file_if_was_created_less_than_'min_stability'_time_ago (3.21s) === RUN TestInitSeedFile === RUN TestInitSeedFile/should_immediately_return_if_seed_file_exists_and_it_was_created_more_than_'min_stability'_time_ago === PAUSE TestInitSeedFile/should_immediately_return_if_seed_file_exists_and_it_was_created_more_than_'min_stability'_time_ago === RUN TestInitSeedFile/should_wait_for_'min_stability'_and_return_the_seed_file_if_it_exists_and_was_created_less_than_'min_stability'_time_ago === PAUSE TestInitSeedFile/should_wait_for_'min_stability'_and_return_the_seed_file_if_it_exists_and_was_created_less_than_'min_stability'_time_ago === RUN TestInitSeedFile/should_create_the_seed_file_if_doesn't_exist_and_then_wait_for_'min_stability' === PAUSE TestInitSeedFile/should_create_the_seed_file_if_doesn't_exist_and_then_wait_for_'min_stability' === RUN TestInitSeedFile/should_re-create_the_seed_file_if_exist_but_is_corrupted,_and_then_wait_for_'min_stability' === PAUSE TestInitSeedFile/should_re-create_the_seed_file_if_exist_but_is_corrupted,_and_then_wait_for_'min_stability' === CONT TestInitSeedFile/should_immediately_return_if_seed_file_exists_and_it_was_created_more_than_'min_stability'_time_ago === CONT TestInitSeedFile/should_re-create_the_seed_file_if_exist_but_is_corrupted,_and_then_wait_for_'min_stability' === CONT TestInitSeedFile/should_create_the_seed_file_if_doesn't_exist_and_then_wait_for_'min_stability' === CONT TestInitSeedFile/should_wait_for_'min_stability'_and_return_the_seed_file_if_it_exists_and_was_created_less_than_'min_stability'_time_ago --- PASS: TestInitSeedFile (0.00s) --- PASS: TestInitSeedFile/should_immediately_return_if_seed_file_exists_and_it_was_created_more_than_'min_stability'_time_ago (0.00s) --- PASS: TestInitSeedFile/should_re-create_the_seed_file_if_exist_but_is_corrupted,_and_then_wait_for_'min_stability' (3.39s) --- PASS: TestInitSeedFile/should_wait_for_'min_stability'_and_return_the_seed_file_if_it_exists_and_was_created_less_than_'min_stability'_time_ago (3.39s) --- PASS: TestInitSeedFile/should_create_the_seed_file_if_doesn't_exist_and_then_wait_for_'min_stability' (4.19s) === RUN TestInitSeedFile_CreatingConcurrency === PAUSE TestInitSeedFile_CreatingConcurrency === RUN TestCounter --- PASS: TestCounter (1.00s) === CONT TestReporter_SendReportShouldSkipToNextReportOnLongFailure === CONT TestInitSeedFile_CreatingConcurrency --- PASS: TestReporter_SendReportShouldSkipToNextReportOnLongFailure (4.03s) --- PASS: TestInitSeedFile_CreatingConcurrency (6.60s) PASS ok github.com/grafana/mimir/pkg/usagestats 19.657s === RUN TestActiveGroups --- PASS: TestActiveGroups (0.00s) === RUN TestActiveGroupsConcurrentUpdateAndPurge --- PASS: TestActiveGroupsConcurrentUpdateAndPurge (1.04s) === RUN TestActiveGroupLimitExceeded --- PASS: TestActiveGroupLimitExceeded (0.00s) === RUN TestUpdateActiveGroups --- PASS: TestUpdateActiveGroups (0.00s) === RUN TestActiveUser --- PASS: TestActiveUser (0.00s) === RUN TestActiveUserConcurrentUpdateAndPurge --- PASS: TestActiveUserConcurrentUpdateAndPurge (1.02s) === RUN TestAllowedTenants_NoConfig --- PASS: TestAllowedTenants_NoConfig (0.00s) === RUN TestAllowedTenants_Enabled --- PASS: TestAllowedTenants_Enabled (0.00s) === RUN TestAllowedTenants_Disabled --- PASS: TestAllowedTenants_Disabled (0.00s) === RUN TestAllowedTenants_Combination --- PASS: TestAllowedTenants_Combination (0.00s) === RUN TestAllowedTenants_Nil --- PASS: TestAllowedTenants_Nil (0.00s) === RUN TestGetSourceFromOutgoingCtx === RUN TestGetSourceFromOutgoingCtx/No_value_in_key === RUN TestGetSourceFromOutgoingCtx/Value_in_key === RUN TestGetSourceFromOutgoingCtx/Stored_under_wrong_key --- PASS: TestGetSourceFromOutgoingCtx (0.00s) --- PASS: TestGetSourceFromOutgoingCtx/No_value_in_key (0.00s) --- PASS: TestGetSourceFromOutgoingCtx/Value_in_key (0.00s) --- PASS: TestGetSourceFromOutgoingCtx/Stored_under_wrong_key (0.00s) === RUN TestTrackRegisteredFlags --- PASS: TestTrackRegisteredFlags (0.00s) === RUN TestLabelMatchersToString --- PASS: TestLabelMatchersToString (0.00s) === RUN TestMultiMatchersStringer === RUN TestMultiMatchersStringer/One_nested_matcher === RUN TestMultiMatchersStringer/Two_nested_matchers --- PASS: TestMultiMatchersStringer (0.00s) --- PASS: TestMultiMatchersStringer/One_nested_matcher (0.00s) --- PASS: TestMultiMatchersStringer/Two_nested_matchers (0.00s) === RUN TestMatchersStringer === RUN TestMatchersStringer/One_matcher === RUN TestMatchersStringer/Two_matchers --- PASS: TestMatchersStringer (0.00s) --- PASS: TestMatchersStringer/One_matcher (0.00s) --- PASS: TestMatchersStringer/Two_matchers (0.00s) === RUN TestMergeSampleSets --- PASS: TestMergeSampleSets (0.00s) === RUN TestMergeNSampleSets --- PASS: TestMergeNSampleSets (0.00s) === RUN TestMergeSlices === RUN TestMergeSlices/empty_input === RUN TestMergeSlices/single_input === RUN TestMergeSlices/two_inputs_same === RUN TestMergeSlices/two_inputs_interleaved === RUN TestMergeSlices/first_input_short === RUN TestMergeSlices/second_input_short === RUN TestMergeSlices/some_duplicates --- PASS: TestMergeSlices (0.00s) --- PASS: TestMergeSlices/empty_input (0.00s) --- PASS: TestMergeSlices/single_input (0.00s) --- PASS: TestMergeSlices/two_inputs_same (0.00s) --- PASS: TestMergeSlices/two_inputs_interleaved (0.00s) --- PASS: TestMergeSlices/first_input_short (0.00s) --- PASS: TestMergeSlices/second_input_short (0.00s) --- PASS: TestMergeSlices/some_duplicates (0.00s) === RUN TestSum --- PASS: TestSum (0.00s) === RUN TestMax --- PASS: TestMax (0.00s) === RUN TestCounterValue --- PASS: TestCounterValue (0.00s) === RUN TestGetMetricsWithLabelNames --- PASS: TestGetMetricsWithLabelNames (0.01s) === RUN TestSendSumOfGaugesPerUserWithLabels --- PASS: TestSendSumOfGaugesPerUserWithLabels (0.00s) === RUN TestSendMaxOfGauges --- PASS: TestSendMaxOfGauges (0.00s) === RUN TestSendSumOfHistogramsWithLabels --- PASS: TestSendSumOfHistogramsWithLabels (0.00s) === RUN TestSendSumOfCountersPerUser_WithLabels === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one,_and_skip_zero_value_metrics === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two,_and_skip_zero_value_metrics === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two === RUN TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two,_and_skip_zero_value_metrics --- PASS: TestSendSumOfCountersPerUser_WithLabels (0.01s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_one,_and_skip_zero_value_metrics (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user_and_label_two,_and_skip_zero_value_metrics (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two (0.00s) --- PASS: TestSendSumOfCountersPerUser_WithLabels/group_metrics_by_user,_label_one_and_label_two,_and_skip_zero_value_metrics (0.00s) === RUN TestSendSumOfSummariesPerUser --- PASS: TestSendSumOfSummariesPerUser (0.00s) === RUN TestFloat64PrecisionStability metrics_helper_test.go:505: random generator seed: 1681075372641698673 --- PASS: TestFloat64PrecisionStability (25.55s) === RUN TestUserRegistries_RemoveBaseline --- PASS: TestUserRegistries_RemoveBaseline (0.02s) === RUN TestUserRegistries_RemoveUserRegistry_SoftRemoval --- PASS: TestUserRegistries_RemoveUserRegistry_SoftRemoval (0.01s) === RUN TestUserRegistries_RemoveUserRegistry_HardRemoval --- PASS: TestUserRegistries_RemoveUserRegistry_HardRemoval (0.01s) === RUN TestUserRegistries_AddUserRegistry_ReplaceRegistry --- PASS: TestUserRegistries_AddUserRegistry_ReplaceRegistry (0.01s) === RUN TestUserRegistries_GetRegistryForUser --- PASS: TestUserRegistries_GetRegistryForUser (0.00s) === RUN TestShuffleShardExpectedInstancesPerZone --- PASS: TestShuffleShardExpectedInstancesPerZone (0.00s) === RUN TestShuffleShardExpectedInstances --- PASS: TestShuffleShardExpectedInstances (0.00s) === RUN TestRemoveSliceIndexes === RUN TestRemoveSliceIndexes/no_change === RUN TestRemoveSliceIndexes/remove_first === RUN TestRemoveSliceIndexes/remove_middle === RUN TestRemoveSliceIndexes/remove_last === RUN TestRemoveSliceIndexes/remove_all === RUN TestRemoveSliceIndexes/remove_two_ranges === RUN TestRemoveSliceIndexes/index_overrun === RUN TestRemoveSliceIndexes/duplicate_indexes === RUN TestRemoveSliceIndexes/negative_indexes === RUN TestRemoveSliceIndexes/all_cases_combined --- PASS: TestRemoveSliceIndexes (0.00s) --- PASS: TestRemoveSliceIndexes/no_change (0.00s) --- PASS: TestRemoveSliceIndexes/remove_first (0.00s) --- PASS: TestRemoveSliceIndexes/remove_middle (0.00s) --- PASS: TestRemoveSliceIndexes/remove_last (0.00s) --- PASS: TestRemoveSliceIndexes/remove_all (0.00s) --- PASS: TestRemoveSliceIndexes/remove_two_ranges (0.00s) --- PASS: TestRemoveSliceIndexes/index_overrun (0.00s) --- PASS: TestRemoveSliceIndexes/duplicate_indexes (0.00s) --- PASS: TestRemoveSliceIndexes/negative_indexes (0.00s) --- PASS: TestRemoveSliceIndexes/all_cases_combined (0.00s) === RUN TestTimeFromMillis === RUN TestTimeFromMillis/0 === RUN TestTimeFromMillis/1 --- PASS: TestTimeFromMillis (0.00s) --- PASS: TestTimeFromMillis/0 (0.00s) --- PASS: TestTimeFromMillis/1 (0.00s) === RUN TestTimeRoundTrip === RUN TestTimeRoundTrip/0 === RUN TestTimeRoundTrip/1 === RUN TestTimeRoundTrip/2 --- PASS: TestTimeRoundTrip (0.00s) --- PASS: TestTimeRoundTrip/0 (0.00s) --- PASS: TestTimeRoundTrip/1 (0.00s) --- PASS: TestTimeRoundTrip/2 (0.00s) === RUN TestDurationWithJitter --- PASS: TestDurationWithJitter (0.02s) === RUN TestDurationWithJitter_ZeroInputDuration --- PASS: TestDurationWithJitter_ZeroInputDuration (0.00s) === RUN TestDurationWithPositiveJitter --- PASS: TestDurationWithPositiveJitter (0.02s) === RUN TestDurationWithPositiveJitter_ZeroInputDuration --- PASS: TestDurationWithPositiveJitter_ZeroInputDuration (0.00s) === RUN TestParseTime --- PASS: TestParseTime (0.00s) === RUN TestNewDisableableTicker_Enabled --- PASS: TestNewDisableableTicker_Enabled (0.11s) === RUN TestNewDisableableTicker_Disabled --- PASS: TestNewDisableableTicker_Disabled (0.10s) === RUN TestYoloBuf --- PASS: TestYoloBuf (0.00s) === RUN TestRenderHTTPResponse === RUN TestRenderHTTPResponse/Test_Renders_json === RUN TestRenderHTTPResponse/Test_Renders_html --- PASS: TestRenderHTTPResponse (0.00s) --- PASS: TestRenderHTTPResponse/Test_Renders_json (0.00s) --- PASS: TestRenderHTTPResponse/Test_Renders_html (0.00s) === RUN TestWriteTextResponse --- PASS: TestWriteTextResponse (0.00s) === RUN TestStreamWriteYAMLResponse --- PASS: TestStreamWriteYAMLResponse (0.01s) === RUN TestParseProtoReader === RUN TestParseProtoReader/rawSnappy === RUN TestParseProtoReader/noCompression === RUN TestParseProtoReader/too_big_rawSnappy === RUN TestParseProtoReader/too_big_decoded_rawSnappy === RUN TestParseProtoReader/too_big_noCompression === RUN TestParseProtoReader/bytesbuffer_rawSnappy === RUN TestParseProtoReader/bytesbuffer_noCompression === RUN TestParseProtoReader/bytesbuffer_too_big_rawSnappy === RUN TestParseProtoReader/bytesbuffer_too_big_decoded_rawSnappy === RUN TestParseProtoReader/bytesbuffer_too_big_noCompression --- PASS: TestParseProtoReader (0.01s) --- PASS: TestParseProtoReader/rawSnappy (0.00s) --- PASS: TestParseProtoReader/noCompression (0.00s) --- PASS: TestParseProtoReader/too_big_rawSnappy (0.00s) --- PASS: TestParseProtoReader/too_big_decoded_rawSnappy (0.00s) --- PASS: TestParseProtoReader/too_big_noCompression (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_rawSnappy (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_noCompression (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_too_big_rawSnappy (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_too_big_decoded_rawSnappy (0.00s) --- PASS: TestParseProtoReader/bytesbuffer_too_big_noCompression (0.00s) === RUN TestIsRequestBodyTooLargeRegression --- PASS: TestIsRequestBodyTooLargeRegression (0.00s) === RUN TestNewMsgSizeTooLargeErr --- PASS: TestNewMsgSizeTooLargeErr (0.00s) PASS ok github.com/grafana/mimir/pkg/util 28.138s === RUN TestActivityTracker --- PASS: TestActivityTracker (0.01s) === RUN TestNilActivityTracker --- PASS: TestNilActivityTracker (0.00s) === RUN TestTrimEntrySize === RUN TestTrimEntrySize/hello_world,_100 === RUN TestTrimEntrySize/hello_world,_10 === RUN TestTrimEntrySize/hello_world,_5 === RUN TestTrimEntrySize/🎉🎄🎅,_5 === RUN TestTrimEntrySize/🎉🎄🎅,_8 === RUN TestTrimEntrySize/🎉🎄🎅,_9 === RUN TestTrimEntrySize/🎉🎄🎅,_10 === RUN TestTrimEntrySize/🎉🎄🎅,_11 === RUN TestTrimEntrySize/🎉🎄🎅,_12 --- PASS: TestTrimEntrySize (0.00s) --- PASS: TestTrimEntrySize/hello_world,_100 (0.00s) --- PASS: TestTrimEntrySize/hello_world,_10 (0.00s) --- PASS: TestTrimEntrySize/hello_world,_5 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_5 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_8 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_9 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_10 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_11 (0.00s) --- PASS: TestTrimEntrySize/🎉🎄🎅,_12 (0.00s) PASS ok github.com/grafana/mimir/pkg/util/activitytracker 0.100s === RUN TestParseLabelMatchers === RUN TestParseLabelMatchers/simple_api_matcher_for_metric_name === RUN TestParseLabelMatchers/simple_api_matcher_for_metric_name/unmarshal_yaml === RUN TestParseLabelMatchers/simple_api_matcher_for_metric_name/unmarshal_yaml/marshal_yaml === RUN TestParseLabelMatchers/simple_api_matcher_for_metric_name/set_string_arg === RUN TestParseLabelMatchers/two_matcher_sets_with_two_matchers_each_per_source,_unsorted === RUN TestParseLabelMatchers/two_matcher_sets_with_two_matchers_each_per_source,_unsorted/unmarshal_yaml === RUN TestParseLabelMatchers/two_matcher_sets_with_two_matchers_each_per_source,_unsorted/unmarshal_yaml/marshal_yaml === RUN TestParseLabelMatchers/two_matcher_sets_with_two_matchers_each_per_source,_unsorted/set_string_arg === RUN TestParseLabelMatchers/invalid_matcher === RUN TestParseLabelMatchers/invalid_matcher/unmarshal_yaml === RUN TestParseLabelMatchers/invalid_matcher/set_string_arg --- PASS: TestParseLabelMatchers (0.01s) --- PASS: TestParseLabelMatchers/simple_api_matcher_for_metric_name (0.00s) --- PASS: TestParseLabelMatchers/simple_api_matcher_for_metric_name/unmarshal_yaml (0.00s) --- PASS: TestParseLabelMatchers/simple_api_matcher_for_metric_name/unmarshal_yaml/marshal_yaml (0.00s) --- PASS: TestParseLabelMatchers/simple_api_matcher_for_metric_name/set_string_arg (0.00s) --- PASS: TestParseLabelMatchers/two_matcher_sets_with_two_matchers_each_per_source,_unsorted (0.00s) --- PASS: TestParseLabelMatchers/two_matcher_sets_with_two_matchers_each_per_source,_unsorted/unmarshal_yaml (0.00s) --- PASS: TestParseLabelMatchers/two_matcher_sets_with_two_matchers_each_per_source,_unsorted/unmarshal_yaml/marshal_yaml (0.00s) --- PASS: TestParseLabelMatchers/two_matcher_sets_with_two_matchers_each_per_source,_unsorted/set_string_arg (0.00s) --- PASS: TestParseLabelMatchers/invalid_matcher (0.00s) --- PASS: TestParseLabelMatchers/invalid_matcher/unmarshal_yaml (0.00s) --- PASS: TestParseLabelMatchers/invalid_matcher/set_string_arg (0.00s) === RUN TestIsEphemeral === RUN TestIsEphemeral/no_matchers === RUN TestIsEphemeral/matching_labels_but_with_different_source === RUN TestIsEphemeral/matching_source_but_with_different_labels === RUN TestIsEphemeral/matching_source_and_labels,_matching_on_metric_name === RUN TestIsEphemeral/matching_source_and_labels,_matching_on_other_label === RUN TestIsEphemeral/matching_source_and_labels,_matching_on_both_labels === RUN TestIsEphemeral/matching_source_and_labels,_matching_on_both_labels,_unsorted === RUN TestIsEphemeral/matching_rule_for_source_'any' --- PASS: TestIsEphemeral (0.00s) --- PASS: TestIsEphemeral/no_matchers (0.00s) --- PASS: TestIsEphemeral/matching_labels_but_with_different_source (0.00s) --- PASS: TestIsEphemeral/matching_source_but_with_different_labels (0.00s) --- PASS: TestIsEphemeral/matching_source_and_labels,_matching_on_metric_name (0.00s) --- PASS: TestIsEphemeral/matching_source_and_labels,_matching_on_other_label (0.00s) --- PASS: TestIsEphemeral/matching_source_and_labels,_matching_on_both_labels (0.00s) --- PASS: TestIsEphemeral/matching_source_and_labels,_matching_on_both_labels,_unsorted (0.00s) --- PASS: TestIsEphemeral/matching_rule_for_source_'any' (0.00s) PASS ok github.com/grafana/mimir/pkg/util/ephemeral 0.158s === RUN TestID_Message --- PASS: TestID_Message (0.00s) === RUN TestID_MessageWithPerInstanceLimitConfig --- PASS: TestID_MessageWithPerInstanceLimitConfig (0.00s) === RUN TestID_MessageWithPerTenantLimitConfig --- PASS: TestID_MessageWithPerTenantLimitConfig (0.00s) PASS ok github.com/grafana/mimir/pkg/util/globalerror 0.071s === RUN TestSetAcceptEncodingForPushOptionsWithoutHeaders --- PASS: TestSetAcceptEncodingForPushOptionsWithoutHeaders (0.00s) === RUN TestSetAcceptEncodingForPushOptionsWithHeaders --- PASS: TestSetAcceptEncodingForPushOptionsWithHeaders (0.00s) === RUN TestParseEncodings --- PASS: TestParseEncodings (0.00s) === RUN TestRequestAcceptance === RUN TestRequestAcceptance/identity;q=0,_*;q=0.5 === RUN TestRequestAcceptance/gzip === RUN TestRequestAcceptance/gzip;q=1 === RUN TestRequestAcceptance/gzip;q=1,_identity;q=0 === RUN TestRequestAcceptance/gzip;q=1,_identity;q=0,_*;q=0.5 === RUN TestRequestAcceptance/foo;q=1,_gzip;q=0.5,_*;q=0 === RUN TestRequestAcceptance/identity;q=0 --- PASS: TestRequestAcceptance (0.00s) --- PASS: TestRequestAcceptance/identity;q=0,_*;q=0.5 (0.00s) --- PASS: TestRequestAcceptance/gzip (0.00s) --- PASS: TestRequestAcceptance/gzip;q=1 (0.00s) --- PASS: TestRequestAcceptance/gzip;q=1,_identity;q=0 (0.00s) --- PASS: TestRequestAcceptance/gzip;q=1,_identity;q=0,_*;q=0.5 (0.00s) --- PASS: TestRequestAcceptance/foo;q=1,_gzip;q=0.5,_*;q=0 (0.00s) --- PASS: TestRequestAcceptance/identity;q=0 (0.00s) === RUN TestGzipHandler --- PASS: TestGzipHandler (0.02s) === RUN TestGzipHandlerSmallBodyNoCompression --- PASS: TestGzipHandlerSmallBodyNoCompression (0.00s) === RUN TestGzipHandlerSmallButDoesNotAcceptIdentity --- PASS: TestGzipHandlerSmallButDoesNotAcceptIdentity (0.00s) === RUN TestGzipHandlerAlreadyCompressed --- PASS: TestGzipHandlerAlreadyCompressed (0.00s) === RUN TestNewGzipLevelHandler --- PASS: TestNewGzipLevelHandler (0.15s) === RUN TestNewGzipLevelHandlerReturnsErrorForInvalidLevels --- PASS: TestNewGzipLevelHandlerReturnsErrorForInvalidLevels (0.00s) === RUN TestMustNewGzipLevelHandlerWillPanic --- PASS: TestMustNewGzipLevelHandlerWillPanic (0.00s) === RUN TestGzipHandlerNoBody --- PASS: TestGzipHandlerNoBody (0.01s) === RUN TestGzipHandlerContentLength --- PASS: TestGzipHandlerContentLength (0.05s) === RUN TestGzipHandlerMinSizeMustBePositive --- PASS: TestGzipHandlerMinSizeMustBePositive (0.00s) === RUN TestGzipHandlerMinSize --- PASS: TestGzipHandlerMinSize (0.00s) === RUN TestGzipDoubleClose --- PASS: TestGzipDoubleClose (0.00s) === RUN TestGzipHandlerDoubleWriteHeader --- PASS: TestGzipHandlerDoubleWriteHeader (0.00s) === RUN TestStatusCodes --- PASS: TestStatusCodes (0.00s) === RUN TestFlushBeforeWrite --- PASS: TestFlushBeforeWrite (0.02s) === RUN TestImplementFlusher --- PASS: TestImplementFlusher (0.00s) === RUN TestIgnoreSubsequentWriteHeader --- PASS: TestIgnoreSubsequentWriteHeader (0.00s) === RUN TestDontWriteWhenNotWrittenTo --- PASS: TestDontWriteWhenNotWrittenTo (0.00s) === RUN TestContentTypes --- PASS: TestContentTypes (0.05s) PASS ok github.com/grafana/mimir/pkg/util/gziphandler 0.412s === RUN TestPrioritizeRecoverableErr === RUN TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error === RUN TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error,_reverse_order === RUN TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_non-grpc_error === RUN TestPrioritizeRecoverableErr/recoverable_grpc_error,_non-recoverable_grpc_error_and_non-grpc_error === RUN TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_too_many_requests_error === RUN TestPrioritizeRecoverableErr/non-recoverable_grpc_error === RUN TestPrioritizeRecoverableErr/no_error --- PASS: TestPrioritizeRecoverableErr (0.03s) --- PASS: TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/recoverable_grpc_error_and_non-recoverable_grpc_error,_reverse_order (0.00s) --- PASS: TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_non-grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/recoverable_grpc_error,_non-recoverable_grpc_error_and_non-grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/non-recoverable_grpc_error_and_too_many_requests_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/non-recoverable_grpc_error (0.00s) --- PASS: TestPrioritizeRecoverableErr/no_error (0.00s) PASS ok github.com/grafana/mimir/pkg/util/httpgrpcutil 0.189s === RUN TestTracerTransportPropagatesTrace === RUN TestTracerTransportPropagatesTrace/no_next_transport === RUN TestTracerTransportPropagatesTrace/with_next_transport --- PASS: TestTracerTransportPropagatesTrace (0.06s) --- PASS: TestTracerTransportPropagatesTrace/no_next_transport (0.03s) --- PASS: TestTracerTransportPropagatesTrace/with_next_transport (0.03s) PASS ok github.com/grafana/mimir/pkg/util/instrumentation 0.165s === RUN TestQueryLimiter_AddSeries_ShouldReturnNoErrorOnLimitNotExceeded --- PASS: TestQueryLimiter_AddSeries_ShouldReturnNoErrorOnLimitNotExceeded (0.00s) === RUN TestQueryLimiter_AddSeriers_ShouldReturnErrorOnLimitExceeded --- PASS: TestQueryLimiter_AddSeriers_ShouldReturnErrorOnLimitExceeded (0.00s) === RUN TestQueryLimiter_AddChunkBytes --- PASS: TestQueryLimiter_AddChunkBytes (0.00s) PASS ok github.com/grafana/mimir/pkg/util/limiter 0.167s === RUN TestRateLimitedLogger rate_limit_test.go:34: PASS: Log() --- PASS: TestRateLimitedLogger (0.00s) === RUN TestRateLimitedLogger_Burst rate_limit_test.go:60: PASS: Log() --- PASS: TestRateLimitedLogger_Burst (0.00s) === RUN ExampleInitLogger --- PASS: ExampleInitLogger (0.00s) PASS ok github.com/grafana/mimir/pkg/util/log 0.144s === RUN TestRate --- PASS: TestRate (0.00s) PASS ok github.com/grafana/mimir/pkg/util/math 0.060s === RUN TestFirewallDialer === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_localhost === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_127.0.0.1 === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_google.com === RUN TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_private_addresses === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_localhost === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_127.0.0.1 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_192.168.0.1 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_10.0.0.1 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_google.com === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_fdf8:f53b:82e4::53 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_fe80::200:5aee:feaa:20a2 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_2001:4860:4860::8844 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:192.168.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_localhost === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_127.0.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_192.168.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_10.0.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_172.217.168.78 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fdf8:f53b:82e4::53 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fe80::200:5aee:feaa:20a2 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_2001:4860:4860::8844 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:10.0.0.1 === RUN TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:172.217.168.78 --- PASS: TestFirewallDialer (0.75s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config (0.23s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_localhost (0.03s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_127.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_google.com (0.10s) --- PASS: TestFirewallDialer/should_not_block_traffic_with_no_block_config/address:_172.217.168.78 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses (0.31s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_localhost (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_127.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_192.168.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_10.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_google.com (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_172.217.168.78 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_fdf8:f53b:82e4::53 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_fe80::200:5aee:feaa:20a2 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_2001:4860:4860::8844 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:172.217.168.78 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_private_addresses/address:_::ffff:192.168.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs (0.21s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_localhost (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_127.0.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_192.168.0.1 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_10.0.0.1 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_172.217.168.78 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fdf8:f53b:82e4::53 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_fe80::200:5aee:feaa:20a2 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_2001:4860:4860::8844 (0.00s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:10.0.0.1 (0.10s) --- PASS: TestFirewallDialer/should_support_blocking_custom_CIDRs/address:_::ffff:172.217.168.78 (0.00s) PASS ok github.com/grafana/mimir/pkg/util/net 0.894s === RUN TestBytesPool --- PASS: TestBytesPool (0.00s) === RUN TestRacePutGet --- PASS: TestRacePutGet (1.02s) === RUN TestSlabPool === RUN TestSlabPool/byte_slices_do_not_overlap_when_fit_on_the_same_slab === RUN TestSlabPool/a_new_slab_is_created_when_the_new_slice_doesn't_fit_on_an_existing_one --- PASS: TestSlabPool (0.00s) --- PASS: TestSlabPool/byte_slices_do_not_overlap_when_fit_on_the_same_slab (0.00s) --- PASS: TestSlabPool/a_new_slab_is_created_when_the_new_slice_doesn't_fit_on_an_existing_one (0.00s) === RUN TestSlabPool_Fuzzy pool_test.go:239: random generator seed: 1681075444480882910 --- PASS: TestSlabPool_Fuzzy (0.21s) PASS ok github.com/grafana/mimir/pkg/util/pool 1.349s === RUN TestProcessCollector --- PASS: TestProcessCollector (0.01s) === RUN TestProcessCollector_UnsupportedPlatform --- PASS: TestProcessCollector_UnsupportedPlatform (0.00s) PASS ok github.com/grafana/mimir/pkg/util/process 0.081s === RUN TestHandler_remoteWrite --- PASS: TestHandler_remoteWrite (0.01s) === RUN TestHandler_otlpWriteNoCompression --- PASS: TestHandler_otlpWriteNoCompression (0.00s) === RUN TestHandler_otlpDroppedMetricsPanic 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. --- PASS: TestHandler_otlpDroppedMetricsPanic (0.01s) === RUN TestHandler_otlpDroppedMetricsPanic2 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. 2023/04/10 05:24:23 label __name__ is overwritten. Check if Prometheus reserved labels are used. --- PASS: TestHandler_otlpDroppedMetricsPanic2 (0.00s) === RUN TestHandler_otlpWriteWithCompression --- PASS: TestHandler_otlpWriteWithCompression (0.03s) === RUN TestHandler_otlpWriteRequestTooBigNoCompression --- PASS: TestHandler_otlpWriteRequestTooBigNoCompression (0.01s) === RUN TestHandler_otlpWriteRequestTooBigWithCompression --- PASS: TestHandler_otlpWriteRequestTooBigWithCompression (0.01s) === RUN TestHandler_otlpWriteRequestWithUnSupportedCompression --- PASS: TestHandler_otlpWriteRequestWithUnSupportedCompression (0.00s) === RUN TestHandler_mimirWriteRequest --- PASS: TestHandler_mimirWriteRequest (0.00s) === RUN TestHandler_contextCanceledRequest --- PASS: TestHandler_contextCanceledRequest (0.00s) === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_false === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_always_false_even_if_write_requests_sets_it_to_true === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_but_write_request_set_to_false_means_SkipLabelNameValidation_is_false === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_means_SkipLabelNameValidation_is_true === RUN TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_but_header_not_sent_means_SkipLabelNameValidation_is_false --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_false (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_false_means_SkipLabelNameValidation_is_always_false_even_if_write_requests_sets_it_to_true (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_but_write_request_set_to_false_means_SkipLabelNameValidation_is_false (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_means_SkipLabelNameValidation_is_true (0.00s) --- PASS: TestHandler_EnsureSkipLabelNameValidationBehaviour/config_flag_set_to_true_and_write_request_set_to_true_but_header_not_sent_means_SkipLabelNameValidation_is_false (0.00s) === RUN TestNewDistributorMaxWriteMessageSizeErr --- PASS: TestNewDistributorMaxWriteMessageSizeErr (0.00s) === RUN TestHandler_ErrorTranslation === RUN TestHandler_ErrorTranslation/a_generic_error_gets_an_HTTP_400 === RUN TestHandler_ErrorTranslation/an_gRPC_error_with_a_status_gets_translated_into_HTTP_error --- PASS: TestHandler_ErrorTranslation (0.00s) --- PASS: TestHandler_ErrorTranslation/a_generic_error_gets_an_HTTP_400 (0.00s) --- PASS: TestHandler_ErrorTranslation/an_gRPC_error_with_a_status_gets_translated_into_HTTP_error (0.00s) === RUN TestRequest_CleanUpOrder --- PASS: TestRequest_CleanUpOrder (0.00s) === RUN TestRequest_CleanUpDoubleCalling --- PASS: TestRequest_CleanUpDoubleCalling (0.00s) === RUN TestRequest_WriteRequestIsParsedOnlyOnce --- PASS: TestRequest_WriteRequestIsParsedOnlyOnce (0.00s) PASS ok github.com/grafana/mimir/pkg/util/push 0.241s === RUN TestRingServiceDiscovery_WithoutMaxUsedInstances --- PASS: TestRingServiceDiscovery_WithoutMaxUsedInstances (3.00s) === RUN TestRingServiceDiscovery_WithMaxUsedInstances --- PASS: TestRingServiceDiscovery_WithMaxUsedInstances (3.00s) === RUN TestSelectInUseInstances === RUN TestSelectInUseInstances/should_return_the_input_on_a_number_of_instances_=_max_instances === RUN TestSelectInUseInstances/should_return_a_subset_of_the_input_on_a_number_of_instances_>_max_instances === RUN TestSelectInUseInstances/should_return_the_input_if_max_instances_is_0 === RUN TestSelectInUseInstances/should_return_the_input_on_empty_list_of_instances === RUN TestSelectInUseInstances/should_return_the_input_on_a_number_of_instances_<_max_instances --- PASS: TestSelectInUseInstances (0.00s) --- PASS: TestSelectInUseInstances/should_return_the_input_on_a_number_of_instances_=_max_instances (0.00s) --- PASS: TestSelectInUseInstances/should_return_a_subset_of_the_input_on_a_number_of_instances_>_max_instances (0.00s) --- PASS: TestSelectInUseInstances/should_return_the_input_if_max_instances_is_0 (0.00s) --- PASS: TestSelectInUseInstances/should_return_the_input_on_empty_list_of_instances (0.00s) --- PASS: TestSelectInUseInstances/should_return_the_input_on_a_number_of_instances_<_max_instances (0.00s) PASS ok github.com/grafana/mimir/pkg/util/servicediscovery 6.221s === RUN TestNewMetadataMetricNameMissingError --- PASS: TestNewMetadataMetricNameMissingError (0.00s) === RUN TestNewMetadataMetricNameTooLongError --- PASS: TestNewMetadataMetricNameTooLongError (0.00s) === RUN TestNewMetadataUnitTooLongError --- PASS: TestNewMetadataUnitTooLongError (0.00s) === RUN TestNewMaxQueryLengthError --- PASS: TestNewMaxQueryLengthError (0.00s) === RUN TestNewTotalMaxQueryLengthError --- PASS: TestNewTotalMaxQueryLengthError (0.00s) === RUN TestNewRequestRateLimitedError --- PASS: TestNewRequestRateLimitedError (0.00s) === RUN TestNewIngestionRateLimitedError --- PASS: TestNewIngestionRateLimitedError (0.00s) === RUN TestOverridesManager_GetOverrides --- PASS: TestOverridesManager_GetOverrides (0.00s) === RUN TestLimitsLoadingFromYaml --- PASS: TestLimitsLoadingFromYaml (0.00s) === RUN TestLimitsLoadingFromJson --- PASS: TestLimitsLoadingFromJson (0.00s) === RUN TestLimitsTagsYamlMatchJson --- PASS: TestLimitsTagsYamlMatchJson (0.00s) === RUN TestLimitsStringDurationYamlMatchJson --- PASS: TestLimitsStringDurationYamlMatchJson (0.00s) === RUN TestLimitsAlwaysUsesPromDuration --- PASS: TestLimitsAlwaysUsesPromDuration (0.00s) === RUN TestMetricRelabelConfigLimitsLoadingFromYaml --- PASS: TestMetricRelabelConfigLimitsLoadingFromYaml (0.00s) === RUN TestSmallestPositiveIntPerTenant --- PASS: TestSmallestPositiveIntPerTenant (0.00s) === RUN TestSmallestPositiveNonZeroIntPerTenant --- PASS: TestSmallestPositiveNonZeroIntPerTenant (0.00s) === RUN TestSmallestPositiveNonZeroDurationPerTenant --- PASS: TestSmallestPositiveNonZeroDurationPerTenant (0.00s) === RUN TestLargestPositiveNonZeroDurationPerTenant --- PASS: TestLargestPositiveNonZeroDurationPerTenant (0.00s) === RUN TestMaxTotalQueryLengthWithoutDefault --- PASS: TestMaxTotalQueryLengthWithoutDefault (0.00s) === RUN TestMaxTotalQueryLengthWithDefault --- PASS: TestMaxTotalQueryLengthWithDefault (0.00s) === RUN TestMaxPartialQueryLengthWithDefault --- PASS: TestMaxPartialQueryLengthWithDefault (0.00s) === RUN TestMaxPartialQueryLengthWithoutDefault --- PASS: TestMaxPartialQueryLengthWithoutDefault (0.00s) === RUN TestAlertmanagerNotificationLimits === RUN TestAlertmanagerNotificationLimits/no_email_specific_limit === RUN TestAlertmanagerNotificationLimits/zero_limit === RUN TestAlertmanagerNotificationLimits/negative_limit === RUN TestAlertmanagerNotificationLimits/positive_limit,_negative_burst === RUN TestAlertmanagerNotificationLimits/infinte_limit --- PASS: TestAlertmanagerNotificationLimits (0.00s) --- PASS: TestAlertmanagerNotificationLimits/no_email_specific_limit (0.00s) --- PASS: TestAlertmanagerNotificationLimits/zero_limit (0.00s) --- PASS: TestAlertmanagerNotificationLimits/negative_limit (0.00s) --- PASS: TestAlertmanagerNotificationLimits/positive_limit,_negative_burst (0.00s) --- PASS: TestAlertmanagerNotificationLimits/infinte_limit (0.00s) === RUN TestAlertmanagerNotificationLimitsOverrides === RUN TestAlertmanagerNotificationLimitsOverrides/no_overrides,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/no_overrides,_email === RUN TestAlertmanagerNotificationLimitsOverrides/partial_email_limit_override === RUN TestAlertmanagerNotificationLimitsOverrides/generic_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/generic_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_email === RUN TestAlertmanagerNotificationLimitsOverrides/different_user_override,_pushover === RUN TestAlertmanagerNotificationLimitsOverrides/different_user_override,_email --- PASS: TestAlertmanagerNotificationLimitsOverrides (0.01s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/no_overrides,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/no_overrides,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/partial_email_limit_override (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/email_limit_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/generic_and_email_limit_override,_email (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/different_user_override,_pushover (0.00s) --- PASS: TestAlertmanagerNotificationLimitsOverrides/different_user_override,_email (0.00s) === RUN TestCustomTrackerConfigDeserialize --- PASS: TestCustomTrackerConfigDeserialize (0.00s) === RUN TestUnmarshalInvalidMetricRelabelConfig === RUN TestUnmarshalInvalidMetricRelabelConfig/yaml === RUN TestUnmarshalInvalidMetricRelabelConfig/json --- PASS: TestUnmarshalInvalidMetricRelabelConfig (0.00s) --- PASS: TestUnmarshalInvalidMetricRelabelConfig/yaml (0.00s) --- PASS: TestUnmarshalInvalidMetricRelabelConfig/json (0.00s) === RUN TestNotificationLimitsMap === RUN TestNotificationLimitsMap/parsing_error === RUN TestNotificationLimitsMap/basic_test === RUN TestNotificationLimitsMap/unknown_integration --- PASS: TestNotificationLimitsMap (0.00s) --- PASS: TestNotificationLimitsMap/parsing_error (0.00s) --- PASS: TestNotificationLimitsMap/basic_test (0.00s) --- PASS: TestNotificationLimitsMap/unknown_integration (0.00s) === RUN TestNotificationsLimitMapYaml --- PASS: TestNotificationsLimitMapYaml (0.00s) === RUN TestUnknownIntegrationWhenLoadingYaml --- PASS: TestUnknownIntegrationWhenLoadingYaml (0.00s) === RUN TestWrongYamlStructureWhenLoadingYaml --- PASS: TestWrongYamlStructureWhenLoadingYaml (0.00s) === RUN TestUserLimitsHandler === RUN TestUserLimitsHandler/Authenticated_user_with_override === RUN TestUserLimitsHandler/Authenticated_user_without_override === RUN TestUserLimitsHandler/Unauthenticated_user --- PASS: TestUserLimitsHandler (0.00s) --- PASS: TestUserLimitsHandler/Authenticated_user_with_override (0.00s) --- PASS: TestUserLimitsHandler/Authenticated_user_without_override (0.00s) --- PASS: TestUserLimitsHandler/Unauthenticated_user (0.00s) === RUN TestValidateLabels --- PASS: TestValidateLabels (0.00s) === RUN TestValidateExemplars --- PASS: TestValidateExemplars (0.00s) === RUN TestValidateMetadata === RUN TestValidateMetadata/with_a_valid_config === RUN TestValidateMetadata/with_no_metric_name === RUN TestValidateMetadata/with_a_long_metric_name === RUN TestValidateMetadata/with_a_long_help === RUN TestValidateMetadata/with_a_long_UTF-8_help === RUN TestValidateMetadata/with_invalid_long_UTF-8_help === RUN TestValidateMetadata/with_a_long_unit --- PASS: TestValidateMetadata (0.02s) --- PASS: TestValidateMetadata/with_a_valid_config (0.00s) --- PASS: TestValidateMetadata/with_no_metric_name (0.00s) --- PASS: TestValidateMetadata/with_a_long_metric_name (0.00s) --- PASS: TestValidateMetadata/with_a_long_help (0.00s) --- PASS: TestValidateMetadata/with_a_long_UTF-8_help (0.00s) --- PASS: TestValidateMetadata/with_invalid_long_UTF-8_help (0.00s) --- PASS: TestValidateMetadata/with_a_long_unit (0.00s) === RUN TestValidateLabelDuplication --- PASS: TestValidateLabelDuplication (0.00s) PASS ok github.com/grafana/mimir/pkg/util/validation 0.352s === RUN TestOverridesExporter_noConfig --- PASS: TestOverridesExporter_noConfig (0.00s) === RUN TestOverridesExporter_emptyConfig --- PASS: TestOverridesExporter_emptyConfig (0.00s) === RUN TestOverridesExporter_withConfig --- PASS: TestOverridesExporter_withConfig (0.00s) === RUN TestOverridesExporter_withRing --- PASS: TestOverridesExporter_withRing (0.19s) === RUN TestOverridesExporter_emptyRing --- PASS: TestOverridesExporter_emptyRing (1.00s) === RUN TestOverridesExporterRing_scaleDown --- PASS: TestOverridesExporterRing_scaleDown (1.02s) PASS ok github.com/grafana/mimir/pkg/util/validation/exporter 2.559s === RUN TestBuildInfoHandler --- PASS: TestBuildInfoHandler (0.00s) PASS ok github.com/grafana/mimir/pkg/util/version 0.162s === RUN TestConfigDescriptorIsUpToDate --- PASS: TestConfigDescriptorIsUpToDate (0.60s) PASS ok github.com/grafana/mimir/tools/config-inspector 3.661s === RUN Test_findFlagsPrefix --- PASS: Test_findFlagsPrefix (0.00s) PASS ok github.com/grafana/mimir/tools/doc-generator/parse 0.652s === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/no_auth === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_no_auth_it_should_forward_the_request_auth === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_an_username_set_it_should_forward_the_request_password_only === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth === RUN Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_NOT_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/no_auth (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_no_auth_it_should_forward_the_request_auth (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_has_an_username_set_it_should_forward_the_request_password_only (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth (0.00s) --- PASS: Test_ProxyBackend_createBackendRequest_HTTPBasicAuthentication/if_the_request_is_NOT_authenticated_and_the_backend_is_authenticated_it_should_use_the_backend_auth (0.00s) === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_last_response_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/no_received_response_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_1st_response_received === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received_but_it's_not_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_2nd_response_received_but_only_the_last_one_is_successful === RUN Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_1st_response_is_successful --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_last_response_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/no_received_response_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_1st_response_received (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_last_response_received_but_it's_not_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/the_preferred_backend_is_the_2nd_response_received_but_only_the_last_one_is_successful (0.00s) --- PASS: Test_ProxyEndpoint_waitBackendResponseForDownstream/there's_no_preferred_backend_configured_and_the_1st_response_is_successful (0.00s) === RUN Test_ProxyEndpoint_Requests === RUN Test_ProxyEndpoint_Requests/GET-request === RUN Test_ProxyEndpoint_Requests/GET-filter-accept-encoding === RUN Test_ProxyEndpoint_Requests/POST-request-with-body --- PASS: Test_ProxyEndpoint_Requests (0.04s) --- PASS: Test_ProxyEndpoint_Requests/GET-request (0.01s) --- PASS: Test_ProxyEndpoint_Requests/GET-filter-accept-encoding (0.01s) --- PASS: Test_ProxyEndpoint_Requests/POST-request-with-body (0.01s) === RUN Test_backendResponse_succeeded === RUN Test_backendResponse_succeeded/4xx_response_status_code === RUN Test_backendResponse_succeeded/5xx_response_status_code === RUN Test_backendResponse_succeeded/Error_while_executing_request === RUN Test_backendResponse_succeeded/2xx_response_status_code === RUN Test_backendResponse_succeeded/3xx_response_status_code --- PASS: Test_backendResponse_succeeded (0.02s) --- PASS: Test_backendResponse_succeeded/4xx_response_status_code (0.00s) --- PASS: Test_backendResponse_succeeded/5xx_response_status_code (0.00s) --- PASS: Test_backendResponse_succeeded/Error_while_executing_request (0.00s) --- PASS: Test_backendResponse_succeeded/2xx_response_status_code (0.00s) --- PASS: Test_backendResponse_succeeded/3xx_response_status_code (0.00s) === RUN Test_backendResponse_statusCode === RUN Test_backendResponse_statusCode/200_response_status_code === RUN Test_backendResponse_statusCode/503_response_status_code === RUN Test_backendResponse_statusCode/Error_while_executing_request --- PASS: Test_backendResponse_statusCode (0.00s) --- PASS: Test_backendResponse_statusCode/200_response_status_code (0.00s) --- PASS: Test_backendResponse_statusCode/503_response_status_code (0.00s) --- PASS: Test_backendResponse_statusCode/Error_while_executing_request (0.00s) === RUN Test_NewProxy --- PASS: Test_NewProxy (0.00s) === RUN Test_Proxy_RequestsForwarding === RUN Test_Proxy_RequestsForwarding/two_backends_without_path_prefix === RUN Test_Proxy_RequestsForwarding/two_backends_with_the_same_path_prefix === RUN Test_Proxy_RequestsForwarding/two_backends_with_different_path_prefix === RUN Test_Proxy_RequestsForwarding/one_backend_returning_2xx === RUN Test_Proxy_RequestsForwarding/one_backend_returning_5xx === RUN Test_Proxy_RequestsForwarding/preferred_backend_returns_4xx === RUN Test_Proxy_RequestsForwarding/preferred_backend_returns_5xx === RUN Test_Proxy_RequestsForwarding/non-preferred_backend_returns_5xx === RUN Test_Proxy_RequestsForwarding/all_backends_returns_5xx --- PASS: Test_Proxy_RequestsForwarding (0.18s) --- PASS: Test_Proxy_RequestsForwarding/two_backends_without_path_prefix (0.05s) --- PASS: Test_Proxy_RequestsForwarding/two_backends_with_the_same_path_prefix (0.02s) --- PASS: Test_Proxy_RequestsForwarding/two_backends_with_different_path_prefix (0.02s) --- PASS: Test_Proxy_RequestsForwarding/one_backend_returning_2xx (0.01s) --- PASS: Test_Proxy_RequestsForwarding/one_backend_returning_5xx (0.01s) --- PASS: Test_Proxy_RequestsForwarding/preferred_backend_returns_4xx (0.02s) --- PASS: Test_Proxy_RequestsForwarding/preferred_backend_returns_5xx (0.03s) --- PASS: Test_Proxy_RequestsForwarding/non-preferred_backend_returns_5xx (0.01s) --- PASS: Test_Proxy_RequestsForwarding/all_backends_returns_5xx (0.01s) === RUN TestProxy_Passthrough === RUN TestProxy_Passthrough/first_backend_preferred === RUN TestProxy_Passthrough/second_backend_preferred --- PASS: TestProxy_Passthrough (0.06s) --- PASS: TestProxy_Passthrough/first_backend_preferred (0.03s) --- PASS: TestProxy_Passthrough/second_backend_preferred (0.03s) === RUN TestProxyHTTPGRPC === RUN TestProxyHTTPGRPC/HTTP_proxy_connection === RUN TestProxyHTTPGRPC/gRPC_proxy_connection --- PASS: TestProxyHTTPGRPC (0.13s) --- PASS: TestProxyHTTPGRPC/HTTP_proxy_connection (0.06s) --- PASS: TestProxyHTTPGRPC/gRPC_proxy_connection (0.07s) === RUN TestCompareMatrix === RUN TestCompareMatrix/no_metrics === RUN TestCompareMatrix/no_metrics_in_actual_response === RUN TestCompareMatrix/extra_metric_in_actual_response === RUN TestCompareMatrix/same_number_of_metrics_but_with_different_labels === RUN TestCompareMatrix/difference_in_number_of_samples === RUN TestCompareMatrix/difference_in_sample_timestamp === RUN TestCompareMatrix/difference_in_sample_value === RUN TestCompareMatrix/correct_samples --- PASS: TestCompareMatrix (0.00s) --- PASS: TestCompareMatrix/no_metrics (0.00s) --- PASS: TestCompareMatrix/no_metrics_in_actual_response (0.00s) --- PASS: TestCompareMatrix/extra_metric_in_actual_response (0.00s) --- PASS: TestCompareMatrix/same_number_of_metrics_but_with_different_labels (0.00s) --- PASS: TestCompareMatrix/difference_in_number_of_samples (0.00s) --- PASS: TestCompareMatrix/difference_in_sample_timestamp (0.00s) --- PASS: TestCompareMatrix/difference_in_sample_value (0.00s) --- PASS: TestCompareMatrix/correct_samples (0.00s) === RUN TestCompareVector === RUN TestCompareVector/no_metrics === RUN TestCompareVector/no_metrics_in_actual_response === RUN TestCompareVector/extra_metric_in_actual_response === RUN TestCompareVector/same_number_of_metrics_but_with_different_labels === RUN TestCompareVector/difference_in_sample_timestamp === RUN TestCompareVector/difference_in_sample_value === RUN TestCompareVector/correct_samples --- PASS: TestCompareVector (0.00s) --- PASS: TestCompareVector/no_metrics (0.00s) --- PASS: TestCompareVector/no_metrics_in_actual_response (0.00s) --- PASS: TestCompareVector/extra_metric_in_actual_response (0.00s) --- PASS: TestCompareVector/same_number_of_metrics_but_with_different_labels (0.00s) --- PASS: TestCompareVector/difference_in_sample_timestamp (0.00s) --- PASS: TestCompareVector/difference_in_sample_value (0.00s) --- PASS: TestCompareVector/correct_samples (0.00s) === RUN TestCompareScalar === RUN TestCompareScalar/difference_in_timestamp === RUN TestCompareScalar/difference_in_value === RUN TestCompareScalar/correct_values --- PASS: TestCompareScalar (0.00s) --- PASS: TestCompareScalar/difference_in_timestamp (0.00s) --- PASS: TestCompareScalar/difference_in_value (0.00s) --- PASS: TestCompareScalar/correct_values (0.00s) === RUN TestCompareSamplesResponse === RUN TestCompareSamplesResponse/difference_in_response_status === RUN TestCompareSamplesResponse/difference_in_resultType === RUN TestCompareSamplesResponse/unregistered_resultType === RUN TestCompareSamplesResponse/valid_scalar_response === RUN TestCompareSamplesResponse/should_pass_if_values_are_slightly_different_but_within_the_tolerance === RUN TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_disabled === RUN TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_enabled === RUN TestCompareSamplesResponse/should_correctly_compare_Inf_values === RUN TestCompareSamplesResponse/should_correctly_compare_-Inf_values === RUN TestCompareSamplesResponse/should_correctly_compare_+Inf_values === RUN TestCompareSamplesResponse/should_fail_if_values_are_significantly_different,_over_the_tolerance === RUN TestCompareSamplesResponse/should_fail_if_large_values_are_significantly_different,_over_the_tolerance_without_using_relative_error === RUN TestCompareSamplesResponse/should_not_fail_if_large_values_are_significantly_different,_over_the_tolerance_using_relative_error === RUN TestCompareSamplesResponse/should_not_fail_when_the_sample_is_recent_and_configured_to_skip --- PASS: TestCompareSamplesResponse (0.02s) --- PASS: TestCompareSamplesResponse/difference_in_response_status (0.00s) --- PASS: TestCompareSamplesResponse/difference_in_resultType (0.00s) --- PASS: TestCompareSamplesResponse/unregistered_resultType (0.00s) --- PASS: TestCompareSamplesResponse/valid_scalar_response (0.00s) --- PASS: TestCompareSamplesResponse/should_pass_if_values_are_slightly_different_but_within_the_tolerance (0.01s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_disabled (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_NaN_values_with_tolerance_is_enabled (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_Inf_values (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_-Inf_values (0.00s) --- PASS: TestCompareSamplesResponse/should_correctly_compare_+Inf_values (0.00s) --- PASS: TestCompareSamplesResponse/should_fail_if_values_are_significantly_different,_over_the_tolerance (0.00s) --- PASS: TestCompareSamplesResponse/should_fail_if_large_values_are_significantly_different,_over_the_tolerance_without_using_relative_error (0.00s) --- PASS: TestCompareSamplesResponse/should_not_fail_if_large_values_are_significantly_different,_over_the_tolerance_using_relative_error (0.00s) --- PASS: TestCompareSamplesResponse/should_not_fail_when_the_sample_is_recent_and_configured_to_skip (0.00s) PASS ok github.com/grafana/mimir/tools/querytee 0.668s FAIL ==> ERROR: A failure occurred in check().  Aborting... ==> ERROR: Build failed, check /var/lib/archbuild/extra-riscv64/root1/build receiving incremental file list mimir-2.6.0-1-riscv64-build.log mimir-2.6.0-1-riscv64-check.log mimir-2.6.0-1-riscv64-pkgver.log mimir-2.6.0-1-riscv64-prepare.log sent 100 bytes received 142,813 bytes 285,826.00 bytes/sec total size is 1,841,243 speedup is 12.88